Started by upstream project "osmo-gsm-tester_build-osmo-pcu-sysmo" build number 5190 originally caused by: Started by upstream project "master-osmo-pcu" build number 5353 originally caused by: Started by upstream project "master-libosmo-gprs" build number 133 originally caused by: Started by timer Running as SYSTEM Building remotely on osmo-gsm-tester-prod (osmo-gsm-tester) in workspace /home/jenkins/workspace/osmo-gsm-tester_run-prod The recommended git tool is: NONE No credentials specified > git rev-parse --resolve-git-dir /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/.git # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url https://gerrit.osmocom.org/osmo-gsm-tester # timeout=10 Fetching upstream changes from https://gerrit.osmocom.org/osmo-gsm-tester > git --version # timeout=10 > git --version # 'git version 2.20.1' > git fetch --tags --force --progress -- https://gerrit.osmocom.org/osmo-gsm-tester +refs/heads/*:refs/remotes/origin/* # timeout=10 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 Checking out Revision bfc438bb2b17f4129018768a1f7bab52f1e96750 (refs/remotes/origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Commit message: "templates: osmo-msc: modernize" > git rev-list --no-walk bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bsc" build number 17657 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts" build number 7507 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-ggsn" build number 6680 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hlr" build number 8701 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-mgw" build number 8946 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hnbgw" build number 2952 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-msc" build number 29267 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu" build number 5151 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-sgsn" build number 30044 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-trx" build number 4676 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-nitb" build number 12970 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-stp" build number 9241 Copied 2 artifacts from "osmo-gsm-tester_build-osmocom-bb" build number 4701 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-sysmo" build number 8038 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-sysmo" build number 5190 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-oc2g" build number 5534 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-oc2g" build number 3908 Copied 2 artifacts from "osmo-gsm-tester_build-open5gs" build number 8 Copied 2 artifacts from "osmo-gsm-tester_build-srslte" build number 19 [osmo-gsm-tester_run-prod] $ /bin/sh /tmp/jenkins18134725923157703934.sh + unlink osmo-gsm-tester/sysmocom/resources.conf + ln -s resources.conf.prod osmo-gsm-tester/sysmocom/resources.conf + PATH=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src:/usr/local/bin:/usr/bin:/bin:/usr/games ./osmo-gsm-tester/contrib/jenkins-run.sh + base=/home/jenkins/workspace/osmo-gsm-tester_run-prod + dirname -- ./osmo-gsm-tester/contrib/jenkins-run.sh + CDPATH= cd -- ./osmo-gsm-tester/contrib + pwd -P + SCRIPT_DIR=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib + OSMO_GSM_TESTER_CONF=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf + date +%F %T + time_start=2022-12-10 05:27:32 + trial_dir_prefix=trial- + rm -rf trial-2369 trial-2369-bin.tgz trial-2369-run.tgz + trial_dir=trial-2370 + mkdir -p trial-2370 + mv open5gs.build-8.tgz osmo-bsc.build-17657.tgz osmo-bts-oc2g.build-5534.tgz osmo-bts-sysmo.build-8038.tgz osmo-bts.build-7507.tgz osmo-ggsn.build-6680.tgz osmo-hlr.build-8701.tgz osmo-hnbgw.build-2952.tgz osmo-mgw.build-8946.tgz osmo-msc.build-29267.tgz osmo-nitb.build-12970.tgz osmo-pcu-oc2g.build-3908.tgz osmo-pcu-sysmo.build-5190.tgz osmo-pcu.build-5151.tgz osmo-sgsn.build-30044.tgz osmo-stp.build-9241.tgz osmo-trx.build-4676.tgz osmocom-bb.build-4701.tgz srslte.build-19.tgz trial-2370 + cat open5gs.build-8.md5 osmo-bsc.build-17657.md5 osmo-bts-oc2g.build-5534.md5 osmo-bts-sysmo.build-8038.md5 osmo-bts.build-7507.md5 osmo-ggsn.build-6680.md5 osmo-hlr.build-8701.md5 osmo-hnbgw.build-2952.md5 osmo-mgw.build-8946.md5 osmo-msc.build-29267.md5 osmo-nitb.build-12970.md5 osmo-pcu-oc2g.build-3908.md5 osmo-pcu-sysmo.build-5190.md5 osmo-pcu.build-5151.md5 osmo-sgsn.build-30044.md5 osmo-stp.build-9241.md5 osmo-trx.build-4676.md5 osmocom-bb.build-4701.md5 srslte.build-19.md5 + rm open5gs.build-8.md5 osmo-bsc.build-17657.md5 osmo-bts-oc2g.build-5534.md5 osmo-bts-sysmo.build-8038.md5 osmo-bts.build-7507.md5 osmo-ggsn.build-6680.md5 osmo-hlr.build-8701.md5 osmo-hnbgw.build-2952.md5 osmo-mgw.build-8946.md5 osmo-msc.build-29267.md5 osmo-nitb.build-12970.md5 osmo-pcu-oc2g.build-3908.md5 osmo-pcu-sysmo.build-5190.md5 osmo-pcu.build-5151.md5 osmo-sgsn.build-30044.md5 osmo-stp.build-9241.md5 osmo-trx.build-4676.md5 osmocom-bb.build-4701.md5 srslte.build-19.md5 + exit_code=1 + which osmo-gsm-tester.py + python3 -u /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo-gsm-tester.py -c /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf trial-2370 combinations: None trial: 'trial-2370' tests: None Running default suites: nitb_sms:sysmo sms:sysmo nitb_ussd:sysmo ussd:sysmo voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:sysmo+mod-bts0-dynts-osmo emergency:sysmo gprs:sysmo gprs:sysmo+mod-bts0-egprs gprs:sysmo+mod-bts0-dynts-ipa gprs:sysmo+mod-bts0-dynts-osmo dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:sysmo+mod-bts0-dynts67-osmo nitb_sms:oc2g sms:oc2g nitb_ussd:oc2g ussd:oc2g voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:oc2g+mod-bts0-dynts-osmo emergency:oc2g gprs:oc2g gprs:oc2g+mod-bts0-egprs gprs:oc2g+mod-bts0-dynts-ipa gprs:oc2g+mod-bts0-dynts-osmo dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:oc2g+mod-bts0-dynts67-osmo nitb_sms:trx-b200 sms:trx-b200 nitb_ussd:trx-b200 ussd:trx-b200 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-b200+mod-bts0-dynts-osmo voice:trx-b200+mod-bts0-trxdversion0 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-b200 gprs:trx-b200 gprs:trx-b200+mod-bts0-egprs gprs:trx-b200+mod-bts0-dynts-ipa gprs:trx-b200+mod-bts0-dynts-osmo gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-b200+mod-bts0-dynts67-osmo nitb_sms:trx-sysmocell5000 sms:trx-sysmocell5000 nitb_ussd:trx-sysmocell5000 ussd:trx-sysmocell5000 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-sysmocell5000+mod-bts0-dynts-osmo emergency:trx-sysmocell5000 gprs:trx-sysmocell5000 gprs:trx-sysmocell5000+mod-bts0-egprs gprs:trx-sysmocell5000+mod-bts0-dynts-ipa gprs:trx-sysmocell5000+mod-bts0-dynts-osmo dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo nitb_sms:trx-umtrx sms:trx-umtrx nitb_ussd:trx-umtrx ussd:trx-umtrx voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-umtrx+mod-bts0-dynts-osmo voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-umtrx gprs:trx-umtrx gprs:trx-umtrx+mod-bts0-egprs gprs:trx-umtrx+mod-bts0-dynts-ipa gprs:trx-umtrx+mod-bts0-dynts-osmo gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-umtrx+mod-bts0-dynts67-osmo nitb_sms:trx-lms sms:trx-lms nitb_ussd:trx-lms ussd:trx-lms voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms+mod-bts0-dynts-osmo emergency:trx-lms gprs:trx-lms gprs:trx-lms+mod-bts0-egprs gprs:trx-lms+mod-bts0-dynts-ipa gprs:trx-lms+mod-bts0-dynts-osmo dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms+mod-bts0-dynts67-osmo nitb_sms:trx-lms-limenet-micro sms:trx-lms-limenet-micro nitb_ussd:trx-lms-limenet-micro ussd:trx-lms-limenet-micro voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo emergency:trx-lms-limenet-micro gprs:trx-lms-limenet-micro gprs:trx-lms-limenet-micro+mod-bts0-egprs gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo nitb_sms:nanobts sms:nanobts+band-1900 nitb_ussd:nanobts+band-1900 ussd:nanobts+band-1900 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any emergency:nanobts+band-1900 gprs:nanobts+band-1900 gprs:nanobts+band-1900+mod-bts0-egprs gprs:nanobts+band-1900+mod-bts0-dynts-ipa dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any sms:nanobts+band-900 nitb_ussd:nanobts+band-900 ussd:nanobts+band-900 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:nanobts+band-900 gprs:nanobts+band-900 gprs:nanobts+band-900+mod-bts0-egprs gprs:nanobts+band-900+mod-bts0-dynts-ipa gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any nitb_smpp smpp encryption 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover_2G:nanobts+bts1-oc2g handover_2G:nanobts+bts1-octphy handover_2G:nanobts+bts1-trx-lms handover_2G:nanobts+bts1-trx-lms-limenet-micro handover_2G:nanobts+bts1-trx-sysmocell5000 handover_2G:nanobts+bts1-sysmo handover_2G:nanobts+bts1-trx-b200 handover_2G:nanobts+bts1-trx-umtrx handover_2G:oc2g+bts1-octphy handover_2G:oc2g+bts1-trx-lms handover_2G:oc2g+bts1-trx-lms-limenet-micro handover_2G:oc2g+bts1-trx-sysmocell5000 handover_2G:oc2g+bts1-sysmo handover_2G:oc2g+bts1-trx-b200 handover_2G:oc2g+bts1-trx-umtrx handover_2G:octphy+bts1-trx-lms handover_2G:octphy+bts1-trx-lms-limenet-micro handover_2G:octphy+bts1-trx-sysmocell5000 handover_2G:octphy+bts1-sysmo handover_2G:octphy+bts1-trx-b200 handover_2G:octphy+bts1-trx-umtrx handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover_2G:trx-lms+bts1-trx-sysmocell5000 handover_2G:trx-lms+bts1-sysmo handover_2G:trx-lms+bts1-trx-b200 handover_2G:trx-lms+bts1-trx-umtrx handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover_2G:trx-sysmocell5000+bts1-sysmo handover_2G:trx-sysmocell5000+bts1-trx-b200 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover_2G:sysmo+bts1-trx-b200 handover_2G:sysmo+bts1-trx-umtrx handover_2G:trx-b200+bts1-trx-umtrx -------------------------------------------------------------------------------------------- trial-2370 -------------------------------------------------------------------------------------------- 05:27:43.765092 tst trial-2370: Detailed log at /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/log --------------------------------------------------------------------- trial-2370 nitb_sms:sysmo --------------------------------------------------------------------- 05:29:52.462960 tst nitb_sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:29:52.466861 tst nitb_sms:sysmo: Verifying 1 x bts (candidates: 11) 05:29:52.488076 tst nitb_sms:sysmo: Verifying 1 x ip_address (candidates: 9) 05:29:52.495653 tst nitb_sms:sysmo: Verifying 2 x modem (candidates: 12) 05:29:52.551145 tst nitb_sms:sysmo: Reserving 1 x bts (candidates: 11) 05:29:52.572241 tst nitb_sms:sysmo: Reserving 1 x ip_address (candidates: 9) 05:29:52.579512 tst nitb_sms:sysmo: Reserving 2 x modem (candidates: 12) 05:29:53.118653 tst nitb_sms:sysmo: RESERVED RESOURCES for nitb_sms: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 nitb_sms:sysmo mo_mt_sms.py ---------------------------------------------- 05:29:53.123758 tst nitb_sms:sysmo: Using 1 x ip_address (candidates: 1) 05:29:53.135017 tst nitb_sms:sysmo: Using 1 x bts (candidates: 1) 05:29:53.517788 tst mo_mt_sms.py: using LAC 26174 05:29:53.760546 tst mo_mt_sms.py: using RAC 164 05:29:53.884800 tst mo_mt_sms.py: using CellId 26174 05:29:54.005921 tst mo_mt_sms.py: using BVCI 26175 05:29:54.117824 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 05:29:54.297703 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 05:29:54.417345 tst mo_mt_sms.py:9: start nitb and bts... 05:29:54.630020 run osmo-nitb_10.42.42.2: Starting osmo-nitb 05:29:56.956764 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30798): Launched 05:29:57.277215 run osmo-nitb_10.42.42.2(pid=30799): Launched 05:29:57.452091 run osmo-nitb_10.42.42.2(pid=30799): ERR: Terminated: ERROR {rc=2} [trial-2370↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30799)] 05:29:57.582853 run osmo-nitb_10.42.42.2(pid=30799): stdout: | (launched: 2022-12-10_05:29:57.217994) 05:29:57.714851 run osmo-nitb_10.42.42.2(pid=30799): stderr: | (launched: 2022-12-10_05:29:57.265156) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 05:29:57.847274 run osmo-nitb_10.42.42.2(pid=30799): stdout: | (launched: 2022-12-10_05:29:57.217994) 05:29:57.973332 run osmo-nitb_10.42.42.2(pid=30799): stderr: | (launched: 2022-12-10_05:29:57.265156) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 05:29:58.124499 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=30799): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30799) [trial-2370↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30799)] [trial-2370↪nitb_sms:sysmo↪mo_mt_sms.py:11] 05:29:58.133513 tst mo_mt_sms.py:11: Test FAILED (5.0 sec) 05:29:58.140552 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30798): Terminating (SIGTERM) 05:29:58.351787 --- ParallelTerminationStrategy: PID 30798 died... 05:29:58.373113 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30798): Terminated: ok {rc=0} 05:29:58.460718 bus /sierra_3: Setting Powered False 05:29:59.560802 bus /sierra_3: Setting Powered False 05:30:00.677488 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 nitb_sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 sms:sysmo --------------------------------------------------------------------- 05:30:01.888859 tst sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:30:01.897261 tst sms:sysmo: Verifying 1 x bts (candidates: 11) 05:30:01.930953 tst sms:sysmo: Verifying 6 x ip_address (candidates: 9) 05:30:01.964079 tst sms:sysmo: Verifying 2 x modem (candidates: 12) 05:30:02.023427 tst sms:sysmo: Reserving 1 x bts (candidates: 11) 05:30:02.051476 tst sms:sysmo: Reserving 6 x ip_address (candidates: 9) 05:30:02.082372 tst sms:sysmo: Reserving 2 x modem (candidates: 12) 05:30:02.614752 tst sms:sysmo: RESERVED RESOURCES for sms: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 sms:sysmo mo_mt_sms.py ---------------------------------------------- 05:30:02.620055 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 05:30:02.630727 tst sms:sysmo: Using 1 x bts (candidates: 1) 05:30:02.668893 tst mo_mt_sms.py: using LAC 26175 05:30:02.785268 tst mo_mt_sms.py: using RAC 165 05:30:02.901646 tst mo_mt_sms.py: using CellId 26175 05:30:03.016262 tst mo_mt_sms.py: using BVCI 26176 05:30:03.123306 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 05:30:03.133898 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 05:30:03.144221 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 05:30:03.154635 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 05:30:03.165142 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 05:30:03.175643 tst sms:sysmo: Using 1 x modem (candidates: 2) 05:30:03.291816 tst sms:sysmo: Using 1 x modem (candidates: 2) 05:30:03.415763 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:30:05.191547 run create_hlr_db(pid=30806): Launched 05:30:05.326649 bus /sierra_2: Setting Powered False 05:30:06.389971 run create_hlr_db(pid=30806): Terminated: ok {rc=0} 05:30:06.819712 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30808): Launched 05:30:07.118948 run osmo-hlr_10.42.42.2(pid=30809): Launched 05:30:07.232060 run osmo-stp_10.42.42.5: Starting osmo-stp 05:30:09.686279 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30811): Launched 05:30:09.987747 run osmo-stp_10.42.42.5(pid=30812): Launched 05:30:10.103435 run osmo-msc_10.42.42.6: Starting osmo-msc 05:30:15.321548 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30814): Launched 05:30:15.619460 run osmo-msc_10.42.42.6(pid=30815): Launched 05:30:15.785877 run osmo-stp_10.42.42.5(pid=30812): ERR: Terminated: ERROR {rc=1} [trial-2370↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30812)] 05:30:16.038211 run osmo-stp_10.42.42.5(pid=30812): stdout: | (launched: 2022-12-10_05:30:09.931575) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:30:16.291803 run osmo-stp_10.42.42.5(pid=30812): stderr: | 20221210053010103 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053010103 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053010103 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053010104 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053010104 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053010104 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053010104 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:30:16.468933 run osmo-stp_10.42.42.5(pid=30812): stdout: | (launched: 2022-12-10_05:30:09.931575) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:30:16.591404 run osmo-stp_10.42.42.5(pid=30812): stderr: | 20221210053010103 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053010103 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053010103 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053010104 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053010104 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053010104 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053010104 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:30:16.736068 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=30812): Process ended prematurely: osmo-stp_10.42.42.5(pid=30812) [trial-2370↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30812)] [trial-2370↪sms:sysmo↪mo_mt_sms.py:16] 05:30:16.745089 tst mo_mt_sms.py:16: Test FAILED (14.1 sec) 05:30:16.773341 run osmo-hlr_10.42.42.2(pid=30809): ERR: Terminated: ERROR {rc=237} [trial-2370↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30809)] 05:30:16.841263 run osmo-hlr_10.42.42.2(pid=30809): stdout: | (launched: 2022-12-10_05:30:07.062794) 05:30:16.911241 run osmo-hlr_10.42.42.2(pid=30809): stderr: | 20221210053007242 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210053007242 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210053007242 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210053007242 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210053007242 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210053007242 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210053007257 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/sms:sysmo/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210053007265 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210053007265 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210053007265 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:30:17.003683 run osmo-msc_10.42.42.6(pid=30815): ERR: Terminated: ERROR {rc=2} [trial-2370↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30815)] 05:30:17.070246 run osmo-msc_10.42.42.6(pid=30815): stdout: | (launched: 2022-12-10_05:30:15.563246) 05:30:17.137078 run osmo-msc_10.42.42.6(pid=30815): stderr: | 20221210053015861 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210053015865 DLGLOBAL DEBUG validating counter group 0x7f68768c3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210053015866 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210053015866 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210053015866 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210053015866 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210053015868 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210053015868 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210053015868 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210053015870 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:30:17.195363 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30808): Terminating (SIGTERM) 05:30:17.237537 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30811): Terminating (SIGTERM) 05:30:17.280642 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30814): Terminating (SIGTERM) 05:30:17.323124 --- ParallelTerminationStrategy: PID 30808 died... 05:30:17.342647 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30808): Terminated: ok {rc=0} 05:30:17.389734 --- ParallelTerminationStrategy: PID 30811 died... 05:30:17.409316 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30811): Terminated: ok {rc=0} 05:30:17.458072 --- ParallelTerminationStrategy: PID 30814 died... 05:30:17.477790 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30814): Terminated: ok {rc=0} 05:30:17.566651 bus /sierra_3: Setting Powered False 05:30:18.667122 bus /sierra_3: Setting Powered False 05:30:19.785387 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 nitb_ussd:sysmo --------------------------------------------------------------------- 05:30:21.006461 tst nitb_ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:30:21.010496 tst nitb_ussd:sysmo: Verifying 1 x bts (candidates: 11) 05:30:21.031823 tst nitb_ussd:sysmo: Verifying 1 x ip_address (candidates: 9) 05:30:21.038850 tst nitb_ussd:sysmo: Verifying 1 x modem (candidates: 12) 05:30:21.073242 tst nitb_ussd:sysmo: Reserving 1 x bts (candidates: 11) 05:30:21.094079 tst nitb_ussd:sysmo: Reserving 1 x ip_address (candidates: 9) 05:30:21.101577 tst nitb_ussd:sysmo: Reserving 1 x modem (candidates: 12) 05:30:21.624363 tst nitb_ussd:sysmo: RESERVED RESOURCES for nitb_ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2370 nitb_ussd:sysmo assert_extension.py ---------------------------------------------- 05:30:21.630586 tst nitb_ussd:sysmo: Using 1 x ip_address (candidates: 1) 05:30:21.641995 tst nitb_ussd:sysmo: Using 1 x bts (candidates: 1) 05:30:21.676462 tst assert_extension.py: using LAC 26176 05:30:21.794954 tst assert_extension.py: using RAC 166 05:30:21.913875 tst assert_extension.py: using CellId 26176 05:30:22.031576 tst assert_extension.py: using BVCI 26177 05:30:22.142247 tst nitb_ussd:sysmo: Using 1 x modem (candidates: 1) 05:30:22.259365 tst assert_extension.py:10: start nitb and bts... 05:30:22.474466 run osmo-nitb_10.42.42.2: Starting osmo-nitb 05:30:23.124793 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30821): Launched 05:30:23.445550 run osmo-nitb_10.42.42.2(pid=30822): Launched 05:30:23.620525 run osmo-nitb_10.42.42.2(pid=30822): ERR: Terminated: ERROR {rc=2} [trial-2370↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30822)] 05:30:23.762834 run osmo-nitb_10.42.42.2(pid=30822): stdout: | (launched: 2022-12-10_05:30:23.385982) 05:30:23.906863 run osmo-nitb_10.42.42.2(pid=30822): stderr: | (launched: 2022-12-10_05:30:23.433316) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 05:30:24.050809 run osmo-nitb_10.42.42.2(pid=30822): stdout: | (launched: 2022-12-10_05:30:23.385982) 05:30:24.188213 run osmo-nitb_10.42.42.2(pid=30822): stderr: | (launched: 2022-12-10_05:30:23.433316) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=30822): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30822) [trial-2370↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30822)] 05:30:24.564392 tst osmo-nitb_10.42.42.2(pid=30822): stdout: | (launched: 2022-12-10_05:30:23.385982) 05:30:24.693173 tst osmo-nitb_10.42.42.2(pid=30822): stderr: | (launched: 2022-12-10_05:30:23.433316) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 05:30:24.845679 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=30822): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30822) [trial-2370↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30822)] [trial-2370↪nitb_ussd:sysmo↪assert_extension.py:12] 05:30:24.854557 tst assert_extension.py:12: Test FAILED (3.2 sec) 05:30:24.861722 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30821): Terminating (SIGTERM) 05:30:25.073285 --- ParallelTerminationStrategy: PID 30821 died... 05:30:25.094214 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30821): Terminated: ok {rc=0} 05:30:25.183333 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 nitb_ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 ussd:sysmo --------------------------------------------------------------------- 05:30:26.347629 tst ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:30:26.352156 tst ussd:sysmo: Verifying 1 x bts (candidates: 11) 05:30:26.375096 tst ussd:sysmo: Verifying 6 x ip_address (candidates: 9) 05:30:26.403851 tst ussd:sysmo: Verifying 1 x modem (candidates: 12) 05:30:26.440659 tst ussd:sysmo: Reserving 1 x bts (candidates: 11) 05:30:26.461920 tst ussd:sysmo: Reserving 6 x ip_address (candidates: 9) 05:30:26.490242 tst ussd:sysmo: Reserving 1 x modem (candidates: 12) 05:30:27.017905 tst ussd:sysmo: RESERVED RESOURCES for ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2370 ussd:sysmo assert_extension.py ---------------------------------------------- 05:30:27.023401 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 05:30:27.034596 tst ussd:sysmo: Using 1 x bts (candidates: 1) 05:30:27.070949 tst assert_extension.py: using LAC 26177 05:30:27.198267 tst assert_extension.py: using RAC 167 05:30:27.324868 tst assert_extension.py: using CellId 26177 05:30:27.454690 tst assert_extension.py: using BVCI 26178 05:30:27.571122 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 05:30:27.582129 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 05:30:27.593074 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 05:30:27.604348 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 05:30:27.615699 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 05:30:27.626977 tst ussd:sysmo: Using 1 x modem (candidates: 1) 05:30:27.741929 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:30:28.207323 run create_hlr_db(pid=30826): Launched 05:30:28.321451 bus /sierra_2: Setting Powered False 05:30:29.381186 run create_hlr_db(pid=30826): Terminated: ok {rc=0} 05:30:29.820396 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30828): Launched 05:30:30.141024 run osmo-hlr_10.42.42.2(pid=30829): Launched 05:30:30.264899 run osmo-stp_10.42.42.5: Starting osmo-stp 05:30:30.816889 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30831): Launched 05:30:31.165694 run osmo-stp_10.42.42.5(pid=30832): Launched 05:30:31.438346 run osmo-msc_10.42.42.6: Starting osmo-msc 05:30:32.040684 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30834): Launched 05:30:32.392454 run osmo-msc_10.42.42.6(pid=30835): Launched 05:30:32.569216 run osmo-stp_10.42.42.5(pid=30832): ERR: Terminated: ERROR {rc=1} [trial-2370↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30832)] 05:30:32.704588 run osmo-stp_10.42.42.5(pid=30832): stdout: | (launched: 2022-12-10_05:30:31.102900) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:30:32.839589 run osmo-stp_10.42.42.5(pid=30832): stderr: | 20221210053031290 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053031290 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053031292 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053031292 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053031293 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053031293 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053031293 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:30:32.974275 run osmo-stp_10.42.42.5(pid=30832): stdout: | (launched: 2022-12-10_05:30:31.102900) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:30:33.101158 run osmo-stp_10.42.42.5(pid=30832): stderr: | 20221210053031290 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053031290 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053031292 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053031292 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053031293 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053031293 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053031293 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:30:33.253201 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=30832): Process ended prematurely: osmo-stp_10.42.42.5(pid=30832) [trial-2370↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30832)] [trial-2370↪ussd:sysmo↪assert_extension.py:17] 05:30:33.262229 tst assert_extension.py:17: Test FAILED (6.2 sec) 05:30:33.289437 run osmo-hlr_10.42.42.2(pid=30829): ERR: Terminated: ERROR {rc=237} [trial-2370↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30829)] 05:30:33.339346 run osmo-hlr_10.42.42.2(pid=30829): stdout: | (launched: 2022-12-10_05:30:30.081555) 05:30:33.391430 run osmo-hlr_10.42.42.2(pid=30829): stderr: | 20221210053030280 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210053030280 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210053030280 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210053030280 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210053030280 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210053030280 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210053030293 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/ussd:sysmo/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210053030301 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210053030302 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210053030302 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:30:33.463377 run osmo-msc_10.42.42.6(pid=30835): ERR: Terminated: ERROR {rc=2} [trial-2370↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30835)] 05:30:33.513455 run osmo-msc_10.42.42.6(pid=30835): stdout: | (launched: 2022-12-10_05:30:32.331595) 05:30:33.565060 run osmo-msc_10.42.42.6(pid=30835): stderr: | 20221210053032659 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210053032659 DLGLOBAL DEBUG validating counter group 0x7f0d9e367c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210053032659 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210053032660 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210053032660 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210053032660 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210053032662 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210053032662 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210053032663 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210053032663 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:30:33.616912 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30828): Terminating (SIGTERM) 05:30:33.658570 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30831): Terminating (SIGTERM) 05:30:33.700190 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30834): Terminating (SIGTERM) 05:30:33.742139 --- ParallelTerminationStrategy: PID 30828 died... 05:30:33.762018 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30828): Terminated: ok {rc=0} 05:30:33.808144 --- ParallelTerminationStrategy: PID 30831 died... 05:30:33.827778 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30831): Terminated: ok {rc=0} 05:30:33.873799 --- ParallelTerminationStrategy: PID 30834 died... 05:30:33.893246 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30834): Terminated: ok {rc=0} 05:30:33.980582 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 05:30:35.175350 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:30:35.182382 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 05:30:35.203883 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 05:30:35.231012 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 05:30:35.282710 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 05:30:35.303291 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 05:30:35.329962 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 05:30:35.880297 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 05:30:35.930897 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:30:35.942019 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 05:30:35.998760 tst mo_mt_call.py: using LAC 26178 05:30:36.121106 tst mo_mt_call.py: using RAC 168 05:30:36.241186 tst mo_mt_call.py: using CellId 26178 05:30:36.372552 tst mo_mt_call.py: using BVCI 26179 05:30:36.491944 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:30:36.503783 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:30:36.515181 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:30:36.526697 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:30:36.538316 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:30:36.549754 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 05:30:36.664525 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 05:30:36.779739 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:30:37.253573 run create_hlr_db(pid=30840): Launched 05:30:37.371604 bus /sierra_2: Setting Powered False 05:30:38.431574 run create_hlr_db(pid=30840): Terminated: ok {rc=0} 05:30:38.877337 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30842): Launched 05:30:39.203676 run osmo-hlr_10.42.42.2(pid=30843): Launched 05:30:39.329556 run osmo-stp_10.42.42.5: Starting osmo-stp 05:30:39.890806 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30845): Launched 05:30:40.216527 run osmo-stp_10.42.42.5(pid=30846): Launched 05:30:40.342603 run osmo-msc_10.42.42.6: Starting osmo-msc 05:30:40.964454 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30848): Launched 05:30:41.291761 run osmo-msc_10.42.42.6(pid=30849): Launched 05:30:41.472306 run osmo-stp_10.42.42.5(pid=30846): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30846)] 05:30:41.612311 run osmo-stp_10.42.42.5(pid=30846): stdout: | (launched: 2022-12-10_05:30:40.155880) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:30:41.750670 run osmo-stp_10.42.42.5(pid=30846): stderr: | 20221210053040351 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053040351 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053040351 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053040352 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053040352 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053040352 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053040352 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:30:41.885605 run osmo-stp_10.42.42.5(pid=30846): stdout: | (launched: 2022-12-10_05:30:40.155880) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:30:42.013873 run osmo-stp_10.42.42.5(pid=30846): stderr: | 20221210053040351 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053040351 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053040351 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053040352 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053040352 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053040352 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053040352 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:30:42.168175 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30846): Process ended prematurely: osmo-stp_10.42.42.5(pid=30846) [trial-2370↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30846)] [trial-2370↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 05:30:42.177905 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 05:30:42.205346 run osmo-hlr_10.42.42.2(pid=30843): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30843)] 05:30:42.255256 run osmo-hlr_10.42.42.2(pid=30843): stdout: | (launched: 2022-12-10_05:30:39.143208) 05:30:42.306797 run osmo-hlr_10.42.42.2(pid=30843): stderr: | 20221210053039342 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210053039342 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210053039342 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210053039342 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210053039342 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210053039342 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210053039355 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210053039363 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210053039364 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210053039364 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:30:42.379053 run osmo-msc_10.42.42.6(pid=30849): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30849)] 05:30:42.428728 run osmo-msc_10.42.42.6(pid=30849): stdout: | (launched: 2022-12-10_05:30:41.230578) 05:30:42.480176 run osmo-msc_10.42.42.6(pid=30849): stderr: | 20221210053041555 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210053041555 DLGLOBAL DEBUG validating counter group 0x7f57477edc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210053041555 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210053041555 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210053041556 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210053041556 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210053041558 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210053041558 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210053041558 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210053041558 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:30:42.531995 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30842): Terminating (SIGTERM) 05:30:42.573323 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30845): Terminating (SIGTERM) 05:30:42.614767 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30848): Terminating (SIGTERM) 05:30:42.656564 --- ParallelTerminationStrategy: PID 30842 died... 05:30:42.676617 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30842): Terminated: ok {rc=0} 05:30:42.722464 --- ParallelTerminationStrategy: PID 30845 died... 05:30:42.741969 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30845): Terminated: ok {rc=0} 05:30:42.787930 --- ParallelTerminationStrategy: PID 30848 died... 05:30:42.807508 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30848): Terminated: ok {rc=0} 05:30:42.895101 bus /sierra_3: Setting Powered False 05:30:43.994949 bus /sierra_3: Setting Powered False 05:30:45.109512 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2370 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 05:30:46.298500 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:30:46.315778 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 05:30:46.484908 tst mo_mt_call_osmux.py: using LAC 26179 05:30:46.628119 tst mo_mt_call_osmux.py: using RAC 169 05:30:46.751991 tst mo_mt_call_osmux.py: using CellId 26179 05:30:46.917659 tst mo_mt_call_osmux.py: using BVCI 26180 05:30:47.032728 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:30:47.045957 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:30:47.059082 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:30:47.072175 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:30:47.085552 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:30:47.097543 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 05:30:47.217081 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 05:30:47.334530 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:30:47.809617 run create_hlr_db(pid=30851): Launched 05:30:47.925928 bus /sierra_2: Setting Powered False 05:30:48.986371 run create_hlr_db(pid=30851): Terminated: ok {rc=0} 05:30:49.433230 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30853): Launched 05:30:49.761226 run osmo-hlr_10.42.42.2(pid=30854): Launched 05:30:49.884414 run osmo-stp_10.42.42.5: Starting osmo-stp 05:30:50.447627 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30856): Launched 05:30:50.774321 run osmo-stp_10.42.42.5(pid=30857): Launched 05:30:50.899024 run osmo-msc_10.42.42.6: Starting osmo-msc 05:30:51.487245 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30859): Launched 05:30:51.813552 run osmo-msc_10.42.42.6(pid=30860): Launched 05:30:51.992096 run osmo-stp_10.42.42.5(pid=30857): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30857)] 05:30:52.128514 run osmo-stp_10.42.42.5(pid=30857): stdout: | (launched: 2022-12-10_05:30:50.713169) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:30:52.265551 run osmo-stp_10.42.42.5(pid=30857): stderr: | 20221210053050909 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053050909 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053050909 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053050909 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053050910 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053050910 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053050910 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:30:52.402675 run osmo-stp_10.42.42.5(pid=30857): stdout: | (launched: 2022-12-10_05:30:50.713169) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:30:52.531753 run osmo-stp_10.42.42.5(pid=30857): stderr: | 20221210053050909 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053050909 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053050909 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053050909 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053050910 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053050910 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053050910 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:30:52.685963 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30857): Process ended prematurely: osmo-stp_10.42.42.5(pid=30857) [trial-2370↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30857)] [trial-2370↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 05:30:52.695600 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 05:30:52.723156 run osmo-hlr_10.42.42.2(pid=30854): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30854)] 05:30:52.773141 run osmo-hlr_10.42.42.2(pid=30854): stdout: | (launched: 2022-12-10_05:30:49.699889) 05:30:52.824695 run osmo-hlr_10.42.42.2(pid=30854): stderr: | 20221210053049902 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210053049902 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210053049902 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210053049902 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210053049902 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210053049902 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210053049948 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210053049958 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210053049958 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210053049958 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:30:52.896362 run osmo-msc_10.42.42.6(pid=30860): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30860)] 05:30:52.946076 run osmo-msc_10.42.42.6(pid=30860): stdout: | (launched: 2022-12-10_05:30:51.752455) 05:30:52.997549 run osmo-msc_10.42.42.6(pid=30860): stderr: | 20221210053052081 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210053052081 DLGLOBAL DEBUG validating counter group 0x7f94ba4abc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210053052081 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210053052081 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210053052081 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210053052081 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210053052083 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210053052083 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210053052084 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210053052084 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:30:53.049140 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30853): Terminating (SIGTERM) 05:30:53.090391 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30856): Terminating (SIGTERM) 05:30:53.131738 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30859): Terminating (SIGTERM) 05:30:53.173111 --- ParallelTerminationStrategy: PID 30853 died... 05:30:53.192904 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30853): Terminated: ok {rc=0} 05:30:53.238749 --- ParallelTerminationStrategy: PID 30856 died... 05:30:53.258294 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30856): Terminated: ok {rc=0} 05:30:53.303741 --- ParallelTerminationStrategy: PID 30859 died... 05:30:53.323176 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30859): Terminated: ok {rc=0} 05:30:53.410559 bus /sierra_3: Setting Powered False 05:30:54.507394 bus /sierra_3: Setting Powered False 05:30:55.622898 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 05:30:56.857960 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:30:56.864755 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 05:30:56.886039 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 05:30:56.913423 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 05:30:56.966951 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 05:30:56.988582 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 05:30:57.015882 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 05:30:57.569801 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 05:30:57.621270 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:30:57.632634 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 05:30:57.689712 tst mo_mt_call.py: using LAC 26180 05:30:57.817179 tst mo_mt_call.py: using RAC 170 05:30:57.956787 tst mo_mt_call.py: using CellId 26180 05:30:58.087470 tst mo_mt_call.py: using BVCI 26181 05:30:58.205431 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:30:58.216875 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:30:58.228142 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:30:58.239415 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:30:58.250770 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:30:58.262098 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 05:30:58.377415 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 05:30:58.501217 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:30:59.006059 run create_hlr_db(pid=30865): Launched 05:30:59.137797 bus /sierra_2: Setting Powered False 05:31:00.198181 run create_hlr_db(pid=30865): Terminated: ok {rc=0} 05:31:00.633120 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30867): Launched 05:31:00.980039 run osmo-hlr_10.42.42.2(pid=30868): Launched 05:31:01.139113 run osmo-stp_10.42.42.5: Starting osmo-stp 05:31:01.861686 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30870): Launched 05:31:02.205153 run osmo-stp_10.42.42.5(pid=30871): Launched 05:31:02.329907 run osmo-msc_10.42.42.6: Starting osmo-msc 05:31:02.923827 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30873): Launched 05:31:03.250960 run osmo-msc_10.42.42.6(pid=30874): Launched 05:31:03.431605 run osmo-stp_10.42.42.5(pid=30871): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30871)] 05:31:03.567744 run osmo-stp_10.42.42.5(pid=30871): stdout: | (launched: 2022-12-10_05:31:02.142656) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:31:03.704169 run osmo-stp_10.42.42.5(pid=30871): stderr: | 20221210053102361 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053102361 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053102361 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053102362 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053102362 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053102362 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053102362 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:31:03.839940 run osmo-stp_10.42.42.5(pid=30871): stdout: | (launched: 2022-12-10_05:31:02.142656) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:31:03.968664 run osmo-stp_10.42.42.5(pid=30871): stderr: | 20221210053102361 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053102361 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053102361 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053102362 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053102362 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053102362 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053102362 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:31:04.122885 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30871): Process ended prematurely: osmo-stp_10.42.42.5(pid=30871) [trial-2370↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30871)] [trial-2370↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 05:31:04.132339 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 05:31:04.159473 run osmo-hlr_10.42.42.2(pid=30868): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30868)] 05:31:04.208903 run osmo-hlr_10.42.42.2(pid=30868): stdout: | (launched: 2022-12-10_05:31:00.910920) 05:31:04.260047 run osmo-hlr_10.42.42.2(pid=30868): stderr: | 20221210053101281 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210053101281 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210053101281 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210053101281 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210053101281 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210053101281 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210053101304 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210053101317 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210053101317 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210053101317 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:31:04.331333 run osmo-msc_10.42.42.6(pid=30874): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30874)] 05:31:04.381674 run osmo-msc_10.42.42.6(pid=30874): stdout: | (launched: 2022-12-10_05:31:03.189105) 05:31:04.433371 run osmo-msc_10.42.42.6(pid=30874): stderr: | 20221210053103516 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210053103516 DLGLOBAL DEBUG validating counter group 0x7f514f779c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210053103516 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210053103516 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210053103517 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210053103517 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210053103518 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210053103519 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210053103519 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210053103519 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:31:04.485361 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30867): Terminating (SIGTERM) 05:31:04.526435 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30870): Terminating (SIGTERM) 05:31:04.567497 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30873): Terminating (SIGTERM) 05:31:04.608799 --- ParallelTerminationStrategy: PID 30867 died... 05:31:04.628506 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30867): Terminated: ok {rc=0} 05:31:04.674192 --- ParallelTerminationStrategy: PID 30870 died... 05:31:04.693379 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30870): Terminated: ok {rc=0} 05:31:04.738981 --- ParallelTerminationStrategy: PID 30873 died... 05:31:04.758380 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30873): Terminated: ok {rc=0} 05:31:04.845623 bus /sierra_3: Setting Powered False 05:31:05.943547 bus /sierra_3: Setting Powered False 05:31:07.060093 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2370 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 05:31:08.208895 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:31:08.221138 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 05:31:08.279556 tst mo_mt_call_osmux.py: using LAC 26181 05:31:08.407575 tst mo_mt_call_osmux.py: using RAC 171 05:31:08.537150 tst mo_mt_call_osmux.py: using CellId 26181 05:31:08.665041 tst mo_mt_call_osmux.py: using BVCI 26182 05:31:08.784709 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:31:08.796328 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:31:08.807660 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:31:08.818979 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:31:08.830330 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:31:08.841793 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 05:31:08.958976 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 05:31:09.078969 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:31:09.585046 run create_hlr_db(pid=30876): Launched 05:31:09.715905 bus /sierra_2: Setting Powered False 05:31:10.779065 run create_hlr_db(pid=30876): Terminated: ok {rc=0} 05:31:11.214611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30878): Launched 05:31:11.520722 run osmo-hlr_10.42.42.2(pid=30879): Launched 05:31:11.637211 run osmo-stp_10.42.42.5: Starting osmo-stp 05:31:12.181971 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30881): Launched 05:31:12.487546 run osmo-stp_10.42.42.5(pid=30882): Launched 05:31:12.604583 run osmo-msc_10.42.42.6: Starting osmo-msc 05:31:13.159824 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30884): Launched 05:31:13.466545 run osmo-msc_10.42.42.6(pid=30885): Launched 05:31:13.636603 run osmo-stp_10.42.42.5(pid=30882): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30882)] 05:31:13.765608 run osmo-stp_10.42.42.5(pid=30882): stdout: | (launched: 2022-12-10_05:31:12.429685) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:31:13.894715 run osmo-stp_10.42.42.5(pid=30882): stderr: | 20221210053112602 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053112603 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053112603 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053112603 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053112604 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053112604 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053112604 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:31:14.022132 run osmo-stp_10.42.42.5(pid=30882): stdout: | (launched: 2022-12-10_05:31:12.429685) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:31:14.142996 run osmo-stp_10.42.42.5(pid=30882): stderr: | 20221210053112602 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053112603 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053112603 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053112603 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053112604 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053112604 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053112604 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:31:14.287735 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30882): Process ended prematurely: osmo-stp_10.42.42.5(pid=30882) [trial-2370↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30882)] [trial-2370↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 05:31:14.296654 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 05:31:14.322917 run osmo-hlr_10.42.42.2(pid=30879): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30879)] 05:31:14.370571 run osmo-hlr_10.42.42.2(pid=30879): stdout: | (launched: 2022-12-10_05:31:11.462648) 05:31:14.419667 run osmo-hlr_10.42.42.2(pid=30879): stderr: | 20221210053111643 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210053111643 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210053111643 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210053111643 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210053111643 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210053111643 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210053111656 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210053111665 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210053111666 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210053111666 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:31:14.487868 run osmo-msc_10.42.42.6(pid=30885): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30885)] 05:31:14.535924 run osmo-msc_10.42.42.6(pid=30885): stdout: | (launched: 2022-12-10_05:31:13.408346) 05:31:14.585483 run osmo-msc_10.42.42.6(pid=30885): stderr: | 20221210053113683 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210053113684 DLGLOBAL DEBUG validating counter group 0x7fc790b14c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210053113684 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210053113684 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210053113684 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210053113684 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210053113686 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210053113686 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210053113687 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210053113687 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:31:14.634863 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30878): Terminating (SIGTERM) 05:31:14.674208 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30881): Terminating (SIGTERM) 05:31:14.713445 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30884): Terminating (SIGTERM) 05:31:14.753128 --- ParallelTerminationStrategy: PID 30878 died... 05:31:14.771931 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30878): Terminated: ok {rc=0} 05:31:14.815917 --- ParallelTerminationStrategy: PID 30881 died... 05:31:14.834378 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30881): Terminated: ok {rc=0} 05:31:14.878114 --- ParallelTerminationStrategy: PID 30884 died... 05:31:14.896393 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30884): Terminated: ok {rc=0} 05:31:14.981506 bus /sierra_3: Setting Powered False 05:31:16.081234 bus /sierra_3: Setting Powered False 05:31:17.200804 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 05:31:18.433068 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:31:18.439412 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 05:31:18.460548 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 05:31:18.487228 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 05:31:18.538794 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 05:31:18.559396 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 05:31:18.586072 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 05:31:19.135284 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 05:31:19.184125 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:31:19.195156 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 05:31:19.252325 tst mo_mt_call.py: using LAC 26182 05:31:19.382390 tst mo_mt_call.py: using RAC 172 05:31:19.513188 tst mo_mt_call.py: using CellId 26182 05:31:19.633515 tst mo_mt_call.py: using BVCI 26183 05:31:19.744321 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:31:19.755768 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:31:19.766718 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:31:19.777845 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:31:19.788881 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:31:19.800033 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 05:31:19.919304 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 05:31:20.035900 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:31:20.511209 run create_hlr_db(pid=30890): Launched 05:31:20.627243 bus /sierra_2: Setting Powered False 05:31:21.687485 run create_hlr_db(pid=30890): Terminated: ok {rc=0} 05:31:22.134725 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30892): Launched 05:31:22.463803 run osmo-hlr_10.42.42.2(pid=30893): Launched 05:31:22.588696 run osmo-stp_10.42.42.5: Starting osmo-stp 05:31:23.155326 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30895): Launched 05:31:23.483501 run osmo-stp_10.42.42.5(pid=30896): Launched 05:31:23.608362 run osmo-msc_10.42.42.6: Starting osmo-msc 05:31:24.200467 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30898): Launched 05:31:24.528128 run osmo-msc_10.42.42.6(pid=30899): Launched 05:31:24.710376 run osmo-stp_10.42.42.5(pid=30896): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30896)] 05:31:24.849165 run osmo-stp_10.42.42.5(pid=30896): stdout: | (launched: 2022-12-10_05:31:23.422111) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:31:24.988039 run osmo-stp_10.42.42.5(pid=30896): stderr: | 20221210053123617 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053123617 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053123617 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053123618 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053123618 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053123618 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053123618 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:31:25.125182 run osmo-stp_10.42.42.5(pid=30896): stdout: | (launched: 2022-12-10_05:31:23.422111) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:31:25.254270 run osmo-stp_10.42.42.5(pid=30896): stderr: | 20221210053123617 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053123617 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053123617 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053123618 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053123618 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053123618 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053123618 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:31:25.409965 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30896): Process ended prematurely: osmo-stp_10.42.42.5(pid=30896) [trial-2370↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30896)] [trial-2370↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 05:31:25.419274 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 05:31:25.447255 run osmo-hlr_10.42.42.2(pid=30893): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30893)] 05:31:25.497743 run osmo-hlr_10.42.42.2(pid=30893): stdout: | (launched: 2022-12-10_05:31:22.402448) 05:31:25.549796 run osmo-hlr_10.42.42.2(pid=30893): stderr: | 20221210053122602 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210053122602 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210053122602 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210053122602 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210053122602 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210053122602 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210053122615 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210053122623 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210053122623 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210053122623 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:31:25.622253 run osmo-msc_10.42.42.6(pid=30899): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30899)] 05:31:25.672690 run osmo-msc_10.42.42.6(pid=30899): stdout: | (launched: 2022-12-10_05:31:24.466840) 05:31:25.724630 run osmo-msc_10.42.42.6(pid=30899): stderr: | 20221210053124791 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210053124791 DLGLOBAL DEBUG validating counter group 0x7f389045ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210053124791 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210053124791 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210053124791 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210053124791 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210053124793 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210053124793 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210053124793 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210053124794 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:31:25.776900 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30892): Terminating (SIGTERM) 05:31:25.818652 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30895): Terminating (SIGTERM) 05:31:25.860285 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30898): Terminating (SIGTERM) 05:31:25.902262 --- ParallelTerminationStrategy: PID 30892 died... 05:31:25.922240 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30892): Terminated: ok {rc=0} 05:31:25.968466 --- ParallelTerminationStrategy: PID 30895 died... 05:31:25.987994 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30895): Terminated: ok {rc=0} 05:31:26.034075 --- ParallelTerminationStrategy: PID 30898 died... 05:31:26.053654 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30898): Terminated: ok {rc=0} 05:31:26.141145 bus /sierra_3: Setting Powered False 05:31:27.242200 bus /sierra_3: Setting Powered False 05:31:28.360146 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2370 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 05:31:29.510569 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:31:29.522883 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 05:31:29.581512 tst mo_mt_call_osmux.py: using LAC 26183 05:31:29.710383 tst mo_mt_call_osmux.py: using RAC 173 05:31:29.839213 tst mo_mt_call_osmux.py: using CellId 26183 05:31:29.969209 tst mo_mt_call_osmux.py: using BVCI 26184 05:31:30.088182 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:31:30.099790 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:31:30.111198 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:31:30.122554 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:31:30.133940 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:31:30.145401 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 05:31:30.265387 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 05:31:30.383137 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:31:30.865396 run create_hlr_db(pid=30901): Launched 05:31:31.036776 bus /sierra_2: Setting Powered False 05:31:32.119839 run create_hlr_db(pid=30901): Terminated: ok {rc=0} 05:31:32.594676 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30903): Launched 05:31:32.924295 run osmo-hlr_10.42.42.2(pid=30904): Launched 05:31:33.049035 run osmo-stp_10.42.42.5: Starting osmo-stp 05:31:33.613209 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30906): Launched 05:31:33.940533 run osmo-stp_10.42.42.5(pid=30907): Launched 05:31:34.064388 run osmo-msc_10.42.42.6: Starting osmo-msc 05:31:34.655706 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30909): Launched 05:31:34.984937 run osmo-msc_10.42.42.6(pid=30910): Launched 05:31:35.166930 run osmo-stp_10.42.42.5(pid=30907): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30907)] 05:31:35.304464 run osmo-stp_10.42.42.5(pid=30907): stdout: | (launched: 2022-12-10_05:31:33.879291) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:31:35.443387 run osmo-stp_10.42.42.5(pid=30907): stderr: | 20221210053134073 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053134073 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053134074 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053134074 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053134074 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053134074 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053134075 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:31:35.580836 run osmo-stp_10.42.42.5(pid=30907): stdout: | (launched: 2022-12-10_05:31:33.879291) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:31:35.710635 run osmo-stp_10.42.42.5(pid=30907): stderr: | 20221210053134073 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053134073 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053134074 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053134074 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053134074 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053134074 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053134075 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:31:35.865748 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30907): Process ended prematurely: osmo-stp_10.42.42.5(pid=30907) [trial-2370↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30907)] [trial-2370↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 05:31:35.875613 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 05:31:35.903287 run osmo-hlr_10.42.42.2(pid=30904): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30904)] 05:31:35.953437 run osmo-hlr_10.42.42.2(pid=30904): stdout: | (launched: 2022-12-10_05:31:32.863309) 05:31:36.005151 run osmo-hlr_10.42.42.2(pid=30904): stderr: | 20221210053133063 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210053133063 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210053133063 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210053133063 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210053133063 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210053133063 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210053133075 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210053133083 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210053133084 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210053133084 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:31:36.077104 run osmo-msc_10.42.42.6(pid=30910): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30910)] 05:31:36.127080 run osmo-msc_10.42.42.6(pid=30910): stdout: | (launched: 2022-12-10_05:31:34.923490) 05:31:36.178793 run osmo-msc_10.42.42.6(pid=30910): stderr: | 20221210053135247 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210053135248 DLGLOBAL DEBUG validating counter group 0x7f57f419ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210053135248 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210053135248 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210053135248 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210053135248 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210053135250 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210053135250 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210053135250 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210053135250 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:31:36.230703 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30903): Terminating (SIGTERM) 05:31:36.272171 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30906): Terminating (SIGTERM) 05:31:36.313601 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30909): Terminating (SIGTERM) 05:31:36.355311 --- ParallelTerminationStrategy: PID 30903 died... 05:31:36.374772 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30903): Terminated: ok {rc=0} 05:31:36.420942 --- ParallelTerminationStrategy: PID 30906 died... 05:31:36.440354 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30906): Terminated: ok {rc=0} 05:31:36.486310 --- ParallelTerminationStrategy: PID 30909 died... 05:31:36.505793 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30909): Terminated: ok {rc=0} 05:31:36.592062 bus /sierra_3: Setting Powered False 05:31:37.690606 bus /sierra_3: Setting Powered False 05:31:38.807249 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 05:31:40.046443 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:31:40.053362 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 05:31:40.075296 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 05:31:40.103770 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 05:31:40.155599 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 05:31:40.176157 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 05:31:40.203001 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 05:31:40.755521 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 05:31:40.808919 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:31:40.820596 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 05:31:40.877785 tst mo_mt_call.py: using LAC 26184 05:31:40.999297 tst mo_mt_call.py: using RAC 174 05:31:41.121667 tst mo_mt_call.py: using CellId 26184 05:31:41.243208 tst mo_mt_call.py: using BVCI 26185 05:31:41.355370 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:31:41.366442 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:31:41.377329 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:31:41.388401 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:31:41.399450 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:31:41.410561 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 05:31:41.526758 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 05:31:41.641693 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:31:42.114834 run create_hlr_db(pid=30915): Launched 05:31:42.230100 bus /sierra_2: Setting Powered False 05:31:43.289880 run create_hlr_db(pid=30915): Terminated: ok {rc=0} 05:31:43.715630 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30917): Launched 05:31:44.021933 run osmo-hlr_10.42.42.2(pid=30918): Launched 05:31:44.137894 run osmo-stp_10.42.42.5: Starting osmo-stp 05:31:44.662106 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30920): Launched 05:31:44.969072 run osmo-stp_10.42.42.5(pid=30921): Launched 05:31:45.085200 run osmo-msc_10.42.42.6: Starting osmo-msc 05:31:45.638152 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30923): Launched 05:31:45.973721 run osmo-msc_10.42.42.6(pid=30924): Launched 05:31:46.185838 run osmo-stp_10.42.42.5(pid=30921): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30921)] 05:31:46.460805 run osmo-stp_10.42.42.5(pid=30921): stdout: | (launched: 2022-12-10_05:31:44.911260) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:31:46.617540 run osmo-stp_10.42.42.5(pid=30921): stderr: | 20221210053145084 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053145084 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053145085 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053145085 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053145086 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053145086 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053145086 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:31:46.895039 run osmo-stp_10.42.42.5(pid=30921): stdout: | (launched: 2022-12-10_05:31:44.911260) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:31:47.069020 run osmo-stp_10.42.42.5(pid=30921): stderr: | 20221210053145084 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053145084 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053145085 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053145085 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053145086 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053145086 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053145086 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:31:47.274729 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30921): Process ended prematurely: osmo-stp_10.42.42.5(pid=30921) [trial-2370↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30921)] [trial-2370↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 05:31:47.289038 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 05:31:47.324219 run osmo-hlr_10.42.42.2(pid=30918): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30918)] 05:31:47.375356 run osmo-hlr_10.42.42.2(pid=30918): stdout: | (launched: 2022-12-10_05:31:43.964082) 05:31:47.428172 run osmo-hlr_10.42.42.2(pid=30918): stderr: | 20221210053144144 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210053144144 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210053144144 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210053144144 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210053144144 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210053144144 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210053144161 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210053144169 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210053144169 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210053144169 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:31:47.499676 run osmo-msc_10.42.42.6(pid=30924): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30924)] 05:31:47.549569 run osmo-msc_10.42.42.6(pid=30924): stdout: | (launched: 2022-12-10_05:31:45.899890) 05:31:47.601448 run osmo-msc_10.42.42.6(pid=30924): stderr: | 20221210053146520 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210053146520 DLGLOBAL DEBUG validating counter group 0x7f2bff1f4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210053146520 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210053146534 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210053146534 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210053146534 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210053146536 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210053146537 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210053146537 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210053146537 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:31:47.653655 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30917): Terminating (SIGTERM) 05:31:47.695434 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30920): Terminating (SIGTERM) 05:31:47.736604 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30923): Terminating (SIGTERM) 05:31:47.778257 --- ParallelTerminationStrategy: PID 30917 died... 05:31:47.798048 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30917): Terminated: ok {rc=0} 05:31:47.843797 --- ParallelTerminationStrategy: PID 30920 died... 05:31:47.863105 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30920): Terminated: ok {rc=0} 05:31:47.909573 --- ParallelTerminationStrategy: PID 30923 died... 05:31:47.929046 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30923): Terminated: ok {rc=0} 05:31:48.016176 bus /sierra_3: Setting Powered False 05:31:49.116444 bus /sierra_3: Setting Powered False 05:31:50.231933 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2370 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 05:31:51.381628 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:31:51.393786 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 05:31:51.451514 tst mo_mt_call_osmux.py: using LAC 26185 05:31:51.580707 tst mo_mt_call_osmux.py: using RAC 175 05:31:51.710376 tst mo_mt_call_osmux.py: using CellId 26185 05:31:51.839907 tst mo_mt_call_osmux.py: using BVCI 26186 05:31:51.958209 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:31:51.970190 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:31:51.981587 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:31:51.992938 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:31:52.004450 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:31:52.015936 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 05:31:52.131405 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 05:31:52.251761 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:31:52.758579 run create_hlr_db(pid=30926): Launched 05:31:52.890895 bus /sierra_2: Setting Powered False 05:31:53.954633 run create_hlr_db(pid=30926): Terminated: ok {rc=0} 05:31:54.391261 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30928): Launched 05:31:54.698716 run osmo-hlr_10.42.42.2(pid=30929): Launched 05:31:54.814632 run osmo-stp_10.42.42.5: Starting osmo-stp 05:31:55.341164 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30931): Launched 05:31:55.647949 run osmo-stp_10.42.42.5(pid=30932): Launched 05:31:55.763495 run osmo-msc_10.42.42.6: Starting osmo-msc 05:31:56.315754 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30934): Launched 05:31:56.623108 run osmo-msc_10.42.42.6(pid=30935): Launched 05:31:56.792820 run osmo-stp_10.42.42.5(pid=30932): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30932)] 05:31:56.922460 run osmo-stp_10.42.42.5(pid=30932): stdout: | (launched: 2022-12-10_05:31:55.590537) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:31:57.051864 run osmo-stp_10.42.42.5(pid=30932): stderr: | 20221210053155763 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053155764 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053155764 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053155764 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053155765 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053155765 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053155765 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:31:57.179231 run osmo-stp_10.42.42.5(pid=30932): stdout: | (launched: 2022-12-10_05:31:55.590537) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:31:57.300241 run osmo-stp_10.42.42.5(pid=30932): stderr: | 20221210053155763 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053155764 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053155764 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053155764 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053155765 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053155765 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053155765 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:31:57.445657 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30932): Process ended prematurely: osmo-stp_10.42.42.5(pid=30932) [trial-2370↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30932)] [trial-2370↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 05:31:57.454883 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 05:31:57.481560 run osmo-hlr_10.42.42.2(pid=30929): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30929)] 05:31:57.529741 run osmo-hlr_10.42.42.2(pid=30929): stdout: | (launched: 2022-12-10_05:31:54.640771) 05:31:57.579502 run osmo-hlr_10.42.42.2(pid=30929): stderr: | 20221210053154820 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210053154821 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210053154821 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210053154821 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210053154821 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210053154821 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210053154832 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210053154841 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210053154841 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210053154841 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:31:57.648098 run osmo-msc_10.42.42.6(pid=30935): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30935)] 05:31:57.695706 run osmo-msc_10.42.42.6(pid=30935): stdout: | (launched: 2022-12-10_05:31:56.565418) 05:31:57.745308 run osmo-msc_10.42.42.6(pid=30935): stderr: | 20221210053156840 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210053156840 DLGLOBAL DEBUG validating counter group 0x7f8a9842cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210053156840 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210053156840 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210053156840 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210053156840 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210053156842 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210053156843 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210053156843 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210053156843 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:31:57.795213 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30928): Terminating (SIGTERM) 05:31:57.834979 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30931): Terminating (SIGTERM) 05:31:57.874855 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30934): Terminating (SIGTERM) 05:31:57.914820 --- ParallelTerminationStrategy: PID 30928 died... 05:31:57.933924 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30928): Terminated: ok {rc=0} 05:31:57.978200 --- ParallelTerminationStrategy: PID 30931 died... 05:31:57.996817 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30931): Terminated: ok {rc=0} 05:31:58.041096 --- ParallelTerminationStrategy: PID 30934 died... 05:31:58.059525 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30934): Terminated: ok {rc=0} 05:31:58.143473 bus /sierra_3: Setting Powered False 05:31:59.240664 bus /sierra_3: Setting Powered False 05:32:00.355793 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 05:32:01.597797 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:32:01.606754 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 05:32:01.631242 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 05:32:01.660820 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 05:32:01.715049 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 05:32:01.750858 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 05:32:01.793233 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 05:32:02.314875 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 05:32:02.366781 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:32:02.378330 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 05:32:02.436442 tst mo_mt_call.py: using LAC 26186 05:32:02.564913 tst mo_mt_call.py: using RAC 176 05:32:02.696599 tst mo_mt_call.py: using CellId 26186 05:32:02.822249 tst mo_mt_call.py: using BVCI 26187 05:32:02.942467 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:32:02.954161 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:32:02.965602 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:32:02.976871 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:32:02.988373 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:32:02.999878 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 05:32:03.115363 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 05:32:03.234821 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:32:03.742056 run create_hlr_db(pid=30940): Launched 05:32:03.875262 bus /sierra_2: Setting Powered False 05:32:04.939227 run create_hlr_db(pid=30940): Terminated: ok {rc=0} 05:32:05.375738 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30942): Launched 05:32:05.684182 run osmo-hlr_10.42.42.2(pid=30943): Launched 05:32:05.800610 run osmo-stp_10.42.42.5: Starting osmo-stp 05:32:06.328662 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30945): Launched 05:32:06.635665 run osmo-stp_10.42.42.5(pid=30946): Launched 05:32:06.751719 run osmo-msc_10.42.42.6: Starting osmo-msc 05:32:07.307367 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30948): Launched 05:32:07.615380 run osmo-msc_10.42.42.6(pid=30949): Launched 05:32:07.784857 run osmo-stp_10.42.42.5(pid=30946): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30946)] 05:32:07.913821 run osmo-stp_10.42.42.5(pid=30946): stdout: | (launched: 2022-12-10_05:32:06.577943) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:32:08.043516 run osmo-stp_10.42.42.5(pid=30946): stderr: | 20221210053206753 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053206753 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053206753 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053206754 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053206754 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053206754 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053206754 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:32:08.171049 run osmo-stp_10.42.42.5(pid=30946): stdout: | (launched: 2022-12-10_05:32:06.577943) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:32:08.292280 run osmo-stp_10.42.42.5(pid=30946): stderr: | 20221210053206753 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053206753 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053206753 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053206754 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053206754 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053206754 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053206754 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:32:08.438233 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30946): Process ended prematurely: osmo-stp_10.42.42.5(pid=30946) [trial-2370↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30946)] [trial-2370↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 05:32:08.447261 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 05:32:08.474624 run osmo-hlr_10.42.42.2(pid=30943): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30943)] 05:32:08.523149 run osmo-hlr_10.42.42.2(pid=30943): stdout: | (launched: 2022-12-10_05:32:05.626177) 05:32:08.573187 run osmo-hlr_10.42.42.2(pid=30943): stderr: | 20221210053205804 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210053205804 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210053205804 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210053205804 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210053205804 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210053205804 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210053205818 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210053205827 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210053205827 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210053205827 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:32:08.642476 run osmo-msc_10.42.42.6(pid=30949): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30949)] 05:32:08.690729 run osmo-msc_10.42.42.6(pid=30949): stdout: | (launched: 2022-12-10_05:32:07.557148) 05:32:08.740585 run osmo-msc_10.42.42.6(pid=30949): stderr: | 20221210053207831 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210053207832 DLGLOBAL DEBUG validating counter group 0x7f3bab705c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210053207832 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210053207832 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210053207832 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210053207832 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210053207834 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210053207834 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210053207835 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210053207835 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:32:08.790573 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30942): Terminating (SIGTERM) 05:32:08.830544 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30945): Terminating (SIGTERM) 05:32:08.870249 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30948): Terminating (SIGTERM) 05:32:08.910468 --- ParallelTerminationStrategy: PID 30942 died... 05:32:08.929085 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30942): Terminated: ok {rc=0} 05:32:08.974003 --- ParallelTerminationStrategy: PID 30945 died... 05:32:08.992628 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30945): Terminated: ok {rc=0} 05:32:09.037042 --- ParallelTerminationStrategy: PID 30948 died... 05:32:09.055599 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30948): Terminated: ok {rc=0} 05:32:09.140102 bus /sierra_3: Setting Powered False 05:32:10.239083 bus /sierra_3: Setting Powered False 05:32:11.357243 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2370 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 05:32:12.504363 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:32:12.516296 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 05:32:12.572913 tst mo_mt_call_osmux.py: using LAC 26187 05:32:12.693573 tst mo_mt_call_osmux.py: using RAC 177 05:32:12.821084 tst mo_mt_call_osmux.py: using CellId 26187 05:32:12.948753 tst mo_mt_call_osmux.py: using BVCI 26188 05:32:13.067219 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:32:13.079049 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:32:13.090659 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:32:13.102381 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:32:13.114113 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:32:13.125763 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 05:32:13.242246 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 05:32:13.365565 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:32:13.871140 run create_hlr_db(pid=30951): Launched 05:32:14.002850 bus /sierra_2: Setting Powered False 05:32:15.066541 run create_hlr_db(pid=30951): Terminated: ok {rc=0} 05:32:15.502171 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30953): Launched 05:32:15.809075 run osmo-hlr_10.42.42.2(pid=30954): Launched 05:32:16.080163 run osmo-stp_10.42.42.5: Starting osmo-stp 05:32:16.666909 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30956): Launched 05:32:17.015257 run osmo-stp_10.42.42.5(pid=30957): Launched 05:32:17.248372 run osmo-msc_10.42.42.6: Starting osmo-msc 05:32:17.851134 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30959): Launched 05:32:18.178042 run osmo-msc_10.42.42.6(pid=30960): Launched 05:32:18.358557 run osmo-stp_10.42.42.5(pid=30957): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30957)] 05:32:18.495340 run osmo-stp_10.42.42.5(pid=30957): stdout: | (launched: 2022-12-10_05:32:16.951043) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:32:18.633249 run osmo-stp_10.42.42.5(pid=30957): stderr: | 20221210053217203 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053217203 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053217204 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053217204 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053217205 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053217205 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053217205 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:32:18.769806 run osmo-stp_10.42.42.5(pid=30957): stdout: | (launched: 2022-12-10_05:32:16.951043) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:32:18.899498 run osmo-stp_10.42.42.5(pid=30957): stderr: | 20221210053217203 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053217203 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053217204 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053217204 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053217205 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053217205 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053217205 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:32:19.055412 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30957): Process ended prematurely: osmo-stp_10.42.42.5(pid=30957) [trial-2370↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30957)] [trial-2370↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 05:32:19.065443 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 05:32:19.093679 run osmo-hlr_10.42.42.2(pid=30954): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30954)] 05:32:19.143501 run osmo-hlr_10.42.42.2(pid=30954): stdout: | (launched: 2022-12-10_05:32:15.751271) 05:32:19.194979 run osmo-hlr_10.42.42.2(pid=30954): stderr: | 20221210053215954 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210053215954 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210053215954 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210053215955 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210053215955 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210053215955 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210053215976 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210053215984 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210053215993 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210053215993 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:32:19.266474 run osmo-msc_10.42.42.6(pid=30960): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30960)] 05:32:19.316292 run osmo-msc_10.42.42.6(pid=30960): stdout: | (launched: 2022-12-10_05:32:18.116910) 05:32:19.367930 run osmo-msc_10.42.42.6(pid=30960): stderr: | 20221210053218445 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210053218445 DLGLOBAL DEBUG validating counter group 0x7f2567b3fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210053218445 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210053218445 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210053218445 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210053218445 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210053218447 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210053218447 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210053218448 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210053218448 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:32:19.419950 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30953): Terminating (SIGTERM) 05:32:19.461236 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30956): Terminating (SIGTERM) 05:32:19.502682 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30959): Terminating (SIGTERM) 05:32:19.544247 --- ParallelTerminationStrategy: PID 30953 died... 05:32:19.564046 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30953): Terminated: ok {rc=0} 05:32:19.610449 --- ParallelTerminationStrategy: PID 30956 died... 05:32:19.629840 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30956): Terminated: ok {rc=0} 05:32:19.675665 --- ParallelTerminationStrategy: PID 30959 died... 05:32:19.695051 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30959): Terminated: ok {rc=0} 05:32:19.782294 bus /sierra_3: Setting Powered False 05:32:20.881061 bus /sierra_3: Setting Powered False 05:32:21.997418 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 05:32:23.228015 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:32:23.234432 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 05:32:23.255181 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 05:32:23.282975 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 05:32:23.335903 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 05:32:23.357489 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 05:32:23.383930 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 05:32:23.934617 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 05:32:23.983715 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:32:23.994844 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 05:32:24.050262 tst mo_mt_call.py: using LAC 26188 05:32:24.171375 tst mo_mt_call.py: using RAC 178 05:32:24.290137 tst mo_mt_call.py: using CellId 26188 05:32:24.411448 tst mo_mt_call.py: using BVCI 26189 05:32:24.523432 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:32:24.534547 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:32:24.545514 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:32:24.556602 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:32:24.567675 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:32:24.579011 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 05:32:24.691633 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 05:32:24.807068 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:32:25.282495 run create_hlr_db(pid=30967): Launched 05:32:25.398358 bus /sierra_2: Setting Powered False 05:32:26.459256 run create_hlr_db(pid=30967): Terminated: ok {rc=0} 05:32:26.907372 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30969): Launched 05:32:27.237169 run osmo-hlr_10.42.42.2(pid=30970): Launched 05:32:27.361720 run osmo-stp_10.42.42.5: Starting osmo-stp 05:32:27.927593 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30972): Launched 05:32:28.255891 run osmo-stp_10.42.42.5(pid=30973): Launched 05:32:28.379508 run osmo-msc_10.42.42.6: Starting osmo-msc 05:32:28.972144 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30975): Launched 05:32:29.300519 run osmo-msc_10.42.42.6(pid=30976): Launched 05:32:29.482959 run osmo-stp_10.42.42.5(pid=30973): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30973)] 05:32:29.619943 run osmo-stp_10.42.42.5(pid=30973): stdout: | (launched: 2022-12-10_05:32:28.193781) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:32:29.758033 run osmo-stp_10.42.42.5(pid=30973): stderr: | 20221210053228390 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053228390 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053228390 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053228390 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053228391 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053228391 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053228391 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:32:29.894603 run osmo-stp_10.42.42.5(pid=30973): stdout: | (launched: 2022-12-10_05:32:28.193781) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:32:30.024475 run osmo-stp_10.42.42.5(pid=30973): stderr: | 20221210053228390 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053228390 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053228390 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053228390 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053228391 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053228391 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053228391 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:32:30.179990 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30973): Process ended prematurely: osmo-stp_10.42.42.5(pid=30973) [trial-2370↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30973)] [trial-2370↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 05:32:30.189848 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 05:32:30.217683 run osmo-hlr_10.42.42.2(pid=30970): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30970)] 05:32:30.267789 run osmo-hlr_10.42.42.2(pid=30970): stdout: | (launched: 2022-12-10_05:32:27.175774) 05:32:30.319847 run osmo-hlr_10.42.42.2(pid=30970): stderr: | 20221210053227378 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210053227378 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210053227378 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210053227378 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210053227378 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210053227378 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210053227391 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210053227401 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210053227401 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210053227401 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:32:30.391653 run osmo-msc_10.42.42.6(pid=30976): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30976)] 05:32:30.442112 run osmo-msc_10.42.42.6(pid=30976): stdout: | (launched: 2022-12-10_05:32:29.239252) 05:32:30.494329 run osmo-msc_10.42.42.6(pid=30976): stderr: | 20221210053229563 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210053229563 DLGLOBAL DEBUG validating counter group 0x7f9d1e654c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210053229563 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210053229563 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210053229563 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210053229564 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210053229565 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210053229566 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210053229566 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210053229566 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:32:30.546237 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30969): Terminating (SIGTERM) 05:32:30.587686 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30972): Terminating (SIGTERM) 05:32:30.629538 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30975): Terminating (SIGTERM) 05:32:30.671497 --- ParallelTerminationStrategy: PID 30969 died... 05:32:30.691281 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30969): Terminated: ok {rc=0} 05:32:30.737609 --- ParallelTerminationStrategy: PID 30972 died... 05:32:30.757483 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30972): Terminated: ok {rc=0} 05:32:30.803711 --- ParallelTerminationStrategy: PID 30975 died... 05:32:30.823262 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30975): Terminated: ok {rc=0} 05:32:30.931294 bus /sierra_3: Setting Powered False 05:32:32.037996 bus /sierra_3: Setting Powered False 05:32:33.154177 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2370 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 05:32:34.304492 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:32:34.316934 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 05:32:34.375397 tst mo_mt_call_osmux.py: using LAC 26189 05:32:34.505623 tst mo_mt_call_osmux.py: using RAC 179 05:32:34.634257 tst mo_mt_call_osmux.py: using CellId 26189 05:32:34.763301 tst mo_mt_call_osmux.py: using BVCI 26190 05:32:34.883765 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:32:34.895518 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:32:34.907083 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:32:34.918635 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:32:34.930156 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:32:34.941851 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 05:32:35.062316 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 05:32:35.179877 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:32:35.656057 run create_hlr_db(pid=30978): Launched 05:32:35.773570 bus /sierra_2: Setting Powered False 05:32:36.834566 run create_hlr_db(pid=30978): Terminated: ok {rc=0} 05:32:37.281234 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30981): Launched 05:32:37.611009 run osmo-hlr_10.42.42.2(pid=30982): Launched 05:32:37.735753 run osmo-stp_10.42.42.5: Starting osmo-stp 05:32:38.271832 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30984): Launched 05:32:38.579396 run osmo-stp_10.42.42.5(pid=30985): Launched 05:32:38.694398 run osmo-msc_10.42.42.6: Starting osmo-msc 05:32:39.262991 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30987): Launched 05:32:39.569013 run osmo-msc_10.42.42.6(pid=30988): Launched 05:32:39.738773 run osmo-stp_10.42.42.5(pid=30985): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30985)] 05:32:39.867713 run osmo-stp_10.42.42.5(pid=30985): stdout: | (launched: 2022-12-10_05:32:38.521090) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:32:39.997649 run osmo-stp_10.42.42.5(pid=30985): stderr: | 20221210053238693 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053238694 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053238694 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053238694 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053238696 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053238697 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053238697 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:32:40.125289 run osmo-stp_10.42.42.5(pid=30985): stdout: | (launched: 2022-12-10_05:32:38.521090) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:32:40.245991 run osmo-stp_10.42.42.5(pid=30985): stderr: | 20221210053238693 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053238694 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053238694 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053238694 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053238696 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053238697 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053238697 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:32:40.390428 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30985): Process ended prematurely: osmo-stp_10.42.42.5(pid=30985) [trial-2370↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30985)] [trial-2370↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 05:32:40.399384 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 05:32:40.425891 run osmo-hlr_10.42.42.2(pid=30982): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30982)] 05:32:40.473415 run osmo-hlr_10.42.42.2(pid=30982): stdout: | (launched: 2022-12-10_05:32:37.549252) 05:32:40.522588 run osmo-hlr_10.42.42.2(pid=30982): stderr: | 20221210053237749 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210053237750 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210053237750 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210053237750 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210053237750 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210053237750 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210053237762 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210053237771 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210053237771 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210053237771 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:32:40.591010 run osmo-msc_10.42.42.6(pid=30988): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30988)] 05:32:40.638452 run osmo-msc_10.42.42.6(pid=30988): stdout: | (launched: 2022-12-10_05:32:39.511180) 05:32:40.687128 run osmo-msc_10.42.42.6(pid=30988): stderr: | 20221210053239787 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210053239787 DLGLOBAL DEBUG validating counter group 0x7fdf54f17c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210053239787 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210053239787 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210053239788 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210053239788 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210053239790 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210053239791 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210053239791 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210053239791 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:32:40.736289 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30981): Terminating (SIGTERM) 05:32:40.775419 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30984): Terminating (SIGTERM) 05:32:40.814874 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30987): Terminating (SIGTERM) 05:32:40.854333 --- ParallelTerminationStrategy: PID 30981 died... 05:32:40.873102 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30981): Terminated: ok {rc=0} 05:32:40.917001 --- ParallelTerminationStrategy: PID 30984 died... 05:32:40.935599 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30984): Terminated: ok {rc=0} 05:32:40.979250 --- ParallelTerminationStrategy: PID 30987 died... 05:32:40.997544 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30987): Terminated: ok {rc=0} 05:32:41.082900 bus /sierra_3: Setting Powered False 05:32:42.183894 bus /sierra_3: Setting Powered False 05:32:43.299269 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 voice:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 05:32:44.532088 tst voice:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:32:44.539476 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 05:32:44.561366 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 05:32:44.589321 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 05:32:44.640771 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 05:32:44.662011 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 05:32:44.689040 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 05:32:45.240638 tst voice:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 05:32:45.292583 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:32:45.303904 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 05:32:45.361187 tst mo_mt_call.py: using LAC 26190 05:32:45.487444 tst mo_mt_call.py: using RAC 180 05:32:45.607554 tst mo_mt_call.py: using CellId 26190 05:32:45.726303 tst mo_mt_call.py: using BVCI 26191 05:32:45.844170 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:32:45.855794 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:32:45.867490 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:32:45.884900 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:32:45.896701 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:32:45.908139 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 05:32:46.047135 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 05:32:46.171141 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:32:46.778603 run create_hlr_db(pid=30993): Launched 05:32:46.947135 bus /sierra_2: Setting Powered False 05:32:48.011255 run create_hlr_db(pid=30993): Terminated: ok {rc=0} 05:32:48.469305 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30995): Launched 05:32:48.795771 run osmo-hlr_10.42.42.2(pid=30996): Launched 05:32:48.919473 run osmo-stp_10.42.42.5: Starting osmo-stp 05:32:49.483589 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30998): Launched 05:32:49.811810 run osmo-stp_10.42.42.5(pid=30999): Launched 05:32:49.935643 run osmo-msc_10.42.42.6: Starting osmo-msc 05:32:50.529595 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31001): Launched 05:32:50.856707 run osmo-msc_10.42.42.6(pid=31002): Launched 05:32:51.038053 run osmo-stp_10.42.42.5(pid=30999): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30999)] 05:32:51.179062 run osmo-stp_10.42.42.5(pid=30999): stdout: | (launched: 2022-12-10_05:32:49.750409) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:32:51.318740 run osmo-stp_10.42.42.5(pid=30999): stderr: | 20221210053249947 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053249948 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053249948 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053249948 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053249949 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053249949 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053249949 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:32:51.456283 run osmo-stp_10.42.42.5(pid=30999): stdout: | (launched: 2022-12-10_05:32:49.750409) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:32:51.586139 run osmo-stp_10.42.42.5(pid=30999): stderr: | 20221210053249947 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053249948 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053249948 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053249948 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053249949 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053249949 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053249949 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:32:51.741184 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30999): Process ended prematurely: osmo-stp_10.42.42.5(pid=30999) [trial-2370↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30999)] [trial-2370↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 05:32:51.750744 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 05:32:51.778331 run osmo-hlr_10.42.42.2(pid=30996): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30996)] 05:32:51.828402 run osmo-hlr_10.42.42.2(pid=30996): stdout: | (launched: 2022-12-10_05:32:48.735027) 05:32:51.880081 run osmo-hlr_10.42.42.2(pid=30996): stderr: | 20221210053248935 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210053248935 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210053248935 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210053248935 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210053248935 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210053248935 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210053248948 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210053248956 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210053248956 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210053248956 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:32:51.952233 run osmo-msc_10.42.42.6(pid=31002): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31002)] 05:32:52.002098 run osmo-msc_10.42.42.6(pid=31002): stdout: | (launched: 2022-12-10_05:32:50.795280) 05:32:52.053694 run osmo-msc_10.42.42.6(pid=31002): stderr: | 20221210053251119 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210053251120 DLGLOBAL DEBUG validating counter group 0x7fd963e1cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210053251120 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210053251120 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210053251120 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210053251120 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210053251122 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210053251122 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210053251122 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210053251122 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:32:52.105499 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30995): Terminating (SIGTERM) 05:32:52.146980 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30998): Terminating (SIGTERM) 05:32:52.188568 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31001): Terminating (SIGTERM) 05:32:52.230363 --- ParallelTerminationStrategy: PID 30995 died... 05:32:52.250308 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30995): Terminated: ok {rc=0} 05:32:52.296272 --- ParallelTerminationStrategy: PID 30998 died... 05:32:52.315786 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30998): Terminated: ok {rc=0} 05:32:52.361616 --- ParallelTerminationStrategy: PID 31001 died... 05:32:52.380845 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31001): Terminated: ok {rc=0} 05:32:52.468224 bus /sierra_3: Setting Powered False 05:32:53.567263 bus /sierra_3: Setting Powered False 05:32:54.684223 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2370 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 05:32:55.832641 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:32:55.844306 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 05:32:55.902741 tst mo_mt_call_osmux.py: using LAC 26191 05:32:56.024346 tst mo_mt_call_osmux.py: using RAC 181 05:32:56.145561 tst mo_mt_call_osmux.py: using CellId 26191 05:32:56.274154 tst mo_mt_call_osmux.py: using BVCI 26192 05:32:56.394214 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:32:56.405750 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:32:56.417086 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:32:56.428344 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:32:56.440050 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:32:56.451414 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 05:32:56.567673 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 05:32:56.688243 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:32:57.194179 run create_hlr_db(pid=31004): Launched 05:32:57.326111 bus /sierra_2: Setting Powered False 05:32:58.390279 run create_hlr_db(pid=31004): Terminated: ok {rc=0} 05:32:58.826081 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31006): Launched 05:32:59.133097 run osmo-hlr_10.42.42.2(pid=31007): Launched 05:32:59.248364 run osmo-stp_10.42.42.5: Starting osmo-stp 05:32:59.788611 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31009): Launched 05:33:00.095602 run osmo-stp_10.42.42.5(pid=31010): Launched 05:33:00.212400 run osmo-msc_10.42.42.6: Starting osmo-msc 05:33:00.765993 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31012): Launched 05:33:01.125203 run osmo-msc_10.42.42.6(pid=31013): Launched 05:33:01.491542 run osmo-stp_10.42.42.5(pid=31010): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31010)] 05:33:01.783338 run osmo-stp_10.42.42.5(pid=31010): stdout: | (launched: 2022-12-10_05:33:00.037720) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:33:01.956552 run osmo-stp_10.42.42.5(pid=31010): stderr: | 20221210053300209 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053300209 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053300209 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053300210 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053300210 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053300210 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053300210 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:33:02.095581 run osmo-stp_10.42.42.5(pid=31010): stdout: | (launched: 2022-12-10_05:33:00.037720) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:33:02.226667 run osmo-stp_10.42.42.5(pid=31010): stderr: | 20221210053300209 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053300209 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053300209 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053300210 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053300210 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053300210 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053300210 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:33:02.381774 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31010): Process ended prematurely: osmo-stp_10.42.42.5(pid=31010) [trial-2370↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31010)] [trial-2370↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 05:33:02.391502 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 05:33:02.419371 run osmo-hlr_10.42.42.2(pid=31007): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31007)] 05:33:02.470353 run osmo-hlr_10.42.42.2(pid=31007): stdout: | (launched: 2022-12-10_05:32:59.075336) 05:33:02.522432 run osmo-hlr_10.42.42.2(pid=31007): stderr: | 20221210053259256 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210053259256 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210053259256 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210053259256 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210053259256 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210053259256 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210053259269 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210053259280 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210053259280 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210053259280 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:33:02.594923 run osmo-msc_10.42.42.6(pid=31013): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31013)] 05:33:02.645296 run osmo-msc_10.42.42.6(pid=31013): stdout: | (launched: 2022-12-10_05:33:01.062426) 05:33:02.697687 run osmo-msc_10.42.42.6(pid=31013): stderr: | 20221210053301568 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210053301577 DLGLOBAL DEBUG validating counter group 0x7f966e142c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210053301577 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210053301577 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210053301577 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210053301578 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210053301579 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210053301580 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210053301580 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210053301580 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:33:02.750060 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31006): Terminating (SIGTERM) 05:33:02.791873 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31009): Terminating (SIGTERM) 05:33:02.833765 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31012): Terminating (SIGTERM) 05:33:02.875697 --- ParallelTerminationStrategy: PID 31006 died... 05:33:02.895749 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31006): Terminated: ok {rc=0} 05:33:02.942115 --- ParallelTerminationStrategy: PID 31009 died... 05:33:02.962038 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31009): Terminated: ok {rc=0} 05:33:03.008149 --- ParallelTerminationStrategy: PID 31012 died... 05:33:03.027855 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31012): Terminated: ok {rc=0} 05:33:03.116669 bus /sierra_3: Setting Powered False 05:33:04.215243 bus /sierra_3: Setting Powered False 05:33:05.330545 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 voice:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 emergency:sysmo --------------------------------------------------------------------- 05:33:06.559210 tst emergency:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:33:06.563518 tst emergency:sysmo: Verifying 1 x bts (candidates: 11) 05:33:06.584429 tst emergency:sysmo: Verifying 6 x ip_address (candidates: 9) 05:33:06.611598 tst emergency:sysmo: Verifying 4 x modem (candidates: 12) 05:33:06.695499 tst emergency:sysmo: Reserving 1 x bts (candidates: 11) 05:33:06.716192 tst emergency:sysmo: Reserving 6 x ip_address (candidates: 9) 05:33:06.742949 tst emergency:sysmo: Reserving 4 x modem (candidates: 12) 05:33:07.325508 tst emergency:sysmo: RESERVED RESOURCES for emergency: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2370 emergency:sysmo emergency_mo_mt_call.py ---------------------------------------------- 05:33:07.330471 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 05:33:07.341094 tst emergency:sysmo: Using 1 x bts (candidates: 1) 05:33:07.377166 tst emergency_mo_mt_call.py: using LAC 26192 05:33:07.497230 tst emergency_mo_mt_call.py: using RAC 182 05:33:07.624381 tst emergency_mo_mt_call.py: using CellId 26192 05:33:07.749489 tst emergency_mo_mt_call.py: using BVCI 26193 05:33:07.861467 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 05:33:07.872146 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 05:33:07.882990 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 05:33:07.894018 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 05:33:07.904817 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 05:33:07.915730 tst emergency:sysmo: Using 1 x modem (candidates: 4) 05:33:08.033226 tst emergency:sysmo: Using 1 x modem (candidates: 4) 05:33:08.149233 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:33:08.648334 run create_hlr_db(pid=31019): Launched 05:33:08.778494 bus /sierra_2: Setting Powered False 05:33:09.842773 run create_hlr_db(pid=31019): Terminated: ok {rc=0} 05:33:10.291186 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31021): Launched 05:33:10.613590 run osmo-hlr_10.42.42.2(pid=31022): Launched 05:33:10.734391 run osmo-stp_10.42.42.5: Starting osmo-stp 05:33:11.286696 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31024): Launched 05:33:11.610811 run osmo-stp_10.42.42.5(pid=31025): Launched 05:33:11.741242 tst emergency_mo_mt_call.py: using MSISDN 7572 05:33:11.904473 run osmo-msc_10.42.42.6: Starting osmo-msc 05:33:12.481634 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31027): Launched 05:33:12.802952 run osmo-msc_10.42.42.6(pid=31028): Launched 05:33:12.980447 run osmo-stp_10.42.42.5(pid=31025): ERR: Terminated: ERROR {rc=1} [trial-2370↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31025)] 05:33:13.115160 run osmo-stp_10.42.42.5(pid=31025): stdout: | (launched: 2022-12-10_05:33:11.550040) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:33:13.249948 run osmo-stp_10.42.42.5(pid=31025): stderr: | 20221210053311744 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053311745 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053311745 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053311745 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053311748 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053311748 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053311748 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:33:13.384235 run osmo-stp_10.42.42.5(pid=31025): stdout: | (launched: 2022-12-10_05:33:11.550040) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:33:13.512547 run osmo-stp_10.42.42.5(pid=31025): stderr: | 20221210053311744 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053311745 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053311745 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053311745 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053311748 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053311748 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053311748 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:33:13.665271 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=31025): Process ended prematurely: osmo-stp_10.42.42.5(pid=31025) [trial-2370↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31025)] [trial-2370↪emergency:sysmo↪emergency_mo_mt_call.py:19] 05:33:13.674171 tst emergency_mo_mt_call.py:19: Test FAILED (6.3 sec) 05:33:13.701305 run osmo-hlr_10.42.42.2(pid=31022): ERR: Terminated: ERROR {rc=237} [trial-2370↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31022)] 05:33:13.750992 run osmo-hlr_10.42.42.2(pid=31022): stdout: | (launched: 2022-12-10_05:33:10.552730) 05:33:13.802385 run osmo-hlr_10.42.42.2(pid=31022): stderr: | 20221210053310755 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210053310755 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210053310755 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210053310755 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210053310755 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210053310755 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210053310771 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/emergency:sysmo/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210053310780 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210053310780 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210053310780 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:33:13.874492 run osmo-msc_10.42.42.6(pid=31028): ERR: Terminated: ERROR {rc=2} [trial-2370↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31028)] 05:33:13.924356 run osmo-msc_10.42.42.6(pid=31028): stdout: | (launched: 2022-12-10_05:33:12.742340) 05:33:13.975713 run osmo-msc_10.42.42.6(pid=31028): stderr: | 20221210053313070 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210053313070 DLGLOBAL DEBUG validating counter group 0x7f2b9ad0ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210053313070 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210053313070 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210053313070 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210053313070 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210053313072 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210053313073 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210053313073 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210053313073 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:33:14.027635 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31021): Terminating (SIGTERM) 05:33:14.069094 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31024): Terminating (SIGTERM) 05:33:14.111311 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31027): Terminating (SIGTERM) 05:33:14.153385 --- ParallelTerminationStrategy: PID 31021 died... 05:33:14.173349 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31021): Terminated: ok {rc=0} 05:33:14.219443 --- ParallelTerminationStrategy: PID 31024 died... 05:33:14.238886 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31024): Terminated: ok {rc=0} 05:33:14.284906 --- ParallelTerminationStrategy: PID 31027 died... 05:33:14.304388 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31027): Terminated: ok {rc=0} 05:33:14.391943 bus /sierra_3: Setting Powered False 05:33:15.491521 bus /sierra_3: Setting Powered False 05:33:16.606690 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2370 emergency:sysmo emergency_preemptive_call.py ---------------------------------------------- 05:33:17.695300 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 05:33:17.706956 tst emergency:sysmo: Using 1 x bts (candidates: 1) 05:33:17.745555 tst emergency_preemptive_call.py: using LAC 26193 05:33:17.873432 tst emergency_preemptive_call.py: using RAC 183 05:33:17.993087 tst emergency_preemptive_call.py: using CellId 26193 05:33:18.120001 tst emergency_preemptive_call.py: using BVCI 26194 05:33:18.235474 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 05:33:18.246944 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 05:33:18.258235 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 05:33:18.269415 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 05:33:18.280426 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 05:33:18.291576 tst emergency:sysmo: Using 1 x modem (candidates: 4) 05:33:18.410019 tst emergency:sysmo: Using 1 x modem (candidates: 4) 05:33:18.529767 tst emergency:sysmo: Using 1 x modem (candidates: 4) 05:33:18.647084 tst emergency:sysmo: Using 1 x modem (candidates: 4) 05:33:18.761252 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:33:19.227572 run create_hlr_db(pid=31030): Launched 05:33:19.341675 bus /sierra_2: Setting Powered False 05:33:20.401145 run create_hlr_db(pid=31030): Terminated: ok {rc=0} 05:33:20.821893 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31032): Launched 05:33:21.124831 run osmo-hlr_10.42.42.2(pid=31033): Launched 05:33:21.239649 run osmo-stp_10.42.42.5: Starting osmo-stp 05:33:21.774144 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31035): Launched 05:33:22.074803 run osmo-stp_10.42.42.5(pid=31036): Launched 05:33:22.198556 tst emergency_preemptive_call.py: using MSISDN 7573 05:33:22.351443 run osmo-msc_10.42.42.6: Starting osmo-msc 05:33:22.890924 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31038): Launched 05:33:23.191684 run osmo-msc_10.42.42.6(pid=31039): Launched 05:33:23.366032 run osmo-stp_10.42.42.5(pid=31036): ERR: Terminated: ERROR {rc=1} [trial-2370↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31036)] 05:33:23.492834 run osmo-stp_10.42.42.5(pid=31036): stdout: | (launched: 2022-12-10_05:33:22.017891) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:33:23.620119 run osmo-stp_10.42.42.5(pid=31036): stderr: | 20221210053322188 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053322188 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053322188 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053322189 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053322189 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053322189 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053322189 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:33:23.745252 run osmo-stp_10.42.42.5(pid=31036): stdout: | (launched: 2022-12-10_05:33:22.017891) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:33:23.866880 run osmo-stp_10.42.42.5(pid=31036): stderr: | 20221210053322188 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053322188 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053322188 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053322189 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053322189 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053322189 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053322189 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:33:24.018457 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=31036): Process ended prematurely: osmo-stp_10.42.42.5(pid=31036) [trial-2370↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31036)] [trial-2370↪emergency:sysmo↪emergency_preemptive_call.py:32] 05:33:24.026708 tst emergency_preemptive_call.py:32: Test FAILED (6.3 sec) 05:33:24.053265 run osmo-hlr_10.42.42.2(pid=31033): ERR: Terminated: ERROR {rc=237} [trial-2370↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31033)] 05:33:24.106140 run osmo-hlr_10.42.42.2(pid=31033): stdout: | (launched: 2022-12-10_05:33:21.067319) 05:33:24.154972 run osmo-hlr_10.42.42.2(pid=31033): stderr: | 20221210053321245 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210053321245 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210053321245 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210053321245 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210053321245 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210053321245 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210053321263 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/emergency:sysmo/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210053321272 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210053321272 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210053321273 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:33:24.223127 run osmo-msc_10.42.42.6(pid=31039): ERR: Terminated: ERROR {rc=2} [trial-2370↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31039)] 05:33:24.270371 run osmo-msc_10.42.42.6(pid=31039): stdout: | (launched: 2022-12-10_05:33:23.134493) 05:33:24.319164 run osmo-msc_10.42.42.6(pid=31039): stderr: | 20221210053323406 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210053323406 DLGLOBAL DEBUG validating counter group 0x7f6d99feec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210053323406 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210053323406 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210053323406 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210053323406 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210053323408 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210053323409 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210053323409 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210053323409 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:33:24.368271 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31032): Terminating (SIGTERM) 05:33:24.407433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31035): Terminating (SIGTERM) 05:33:24.446723 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31038): Terminating (SIGTERM) 05:33:24.486091 --- ParallelTerminationStrategy: PID 31032 died... 05:33:24.504550 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31032): Terminated: ok {rc=0} 05:33:24.548117 --- ParallelTerminationStrategy: PID 31035 died... 05:33:24.566451 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31035): Terminated: ok {rc=0} 05:33:24.610028 --- ParallelTerminationStrategy: PID 31038 died... 05:33:24.628183 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31038): Terminated: ok {rc=0} 05:33:24.712113 bus /sierra_9: Setting Powered False 05:33:25.810534 bus /sierra_9: Setting Powered False 05:33:26.924823 bus /sierra_8: Setting Powered False 05:33:28.023092 bus /sierra_8: Setting Powered False 05:33:29.137638 bus /sierra_3: Setting Powered False 05:33:30.233736 bus /sierra_3: Setting Powered False 05:33:31.344331 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 emergency:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 gprs:sysmo --------------------------------------------------------------------- 05:33:32.605304 tst gprs:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:33:32.609992 tst gprs:sysmo: Verifying 1 x bts (candidates: 11) 05:33:32.631329 tst gprs:sysmo: Verifying 9 x ip_address (candidates: 9) 05:33:32.670989 tst gprs:sysmo: Verifying 4 x modem (candidates: 12) 05:33:32.761335 tst gprs:sysmo: Reserving 1 x bts (candidates: 11) 05:33:32.783353 tst gprs:sysmo: Reserving 9 x ip_address (candidates: 9) 05:33:32.822880 tst gprs:sysmo: Reserving 4 x modem (candidates: 12) 05:33:33.411694 tst gprs:sysmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2370 gprs:sysmo cs_paging_gprs_active.py ---------------------------------------------- 05:33:33.466063 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:33:33.477040 tst gprs:sysmo: Using 1 x bts (candidates: 1) 05:33:33.513204 tst cs_paging_gprs_active.py: using LAC 26194 05:33:33.641962 tst cs_paging_gprs_active.py: using RAC 184 05:33:33.769197 tst cs_paging_gprs_active.py: using CellId 26194 05:33:33.897464 tst cs_paging_gprs_active.py: using BVCI 26195 05:33:34.016168 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:33:34.027225 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:33:34.038271 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:33:34.049245 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:33:34.060001 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:33:34.070946 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:33:34.081927 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:33:34.092827 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:33:34.103908 tst gprs:sysmo: Using 1 x modem (candidates: 4) 05:33:34.224185 tst gprs:sysmo: Using 1 x modem (candidates: 4) 05:33:34.342861 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 05:33:34.549906 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:33:34.863332 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31044): Launched 05:33:35.133121 run iperf3-srv_10.42.42.10(pid=31045): Launched 05:33:35.248884 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 05:33:35.455151 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:33:35.766369 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31046): Launched 05:33:36.035759 run iperf3-srv_10.42.42.10(pid=31047): Launched 05:33:36.150829 tst cs_paging_gprs_active.py:38: start network... 05:33:36.355456 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:33:36.831035 run create_hlr_db(pid=31048): Launched 05:33:36.948483 bus /sierra_2: Setting Powered False 05:33:38.009346 run create_hlr_db(pid=31048): Terminated: ok {rc=0} 05:33:38.459818 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31050): Launched 05:33:38.789175 run osmo-hlr_10.42.42.2(pid=31051): Launched 05:33:38.913323 run osmo-stp_10.42.42.5: Starting osmo-stp 05:33:39.477686 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31053): Launched 05:33:39.805550 run osmo-stp_10.42.42.5(pid=31054): Launched 05:33:39.930119 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:33:41.496137 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31056): Launched 05:33:41.621882 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:33:41.901634 run patchelf(pid=31057): Launched 05:33:42.084575 run osmo-stp_10.42.42.5(pid=31054): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31054)] 05:33:42.222517 run osmo-stp_10.42.42.5(pid=31054): stdout: | (launched: 2022-12-10_05:33:39.743838) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:33:42.362261 run osmo-stp_10.42.42.5(pid=31054): stderr: | 20221210053339941 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053339941 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053339942 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053339942 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053339942 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053339942 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053339943 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:33:42.502017 run osmo-stp_10.42.42.5(pid=31054): stdout: | (launched: 2022-12-10_05:33:39.743838) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:33:42.635573 run osmo-stp_10.42.42.5(pid=31054): stderr: | 20221210053339941 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053339941 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053339942 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053339942 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053339942 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053339942 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053339943 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:33:42.794588 run patchelf(pid=31057): Terminating (SIGINT) 05:33:42.976226 run patchelf(pid=31057): Terminated: ok {rc=0} 05:33:43.108141 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=31054): Process ended prematurely: osmo-stp_10.42.42.5(pid=31054) [trial-2370↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31054)] [trial-2370↪gprs:sysmo↪cs_paging_gprs_active.py:38] 05:33:43.118251 tst cs_paging_gprs_active.py:38: Test FAILED (9.7 sec) 05:33:43.146668 run osmo-hlr_10.42.42.2(pid=31051): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:sysmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31051)] 05:33:43.196813 run osmo-hlr_10.42.42.2(pid=31051): stdout: | (launched: 2022-12-10_05:33:38.727524) 05:33:43.248531 run osmo-hlr_10.42.42.2(pid=31051): stderr: | 20221210053338931 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210053338931 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210053338931 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210053338931 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210053338931 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210053338932 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210053338944 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:sysmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210053338954 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210053338954 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210053338955 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:33:43.300673 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31044): Terminating (SIGTERM) 05:33:43.342308 run iperf3-srv_10.42.42.10(pid=31045): Terminating (SIGTERM) 05:33:43.383917 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31046): Terminating (SIGTERM) 05:33:43.425625 run iperf3-srv_10.42.42.10(pid=31047): Terminating (SIGTERM) 05:33:43.467569 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31050): Terminating (SIGTERM) 05:33:43.509627 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31053): Terminating (SIGTERM) 05:33:43.551221 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31056): Terminating (SIGTERM) 05:33:43.593250 --- ParallelTerminationStrategy: PID 31044 died... 05:33:43.613198 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31044): Terminated: ok {rc=0} 05:33:43.659543 --- ParallelTerminationStrategy: PID 31045 died... 05:33:43.679073 run iperf3-srv_10.42.42.10(pid=31045): Terminated {rc=256} 05:33:43.725554 --- ParallelTerminationStrategy: PID 31046 died... 05:33:43.745304 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31046): Terminated: ok {rc=0} 05:33:43.791368 --- ParallelTerminationStrategy: PID 31047 died... 05:33:43.810940 run iperf3-srv_10.42.42.10(pid=31047): Terminated {rc=256} 05:33:43.856939 --- ParallelTerminationStrategy: PID 31050 died... 05:33:43.876920 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31050): Terminated: ok {rc=0} 05:33:43.923149 --- ParallelTerminationStrategy: PID 31053 died... 05:33:43.942678 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31053): Terminated: ok {rc=0} 05:33:43.989353 --- ParallelTerminationStrategy: PID 31056 died... 05:33:44.009007 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31056): Terminated: ok {rc=0} 05:33:44.097029 bus /gobi_0: Setting Powered False 05:33:45.196140 bus /gobi_0: Setting Powered False 05:33:46.310903 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:sysmo iperf3.py ---------------------------------------------- 05:33:47.458537 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:33:47.470077 tst gprs:sysmo: Using 1 x bts (candidates: 1) 05:33:47.506288 tst iperf3.py: using LAC 26195 05:33:47.639548 tst iperf3.py: using RAC 185 05:33:47.767592 tst iperf3.py: using CellId 26195 05:33:47.894288 tst iperf3.py: using BVCI 26196 05:33:48.012526 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:33:48.023723 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:33:48.034783 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:33:48.045829 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:33:48.056624 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:33:48.067621 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:33:48.078744 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:33:48.089791 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:33:48.100787 tst gprs:sysmo: Using 1 x modem (candidates: 4) 05:33:48.219571 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 05:33:48.440052 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:33:48.770914 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31058): Launched 05:33:49.058602 run iperf3-srv_10.42.42.10(pid=31059): Launched 05:33:49.180704 tst iperf3.py:8: start network... 05:33:49.400224 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:33:49.908719 run create_hlr_db(pid=31061): Launched 05:33:50.040485 bus /gobi_6: Setting Powered False 05:33:51.104863 run create_hlr_db(pid=31061): Terminated: ok {rc=0} 05:33:51.542141 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31063): Launched 05:33:51.850509 run osmo-hlr_10.42.42.2(pid=31064): Launched 05:33:51.966833 run osmo-stp_10.42.42.5: Starting osmo-stp 05:33:52.514582 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31066): Launched 05:33:52.820749 run osmo-stp_10.42.42.5(pid=31067): Launched 05:33:52.936199 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:33:53.462666 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31069): Launched 05:33:53.579045 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:33:53.839004 run patchelf(pid=31070): Launched 05:33:54.008186 run osmo-stp_10.42.42.5(pid=31067): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31067)] 05:33:54.137186 run osmo-stp_10.42.42.5(pid=31067): stdout: | (launched: 2022-12-10_05:33:52.762771) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:33:54.267499 run osmo-stp_10.42.42.5(pid=31067): stderr: | 20221210053352935 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053352935 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053352935 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053352936 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053352936 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053352936 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053352936 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:33:54.398088 run osmo-stp_10.42.42.5(pid=31067): stdout: | (launched: 2022-12-10_05:33:52.762771) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:33:54.522634 run osmo-stp_10.42.42.5(pid=31067): stderr: | 20221210053352935 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053352935 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053352935 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053352936 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053352936 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053352936 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053352936 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:33:54.670521 run patchelf(pid=31070): Terminating (SIGINT) 05:33:54.840678 run patchelf(pid=31070): Terminated: ok {rc=0} 05:33:54.963650 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31067): Process ended prematurely: osmo-stp_10.42.42.5(pid=31067) [trial-2370↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31067)] [trial-2370↪gprs:sysmo↪iperf3.py:8] 05:33:54.973289 tst iperf3.py:8: Test FAILED (7.6 sec) 05:33:55.000582 run osmo-hlr_10.42.42.2(pid=31064): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:sysmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31064)] 05:33:55.047604 run osmo-hlr_10.42.42.2(pid=31064): stdout: | (launched: 2022-12-10_05:33:51.792058) 05:33:55.096368 run osmo-hlr_10.42.42.2(pid=31064): stderr: | 20221210053351971 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210053351971 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210053351971 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210053351971 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210053351971 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210053351971 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210053351984 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:sysmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210053351995 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210053351995 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210053351995 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:33:55.145696 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31058): Terminating (SIGTERM) 05:33:55.185022 run iperf3-srv_10.42.42.10(pid=31059): Terminating (SIGTERM) 05:33:55.224393 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31063): Terminating (SIGTERM) 05:33:55.264096 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31066): Terminating (SIGTERM) 05:33:55.303460 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31069): Terminating (SIGTERM) 05:33:55.343276 --- ParallelTerminationStrategy: PID 31058 died... 05:33:55.362112 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31058): Terminated: ok {rc=0} 05:33:55.406131 --- ParallelTerminationStrategy: PID 31059 died... 05:33:55.424446 run iperf3-srv_10.42.42.10(pid=31059): Terminated {rc=256} 05:33:55.468842 --- ParallelTerminationStrategy: PID 31063 died... 05:33:55.487435 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31063): Terminated: ok {rc=0} 05:33:55.531981 --- ParallelTerminationStrategy: PID 31066 died... 05:33:55.550581 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31066): Terminated: ok {rc=0} 05:33:55.594886 --- ParallelTerminationStrategy: PID 31069 died... 05:33:55.613519 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31069): Terminated: ok {rc=0} 05:33:55.700180 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:sysmo iperf3m4.py ---------------------------------------------- 05:33:56.853403 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:33:56.865413 tst gprs:sysmo: Using 1 x bts (candidates: 1) 05:33:56.903332 tst iperf3m4.py: using LAC 26196 05:33:57.032453 tst iperf3m4.py: using RAC 186 05:33:57.160056 tst iperf3m4.py: using CellId 26196 05:33:57.280234 tst iperf3m4.py: using BVCI 26197 05:33:57.400506 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:33:57.411867 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:33:57.423132 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:33:57.434604 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:33:57.445852 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:33:57.457177 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:33:57.469166 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:33:57.480395 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:33:57.493739 tst gprs:sysmo: Using 1 x modem (candidates: 4) 05:33:57.614315 tst gprs:sysmo: Using 1 x modem (candidates: 4) 05:33:57.734859 tst gprs:sysmo: Using 1 x modem (candidates: 4) 05:33:57.849369 tst gprs:sysmo: Using 1 x modem (candidates: 4) 05:33:57.967125 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 05:33:58.170995 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:33:58.479423 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31071): Launched 05:33:58.748191 run iperf3-srv_10.42.42.10(pid=31072): Launched 05:33:58.862990 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 05:33:59.066878 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:33:59.376025 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31073): Launched 05:33:59.643813 run iperf3-srv_10.42.42.10(pid=31074): Launched 05:33:59.758273 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 05:33:59.962579 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:34:00.270677 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31075): Launched 05:34:00.538420 run iperf3-srv_10.42.42.10(pid=31076): Launched 05:34:00.652158 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 05:34:00.863210 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:34:01.209278 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31077): Launched 05:34:01.526606 run iperf3-srv_10.42.42.10(pid=31078): Launched 05:34:01.657784 tst iperf3m4.py:8: start network... 05:34:01.866650 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:34:02.349693 run create_hlr_db(pid=31079): Launched 05:34:02.466757 bus /gobi_6: Setting Powered False 05:34:03.527286 run create_hlr_db(pid=31079): Terminated: ok {rc=0} 05:34:03.974624 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31081): Launched 05:34:04.286797 run osmo-hlr_10.42.42.2(pid=31082): Launched 05:34:04.403037 run osmo-stp_10.42.42.5: Starting osmo-stp 05:34:04.940222 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31084): Launched 05:34:05.247224 run osmo-stp_10.42.42.5(pid=31085): Launched 05:34:05.363405 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:34:05.889664 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31087): Launched 05:34:06.007084 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:34:06.266598 run patchelf(pid=31088): Launched 05:34:06.436163 run osmo-stp_10.42.42.5(pid=31085): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31085)] 05:34:06.565624 run osmo-stp_10.42.42.5(pid=31085): stdout: | (launched: 2022-12-10_05:34:05.189200) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:34:06.696354 run osmo-stp_10.42.42.5(pid=31085): stderr: | 20221210053405362 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053405362 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053405363 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053405363 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053405363 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053405364 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053405364 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:34:06.827141 run osmo-stp_10.42.42.5(pid=31085): stdout: | (launched: 2022-12-10_05:34:05.189200) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:34:06.951896 run osmo-stp_10.42.42.5(pid=31085): stderr: | 20221210053405362 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053405362 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053405363 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053405363 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053405363 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053405364 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053405364 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:34:07.100047 run patchelf(pid=31088): Terminating (SIGINT) 05:34:07.271010 run patchelf(pid=31088): Terminated: ok {rc=0} 05:34:07.393671 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31085): Process ended prematurely: osmo-stp_10.42.42.5(pid=31085) [trial-2370↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31085)] [trial-2370↪gprs:sysmo↪iperf3m4.py:8] 05:34:07.403210 tst iperf3m4.py:8: Test FAILED (10.6 sec) 05:34:07.431269 run osmo-hlr_10.42.42.2(pid=31082): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:sysmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31082)] 05:34:07.478926 run osmo-hlr_10.42.42.2(pid=31082): stdout: | (launched: 2022-12-10_05:34:04.228312) 05:34:07.528399 run osmo-hlr_10.42.42.2(pid=31082): stderr: | 20221210053404406 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210053404406 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210053404406 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210053404406 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210053404406 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210053404406 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210053404418 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:sysmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210053404427 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210053404427 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210053404427 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:34:07.578328 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31071): Terminating (SIGTERM) 05:34:07.618000 run iperf3-srv_10.42.42.10(pid=31072): Terminating (SIGTERM) 05:34:07.657506 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31073): Terminating (SIGTERM) 05:34:07.697269 run iperf3-srv_10.42.42.10(pid=31074): Terminating (SIGTERM) 05:34:07.736693 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31075): Terminating (SIGTERM) 05:34:07.775980 run iperf3-srv_10.42.42.10(pid=31076): Terminating (SIGTERM) 05:34:07.815298 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31077): Terminating (SIGTERM) 05:34:07.854650 run iperf3-srv_10.42.42.10(pid=31078): Terminating (SIGTERM) 05:34:07.893966 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31081): Terminating (SIGTERM) 05:34:07.933510 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31084): Terminating (SIGTERM) 05:34:07.972740 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31087): Terminating (SIGTERM) 05:34:08.012825 --- ParallelTerminationStrategy: PID 31071 died... 05:34:08.031611 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31071): Terminated: ok {rc=0} 05:34:08.075777 --- ParallelTerminationStrategy: PID 31072 died... 05:34:08.094241 run iperf3-srv_10.42.42.10(pid=31072): Terminated {rc=256} 05:34:08.138547 --- ParallelTerminationStrategy: PID 31073 died... 05:34:08.156902 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31073): Terminated: ok {rc=0} 05:34:08.200838 --- ParallelTerminationStrategy: PID 31074 died... 05:34:08.219749 run iperf3-srv_10.42.42.10(pid=31074): Terminated {rc=256} 05:34:08.263955 --- ParallelTerminationStrategy: PID 31075 died... 05:34:08.282487 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31075): Terminated: ok {rc=0} 05:34:08.326689 --- ParallelTerminationStrategy: PID 31076 died... 05:34:08.345200 run iperf3-srv_10.42.42.10(pid=31076): Terminated {rc=256} 05:34:08.389235 --- ParallelTerminationStrategy: PID 31077 died... 05:34:08.407585 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31077): Terminated: ok {rc=0} 05:34:08.451739 --- ParallelTerminationStrategy: PID 31078 died... 05:34:08.470286 run iperf3-srv_10.42.42.10(pid=31078): Terminated {rc=256} 05:34:08.514861 --- ParallelTerminationStrategy: PID 31081 died... 05:34:08.533474 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31081): Terminated: ok {rc=0} 05:34:08.577601 --- ParallelTerminationStrategy: PID 31084 died... 05:34:08.596314 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31084): Terminated: ok {rc=0} 05:34:08.641172 --- ParallelTerminationStrategy: PID 31087 died... 05:34:08.659720 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31087): Terminated: ok {rc=0} 05:34:08.747013 bus /gobi_4: Setting Powered False 05:34:09.847134 bus /gobi_4: Setting Powered False 05:34:10.963362 bus /gobi_1: Setting Powered False 05:34:12.063346 bus /gobi_1: Setting Powered False 05:34:13.178987 bus /gobi_0: Setting Powered False 05:34:14.276445 bus /gobi_0: Setting Powered False 05:34:15.392712 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:sysmo ping.py ---------------------------------------------- 05:34:16.495448 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:34:16.507852 tst gprs:sysmo: Using 1 x bts (candidates: 1) 05:34:16.546185 tst ping.py: using LAC 26197 05:34:16.668430 tst ping.py: using RAC 187 05:34:16.790125 tst ping.py: using CellId 26197 05:34:16.916603 tst ping.py: using BVCI 26198 05:34:17.035992 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:34:17.047781 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:34:17.059516 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:34:17.071372 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:34:17.083119 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:34:17.094804 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:34:17.106772 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:34:17.118543 tst gprs:sysmo: Using 1 x modem (candidates: 4) 05:34:17.235299 tst ping.py:19: start network... 05:34:17.439298 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:34:17.907287 run create_hlr_db(pid=31090): Launched 05:34:18.022028 bus /gobi_6: Setting Powered False 05:34:19.082412 run create_hlr_db(pid=31090): Terminated: ok {rc=0} 05:34:19.523045 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31092): Launched 05:34:19.847143 run osmo-hlr_10.42.42.2(pid=31093): Launched 05:34:19.969192 run osmo-stp_10.42.42.5: Starting osmo-stp 05:34:20.522210 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31095): Launched 05:34:20.844026 run osmo-stp_10.42.42.5(pid=31096): Launched 05:34:20.965211 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:34:21.518793 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31098): Launched 05:34:21.641456 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:34:21.912886 run patchelf(pid=31099): Launched 05:34:22.091195 run osmo-stp_10.42.42.5(pid=31096): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31096)] 05:34:22.227083 run osmo-stp_10.42.42.5(pid=31096): stdout: | (launched: 2022-12-10_05:34:20.783655) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:34:22.364882 run osmo-stp_10.42.42.5(pid=31096): stderr: | 20221210053420977 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053420977 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053420977 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053420978 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053420978 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053420978 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053420978 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:34:22.503094 run osmo-stp_10.42.42.5(pid=31096): stdout: | (launched: 2022-12-10_05:34:20.783655) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:34:22.634196 run osmo-stp_10.42.42.5(pid=31096): stderr: | 20221210053420977 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053420977 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053420977 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053420978 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053420978 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053420978 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053420978 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:34:22.789405 run patchelf(pid=31099): Terminating (SIGINT) 05:34:22.968244 run patchelf(pid=31099): Terminated: ok {rc=0} 05:34:23.097675 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=31096): Process ended prematurely: osmo-stp_10.42.42.5(pid=31096) [trial-2370↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31096)] [trial-2370↪gprs:sysmo↪ping.py:22] 05:34:23.107290 tst ping.py:22: Test FAILED (6.6 sec) 05:34:23.135379 run osmo-hlr_10.42.42.2(pid=31093): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:sysmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31093)] 05:34:23.185451 run osmo-hlr_10.42.42.2(pid=31093): stdout: | (launched: 2022-12-10_05:34:19.786653) 05:34:23.237330 run osmo-hlr_10.42.42.2(pid=31093): stderr: | 20221210053419986 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210053419986 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210053419986 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210053419986 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210053419986 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210053419986 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210053419997 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:sysmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210053420006 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210053420006 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210053420006 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:34:23.289521 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31092): Terminating (SIGTERM) 05:34:23.331394 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31095): Terminating (SIGTERM) 05:34:23.373310 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31098): Terminating (SIGTERM) 05:34:23.415422 --- ParallelTerminationStrategy: PID 31092 died... 05:34:23.435229 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31092): Terminated: ok {rc=0} 05:34:23.482027 --- ParallelTerminationStrategy: PID 31095 died... 05:34:23.501738 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31095): Terminated: ok {rc=0} 05:34:23.547964 --- ParallelTerminationStrategy: PID 31098 died... 05:34:23.567820 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31098): Terminated: ok {rc=0} 05:34:23.656284 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:sysmo ping_idle_ping.py ---------------------------------------------- 05:34:24.743205 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:34:24.754968 tst gprs:sysmo: Using 1 x bts (candidates: 1) 05:34:24.792545 tst ping_idle_ping.py: using LAC 26198 05:34:24.920515 tst ping_idle_ping.py: using RAC 188 05:34:25.046283 tst ping_idle_ping.py: using CellId 26198 05:34:25.171592 tst ping_idle_ping.py: using BVCI 26199 05:34:25.287668 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:34:25.298771 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:34:25.309815 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:34:25.320678 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:34:25.331630 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:34:25.342473 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:34:25.353429 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:34:25.364424 tst gprs:sysmo: Using 1 x modem (candidates: 4) 05:34:25.488319 tst ping_idle_ping.py:24: start network... 05:34:25.690296 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:34:26.155271 run create_hlr_db(pid=31100): Launched 05:34:26.269582 bus /gobi_6: Setting Powered False 05:34:27.329605 run create_hlr_db(pid=31100): Terminated: ok {rc=0} 05:34:27.750204 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31102): Launched 05:34:28.051124 run osmo-hlr_10.42.42.2(pid=31103): Launched 05:34:28.164754 run osmo-stp_10.42.42.5: Starting osmo-stp 05:34:28.684820 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31105): Launched 05:34:28.985777 run osmo-stp_10.42.42.5(pid=31106): Launched 05:34:29.100211 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:34:29.621231 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31108): Launched 05:34:29.736048 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:34:29.991697 run patchelf(pid=31109): Launched 05:34:30.158955 run osmo-stp_10.42.42.5(pid=31106): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31106)] 05:34:30.286482 run osmo-stp_10.42.42.5(pid=31106): stdout: | (launched: 2022-12-10_05:34:28.928560) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:34:30.415882 run osmo-stp_10.42.42.5(pid=31106): stderr: | 20221210053429102 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053429103 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053429103 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053429103 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053429104 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053429104 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053429104 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:34:30.545201 run osmo-stp_10.42.42.5(pid=31106): stdout: | (launched: 2022-12-10_05:34:28.928560) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:34:30.667916 run osmo-stp_10.42.42.5(pid=31106): stderr: | 20221210053429102 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053429103 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053429103 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053429103 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053429104 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053429104 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053429104 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:34:30.813396 run patchelf(pid=31109): Terminating (SIGINT) 05:34:30.984710 run patchelf(pid=31109): Terminated: ok {rc=0} 05:34:31.108741 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=31106): Process ended prematurely: osmo-stp_10.42.42.5(pid=31106) [trial-2370↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31106)] [trial-2370↪gprs:sysmo↪ping_idle_ping.py:27] 05:34:31.118843 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 05:34:31.147897 run osmo-hlr_10.42.42.2(pid=31103): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:sysmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31103)] 05:34:31.196805 run osmo-hlr_10.42.42.2(pid=31103): stdout: | (launched: 2022-12-10_05:34:27.994286) 05:34:31.247465 run osmo-hlr_10.42.42.2(pid=31103): stderr: | 20221210053428174 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210053428174 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210053428174 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210053428174 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210053428174 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210053428174 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210053428187 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:sysmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210053428195 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210053428195 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210053428195 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:34:31.298861 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31102): Terminating (SIGTERM) 05:34:31.340490 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31105): Terminating (SIGTERM) 05:34:31.382051 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31108): Terminating (SIGTERM) 05:34:31.423745 --- ParallelTerminationStrategy: PID 31102 died... 05:34:31.443138 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31102): Terminated: ok {rc=0} 05:34:31.490055 --- ParallelTerminationStrategy: PID 31105 died... 05:34:31.509519 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31105): Terminated: ok {rc=0} 05:34:31.556353 --- ParallelTerminationStrategy: PID 31108 died... 05:34:31.575783 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31108): Terminated: ok {rc=0} 05:34:31.665531 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2370 gprs:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 gprs:sysmo+mod-bts0-egprs --------------------------------------------------------------------- 05:34:32.948099 tst gprs:sysmo+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:34:32.953763 tst gprs:sysmo+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 05:34:32.977780 tst gprs:sysmo+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 05:34:33.017529 tst gprs:sysmo+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 05:34:33.105560 tst gprs:sysmo+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 05:34:33.126919 tst gprs:sysmo+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 05:34:33.166389 tst gprs:sysmo+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 05:34:33.759858 tst gprs:sysmo+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2370 gprs:sysmo+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 05:34:33.810331 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:34:33.821105 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 05:34:33.857894 tst cs_paging_gprs_active.py: using LAC 26199 05:34:33.978462 tst cs_paging_gprs_active.py: using RAC 189 05:34:34.100403 tst cs_paging_gprs_active.py: using CellId 26199 05:34:34.222403 tst cs_paging_gprs_active.py: using BVCI 26200 05:34:34.335842 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:34:34.346699 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:34:34.357273 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:34:34.368140 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:34:34.379405 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:34:34.390175 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:34:34.401147 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:34:34.411771 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:34:34.422834 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 05:34:34.544268 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 05:34:34.664539 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 05:34:34.886226 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:34:35.217338 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31114): Launched 05:34:35.505610 run iperf3-srv_10.42.42.10(pid=31115): Launched 05:34:35.628524 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 05:34:35.849547 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:34:36.181690 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31116): Launched 05:34:36.468341 run iperf3-srv_10.42.42.10(pid=31117): Launched 05:34:36.591574 tst cs_paging_gprs_active.py:38: start network... 05:34:36.812787 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:34:37.323326 run create_hlr_db(pid=31118): Launched 05:34:37.457482 bus /gobi_6: Setting Powered False 05:34:38.520475 run create_hlr_db(pid=31118): Terminated: ok {rc=0} 05:34:38.976852 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31120): Launched 05:34:39.306314 run osmo-hlr_10.42.42.2(pid=31121): Launched 05:34:39.430833 run osmo-stp_10.42.42.5: Starting osmo-stp 05:34:39.994200 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31123): Launched 05:34:40.324090 run osmo-stp_10.42.42.5(pid=31124): Launched 05:34:40.447912 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:34:41.016529 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31126): Launched 05:34:41.143248 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:34:41.421579 run patchelf(pid=31127): Launched 05:34:41.603568 run osmo-stp_10.42.42.5(pid=31124): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31124)] 05:34:41.741886 run osmo-stp_10.42.42.5(pid=31124): stdout: | (launched: 2022-12-10_05:34:40.262274) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:34:41.881290 run osmo-stp_10.42.42.5(pid=31124): stderr: | 20221210053440459 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053440459 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053440459 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053440460 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053440460 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053440460 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053440460 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:34:42.021189 run osmo-stp_10.42.42.5(pid=31124): stdout: | (launched: 2022-12-10_05:34:40.262274) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:34:42.155530 run osmo-stp_10.42.42.5(pid=31124): stderr: | 20221210053440459 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053440459 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053440459 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053440460 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053440460 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053440460 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053440460 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:34:42.314510 run patchelf(pid=31127): Terminating (SIGINT) 05:34:42.496739 run patchelf(pid=31127): Terminated: ok {rc=0} 05:34:42.628644 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=31124): Process ended prematurely: osmo-stp_10.42.42.5(pid=31124) [trial-2370↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31124)] [trial-2370↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 05:34:42.638914 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 05:34:42.667349 run osmo-hlr_10.42.42.2(pid=31121): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31121)] 05:34:42.717440 run osmo-hlr_10.42.42.2(pid=31121): stdout: | (launched: 2022-12-10_05:34:39.244329) 05:34:42.769465 run osmo-hlr_10.42.42.2(pid=31121): stderr: | 20221210053439446 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210053439446 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210053439446 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210053439446 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210053439446 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210053439446 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210053439459 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:sysmo+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210053439468 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210053439468 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210053439468 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:34:42.821884 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31114): Terminating (SIGTERM) 05:34:42.863874 run iperf3-srv_10.42.42.10(pid=31115): Terminating (SIGTERM) 05:34:42.905507 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31116): Terminating (SIGTERM) 05:34:42.947316 run iperf3-srv_10.42.42.10(pid=31117): Terminating (SIGTERM) 05:34:42.988862 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31120): Terminating (SIGTERM) 05:34:43.030693 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31123): Terminating (SIGTERM) 05:34:43.072440 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31126): Terminating (SIGTERM) 05:34:43.114779 --- ParallelTerminationStrategy: PID 31114 died... 05:34:43.134769 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31114): Terminated: ok {rc=0} 05:34:43.181208 --- ParallelTerminationStrategy: PID 31115 died... 05:34:43.200626 run iperf3-srv_10.42.42.10(pid=31115): Terminated {rc=256} 05:34:43.246807 --- ParallelTerminationStrategy: PID 31116 died... 05:34:43.266522 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31116): Terminated: ok {rc=0} 05:34:43.312559 --- ParallelTerminationStrategy: PID 31117 died... 05:34:43.332038 run iperf3-srv_10.42.42.10(pid=31117): Terminated {rc=256} 05:34:43.377785 --- ParallelTerminationStrategy: PID 31120 died... 05:34:43.397161 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31120): Terminated: ok {rc=0} 05:34:43.442591 --- ParallelTerminationStrategy: PID 31123 died... 05:34:43.461899 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31123): Terminated: ok {rc=0} 05:34:43.507878 --- ParallelTerminationStrategy: PID 31126 died... 05:34:43.527097 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31126): Terminated: ok {rc=0} 05:34:43.614270 bus /gobi_0: Setting Powered False 05:34:44.711026 bus /gobi_0: Setting Powered False 05:34:45.825726 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:sysmo+mod-bts0-egprs iperf3.py ---------------------------------------------- 05:34:47.001903 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:34:47.018036 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 05:34:47.062256 tst iperf3.py: using LAC 26200 05:34:47.225549 tst iperf3.py: using RAC 190 05:34:47.358154 tst iperf3.py: using CellId 26200 05:34:47.478012 tst iperf3.py: using BVCI 26201 05:34:47.589270 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:34:47.600007 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:34:47.610748 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:34:47.621627 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:34:47.632399 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:34:47.643174 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:34:47.654199 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:34:47.665070 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:34:47.676071 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 05:34:47.793844 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 05:34:47.998392 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:34:48.306883 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31128): Launched 05:34:48.574724 run iperf3-srv_10.42.42.10(pid=31129): Launched 05:34:48.688508 tst iperf3.py:8: start network... 05:34:48.891911 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:34:49.365191 run create_hlr_db(pid=31130): Launched 05:34:49.481145 bus /gobi_6: Setting Powered False 05:34:50.541857 run create_hlr_db(pid=31130): Terminated: ok {rc=0} 05:34:50.968302 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31132): Launched 05:34:51.274844 run osmo-hlr_10.42.42.2(pid=31133): Launched 05:34:51.390602 run osmo-stp_10.42.42.5: Starting osmo-stp 05:34:51.914910 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31135): Launched 05:34:52.221419 run osmo-stp_10.42.42.5(pid=31136): Launched 05:34:52.337297 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:34:52.866553 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31138): Launched 05:34:52.983146 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:34:53.243069 run patchelf(pid=31139): Launched 05:34:53.412195 run osmo-stp_10.42.42.5(pid=31136): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31136)] 05:34:53.541286 run osmo-stp_10.42.42.5(pid=31136): stdout: | (launched: 2022-12-10_05:34:52.163179) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:34:53.671480 run osmo-stp_10.42.42.5(pid=31136): stderr: | 20221210053452337 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053452338 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053452338 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053452338 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053452340 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053452341 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053452341 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:34:53.802089 run osmo-stp_10.42.42.5(pid=31136): stdout: | (launched: 2022-12-10_05:34:52.163179) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:34:53.926986 run osmo-stp_10.42.42.5(pid=31136): stderr: | 20221210053452337 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053452338 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053452338 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053452338 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053452340 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053452341 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053452341 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:34:54.074726 run patchelf(pid=31139): Terminating (SIGINT) 05:34:54.244916 run patchelf(pid=31139): Terminated: ok {rc=0} 05:34:54.369637 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31136): Process ended prematurely: osmo-stp_10.42.42.5(pid=31136) [trial-2370↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31136)] [trial-2370↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8] 05:34:54.379112 tst iperf3.py:8: Test FAILED (7.4 sec) 05:34:54.406486 run osmo-hlr_10.42.42.2(pid=31133): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:sysmo+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31133)] 05:34:54.453986 run osmo-hlr_10.42.42.2(pid=31133): stdout: | (launched: 2022-12-10_05:34:51.216705) 05:34:54.502996 run osmo-hlr_10.42.42.2(pid=31133): stderr: | 20221210053451392 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210053451392 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210053451392 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210053451392 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210053451393 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210053451393 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210053451433 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:sysmo+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210053451444 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210053451444 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210053451444 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:34:54.552500 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31128): Terminating (SIGTERM) 05:34:54.592033 run iperf3-srv_10.42.42.10(pid=31129): Terminating (SIGTERM) 05:34:54.631315 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31132): Terminating (SIGTERM) 05:34:54.670672 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31135): Terminating (SIGTERM) 05:34:54.709929 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31138): Terminating (SIGTERM) 05:34:54.749476 --- ParallelTerminationStrategy: PID 31128 died... 05:34:54.768219 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31128): Terminated: ok {rc=0} 05:34:54.812178 --- ParallelTerminationStrategy: PID 31129 died... 05:34:54.830614 run iperf3-srv_10.42.42.10(pid=31129): Terminated {rc=256} 05:34:54.874609 --- ParallelTerminationStrategy: PID 31132 died... 05:34:54.892879 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31132): Terminated: ok {rc=0} 05:34:54.937028 --- ParallelTerminationStrategy: PID 31135 died... 05:34:54.955451 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31135): Terminated: ok {rc=0} 05:34:54.999409 --- ParallelTerminationStrategy: PID 31138 died... 05:34:55.017944 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31138): Terminated: ok {rc=0} 05:34:55.104462 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:sysmo+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 05:34:56.253296 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:34:56.264682 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 05:34:56.302828 tst iperf3m4.py: using LAC 26201 05:34:56.425096 tst iperf3m4.py: using RAC 191 05:34:56.546248 tst iperf3m4.py: using CellId 26201 05:34:56.668151 tst iperf3m4.py: using BVCI 26202 05:34:56.780706 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:34:56.791520 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:34:56.802434 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:34:56.813479 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:34:56.824139 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:34:56.834914 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:34:56.845960 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:34:56.856559 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:34:56.867467 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 05:34:56.983058 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 05:34:57.102561 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 05:34:57.224519 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 05:34:57.340523 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 05:34:57.546550 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:34:57.858046 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31140): Launched 05:34:58.127153 run iperf3-srv_10.42.42.10(pid=31141): Launched 05:34:58.242261 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 05:34:58.448588 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:34:58.758755 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31142): Launched 05:34:59.046846 run iperf3-srv_10.42.42.10(pid=31143): Launched 05:34:59.169275 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 05:34:59.389038 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:34:59.720449 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31144): Launched 05:35:00.006649 run iperf3-srv_10.42.42.10(pid=31145): Launched 05:35:00.128806 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 05:35:00.349160 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:35:00.679670 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31146): Launched 05:35:00.973690 run iperf3-srv_10.42.42.10(pid=31147): Launched 05:35:01.118397 tst iperf3m4.py:8: start network... 05:35:01.342170 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:35:01.870667 run create_hlr_db(pid=31151): Launched 05:35:02.026709 bus /gobi_6: Setting Powered False 05:35:03.087030 run create_hlr_db(pid=31151): Terminated: ok {rc=0} 05:35:03.537177 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31153): Launched 05:35:03.865423 run osmo-hlr_10.42.42.2(pid=31154): Launched 05:35:03.988735 run osmo-stp_10.42.42.5: Starting osmo-stp 05:35:04.559636 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31156): Launched 05:35:04.888422 run osmo-stp_10.42.42.5(pid=31157): Launched 05:35:05.011932 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:35:05.576206 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31159): Launched 05:35:05.700506 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:35:05.977799 run patchelf(pid=31160): Launched 05:35:06.159539 run osmo-stp_10.42.42.5(pid=31157): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31157)] 05:35:06.297962 run osmo-stp_10.42.42.5(pid=31157): stdout: | (launched: 2022-12-10_05:35:04.826815) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:35:06.437871 run osmo-stp_10.42.42.5(pid=31157): stderr: | 20221210053505023 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053505023 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053505023 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053505024 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053505024 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053505024 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053505024 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:35:06.577922 run osmo-stp_10.42.42.5(pid=31157): stdout: | (launched: 2022-12-10_05:35:04.826815) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:35:06.711535 run osmo-stp_10.42.42.5(pid=31157): stderr: | 20221210053505023 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053505023 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053505023 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053505024 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053505024 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053505024 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053505024 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:35:06.869975 run patchelf(pid=31160): Terminating (SIGINT) 05:35:07.052234 run patchelf(pid=31160): Terminated: ok {rc=0} 05:35:07.183428 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31157): Process ended prematurely: osmo-stp_10.42.42.5(pid=31157) [trial-2370↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31157)] [trial-2370↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8] 05:35:07.193729 tst iperf3m4.py:8: Test FAILED (11.0 sec) 05:35:07.222461 run osmo-hlr_10.42.42.2(pid=31154): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31154)] 05:35:07.272198 run osmo-hlr_10.42.42.2(pid=31154): stdout: | (launched: 2022-12-10_05:35:03.803807) 05:35:07.323765 run osmo-hlr_10.42.42.2(pid=31154): stderr: | 20221210053504007 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210053504007 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210053504007 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210053504007 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210053504007 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210053504007 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210053504020 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:sysmo+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210053504029 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210053504029 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210053504029 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:35:07.375643 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31140): Terminating (SIGTERM) 05:35:07.416914 run iperf3-srv_10.42.42.10(pid=31141): Terminating (SIGTERM) 05:35:07.458245 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31142): Terminating (SIGTERM) 05:35:07.499461 run iperf3-srv_10.42.42.10(pid=31143): Terminating (SIGTERM) 05:35:07.540706 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31144): Terminating (SIGTERM) 05:35:07.584086 run iperf3-srv_10.42.42.10(pid=31145): Terminating (SIGTERM) 05:35:07.625301 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31146): Terminating (SIGTERM) 05:35:07.666550 run iperf3-srv_10.42.42.10(pid=31147): Terminating (SIGTERM) 05:35:07.707709 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31153): Terminating (SIGTERM) 05:35:07.749239 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31156): Terminating (SIGTERM) 05:35:07.790557 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31159): Terminating (SIGTERM) 05:35:07.831931 --- ParallelTerminationStrategy: PID 31140 died... 05:35:07.851675 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31140): Terminated: ok {rc=0} 05:35:07.897786 --- ParallelTerminationStrategy: PID 31141 died... 05:35:07.917186 run iperf3-srv_10.42.42.10(pid=31141): Terminated {rc=256} 05:35:07.962805 --- ParallelTerminationStrategy: PID 31142 died... 05:35:07.982283 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31142): Terminated: ok {rc=0} 05:35:08.027910 --- ParallelTerminationStrategy: PID 31143 died... 05:35:08.047350 run iperf3-srv_10.42.42.10(pid=31143): Terminated {rc=256} 05:35:08.092931 --- ParallelTerminationStrategy: PID 31144 died... 05:35:08.112697 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31144): Terminated: ok {rc=0} 05:35:08.158730 --- ParallelTerminationStrategy: PID 31145 died... 05:35:08.178156 run iperf3-srv_10.42.42.10(pid=31145): Terminated {rc=256} 05:35:08.223813 --- ParallelTerminationStrategy: PID 31146 died... 05:35:08.243356 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31146): Terminated: ok {rc=0} 05:35:08.289317 --- ParallelTerminationStrategy: PID 31147 died... 05:35:08.308824 run iperf3-srv_10.42.42.10(pid=31147): Terminated {rc=256} 05:35:08.354830 --- ParallelTerminationStrategy: PID 31153 died... 05:35:08.374552 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31153): Terminated: ok {rc=0} 05:35:08.420600 --- ParallelTerminationStrategy: PID 31156 died... 05:35:08.440230 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31156): Terminated: ok {rc=0} 05:35:08.486218 --- ParallelTerminationStrategy: PID 31159 died... 05:35:08.506122 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31159): Terminated: ok {rc=0} 05:35:08.593759 bus /gobi_4: Setting Powered False 05:35:09.694019 bus /gobi_4: Setting Powered False 05:35:10.810902 bus /gobi_1: Setting Powered False 05:35:11.910522 bus /gobi_1: Setting Powered False 05:35:13.028936 bus /gobi_0: Setting Powered False 05:35:14.126900 bus /gobi_0: Setting Powered False 05:35:15.243720 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:sysmo+mod-bts0-egprs ping.py ---------------------------------------------- 05:35:16.355995 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:35:16.372246 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 05:35:16.418802 tst ping.py: using LAC 26202 05:35:16.544038 tst ping.py: using RAC 192 05:35:16.666437 tst ping.py: using CellId 26202 05:35:16.822005 tst ping.py: using BVCI 26203 05:35:16.954421 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:35:16.966454 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:35:16.979415 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:35:16.991074 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:35:17.003619 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:35:17.017631 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:35:17.030712 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:35:17.043495 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 05:35:17.163981 tst ping.py:19: start network... 05:35:17.368232 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:35:17.834158 run create_hlr_db(pid=31161): Launched 05:35:17.948898 bus /gobi_6: Setting Powered False 05:35:19.009521 run create_hlr_db(pid=31161): Terminated: ok {rc=0} 05:35:19.430581 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31163): Launched 05:35:19.731791 run osmo-hlr_10.42.42.2(pid=31164): Launched 05:35:19.845751 run osmo-stp_10.42.42.5: Starting osmo-stp 05:35:20.361296 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31166): Launched 05:35:20.661579 run osmo-stp_10.42.42.5(pid=31167): Launched 05:35:20.775669 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:35:21.294582 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31169): Launched 05:35:21.411799 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:35:21.666886 run patchelf(pid=31170): Launched 05:35:21.833718 run osmo-stp_10.42.42.5(pid=31167): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31167)] 05:35:21.960856 run osmo-stp_10.42.42.5(pid=31167): stdout: | (launched: 2022-12-10_05:35:20.604464) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:35:22.089708 run osmo-stp_10.42.42.5(pid=31167): stderr: | 20221210053520777 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053520777 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053520777 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053520777 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053520778 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053520778 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053520778 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:35:22.218670 run osmo-stp_10.42.42.5(pid=31167): stdout: | (launched: 2022-12-10_05:35:20.604464) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:35:22.341094 run osmo-stp_10.42.42.5(pid=31167): stderr: | 20221210053520777 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053520777 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053520777 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053520777 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053520778 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053520778 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053520778 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:35:22.486447 run patchelf(pid=31170): Terminating (SIGINT) 05:35:22.654479 run patchelf(pid=31170): Terminated: ok {rc=0} 05:35:22.775207 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=31167): Process ended prematurely: osmo-stp_10.42.42.5(pid=31167) [trial-2370↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31167)] [trial-2370↪gprs:sysmo+mod-bts0-egprs↪ping.py:22] 05:35:22.784084 tst ping.py:22: Test FAILED (6.4 sec) 05:35:22.811366 run osmo-hlr_10.42.42.2(pid=31164): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:sysmo+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31164)] 05:35:22.859438 run osmo-hlr_10.42.42.2(pid=31164): stdout: | (launched: 2022-12-10_05:35:19.674866) 05:35:22.909264 run osmo-hlr_10.42.42.2(pid=31164): stderr: | 20221210053519854 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210053519854 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210053519854 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210053519854 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210053519855 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210053519855 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210053519867 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:sysmo+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210053519876 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210053519876 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210053519876 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:35:22.959562 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31163): Terminating (SIGTERM) 05:35:22.999816 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31166): Terminating (SIGTERM) 05:35:23.039960 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31169): Terminating (SIGTERM) 05:35:23.080255 --- ParallelTerminationStrategy: PID 31163 died... 05:35:23.099576 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31163): Terminated: ok {rc=0} 05:35:23.144671 --- ParallelTerminationStrategy: PID 31166 died... 05:35:23.163581 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31166): Terminated: ok {rc=0} 05:35:23.208205 --- ParallelTerminationStrategy: PID 31169 died... 05:35:23.227136 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31169): Terminated: ok {rc=0} 05:35:23.313456 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:sysmo+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 05:35:24.401906 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:35:24.414089 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 05:35:24.454348 tst ping_idle_ping.py: using LAC 26203 05:35:24.581684 tst ping_idle_ping.py: using RAC 193 05:35:24.702222 tst ping_idle_ping.py: using CellId 26203 05:35:24.823511 tst ping_idle_ping.py: using BVCI 26204 05:35:24.934803 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:35:24.945844 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:35:24.956668 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:35:24.967777 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:35:24.978660 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:35:24.989473 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:35:25.000371 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:35:25.011326 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 05:35:25.135430 tst ping_idle_ping.py:24: start network... 05:35:25.337401 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:35:25.806014 run create_hlr_db(pid=31171): Launched 05:35:25.919765 bus /gobi_6: Setting Powered False 05:35:26.980563 run create_hlr_db(pid=31171): Terminated: ok {rc=0} 05:35:27.425203 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31173): Launched 05:35:27.751443 run osmo-hlr_10.42.42.2(pid=31174): Launched 05:35:27.874537 run osmo-stp_10.42.42.5: Starting osmo-stp 05:35:28.433325 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31176): Launched 05:35:28.756604 run osmo-stp_10.42.42.5(pid=31177): Launched 05:35:28.879099 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:35:29.438907 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31179): Launched 05:35:29.562150 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:35:29.836462 run patchelf(pid=31180): Launched 05:35:30.015475 run osmo-stp_10.42.42.5(pid=31177): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31177)] 05:35:30.152138 run osmo-stp_10.42.42.5(pid=31177): stdout: | (launched: 2022-12-10_05:35:28.695959) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:35:30.290305 run osmo-stp_10.42.42.5(pid=31177): stderr: | 20221210053528892 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053528892 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053528892 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053528892 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053528893 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053528893 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053528893 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:35:30.428549 run osmo-stp_10.42.42.5(pid=31177): stdout: | (launched: 2022-12-10_05:35:28.695959) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:35:30.561262 run osmo-stp_10.42.42.5(pid=31177): stderr: | 20221210053528892 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053528892 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053528892 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053528892 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053528893 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053528893 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053528893 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:35:30.717740 run patchelf(pid=31180): Terminating (SIGINT) 05:35:30.928739 run patchelf(pid=31180): Terminated: ok {rc=0} 05:35:31.073272 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=31177): Process ended prematurely: osmo-stp_10.42.42.5(pid=31177) [trial-2370↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31177)] [trial-2370↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27] 05:35:31.083623 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 05:35:31.113396 run osmo-hlr_10.42.42.2(pid=31174): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31174)] 05:35:31.165820 run osmo-hlr_10.42.42.2(pid=31174): stdout: | (launched: 2022-12-10_05:35:27.690470) 05:35:31.218936 run osmo-hlr_10.42.42.2(pid=31174): stderr: | 20221210053527893 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210053527893 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210053527893 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210053527893 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210053527893 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210053527893 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210053527905 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:sysmo+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210053527915 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210053527916 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210053527916 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:35:31.273560 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31173): Terminating (SIGTERM) 05:35:31.317251 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31176): Terminating (SIGTERM) 05:35:31.362759 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31179): Terminating (SIGTERM) 05:35:31.408345 --- ParallelTerminationStrategy: PID 31173 died... 05:35:31.428794 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31173): Terminated: ok {rc=0} 05:35:31.479756 --- ParallelTerminationStrategy: PID 31176 died... 05:35:31.499863 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31176): Terminated: ok {rc=0} 05:35:31.548915 --- ParallelTerminationStrategy: PID 31179 died... 05:35:31.569329 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31179): Terminated: ok {rc=0} 05:35:31.659808 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2370 gprs:sysmo+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 gprs:sysmo+mod-bts0-dynts-ipa --------------------------------------------------------------------- 05:35:32.943628 tst gprs:sysmo+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:35:32.950052 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 05:35:32.972022 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 05:35:33.010528 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 05:35:33.104434 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 05:35:33.126082 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 05:35:33.165675 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 05:35:33.760875 tst gprs:sysmo+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2370 gprs:sysmo+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 05:35:33.813470 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:35:33.824892 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 05:35:33.882613 tst cs_paging_gprs_active.py: using LAC 26204 05:35:34.010635 tst cs_paging_gprs_active.py: using RAC 194 05:35:34.141008 tst cs_paging_gprs_active.py: using CellId 26204 05:35:34.268911 tst cs_paging_gprs_active.py: using BVCI 26205 05:35:34.388017 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:35:34.399402 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:35:34.410591 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:35:34.421738 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:35:34.432753 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:35:34.443857 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:35:34.455108 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:35:34.466141 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:35:34.477400 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 05:35:34.593512 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 05:35:34.710837 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 05:35:34.916237 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:35:35.226384 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31186): Launched 05:35:35.495070 run iperf3-srv_10.42.42.10(pid=31187): Launched 05:35:35.609639 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 05:35:35.813925 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:35:36.122895 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31188): Launched 05:35:36.390893 run iperf3-srv_10.42.42.10(pid=31189): Launched 05:35:36.505512 tst cs_paging_gprs_active.py:38: start network... 05:35:36.710028 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:35:37.186335 run create_hlr_db(pid=31190): Launched 05:35:37.303883 bus /gobi_6: Setting Powered False 05:35:38.364052 run create_hlr_db(pid=31190): Terminated: ok {rc=0} 05:35:38.814337 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31192): Launched 05:35:39.146046 run osmo-hlr_10.42.42.2(pid=31193): Launched 05:35:39.271438 run osmo-stp_10.42.42.5: Starting osmo-stp 05:35:39.836139 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31195): Launched 05:35:40.166549 run osmo-stp_10.42.42.5(pid=31196): Launched 05:35:40.290948 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:35:40.857846 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31198): Launched 05:35:40.975814 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:35:41.236008 run patchelf(pid=31199): Launched 05:35:41.406256 run osmo-stp_10.42.42.5(pid=31196): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31196)] 05:35:41.536196 run osmo-stp_10.42.42.5(pid=31196): stdout: | (launched: 2022-12-10_05:35:40.104886) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:35:41.668079 run osmo-stp_10.42.42.5(pid=31196): stderr: | 20221210053540302 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053540302 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053540302 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053540302 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053540303 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053540303 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053540303 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:35:41.799763 run osmo-stp_10.42.42.5(pid=31196): stdout: | (launched: 2022-12-10_05:35:40.104886) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:35:41.925515 run osmo-stp_10.42.42.5(pid=31196): stderr: | 20221210053540302 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053540302 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053540302 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053540302 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053540303 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053540303 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053540303 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:35:42.074416 run patchelf(pid=31199): Terminating (SIGINT) 05:35:42.246093 run patchelf(pid=31199): Terminated: ok {rc=0} 05:35:42.370072 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=31196): Process ended prematurely: osmo-stp_10.42.42.5(pid=31196) [trial-2370↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31196)] [trial-2370↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 05:35:42.379672 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 05:35:42.407082 run osmo-hlr_10.42.42.2(pid=31193): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31193)] 05:35:42.454278 run osmo-hlr_10.42.42.2(pid=31193): stdout: | (launched: 2022-12-10_05:35:39.083943) 05:35:42.503227 run osmo-hlr_10.42.42.2(pid=31193): stderr: | 20221210053539284 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210053539284 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210053539284 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210053539284 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210053539284 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210053539285 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210053539298 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:sysmo+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210053539306 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210053539307 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210053539307 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:35:42.552785 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31186): Terminating (SIGTERM) 05:35:42.592254 run iperf3-srv_10.42.42.10(pid=31187): Terminating (SIGTERM) 05:35:42.631583 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31188): Terminating (SIGTERM) 05:35:42.671269 run iperf3-srv_10.42.42.10(pid=31189): Terminating (SIGTERM) 05:35:42.710767 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31192): Terminating (SIGTERM) 05:35:42.750302 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31195): Terminating (SIGTERM) 05:35:42.789777 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31198): Terminating (SIGTERM) 05:35:42.829509 --- ParallelTerminationStrategy: PID 31186 died... 05:35:42.848270 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31186): Terminated: ok {rc=0} 05:35:42.892272 --- ParallelTerminationStrategy: PID 31187 died... 05:35:42.910610 run iperf3-srv_10.42.42.10(pid=31187): Terminated {rc=256} 05:35:42.955031 --- ParallelTerminationStrategy: PID 31188 died... 05:35:42.973411 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31188): Terminated: ok {rc=0} 05:35:43.017049 --- ParallelTerminationStrategy: PID 31189 died... 05:35:43.035333 run iperf3-srv_10.42.42.10(pid=31189): Terminated {rc=256} 05:35:43.079043 --- ParallelTerminationStrategy: PID 31192 died... 05:35:43.097357 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31192): Terminated: ok {rc=0} 05:35:43.141166 --- ParallelTerminationStrategy: PID 31195 died... 05:35:43.159498 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31195): Terminated: ok {rc=0} 05:35:43.203292 --- ParallelTerminationStrategy: PID 31198 died... 05:35:43.221676 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31198): Terminated: ok {rc=0} 05:35:43.307112 bus /gobi_0: Setting Powered False 05:35:44.406755 bus /gobi_0: Setting Powered False 05:35:45.519118 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:sysmo+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 05:35:46.673232 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:35:46.687260 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 05:35:46.747811 tst iperf3.py: using LAC 26205 05:35:46.877180 tst iperf3.py: using RAC 195 05:35:47.034864 tst iperf3.py: using CellId 26205 05:35:47.164218 tst iperf3.py: using BVCI 26206 05:35:47.278672 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:35:47.291188 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:35:47.302673 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:35:47.314934 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:35:47.326477 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:35:47.337997 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:35:47.349730 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:35:47.361310 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:35:47.372856 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 05:35:47.492922 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 05:35:47.715494 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:35:48.045714 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31200): Launched 05:35:48.332314 run iperf3-srv_10.42.42.10(pid=31201): Launched 05:35:48.457127 tst iperf3.py:8: start network... 05:35:48.678472 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:35:49.187393 run create_hlr_db(pid=31202): Launched 05:35:49.320053 bus /gobi_6: Setting Powered False 05:35:50.384852 run create_hlr_db(pid=31202): Terminated: ok {rc=0} 05:35:50.841846 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31204): Launched 05:35:51.171041 run osmo-hlr_10.42.42.2(pid=31205): Launched 05:35:51.294441 run osmo-stp_10.42.42.5: Starting osmo-stp 05:35:51.863671 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31207): Launched 05:35:52.191998 run osmo-stp_10.42.42.5(pid=31208): Launched 05:35:52.315419 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:35:52.882176 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31210): Launched 05:35:53.007197 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:35:53.284664 run patchelf(pid=31211): Launched 05:35:53.466558 run osmo-stp_10.42.42.5(pid=31208): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31208)] 05:35:53.605491 run osmo-stp_10.42.42.5(pid=31208): stdout: | (launched: 2022-12-10_05:35:52.130342) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:35:53.745365 run osmo-stp_10.42.42.5(pid=31208): stderr: | 20221210053552325 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053552325 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053552325 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053552326 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053552326 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053552326 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053552326 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:35:53.885196 run osmo-stp_10.42.42.5(pid=31208): stdout: | (launched: 2022-12-10_05:35:52.130342) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:35:54.019143 run osmo-stp_10.42.42.5(pid=31208): stderr: | 20221210053552325 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053552325 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053552325 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053552326 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053552326 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053552326 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053552326 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:35:54.178251 run patchelf(pid=31211): Terminating (SIGINT) 05:35:54.360848 run patchelf(pid=31211): Terminated: ok {rc=0} 05:35:54.492127 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31208): Process ended prematurely: osmo-stp_10.42.42.5(pid=31208) [trial-2370↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31208)] [trial-2370↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8] 05:35:54.502397 tst iperf3.py:8: Test FAILED (7.9 sec) 05:35:54.531248 run osmo-hlr_10.42.42.2(pid=31205): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31205)] 05:35:54.581095 run osmo-hlr_10.42.42.2(pid=31205): stdout: | (launched: 2022-12-10_05:35:51.109250) 05:35:54.632604 run osmo-hlr_10.42.42.2(pid=31205): stderr: | 20221210053551310 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210053551310 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210053551310 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210053551310 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210053551310 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210053551310 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210053551323 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:sysmo+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210053551331 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210053551331 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210053551331 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:35:54.684594 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31200): Terminating (SIGTERM) 05:35:54.726379 run iperf3-srv_10.42.42.10(pid=31201): Terminating (SIGTERM) 05:35:54.768492 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31204): Terminating (SIGTERM) 05:35:54.810328 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31207): Terminating (SIGTERM) 05:35:54.851912 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31210): Terminating (SIGTERM) 05:35:54.893783 --- ParallelTerminationStrategy: PID 31200 died... 05:35:54.913772 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31200): Terminated: ok {rc=0} 05:35:54.959937 --- ParallelTerminationStrategy: PID 31201 died... 05:35:54.979450 run iperf3-srv_10.42.42.10(pid=31201): Terminated {rc=256} 05:35:55.025312 --- ParallelTerminationStrategy: PID 31204 died... 05:35:55.044831 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31204): Terminated: ok {rc=0} 05:35:55.090783 --- ParallelTerminationStrategy: PID 31207 died... 05:35:55.110367 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31207): Terminated: ok {rc=0} 05:35:55.156296 --- ParallelTerminationStrategy: PID 31210 died... 05:35:55.175904 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31210): Terminated: ok {rc=0} 05:35:55.262762 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:sysmo+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 05:35:56.413309 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:35:56.425404 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 05:35:56.483103 tst iperf3m4.py: using LAC 26206 05:35:56.609362 tst iperf3m4.py: using RAC 196 05:35:56.735756 tst iperf3m4.py: using CellId 26206 05:35:56.862128 tst iperf3m4.py: using BVCI 26207 05:35:56.980647 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:35:56.992092 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:35:57.003228 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:35:57.014353 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:35:57.025438 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:35:57.036558 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:35:57.047907 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:35:57.059014 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:35:57.070389 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 05:35:57.188177 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 05:35:57.305851 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 05:35:57.425272 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 05:35:57.540711 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 05:35:57.746676 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:35:58.055588 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31212): Launched 05:35:58.324240 run iperf3-srv_10.42.42.10(pid=31213): Launched 05:35:58.439250 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 05:35:58.644259 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:35:58.954286 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31214): Launched 05:35:59.222143 run iperf3-srv_10.42.42.10(pid=31215): Launched 05:35:59.336655 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 05:35:59.541389 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:35:59.850795 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31216): Launched 05:36:00.118765 run iperf3-srv_10.42.42.10(pid=31217): Launched 05:36:00.233450 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 05:36:00.438279 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:36:00.747182 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31218): Launched 05:36:01.036587 run iperf3-srv_10.42.42.10(pid=31219): Launched 05:36:01.175992 tst iperf3m4.py:8: start network... 05:36:01.402278 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:36:01.927368 run create_hlr_db(pid=31220): Launched 05:36:02.091534 bus /gobi_6: Setting Powered False 05:36:03.155678 run create_hlr_db(pid=31220): Terminated: ok {rc=0} 05:36:03.592356 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31222): Launched 05:36:03.899560 run osmo-hlr_10.42.42.2(pid=31223): Launched 05:36:04.015223 run osmo-stp_10.42.42.5: Starting osmo-stp 05:36:04.558654 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31225): Launched 05:36:04.864623 run osmo-stp_10.42.42.5(pid=31226): Launched 05:36:04.980512 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:36:05.510180 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31228): Launched 05:36:05.627526 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:36:05.887854 run patchelf(pid=31229): Launched 05:36:06.058077 run osmo-stp_10.42.42.5(pid=31226): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31226)] 05:36:06.187782 run osmo-stp_10.42.42.5(pid=31226): stdout: | (launched: 2022-12-10_05:36:04.806333) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:36:06.318246 run osmo-stp_10.42.42.5(pid=31226): stderr: | 20221210053604978 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053604978 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053604978 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053604979 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053604979 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053604979 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053604979 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:36:06.448621 run osmo-stp_10.42.42.5(pid=31226): stdout: | (launched: 2022-12-10_05:36:04.806333) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:36:06.573625 run osmo-stp_10.42.42.5(pid=31226): stderr: | 20221210053604978 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053604978 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053604978 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053604979 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053604979 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053604979 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053604979 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:36:06.721728 run patchelf(pid=31229): Terminating (SIGINT) 05:36:06.893222 run patchelf(pid=31229): Terminated: ok {rc=0} 05:36:07.016523 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31226): Process ended prematurely: osmo-stp_10.42.42.5(pid=31226) [trial-2370↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31226)] [trial-2370↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8] 05:36:07.026213 tst iperf3m4.py:8: Test FAILED (10.7 sec) 05:36:07.053896 run osmo-hlr_10.42.42.2(pid=31223): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31223)] 05:36:07.102071 run osmo-hlr_10.42.42.2(pid=31223): stdout: | (launched: 2022-12-10_05:36:03.841570) 05:36:07.151352 run osmo-hlr_10.42.42.2(pid=31223): stderr: | 20221210053604021 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210053604021 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210053604021 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210053604021 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210053604021 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210053604021 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210053604033 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:sysmo+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210053604042 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210053604042 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210053604042 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:36:07.201568 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31212): Terminating (SIGTERM) 05:36:07.241155 run iperf3-srv_10.42.42.10(pid=31213): Terminating (SIGTERM) 05:36:07.280766 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31214): Terminating (SIGTERM) 05:36:07.320476 run iperf3-srv_10.42.42.10(pid=31215): Terminating (SIGTERM) 05:36:07.360105 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31216): Terminating (SIGTERM) 05:36:07.399438 run iperf3-srv_10.42.42.10(pid=31217): Terminating (SIGTERM) 05:36:07.438904 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31218): Terminating (SIGTERM) 05:36:07.478504 run iperf3-srv_10.42.42.10(pid=31219): Terminating (SIGTERM) 05:36:07.517875 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31222): Terminating (SIGTERM) 05:36:07.557473 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31225): Terminating (SIGTERM) 05:36:07.597041 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31228): Terminating (SIGTERM) 05:36:07.636478 --- ParallelTerminationStrategy: PID 31212 died... 05:36:07.655777 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31212): Terminated: ok {rc=0} 05:36:07.700014 --- ParallelTerminationStrategy: PID 31213 died... 05:36:07.718479 run iperf3-srv_10.42.42.10(pid=31213): Terminated {rc=256} 05:36:07.762316 --- ParallelTerminationStrategy: PID 31214 died... 05:36:07.780842 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31214): Terminated: ok {rc=0} 05:36:07.825249 --- ParallelTerminationStrategy: PID 31215 died... 05:36:07.843693 run iperf3-srv_10.42.42.10(pid=31215): Terminated {rc=256} 05:36:07.888170 --- ParallelTerminationStrategy: PID 31216 died... 05:36:07.906711 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31216): Terminated: ok {rc=0} 05:36:07.950639 --- ParallelTerminationStrategy: PID 31217 died... 05:36:07.969135 run iperf3-srv_10.42.42.10(pid=31217): Terminated {rc=256} 05:36:08.012914 --- ParallelTerminationStrategy: PID 31218 died... 05:36:08.031457 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31218): Terminated: ok {rc=0} 05:36:08.075406 --- ParallelTerminationStrategy: PID 31219 died... 05:36:08.093926 run iperf3-srv_10.42.42.10(pid=31219): Terminated {rc=256} 05:36:08.137769 --- ParallelTerminationStrategy: PID 31222 died... 05:36:08.156236 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31222): Terminated: ok {rc=0} 05:36:08.201042 --- ParallelTerminationStrategy: PID 31225 died... 05:36:08.219654 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31225): Terminated: ok {rc=0} 05:36:08.263667 --- ParallelTerminationStrategy: PID 31228 died... 05:36:08.282358 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31228): Terminated: ok {rc=0} 05:36:08.365646 bus /gobi_4: Setting Powered False 05:36:09.461946 bus /gobi_4: Setting Powered False 05:36:10.577687 bus /gobi_1: Setting Powered False 05:36:11.677668 bus /gobi_1: Setting Powered False 05:36:12.793910 bus /gobi_0: Setting Powered False 05:36:13.891715 bus /gobi_0: Setting Powered False 05:36:15.008052 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:sysmo+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 05:36:16.110796 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:36:16.123846 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 05:36:16.182807 tst ping.py: using LAC 26207 05:36:16.311286 tst ping.py: using RAC 197 05:36:16.469004 tst ping.py: using CellId 26207 05:36:16.601717 tst ping.py: using BVCI 26208 05:36:16.749320 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:36:16.763388 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:36:16.775582 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:36:16.787874 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:36:16.800173 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:36:16.812549 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:36:16.824559 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:36:16.836461 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 05:36:16.981562 tst ping.py:19: start network... 05:36:17.228413 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:36:17.699052 run create_hlr_db(pid=31230): Launched 05:36:17.814350 bus /gobi_6: Setting Powered False 05:36:18.874210 run create_hlr_db(pid=31230): Terminated: ok {rc=0} 05:36:19.317214 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31232): Launched 05:36:19.640463 run osmo-hlr_10.42.42.2(pid=31233): Launched 05:36:19.762189 run osmo-stp_10.42.42.5: Starting osmo-stp 05:36:20.324795 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31235): Launched 05:36:20.647742 run osmo-stp_10.42.42.5(pid=31236): Launched 05:36:20.769590 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:36:21.325704 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31238): Launched 05:36:21.447654 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:36:21.720488 run patchelf(pid=31239): Launched 05:36:21.899224 run osmo-stp_10.42.42.5(pid=31236): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31236)] 05:36:22.036057 run osmo-stp_10.42.42.5(pid=31236): stdout: | (launched: 2022-12-10_05:36:20.587081) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:36:22.174138 run osmo-stp_10.42.42.5(pid=31236): stderr: | 20221210053620781 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053620781 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053620782 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053620782 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053620783 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053620783 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053620783 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:36:22.311823 run osmo-stp_10.42.42.5(pid=31236): stdout: | (launched: 2022-12-10_05:36:20.587081) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:36:22.443093 run osmo-stp_10.42.42.5(pid=31236): stderr: | 20221210053620781 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053620781 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053620782 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053620782 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053620783 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053620783 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053620783 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:36:22.599316 run patchelf(pid=31239): Terminating (SIGINT) 05:36:22.778676 run patchelf(pid=31239): Terminated: ok {rc=0} 05:36:22.907394 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=31236): Process ended prematurely: osmo-stp_10.42.42.5(pid=31236) [trial-2370↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31236)] [trial-2370↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22] 05:36:22.917114 tst ping.py:22: Test FAILED (6.8 sec) 05:36:22.945148 run osmo-hlr_10.42.42.2(pid=31233): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31233)] 05:36:22.995147 run osmo-hlr_10.42.42.2(pid=31233): stdout: | (launched: 2022-12-10_05:36:19.579938) 05:36:23.046316 run osmo-hlr_10.42.42.2(pid=31233): stderr: | 20221210053619782 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210053619783 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210053619783 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210053619783 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210053619783 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210053619783 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210053619795 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:sysmo+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210053619805 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210053619805 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210053619805 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:36:23.097941 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31232): Terminating (SIGTERM) 05:36:23.139257 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31235): Terminating (SIGTERM) 05:36:23.180517 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31238): Terminating (SIGTERM) 05:36:23.222175 --- ParallelTerminationStrategy: PID 31232 died... 05:36:23.241918 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31232): Terminated: ok {rc=0} 05:36:23.287705 --- ParallelTerminationStrategy: PID 31235 died... 05:36:23.307249 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31235): Terminated: ok {rc=0} 05:36:23.352494 --- ParallelTerminationStrategy: PID 31238 died... 05:36:23.371786 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31238): Terminated: ok {rc=0} 05:36:23.458291 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:sysmo+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 05:36:24.545024 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:36:24.557131 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 05:36:24.616709 tst ping_idle_ping.py: using LAC 26208 05:36:24.744276 tst ping_idle_ping.py: using RAC 198 05:36:24.870374 tst ping_idle_ping.py: using CellId 26208 05:36:24.995213 tst ping_idle_ping.py: using BVCI 26209 05:36:25.111230 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:36:25.122847 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:36:25.134256 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:36:25.145497 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:36:25.156614 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:36:25.167727 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:36:25.179107 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:36:25.190256 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 05:36:25.306393 tst ping_idle_ping.py:24: start network... 05:36:25.507188 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:36:25.976714 run create_hlr_db(pid=31240): Launched 05:36:26.091904 bus /gobi_6: Setting Powered False 05:36:27.152154 run create_hlr_db(pid=31240): Terminated: ok {rc=0} 05:36:27.596465 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31242): Launched 05:36:27.920396 run osmo-hlr_10.42.42.2(pid=31243): Launched 05:36:28.043356 run osmo-stp_10.42.42.5: Starting osmo-stp 05:36:28.600126 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31245): Launched 05:36:28.923829 run osmo-stp_10.42.42.5(pid=31246): Launched 05:36:29.047406 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:36:29.607173 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31248): Launched 05:36:29.730452 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:36:30.004309 run patchelf(pid=31249): Launched 05:36:30.182967 run osmo-stp_10.42.42.5(pid=31246): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31246)] 05:36:30.319322 run osmo-stp_10.42.42.5(pid=31246): stdout: | (launched: 2022-12-10_05:36:28.862872) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:36:30.457376 run osmo-stp_10.42.42.5(pid=31246): stderr: | 20221210053629056 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053629056 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053629056 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053629057 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053629059 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053629059 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053629059 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:36:30.595764 run osmo-stp_10.42.42.5(pid=31246): stdout: | (launched: 2022-12-10_05:36:28.862872) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:36:30.727503 run osmo-stp_10.42.42.5(pid=31246): stderr: | 20221210053629056 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053629056 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053629056 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053629057 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053629059 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053629059 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053629059 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:36:30.892540 run patchelf(pid=31249): Terminating (SIGINT) 05:36:31.078546 run patchelf(pid=31249): Terminated: ok {rc=0} 05:36:31.210356 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=31246): Process ended prematurely: osmo-stp_10.42.42.5(pid=31246) [trial-2370↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31246)] [trial-2370↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 05:36:31.220887 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 05:36:31.250299 run osmo-hlr_10.42.42.2(pid=31243): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31243)] 05:36:31.301210 run osmo-hlr_10.42.42.2(pid=31243): stdout: | (launched: 2022-12-10_05:36:27.859806) 05:36:31.353985 run osmo-hlr_10.42.42.2(pid=31243): stderr: | 20221210053628058 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210053628058 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210053628058 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210053628058 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210053628058 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210053628058 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210053628071 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:sysmo+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210053628081 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210053628081 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210053628081 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:36:31.407226 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31242): Terminating (SIGTERM) 05:36:31.450309 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31245): Terminating (SIGTERM) 05:36:31.493738 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31248): Terminating (SIGTERM) 05:36:31.538243 --- ParallelTerminationStrategy: PID 31242 died... 05:36:31.558842 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31242): Terminated: ok {rc=0} 05:36:31.606485 --- ParallelTerminationStrategy: PID 31245 died... 05:36:31.626576 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31245): Terminated: ok {rc=0} 05:36:31.673747 --- ParallelTerminationStrategy: PID 31248 died... 05:36:31.693874 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31248): Terminated: ok {rc=0} 05:36:31.781882 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2370 gprs:sysmo+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 gprs:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 05:36:33.074342 tst gprs:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:36:33.081668 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 05:36:33.103153 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 05:36:33.141945 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 05:36:33.231493 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 05:36:33.253377 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 05:36:33.293091 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 05:36:33.884320 tst gprs:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2370 gprs:sysmo+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 05:36:33.936867 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:36:33.948160 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 05:36:34.006310 tst cs_paging_gprs_active.py: using LAC 26209 05:36:34.137193 tst cs_paging_gprs_active.py: using RAC 199 05:36:34.264769 tst cs_paging_gprs_active.py: using CellId 26209 05:36:34.390780 tst cs_paging_gprs_active.py: using BVCI 26210 05:36:34.511303 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:36:34.522656 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:36:34.533797 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:36:34.545258 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:36:34.556309 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:36:34.567564 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:36:34.578749 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:36:34.590223 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:36:34.601789 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 05:36:34.719947 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 05:36:34.840365 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 05:36:35.061684 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:36:35.392595 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31253): Launched 05:36:35.679376 run iperf3-srv_10.42.42.10(pid=31254): Launched 05:36:35.801737 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 05:36:36.022156 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:36:36.352053 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31255): Launched 05:36:36.638593 run iperf3-srv_10.42.42.10(pid=31256): Launched 05:36:36.761205 tst cs_paging_gprs_active.py:38: start network... 05:36:36.980739 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:36:37.489135 run create_hlr_db(pid=31257): Launched 05:36:37.622278 bus /gobi_6: Setting Powered False 05:36:38.686867 run create_hlr_db(pid=31257): Terminated: ok {rc=0} 05:36:39.142993 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31259): Launched 05:36:39.472256 run osmo-hlr_10.42.42.2(pid=31260): Launched 05:36:39.597563 run osmo-stp_10.42.42.5: Starting osmo-stp 05:36:40.161348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31262): Launched 05:36:40.489032 run osmo-stp_10.42.42.5(pid=31263): Launched 05:36:40.613558 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:36:41.179193 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31265): Launched 05:36:41.304019 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:36:41.582200 run patchelf(pid=31266): Launched 05:36:41.764560 run osmo-stp_10.42.42.5(pid=31263): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31263)] 05:36:41.903116 run osmo-stp_10.42.42.5(pid=31263): stdout: | (launched: 2022-12-10_05:36:40.427536) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:36:42.043516 run osmo-stp_10.42.42.5(pid=31263): stderr: | 20221210053640623 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053640623 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053640623 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053640624 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053640624 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053640624 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053640624 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:36:42.183905 run osmo-stp_10.42.42.5(pid=31263): stdout: | (launched: 2022-12-10_05:36:40.427536) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:36:42.318258 run osmo-stp_10.42.42.5(pid=31263): stderr: | 20221210053640623 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053640623 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053640623 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053640624 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053640624 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053640624 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053640624 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:36:42.477306 run patchelf(pid=31266): Terminating (SIGINT) 05:36:42.660550 run patchelf(pid=31266): Terminated: ok {rc=0} 05:36:42.792619 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=31263): Process ended prematurely: osmo-stp_10.42.42.5(pid=31263) [trial-2370↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31263)] [trial-2370↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 05:36:42.802926 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 05:36:42.831256 run osmo-hlr_10.42.42.2(pid=31260): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31260)] 05:36:42.880881 run osmo-hlr_10.42.42.2(pid=31260): stdout: | (launched: 2022-12-10_05:36:39.410600) 05:36:42.932144 run osmo-hlr_10.42.42.2(pid=31260): stderr: | 20221210053639610 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210053639610 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210053639610 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210053639610 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210053639610 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210053639610 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210053639623 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:sysmo+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210053639631 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210053639631 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210053639631 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:36:42.983764 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31253): Terminating (SIGTERM) 05:36:43.025347 run iperf3-srv_10.42.42.10(pid=31254): Terminating (SIGTERM) 05:36:43.066839 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31255): Terminating (SIGTERM) 05:36:43.108525 run iperf3-srv_10.42.42.10(pid=31256): Terminating (SIGTERM) 05:36:43.150260 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31259): Terminating (SIGTERM) 05:36:43.191786 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31262): Terminating (SIGTERM) 05:36:43.233123 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31265): Terminating (SIGTERM) 05:36:43.274559 --- ParallelTerminationStrategy: PID 31253 died... 05:36:43.294477 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31253): Terminated: ok {rc=0} 05:36:43.340609 --- ParallelTerminationStrategy: PID 31254 died... 05:36:43.360060 run iperf3-srv_10.42.42.10(pid=31254): Terminated {rc=256} 05:36:43.405594 --- ParallelTerminationStrategy: PID 31255 died... 05:36:43.424857 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31255): Terminated: ok {rc=0} 05:36:43.470694 --- ParallelTerminationStrategy: PID 31256 died... 05:36:43.490055 run iperf3-srv_10.42.42.10(pid=31256): Terminated {rc=256} 05:36:43.535978 --- ParallelTerminationStrategy: PID 31259 died... 05:36:43.555837 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31259): Terminated: ok {rc=0} 05:36:43.601759 --- ParallelTerminationStrategy: PID 31262 died... 05:36:43.621290 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31262): Terminated: ok {rc=0} 05:36:43.667026 --- ParallelTerminationStrategy: PID 31265 died... 05:36:43.686575 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31265): Terminated: ok {rc=0} 05:36:43.774218 bus /gobi_0: Setting Powered False 05:36:44.871335 bus /gobi_0: Setting Powered False 05:36:45.985440 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:sysmo+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 05:36:47.144371 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:36:47.157210 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 05:36:47.224831 tst iperf3.py: using LAC 26210 05:36:47.352786 tst iperf3.py: using RAC 200 05:36:47.481147 tst iperf3.py: using CellId 26210 05:36:47.608703 tst iperf3.py: using BVCI 26211 05:36:47.727723 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:36:47.739260 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:36:47.750590 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:36:47.762255 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:36:47.773603 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:36:47.784823 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:36:47.796311 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:36:47.807854 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:36:47.819350 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 05:36:47.937066 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 05:36:48.143018 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:36:48.453106 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31267): Launched 05:36:48.722567 run iperf3-srv_10.42.42.10(pid=31268): Launched 05:36:48.837748 tst iperf3.py:8: start network... 05:36:49.043534 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:36:49.522028 run create_hlr_db(pid=31269): Launched 05:36:49.639402 bus /gobi_6: Setting Powered False 05:36:50.700106 run create_hlr_db(pid=31269): Terminated: ok {rc=0} 05:36:51.149804 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31271): Launched 05:36:51.480474 run osmo-hlr_10.42.42.2(pid=31272): Launched 05:36:51.607671 run osmo-stp_10.42.42.5: Starting osmo-stp 05:36:52.173840 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31274): Launched 05:36:52.503139 run osmo-stp_10.42.42.5(pid=31275): Launched 05:36:52.628049 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:36:53.197750 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31277): Launched 05:36:53.323218 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:36:53.601665 run patchelf(pid=31278): Launched 05:36:53.784885 run osmo-stp_10.42.42.5(pid=31275): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31275)] 05:36:53.922852 run osmo-stp_10.42.42.5(pid=31275): stdout: | (launched: 2022-12-10_05:36:52.441461) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:36:54.062877 run osmo-stp_10.42.42.5(pid=31275): stderr: | 20221210053652636 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053652636 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053652636 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053652636 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053652637 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053652637 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053652637 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:36:54.202518 run osmo-stp_10.42.42.5(pid=31275): stdout: | (launched: 2022-12-10_05:36:52.441461) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:36:54.336037 run osmo-stp_10.42.42.5(pid=31275): stderr: | 20221210053652636 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053652636 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053652636 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053652636 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053652637 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053652637 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053652637 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:36:54.494527 run patchelf(pid=31278): Terminating (SIGINT) 05:36:54.677400 run patchelf(pid=31278): Terminated: ok {rc=0} 05:36:54.808470 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31275): Process ended prematurely: osmo-stp_10.42.42.5(pid=31275) [trial-2370↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31275)] [trial-2370↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8] 05:36:54.818718 tst iperf3.py:8: Test FAILED (7.7 sec) 05:36:54.847048 run osmo-hlr_10.42.42.2(pid=31272): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31272)] 05:36:54.896782 run osmo-hlr_10.42.42.2(pid=31272): stdout: | (launched: 2022-12-10_05:36:51.418967) 05:36:54.948474 run osmo-hlr_10.42.42.2(pid=31272): stderr: | 20221210053651619 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210053651619 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210053651619 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210053651619 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210053651619 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210053651619 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210053651631 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:sysmo+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210053651640 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210053651641 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210053651641 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:36:55.000574 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31267): Terminating (SIGTERM) 05:36:55.042331 run iperf3-srv_10.42.42.10(pid=31268): Terminating (SIGTERM) 05:36:55.084082 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31271): Terminating (SIGTERM) 05:36:55.126247 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31274): Terminating (SIGTERM) 05:36:55.167861 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31277): Terminating (SIGTERM) 05:36:55.210101 --- ParallelTerminationStrategy: PID 31267 died... 05:36:55.230165 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31267): Terminated: ok {rc=0} 05:36:55.277074 --- ParallelTerminationStrategy: PID 31268 died... 05:36:55.296581 run iperf3-srv_10.42.42.10(pid=31268): Terminated {rc=256} 05:36:55.342685 --- ParallelTerminationStrategy: PID 31271 died... 05:36:55.362384 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31271): Terminated: ok {rc=0} 05:36:55.408461 --- ParallelTerminationStrategy: PID 31274 died... 05:36:55.428021 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31274): Terminated: ok {rc=0} 05:36:55.474329 --- ParallelTerminationStrategy: PID 31277 died... 05:36:55.494016 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31277): Terminated: ok {rc=0} 05:36:55.581355 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:sysmo+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 05:36:56.729528 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:36:56.741211 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 05:36:56.797536 tst iperf3m4.py: using LAC 26211 05:36:56.918658 tst iperf3m4.py: using RAC 201 05:36:57.039218 tst iperf3m4.py: using CellId 26211 05:36:57.158580 tst iperf3m4.py: using BVCI 26212 05:36:57.271840 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:36:57.282935 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:36:57.293746 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:36:57.304755 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:36:57.315753 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:36:57.326813 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:36:57.337821 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:36:57.348733 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:36:57.359903 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 05:36:57.476256 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 05:36:57.599998 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 05:36:57.719221 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 05:36:57.839287 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 05:36:58.060053 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:36:58.389609 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31279): Launched 05:36:58.674971 run iperf3-srv_10.42.42.10(pid=31280): Launched 05:36:58.797237 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 05:36:59.016711 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:36:59.347719 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31281): Launched 05:36:59.634271 run iperf3-srv_10.42.42.10(pid=31282): Launched 05:36:59.758150 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 05:36:59.977424 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:37:00.306669 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31283): Launched 05:37:00.595242 run iperf3-srv_10.42.42.10(pid=31284): Launched 05:37:00.717309 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 05:37:00.958031 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:37:01.299185 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31285): Launched 05:37:01.603205 run iperf3-srv_10.42.42.10(pid=31286): Launched 05:37:01.741212 tst iperf3m4.py:8: start network... 05:37:01.965687 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:37:02.475759 run create_hlr_db(pid=31287): Launched 05:37:02.608142 bus /gobi_6: Setting Powered False 05:37:03.667745 run create_hlr_db(pid=31287): Terminated: ok {rc=0} 05:37:04.123341 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31289): Launched 05:37:04.451544 run osmo-hlr_10.42.42.2(pid=31290): Launched 05:37:04.575667 run osmo-stp_10.42.42.5: Starting osmo-stp 05:37:05.150981 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31292): Launched 05:37:05.479866 run osmo-stp_10.42.42.5(pid=31293): Launched 05:37:05.604894 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:37:06.171296 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31295): Launched 05:37:06.296501 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:37:06.574810 run patchelf(pid=31296): Launched 05:37:06.756714 run osmo-stp_10.42.42.5(pid=31293): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31293)] 05:37:06.894992 run osmo-stp_10.42.42.5(pid=31293): stdout: | (launched: 2022-12-10_05:37:05.418310) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:37:07.034627 run osmo-stp_10.42.42.5(pid=31293): stderr: | 20221210053705614 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053705614 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053705614 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053705615 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053705615 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053705615 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053705615 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:37:07.174423 run osmo-stp_10.42.42.5(pid=31293): stdout: | (launched: 2022-12-10_05:37:05.418310) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:37:07.308327 run osmo-stp_10.42.42.5(pid=31293): stderr: | 20221210053705614 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053705614 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053705614 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053705615 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053705615 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053705615 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053705615 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:37:07.467223 run patchelf(pid=31296): Terminating (SIGINT) 05:37:07.650446 run patchelf(pid=31296): Terminated: ok {rc=0} 05:37:07.782033 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31293): Process ended prematurely: osmo-stp_10.42.42.5(pid=31293) [trial-2370↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31293)] [trial-2370↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8] 05:37:07.792244 tst iperf3m4.py:8: Test FAILED (11.1 sec) 05:37:07.820915 run osmo-hlr_10.42.42.2(pid=31290): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31290)] 05:37:07.870610 run osmo-hlr_10.42.42.2(pid=31290): stdout: | (launched: 2022-12-10_05:37:04.389956) 05:37:07.921961 run osmo-hlr_10.42.42.2(pid=31290): stderr: | 20221210053704593 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210053704593 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210053704593 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210053704593 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210053704593 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210053704593 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210053704606 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:sysmo+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210053704614 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210053704614 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210053704614 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:37:07.973881 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31279): Terminating (SIGTERM) 05:37:08.015288 run iperf3-srv_10.42.42.10(pid=31280): Terminating (SIGTERM) 05:37:08.056502 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31281): Terminating (SIGTERM) 05:37:08.098278 run iperf3-srv_10.42.42.10(pid=31282): Terminating (SIGTERM) 05:37:08.140040 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31283): Terminating (SIGTERM) 05:37:08.181856 run iperf3-srv_10.42.42.10(pid=31284): Terminating (SIGTERM) 05:37:08.223343 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31285): Terminating (SIGTERM) 05:37:08.264940 run iperf3-srv_10.42.42.10(pid=31286): Terminating (SIGTERM) 05:37:08.306505 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31289): Terminating (SIGTERM) 05:37:08.348293 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31292): Terminating (SIGTERM) 05:37:08.390005 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31295): Terminating (SIGTERM) 05:37:08.431957 --- ParallelTerminationStrategy: PID 31279 died... 05:37:08.451969 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31279): Terminated: ok {rc=0} 05:37:08.498211 --- ParallelTerminationStrategy: PID 31280 died... 05:37:08.517646 run iperf3-srv_10.42.42.10(pid=31280): Terminated {rc=256} 05:37:08.563728 --- ParallelTerminationStrategy: PID 31281 died... 05:37:08.583310 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31281): Terminated: ok {rc=0} 05:37:08.629313 --- ParallelTerminationStrategy: PID 31282 died... 05:37:08.648802 run iperf3-srv_10.42.42.10(pid=31282): Terminated {rc=256} 05:37:08.694593 --- ParallelTerminationStrategy: PID 31283 died... 05:37:08.713980 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31283): Terminated: ok {rc=0} 05:37:08.759735 --- ParallelTerminationStrategy: PID 31284 died... 05:37:08.779211 run iperf3-srv_10.42.42.10(pid=31284): Terminated {rc=256} 05:37:08.824857 --- ParallelTerminationStrategy: PID 31285 died... 05:37:08.844263 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31285): Terminated: ok {rc=0} 05:37:08.889977 --- ParallelTerminationStrategy: PID 31286 died... 05:37:08.909522 run iperf3-srv_10.42.42.10(pid=31286): Terminated {rc=256} 05:37:08.955036 --- ParallelTerminationStrategy: PID 31289 died... 05:37:08.974552 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31289): Terminated: ok {rc=0} 05:37:09.020238 --- ParallelTerminationStrategy: PID 31292 died... 05:37:09.039682 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31292): Terminated: ok {rc=0} 05:37:09.085410 --- ParallelTerminationStrategy: PID 31295 died... 05:37:09.104886 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31295): Terminated: ok {rc=0} 05:37:09.192318 bus /gobi_4: Setting Powered False 05:37:10.290839 bus /gobi_4: Setting Powered False 05:37:11.406582 bus /gobi_1: Setting Powered False 05:37:12.506266 bus /gobi_1: Setting Powered False 05:37:13.623704 bus /gobi_0: Setting Powered False 05:37:14.720725 bus /gobi_0: Setting Powered False 05:37:15.848783 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:sysmo+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 05:37:16.969619 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:37:16.982660 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 05:37:17.042431 tst ping.py: using LAC 26212 05:37:17.170605 tst ping.py: using RAC 202 05:37:17.297425 tst ping.py: using CellId 26212 05:37:17.415055 tst ping.py: using BVCI 26213 05:37:17.527047 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:37:17.538362 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:37:17.549424 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:37:17.560761 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:37:17.572059 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:37:17.583333 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:37:17.594562 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:37:17.605690 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 05:37:17.720314 tst ping.py:19: start network... 05:37:17.920779 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:37:18.385696 run create_hlr_db(pid=31297): Launched 05:37:18.499618 bus /gobi_6: Setting Powered False 05:37:19.560222 run create_hlr_db(pid=31297): Terminated: ok {rc=0} 05:37:20.001640 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31299): Launched 05:37:20.324624 run osmo-hlr_10.42.42.2(pid=31300): Launched 05:37:20.447109 run osmo-stp_10.42.42.5: Starting osmo-stp 05:37:21.004123 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31302): Launched 05:37:21.326223 run osmo-stp_10.42.42.5(pid=31303): Launched 05:37:21.450352 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:37:22.005964 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31305): Launched 05:37:22.129746 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:37:22.401685 run patchelf(pid=31306): Launched 05:37:22.581748 run osmo-stp_10.42.42.5(pid=31303): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31303)] 05:37:22.717500 run osmo-stp_10.42.42.5(pid=31303): stdout: | (launched: 2022-12-10_05:37:21.265051) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:37:22.854679 run osmo-stp_10.42.42.5(pid=31303): stderr: | 20221210053721461 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053721461 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053721461 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053721462 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053721462 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053721462 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053721462 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:37:22.991770 run osmo-stp_10.42.42.5(pid=31303): stdout: | (launched: 2022-12-10_05:37:21.265051) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:37:23.122940 run osmo-stp_10.42.42.5(pid=31303): stderr: | 20221210053721461 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053721461 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053721461 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053721462 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053721462 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053721462 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053721462 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:37:23.277825 run patchelf(pid=31306): Terminating (SIGINT) 05:37:23.456667 run patchelf(pid=31306): Terminated: ok {rc=0} 05:37:23.585511 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=31303): Process ended prematurely: osmo-stp_10.42.42.5(pid=31303) [trial-2370↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31303)] [trial-2370↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22] 05:37:23.595064 tst ping.py:22: Test FAILED (6.6 sec) 05:37:23.623250 run osmo-hlr_10.42.42.2(pid=31300): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31300)] 05:37:23.673696 run osmo-hlr_10.42.42.2(pid=31300): stdout: | (launched: 2022-12-10_05:37:20.263965) 05:37:23.725671 run osmo-hlr_10.42.42.2(pid=31300): stderr: | 20221210053720464 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210053720464 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210053720464 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210053720464 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210053720464 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210053720465 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210053720479 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:sysmo+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210053720489 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210053720489 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210053720489 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:37:23.777879 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31299): Terminating (SIGTERM) 05:37:23.819867 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31302): Terminating (SIGTERM) 05:37:23.861663 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31305): Terminating (SIGTERM) 05:37:23.903736 --- ParallelTerminationStrategy: PID 31299 died... 05:37:23.923815 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31299): Terminated: ok {rc=0} 05:37:23.969990 --- ParallelTerminationStrategy: PID 31302 died... 05:37:23.989516 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31302): Terminated: ok {rc=0} 05:37:24.035412 --- ParallelTerminationStrategy: PID 31305 died... 05:37:24.055070 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31305): Terminated: ok {rc=0} 05:37:24.143059 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:sysmo+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 05:37:25.231905 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:37:25.244485 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 05:37:25.305184 tst ping_idle_ping.py: using LAC 26213 05:37:25.433530 tst ping_idle_ping.py: using RAC 203 05:37:25.561401 tst ping_idle_ping.py: using CellId 26213 05:37:25.687951 tst ping_idle_ping.py: using BVCI 26214 05:37:25.800112 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:37:25.812761 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:37:25.823823 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:37:25.835461 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:37:25.847217 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:37:25.858931 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:37:25.870872 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:37:25.882583 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 05:37:26.000307 tst ping_idle_ping.py:24: start network... 05:37:26.216446 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:37:26.718869 run create_hlr_db(pid=31307): Launched 05:37:26.849437 bus /gobi_6: Setting Powered False 05:37:27.912920 run create_hlr_db(pid=31307): Terminated: ok {rc=0} 05:37:28.346950 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31309): Launched 05:37:28.651762 run osmo-hlr_10.42.42.2(pid=31310): Launched 05:37:28.767594 run osmo-stp_10.42.42.5: Starting osmo-stp 05:37:29.292430 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31312): Launched 05:37:29.595555 run osmo-stp_10.42.42.5(pid=31313): Launched 05:37:29.710422 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:37:30.235221 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31315): Launched 05:37:30.350618 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:37:30.607856 run patchelf(pid=31316): Launched 05:37:30.775964 run osmo-stp_10.42.42.5(pid=31313): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31313)] 05:37:30.914448 run osmo-stp_10.42.42.5(pid=31313): stdout: | (launched: 2022-12-10_05:37:29.538321) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:37:31.060139 run osmo-stp_10.42.42.5(pid=31313): stderr: | 20221210053729710 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053729710 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053729710 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053729710 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053729713 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053729713 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053729713 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:37:31.204047 run osmo-stp_10.42.42.5(pid=31313): stdout: | (launched: 2022-12-10_05:37:29.538321) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:37:31.341048 run osmo-stp_10.42.42.5(pid=31313): stderr: | 20221210053729710 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053729710 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053729710 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053729710 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053729713 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053729713 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053729713 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:37:31.503763 run patchelf(pid=31316): Terminating (SIGINT) 05:37:31.692364 run patchelf(pid=31316): Terminated: ok {rc=0} 05:37:31.826288 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=31313): Process ended prematurely: osmo-stp_10.42.42.5(pid=31313) [trial-2370↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31313)] [trial-2370↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 05:37:31.837162 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 05:37:31.869312 run osmo-hlr_10.42.42.2(pid=31310): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31310)] 05:37:31.922217 run osmo-hlr_10.42.42.2(pid=31310): stdout: | (launched: 2022-12-10_05:37:28.594089) 05:37:31.977507 run osmo-hlr_10.42.42.2(pid=31310): stderr: | 20221210053728772 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210053728772 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210053728772 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210053728772 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210053728772 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210053728773 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210053728785 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:sysmo+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210053728794 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210053728794 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210053728794 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:37:32.033058 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31309): Terminating (SIGTERM) 05:37:32.078864 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31312): Terminating (SIGTERM) 05:37:32.125138 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31315): Terminating (SIGTERM) 05:37:32.172608 --- ParallelTerminationStrategy: PID 31309 died... 05:37:32.193647 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31309): Terminated: ok {rc=0} 05:37:32.244861 --- ParallelTerminationStrategy: PID 31312 died... 05:37:32.266727 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31312): Terminated: ok {rc=0} 05:37:32.314232 --- ParallelTerminationStrategy: PID 31315 died... 05:37:32.333975 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31315): Terminated: ok {rc=0} 05:37:32.423953 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2370 gprs:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 05:37:33.718004 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:37:33.725647 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 05:37:33.748201 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 05:37:33.785507 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 05:37:33.845830 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 05:37:33.867655 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 05:37:33.903658 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 05:37:34.454959 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2370 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 05:37:34.460185 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 05:37:34.471783 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 05:37:34.530274 tst switch_tch_pdch.py: using LAC 26214 05:37:34.655740 tst switch_tch_pdch.py: using RAC 204 05:37:34.780649 tst switch_tch_pdch.py: using CellId 26214 05:37:34.908577 tst switch_tch_pdch.py: using BVCI 26215 05:37:35.026106 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 05:37:35.037943 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 05:37:35.049566 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 05:37:35.061057 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 05:37:35.072457 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 05:37:35.084062 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 05:37:35.095742 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 05:37:35.107199 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 05:37:35.223901 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 05:37:35.338698 tst switch_tch_pdch.py:51: start network... 05:37:35.538924 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:37:36.015815 run create_hlr_db(pid=31323): Launched 05:37:36.147088 bus /gobi_6: Setting Powered False 05:37:37.210538 run create_hlr_db(pid=31323): Terminated: ok {rc=0} 05:37:37.659172 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31325): Launched 05:37:37.980125 run osmo-hlr_10.42.42.2(pid=31326): Launched 05:37:38.100925 run osmo-stp_10.42.42.5: Starting osmo-stp 05:37:38.654083 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31328): Launched 05:37:38.975001 run osmo-stp_10.42.42.5(pid=31329): Launched 05:37:39.096367 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:37:39.651838 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31331): Launched 05:37:39.774210 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:37:40.046428 run patchelf(pid=31332): Launched 05:37:40.224700 run osmo-stp_10.42.42.5(pid=31329): ERR: Terminated: ERROR {rc=1} [trial-2370↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31329)] 05:37:40.360126 run osmo-stp_10.42.42.5(pid=31329): stdout: | (launched: 2022-12-10_05:37:38.914454) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:37:40.497600 run osmo-stp_10.42.42.5(pid=31329): stderr: | 20221210053739108 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053739108 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053739108 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053739109 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053739109 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053739109 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053739109 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:37:40.635415 run osmo-stp_10.42.42.5(pid=31329): stdout: | (launched: 2022-12-10_05:37:38.914454) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:37:40.766596 run osmo-stp_10.42.42.5(pid=31329): stderr: | 20221210053739108 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053739108 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053739108 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053739109 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053739109 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053739109 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053739109 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:37:40.921725 run patchelf(pid=31332): Terminating (SIGINT) 05:37:41.101092 run patchelf(pid=31332): Terminated: ok {rc=0} 05:37:41.230282 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=31329): Process ended prematurely: osmo-stp_10.42.42.5(pid=31329) [trial-2370↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31329)] [trial-2370↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 05:37:41.239828 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 05:37:41.267835 run osmo-hlr_10.42.42.2(pid=31326): ERR: Terminated: ERROR {rc=237} [trial-2370↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31326)] 05:37:41.317909 run osmo-hlr_10.42.42.2(pid=31326): stdout: | (launched: 2022-12-10_05:37:37.919547) 05:37:41.369819 run osmo-hlr_10.42.42.2(pid=31326): stderr: | 20221210053738121 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210053738121 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210053738121 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210053738121 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210053738121 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210053738121 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210053738134 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210053738143 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210053738143 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210053738143 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:37:41.421812 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31325): Terminating (SIGTERM) 05:37:41.463689 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31328): Terminating (SIGTERM) 05:37:41.505666 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31331): Terminating (SIGTERM) 05:37:41.547958 --- ParallelTerminationStrategy: PID 31325 died... 05:37:41.568148 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31325): Terminated: ok {rc=0} 05:37:41.615105 --- ParallelTerminationStrategy: PID 31328 died... 05:37:41.634695 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31328): Terminated: ok {rc=0} 05:37:41.681168 --- ParallelTerminationStrategy: PID 31331 died... 05:37:41.700660 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31331): Terminated: ok {rc=0} 05:37:41.787801 bus /gobi_0: Setting Powered False 05:37:42.886993 bus /gobi_0: Setting Powered False 05:37:44.004840 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2370 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 dynts:sysmo+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 05:37:45.239505 tst dynts:sysmo+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:37:45.245743 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 05:37:45.267235 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 05:37:45.301944 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 05:37:45.356515 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 05:37:45.378157 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 05:37:45.413064 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 05:37:45.974085 tst dynts:sysmo+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2370 dynts:sysmo+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 05:37:45.979736 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 05:37:45.991250 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 05:37:46.052734 tst switch_tch_pdch.py: using LAC 26215 05:37:46.174656 tst switch_tch_pdch.py: using RAC 205 05:37:46.338607 tst switch_tch_pdch.py: using CellId 26215 05:37:46.471653 tst switch_tch_pdch.py: using BVCI 26216 05:37:46.630385 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 05:37:46.646150 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 05:37:46.661839 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 05:37:46.676690 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 05:37:46.687935 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 05:37:46.699836 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 05:37:46.712861 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 05:37:46.724387 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 05:37:46.841172 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 05:37:46.985531 tst switch_tch_pdch.py:51: start network... 05:37:47.247298 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:37:47.722326 run create_hlr_db(pid=31336): Launched 05:37:47.853136 bus /gobi_6: Setting Powered False 05:37:48.916644 run create_hlr_db(pid=31336): Terminated: ok {rc=0} 05:37:49.323907 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31338): Launched 05:37:49.626933 run osmo-hlr_10.42.42.2(pid=31339): Launched 05:37:49.741901 run osmo-stp_10.42.42.5: Starting osmo-stp 05:37:50.234084 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31341): Launched 05:37:50.535031 run osmo-stp_10.42.42.5(pid=31342): Launched 05:37:50.648416 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:37:51.144062 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31344): Launched 05:37:51.259291 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:37:51.515200 run patchelf(pid=31345): Launched 05:37:51.682635 run osmo-stp_10.42.42.5(pid=31342): ERR: Terminated: ERROR {rc=1} [trial-2370↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31342)] 05:37:51.810034 run osmo-stp_10.42.42.5(pid=31342): stdout: | (launched: 2022-12-10_05:37:50.477920) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:37:51.939098 run osmo-stp_10.42.42.5(pid=31342): stderr: | 20221210053750649 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053750650 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053750650 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053750650 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053750651 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053750651 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053750651 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:37:52.068253 run osmo-stp_10.42.42.5(pid=31342): stdout: | (launched: 2022-12-10_05:37:50.477920) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:37:52.191096 run osmo-stp_10.42.42.5(pid=31342): stderr: | 20221210053750649 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053750650 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053750650 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053750650 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053750651 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053750651 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053750651 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:37:52.336791 run patchelf(pid=31345): Terminating (SIGINT) 05:37:52.505152 run patchelf(pid=31345): Terminated: ok {rc=0} 05:37:52.626758 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=31342): Process ended prematurely: osmo-stp_10.42.42.5(pid=31342) [trial-2370↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31342)] [trial-2370↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 05:37:52.635722 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 05:37:52.662984 run osmo-hlr_10.42.42.2(pid=31339): ERR: Terminated: ERROR {rc=237} [trial-2370↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31339)] 05:37:52.710952 run osmo-hlr_10.42.42.2(pid=31339): stdout: | (launched: 2022-12-10_05:37:49.569638) 05:37:52.760791 run osmo-hlr_10.42.42.2(pid=31339): stderr: | 20221210053749748 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210053749748 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210053749748 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210053749748 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210053749748 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210053749748 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210053749760 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/dynts:sysmo+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210053749769 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210053749769 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210053749769 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:37:52.810919 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31338): Terminating (SIGTERM) 05:37:52.851029 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31341): Terminating (SIGTERM) 05:37:52.890845 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31344): Terminating (SIGTERM) 05:37:52.930965 --- ParallelTerminationStrategy: PID 31338 died... 05:37:52.950113 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31338): Terminated: ok {rc=0} 05:37:52.994512 --- ParallelTerminationStrategy: PID 31341 died... 05:37:53.013042 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31341): Terminated: ok {rc=0} 05:37:53.057612 --- ParallelTerminationStrategy: PID 31344 died... 05:37:53.076242 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31344): Terminated: ok {rc=0} 05:37:53.162876 bus /gobi_0: Setting Powered False 05:37:54.262083 bus /gobi_0: Setting Powered False 05:37:55.376491 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2370 dynts:sysmo+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 nitb_sms:oc2g --------------------------------------------------------------------- 05:37:56.620736 tst nitb_sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:37:56.624917 tst nitb_sms:oc2g: Verifying 1 x bts (candidates: 11) 05:37:56.646393 tst nitb_sms:oc2g: Verifying 1 x ip_address (candidates: 9) 05:37:56.653561 tst nitb_sms:oc2g: Verifying 2 x modem (candidates: 12) 05:37:56.707749 tst nitb_sms:oc2g: Reserving 1 x bts (candidates: 11) 05:37:56.730042 tst nitb_sms:oc2g: Reserving 1 x ip_address (candidates: 9) 05:37:56.737191 tst nitb_sms:oc2g: Reserving 2 x modem (candidates: 12) 05:37:57.270115 tst nitb_sms:oc2g: RESERVED RESOURCES for nitb_sms: bts OC-2G ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 nitb_sms:oc2g mo_mt_sms.py ---------------------------------------------- 05:37:57.275257 tst nitb_sms:oc2g: Using 1 x ip_address (candidates: 1) 05:37:57.285907 tst nitb_sms:oc2g: Using 1 x bts (candidates: 1) 05:37:57.319604 tst mo_mt_sms.py: using LAC 26216 05:37:57.437775 tst mo_mt_sms.py: using RAC 206 05:37:57.557432 tst mo_mt_sms.py: using CellId 26216 05:37:57.684491 tst mo_mt_sms.py: using BVCI 26217 05:37:57.803432 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 05:37:57.916306 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 05:37:58.034882 tst mo_mt_sms.py:9: start nitb and bts... 05:37:58.251116 run osmo-nitb_10.42.42.2: Starting osmo-nitb 05:37:58.907858 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31349): Launched 05:37:59.233422 run osmo-nitb_10.42.42.2(pid=31350): Launched 05:37:59.410752 run osmo-nitb_10.42.42.2(pid=31350): ERR: Terminated: ERROR {rc=2} [trial-2370↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31350)] 05:37:59.554849 run osmo-nitb_10.42.42.2(pid=31350): stdout: | (launched: 2022-12-10_05:37:59.172654) 05:37:59.700824 run osmo-nitb_10.42.42.2(pid=31350): stderr: | (launched: 2022-12-10_05:37:59.220353) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 05:37:59.847179 run osmo-nitb_10.42.42.2(pid=31350): stdout: | (launched: 2022-12-10_05:37:59.172654) 05:37:59.986538 run osmo-nitb_10.42.42.2(pid=31350): stderr: | (launched: 2022-12-10_05:37:59.220353) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=31350): Process ended prematurely: osmo-nitb_10.42.42.2(pid=31350) [trial-2370↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31350)] 05:38:00.354433 tst osmo-nitb_10.42.42.2(pid=31350): stdout: | (launched: 2022-12-10_05:37:59.172654) 05:38:00.484440 tst osmo-nitb_10.42.42.2(pid=31350): stderr: | (launched: 2022-12-10_05:37:59.220353) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 05:38:00.638162 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=31350): Process ended prematurely: osmo-nitb_10.42.42.2(pid=31350) [trial-2370↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31350)] [trial-2370↪nitb_sms:oc2g↪mo_mt_sms.py:11] 05:38:00.647370 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 05:38:00.654629 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31349): Terminating (SIGTERM) 05:38:00.864516 --- ParallelTerminationStrategy: PID 31349 died... 05:38:00.896924 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31349): Terminated: ok {rc=0} 05:38:00.985952 bus /sierra_3: Setting Powered False 05:38:02.093992 bus /sierra_3: Setting Powered False 05:38:03.222271 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 nitb_sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 sms:oc2g --------------------------------------------------------------------- 05:38:04.403434 tst sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:38:04.407992 tst sms:oc2g: Verifying 1 x bts (candidates: 11) 05:38:04.429456 tst sms:oc2g: Verifying 6 x ip_address (candidates: 9) 05:38:04.457384 tst sms:oc2g: Verifying 2 x modem (candidates: 12) 05:38:04.511961 tst sms:oc2g: Reserving 1 x bts (candidates: 11) 05:38:04.533300 tst sms:oc2g: Reserving 6 x ip_address (candidates: 9) 05:38:04.560294 tst sms:oc2g: Reserving 2 x modem (candidates: 12) 05:38:05.105664 tst sms:oc2g: RESERVED RESOURCES for sms: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 sms:oc2g mo_mt_sms.py ---------------------------------------------- 05:38:05.110792 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 05:38:05.121793 tst sms:oc2g: Using 1 x bts (candidates: 1) 05:38:05.155665 tst mo_mt_sms.py: using LAC 26217 05:38:05.275458 tst mo_mt_sms.py: using RAC 207 05:38:05.392783 tst mo_mt_sms.py: using CellId 26217 05:38:05.510907 tst mo_mt_sms.py: using BVCI 26218 05:38:05.621763 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 05:38:05.632441 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 05:38:05.643095 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 05:38:05.654100 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 05:38:05.665386 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 05:38:05.676052 tst sms:oc2g: Using 1 x modem (candidates: 2) 05:38:05.794128 tst sms:oc2g: Using 1 x modem (candidates: 2) 05:38:05.914529 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:38:06.413990 run create_hlr_db(pid=31354): Launched 05:38:06.543894 bus /sierra_2: Setting Powered False 05:38:07.607034 run create_hlr_db(pid=31354): Terminated: ok {rc=0} 05:38:08.056732 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31356): Launched 05:38:08.379382 run osmo-hlr_10.42.42.2(pid=31357): Launched 05:38:08.500612 run osmo-stp_10.42.42.5: Starting osmo-stp 05:38:09.057562 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31359): Launched 05:38:09.379543 run osmo-stp_10.42.42.5(pid=31360): Launched 05:38:09.501394 run osmo-msc_10.42.42.6: Starting osmo-msc 05:38:10.084369 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31362): Launched 05:38:10.409922 run osmo-msc_10.42.42.6(pid=31363): Launched 05:38:10.590449 run osmo-stp_10.42.42.5(pid=31360): ERR: Terminated: ERROR {rc=1} [trial-2370↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31360)] 05:38:10.724815 run osmo-stp_10.42.42.5(pid=31360): stdout: | (launched: 2022-12-10_05:38:09.318751) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:38:10.860003 run osmo-stp_10.42.42.5(pid=31360): stderr: | 20221210053809515 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053809515 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053809515 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053809515 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053809516 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053809516 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053809516 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:38:10.994375 run osmo-stp_10.42.42.5(pid=31360): stdout: | (launched: 2022-12-10_05:38:09.318751) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:38:11.121211 run osmo-stp_10.42.42.5(pid=31360): stderr: | 20221210053809515 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053809515 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053809515 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053809515 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053809516 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053809516 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053809516 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:38:11.273207 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=31360): Process ended prematurely: osmo-stp_10.42.42.5(pid=31360) [trial-2370↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31360)] [trial-2370↪sms:oc2g↪mo_mt_sms.py:16] 05:38:11.282269 tst mo_mt_sms.py:16: Test FAILED (6.2 sec) 05:38:11.309409 run osmo-hlr_10.42.42.2(pid=31357): ERR: Terminated: ERROR {rc=237} [trial-2370↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31357)] 05:38:11.358725 run osmo-hlr_10.42.42.2(pid=31357): stdout: | (launched: 2022-12-10_05:38:08.318543) 05:38:11.409848 run osmo-hlr_10.42.42.2(pid=31357): stderr: | 20221210053808519 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210053808519 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210053808519 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210053808519 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210053808519 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210053808519 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210053808532 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/sms:oc2g/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210053808540 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210053808540 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210053808540 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:38:11.481422 run osmo-msc_10.42.42.6(pid=31363): ERR: Terminated: ERROR {rc=2} [trial-2370↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31363)] 05:38:11.530999 run osmo-msc_10.42.42.6(pid=31363): stdout: | (launched: 2022-12-10_05:38:10.348549) 05:38:11.582266 run osmo-msc_10.42.42.6(pid=31363): stderr: | 20221210053810674 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210053810674 DLGLOBAL DEBUG validating counter group 0x7f0b2a4e4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210053810674 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210053810674 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210053810674 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210053810675 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210053810676 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210053810677 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210053810677 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210053810677 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:38:11.634138 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31356): Terminating (SIGTERM) 05:38:11.675560 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31359): Terminating (SIGTERM) 05:38:11.716783 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31362): Terminating (SIGTERM) 05:38:11.758870 --- ParallelTerminationStrategy: PID 31356 died... 05:38:11.778878 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31356): Terminated: ok {rc=0} 05:38:11.825103 --- ParallelTerminationStrategy: PID 31359 died... 05:38:11.844932 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31359): Terminated: ok {rc=0} 05:38:11.891773 --- ParallelTerminationStrategy: PID 31362 died... 05:38:11.911290 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31362): Terminated: ok {rc=0} 05:38:11.999108 bus /sierra_3: Setting Powered False 05:38:13.096089 bus /sierra_3: Setting Powered False 05:38:14.213040 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 nitb_ussd:oc2g --------------------------------------------------------------------- 05:38:15.427869 tst nitb_ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:38:15.432046 tst nitb_ussd:oc2g: Verifying 1 x bts (candidates: 11) 05:38:15.453221 tst nitb_ussd:oc2g: Verifying 1 x ip_address (candidates: 9) 05:38:15.460328 tst nitb_ussd:oc2g: Verifying 1 x modem (candidates: 12) 05:38:15.497582 tst nitb_ussd:oc2g: Reserving 1 x bts (candidates: 11) 05:38:15.518975 tst nitb_ussd:oc2g: Reserving 1 x ip_address (candidates: 9) 05:38:15.526374 tst nitb_ussd:oc2g: Reserving 1 x modem (candidates: 12) 05:38:16.050475 tst nitb_ussd:oc2g: RESERVED RESOURCES for nitb_ussd: bts OC-2G ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2370 nitb_ussd:oc2g assert_extension.py ---------------------------------------------- 05:38:16.058002 tst nitb_ussd:oc2g: Using 1 x ip_address (candidates: 1) 05:38:16.078195 tst nitb_ussd:oc2g: Using 1 x bts (candidates: 1) 05:38:16.124239 tst assert_extension.py: using LAC 26218 05:38:16.304141 tst assert_extension.py: using RAC 208 05:38:16.456156 tst assert_extension.py: using CellId 26218 05:38:16.595649 tst assert_extension.py: using BVCI 26219 05:38:16.728267 tst nitb_ussd:oc2g: Using 1 x modem (candidates: 1) 05:38:16.847545 tst assert_extension.py:10: start nitb and bts... 05:38:17.095823 run osmo-nitb_10.42.42.2: Starting osmo-nitb 05:38:17.789790 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31441): Launched 05:38:18.133809 run osmo-nitb_10.42.42.2(pid=31451): Launched 05:38:18.359946 run osmo-nitb_10.42.42.2(pid=31451): ERR: Terminated: ERROR {rc=2} [trial-2370↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31451)] 05:38:18.508743 run osmo-nitb_10.42.42.2(pid=31451): stdout: | (launched: 2022-12-10_05:38:18.066958) 05:38:18.679118 run osmo-nitb_10.42.42.2(pid=31451): stderr: | (launched: 2022-12-10_05:38:18.115821) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 05:38:18.855263 run osmo-nitb_10.42.42.2(pid=31451): stdout: | (launched: 2022-12-10_05:38:18.066958) 05:38:19.015451 run osmo-nitb_10.42.42.2(pid=31451): stderr: | (launched: 2022-12-10_05:38:18.115821) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=31451): Process ended prematurely: osmo-nitb_10.42.42.2(pid=31451) [trial-2370↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31451)] 05:38:19.293811 tst osmo-nitb_10.42.42.2(pid=31451): stdout: | (launched: 2022-12-10_05:38:18.066958) 05:38:19.447727 tst osmo-nitb_10.42.42.2(pid=31451): stderr: | (launched: 2022-12-10_05:38:18.115821) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 05:38:19.611264 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=31451): Process ended prematurely: osmo-nitb_10.42.42.2(pid=31451) [trial-2370↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31451)] [trial-2370↪nitb_ussd:oc2g↪assert_extension.py:12] 05:38:19.620899 tst assert_extension.py:12: Test FAILED (3.6 sec) 05:38:19.628739 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31441): Terminating (SIGTERM) 05:38:19.843474 --- ParallelTerminationStrategy: PID 31441 died... 05:38:19.865317 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31441): Terminated: ok {rc=0} 05:38:19.953709 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 nitb_ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 ussd:oc2g --------------------------------------------------------------------- 05:38:21.117910 tst ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:38:21.122884 tst ussd:oc2g: Verifying 1 x bts (candidates: 11) 05:38:21.145578 tst ussd:oc2g: Verifying 6 x ip_address (candidates: 9) 05:38:21.176772 tst ussd:oc2g: Verifying 1 x modem (candidates: 12) 05:38:21.211845 tst ussd:oc2g: Reserving 1 x bts (candidates: 11) 05:38:21.234111 tst ussd:oc2g: Reserving 6 x ip_address (candidates: 9) 05:38:21.264883 tst ussd:oc2g: Reserving 1 x modem (candidates: 12) 05:38:21.784226 tst ussd:oc2g: RESERVED RESOURCES for ussd: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2370 ussd:oc2g assert_extension.py ---------------------------------------------- 05:38:21.790844 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 05:38:21.802571 tst ussd:oc2g: Using 1 x bts (candidates: 1) 05:38:21.840390 tst assert_extension.py: using LAC 26219 05:38:21.960619 tst assert_extension.py: using RAC 209 05:38:22.082931 tst assert_extension.py: using CellId 26219 05:38:22.207684 tst assert_extension.py: using BVCI 26220 05:38:22.320112 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 05:38:22.331744 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 05:38:22.343204 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 05:38:22.357039 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 05:38:22.369571 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 05:38:22.381128 tst ussd:oc2g: Using 1 x modem (candidates: 1) 05:38:22.500226 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:38:22.980438 run create_hlr_db(pid=31644): Launched 05:38:23.139233 bus /sierra_2: Setting Powered False 05:38:24.199504 run create_hlr_db(pid=31644): Terminated: ok {rc=0} 05:38:24.638435 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31646): Launched 05:38:24.979158 run osmo-hlr_10.42.42.2(pid=31647): Launched 05:38:25.220591 run osmo-stp_10.42.42.5: Starting osmo-stp 05:38:25.899306 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31649): Launched 05:38:26.228456 run osmo-stp_10.42.42.5(pid=31650): Launched 05:38:26.463756 run osmo-msc_10.42.42.6: Starting osmo-msc 05:38:27.194049 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31652): Launched 05:38:27.520881 run osmo-msc_10.42.42.6(pid=31653): Launched 05:38:27.869393 run osmo-stp_10.42.42.5(pid=31650): ERR: Terminated: ERROR {rc=1} [trial-2370↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31650)] 05:38:28.136051 run osmo-stp_10.42.42.5(pid=31650): stdout: | (launched: 2022-12-10_05:38:26.166427) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:38:28.409413 run osmo-stp_10.42.42.5(pid=31650): stderr: | 20221210053826500 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053826509 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053826509 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053826510 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053826510 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053826510 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053826510 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:38:28.604515 run osmo-stp_10.42.42.5(pid=31650): stdout: | (launched: 2022-12-10_05:38:26.166427) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:38:28.728667 run osmo-stp_10.42.42.5(pid=31650): stderr: | 20221210053826500 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053826509 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053826509 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053826510 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053826510 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053826510 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053826510 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:38:28.878398 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=31650): Process ended prematurely: osmo-stp_10.42.42.5(pid=31650) [trial-2370↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31650)] [trial-2370↪ussd:oc2g↪assert_extension.py:17] 05:38:28.887789 tst assert_extension.py:17: Test FAILED (7.1 sec) 05:38:28.917551 run osmo-hlr_10.42.42.2(pid=31647): ERR: Terminated: ERROR {rc=237} [trial-2370↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31647)] 05:38:28.968122 run osmo-hlr_10.42.42.2(pid=31647): stdout: | (launched: 2022-12-10_05:38:24.915391) 05:38:29.019951 run osmo-hlr_10.42.42.2(pid=31647): stderr: | 20221210053825234 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210053825234 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210053825234 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210053825234 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210053825234 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210053825234 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210053825251 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/ussd:oc2g/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210053825267 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210053825268 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210053825268 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:38:29.093200 run osmo-msc_10.42.42.6(pid=31653): ERR: Terminated: ERROR {rc=2} [trial-2370↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31653)] 05:38:29.143519 run osmo-msc_10.42.42.6(pid=31653): stdout: | (launched: 2022-12-10_05:38:27.459820) 05:38:29.195338 run osmo-msc_10.42.42.6(pid=31653): stderr: | 20221210053828062 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210053828062 DLGLOBAL DEBUG validating counter group 0x7f9e2b7c4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210053828062 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210053828063 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210053828063 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210053828063 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210053828073 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210053828073 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210053828073 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210053828073 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:38:29.248498 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31646): Terminating (SIGTERM) 05:38:29.292188 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31649): Terminating (SIGTERM) 05:38:29.336348 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31652): Terminating (SIGTERM) 05:38:29.381705 --- ParallelTerminationStrategy: PID 31646 died... 05:38:29.401568 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31646): Terminated: ok {rc=0} 05:38:29.450682 --- ParallelTerminationStrategy: PID 31649 died... 05:38:29.471448 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31649): Terminated: ok {rc=0} 05:38:29.518961 --- ParallelTerminationStrategy: PID 31652 died... 05:38:29.539213 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31652): Terminated: ok {rc=0} 05:38:29.628693 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 05:38:30.829062 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:38:30.836222 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 05:38:30.862140 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 05:38:30.892640 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 05:38:30.954573 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 05:38:30.996806 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 05:38:31.045993 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 05:38:31.586204 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 05:38:31.641287 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:38:31.653367 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 05:38:31.716157 tst mo_mt_call.py: using LAC 26220 05:38:31.882678 tst mo_mt_call.py: using RAC 210 05:38:32.028181 tst mo_mt_call.py: using CellId 26220 05:38:32.173513 tst mo_mt_call.py: using BVCI 26221 05:38:32.322150 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:38:32.338721 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:38:32.354655 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:38:32.371475 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:38:32.386548 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:38:32.402350 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 05:38:32.574299 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 05:38:32.716793 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:38:33.255944 run create_hlr_db(pid=31658): Launched 05:38:33.428122 bus /sierra_2: Setting Powered False 05:38:34.494985 run create_hlr_db(pid=31658): Terminated: ok {rc=0} 05:38:34.968008 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31660): Launched 05:38:35.320758 run osmo-hlr_10.42.42.2(pid=31661): Launched 05:38:35.577569 run osmo-stp_10.42.42.5: Starting osmo-stp 05:38:36.266983 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31663): Launched 05:38:36.618607 run osmo-stp_10.42.42.5(pid=31664): Launched 05:38:36.876938 run osmo-msc_10.42.42.6: Starting osmo-msc 05:38:37.571968 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31666): Launched 05:38:37.925239 run osmo-msc_10.42.42.6(pid=31667): Launched 05:38:38.301292 run osmo-stp_10.42.42.5(pid=31664): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31664)] 05:38:38.588468 run osmo-stp_10.42.42.5(pid=31664): stdout: | (launched: 2022-12-10_05:38:36.553687) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:38:38.765622 run osmo-stp_10.42.42.5(pid=31664): stderr: | 20221210053836859 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053836860 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053836860 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053836860 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053836869 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053836869 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053836869 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:38:38.907774 run osmo-stp_10.42.42.5(pid=31664): stdout: | (launched: 2022-12-10_05:38:36.553687) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:38:39.041545 run osmo-stp_10.42.42.5(pid=31664): stderr: | 20221210053836859 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053836860 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053836860 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053836860 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053836869 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053836869 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053836869 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:38:39.203599 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31664): Process ended prematurely: osmo-stp_10.42.42.5(pid=31664) [trial-2370↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31664)] [trial-2370↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 05:38:39.214672 tst mo_mt_call.py:8: Test FAILED (7.6 sec) 05:38:39.244633 run osmo-hlr_10.42.42.2(pid=31661): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31661)] 05:38:39.297790 run osmo-hlr_10.42.42.2(pid=31661): stdout: | (launched: 2022-12-10_05:38:35.255784) 05:38:39.351557 run osmo-hlr_10.42.42.2(pid=31661): stderr: | 20221210053835571 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210053835571 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210053835571 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210053835571 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210053835571 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210053835571 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210053835590 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210053835610 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210053835610 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210053835610 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:38:39.425798 run osmo-msc_10.42.42.6(pid=31667): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31667)] 05:38:39.479201 run osmo-msc_10.42.42.6(pid=31667): stdout: | (launched: 2022-12-10_05:38:37.859795) 05:38:39.532748 run osmo-msc_10.42.42.6(pid=31667): stderr: | 20221210053838382 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210053838382 DLGLOBAL DEBUG validating counter group 0x7f3bcd698c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210053838382 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210053838383 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210053838383 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210053838383 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210053838386 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210053838387 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210053838387 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210053838387 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:38:39.587608 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31660): Terminating (SIGTERM) 05:38:39.631552 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31663): Terminating (SIGTERM) 05:38:39.678174 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31666): Terminating (SIGTERM) 05:38:39.724178 --- ParallelTerminationStrategy: PID 31660 died... 05:38:39.745061 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31660): Terminated: ok {rc=0} 05:38:39.794089 --- ParallelTerminationStrategy: PID 31663 died... 05:38:39.814414 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31663): Terminated: ok {rc=0} 05:38:39.861595 --- ParallelTerminationStrategy: PID 31666 died... 05:38:39.882696 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31666): Terminated: ok {rc=0} 05:38:39.972225 bus /sierra_3: Setting Powered False 05:38:41.071265 bus /sierra_3: Setting Powered False 05:38:42.187556 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2370 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 05:38:43.333593 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:38:43.345442 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 05:38:43.401763 tst mo_mt_call_osmux.py: using LAC 26221 05:38:43.523897 tst mo_mt_call_osmux.py: using RAC 211 05:38:43.646214 tst mo_mt_call_osmux.py: using CellId 26221 05:38:43.766646 tst mo_mt_call_osmux.py: using BVCI 26222 05:38:43.879142 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:38:43.890220 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:38:43.901218 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:38:43.912319 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:38:43.923310 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:38:43.934443 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 05:38:44.051237 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 05:38:44.172723 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:38:44.681970 run create_hlr_db(pid=31670): Launched 05:38:44.815338 bus /sierra_2: Setting Powered False 05:38:45.885158 run create_hlr_db(pid=31670): Terminated: ok {rc=0} 05:38:46.351203 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31672): Launched 05:38:46.698566 run osmo-hlr_10.42.42.2(pid=31673): Launched 05:38:46.953387 run osmo-stp_10.42.42.5: Starting osmo-stp 05:38:47.592370 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31675): Launched 05:38:47.921374 run osmo-stp_10.42.42.5(pid=31676): Launched 05:38:48.045711 run osmo-msc_10.42.42.6: Starting osmo-msc 05:38:48.639624 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31678): Launched 05:38:48.967797 run osmo-msc_10.42.42.6(pid=31679): Launched 05:38:49.149209 run osmo-stp_10.42.42.5(pid=31676): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31676)] 05:38:49.286556 run osmo-stp_10.42.42.5(pid=31676): stdout: | (launched: 2022-12-10_05:38:47.859799) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:38:49.424598 run osmo-stp_10.42.42.5(pid=31676): stderr: | 20221210053848056 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053848056 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053848056 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053848057 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053848057 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053848057 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053848057 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:38:49.561992 run osmo-stp_10.42.42.5(pid=31676): stdout: | (launched: 2022-12-10_05:38:47.859799) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:38:49.691809 run osmo-stp_10.42.42.5(pid=31676): stderr: | 20221210053848056 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053848056 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053848056 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053848057 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053848057 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053848057 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053848057 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:38:49.847091 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31676): Process ended prematurely: osmo-stp_10.42.42.5(pid=31676) [trial-2370↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31676)] [trial-2370↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 05:38:49.856506 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 05:38:49.884318 run osmo-hlr_10.42.42.2(pid=31673): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31673)] 05:38:49.934275 run osmo-hlr_10.42.42.2(pid=31673): stdout: | (launched: 2022-12-10_05:38:46.634254) 05:38:49.985776 run osmo-hlr_10.42.42.2(pid=31673): stderr: | 20221210053846950 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210053846950 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210053846950 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210053846951 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210053846951 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210053846951 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210053846967 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210053846975 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210053846976 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210053846976 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:38:50.057359 run osmo-msc_10.42.42.6(pid=31679): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31679)] 05:38:50.107195 run osmo-msc_10.42.42.6(pid=31679): stdout: | (launched: 2022-12-10_05:38:48.906271) 05:38:50.158811 run osmo-msc_10.42.42.6(pid=31679): stderr: | 20221210053849230 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210053849231 DLGLOBAL DEBUG validating counter group 0x7fb982d2bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210053849231 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210053849231 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210053849231 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210053849231 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210053849233 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210053849233 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210053849233 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210053849233 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:38:50.210477 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31672): Terminating (SIGTERM) 05:38:50.251677 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31675): Terminating (SIGTERM) 05:38:50.292859 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31678): Terminating (SIGTERM) 05:38:50.334743 --- ParallelTerminationStrategy: PID 31672 died... 05:38:50.354590 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31672): Terminated: ok {rc=0} 05:38:50.400470 --- ParallelTerminationStrategy: PID 31675 died... 05:38:50.419918 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31675): Terminated: ok {rc=0} 05:38:50.465657 --- ParallelTerminationStrategy: PID 31678 died... 05:38:50.485203 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31678): Terminated: ok {rc=0} 05:38:50.572777 bus /sierra_3: Setting Powered False 05:38:51.671937 bus /sierra_3: Setting Powered False 05:38:52.786430 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 05:38:54.019378 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:38:54.026616 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 05:38:54.047779 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 05:38:54.075159 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 05:38:54.126941 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 05:38:54.148199 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 05:38:54.175828 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 05:38:54.728012 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 05:38:54.779968 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:38:54.791573 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 05:38:54.847600 tst mo_mt_call.py: using LAC 26222 05:38:54.975912 tst mo_mt_call.py: using RAC 212 05:38:55.102798 tst mo_mt_call.py: using CellId 26222 05:38:55.230872 tst mo_mt_call.py: using BVCI 26223 05:38:55.349467 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:38:55.361134 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:38:55.372555 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:38:55.383911 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:38:55.395258 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:38:55.406914 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 05:38:55.524247 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 05:38:55.644778 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:38:56.152856 run create_hlr_db(pid=31685): Launched 05:38:56.285260 bus /sierra_2: Setting Powered False 05:38:57.349337 run create_hlr_db(pid=31685): Terminated: ok {rc=0} 05:38:57.806646 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31687): Launched 05:38:58.135960 run osmo-hlr_10.42.42.2(pid=31688): Launched 05:38:58.261069 run osmo-stp_10.42.42.5: Starting osmo-stp 05:38:58.823502 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31690): Launched 05:38:59.151534 run osmo-stp_10.42.42.5(pid=31691): Launched 05:38:59.275388 run osmo-msc_10.42.42.6: Starting osmo-msc 05:38:59.867833 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31693): Launched 05:39:00.197061 run osmo-msc_10.42.42.6(pid=31694): Launched 05:39:00.379542 run osmo-stp_10.42.42.5(pid=31691): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31691)] 05:39:00.521691 run osmo-stp_10.42.42.5(pid=31691): stdout: | (launched: 2022-12-10_05:38:59.089844) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:39:00.660402 run osmo-stp_10.42.42.5(pid=31691): stderr: | 20221210053859285 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053859285 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053859285 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053859286 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053859286 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053859286 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053859286 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:39:00.797660 run osmo-stp_10.42.42.5(pid=31691): stdout: | (launched: 2022-12-10_05:38:59.089844) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:39:00.953886 run osmo-stp_10.42.42.5(pid=31691): stderr: | 20221210053859285 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053859285 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053859285 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053859286 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053859286 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053859286 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053859286 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:39:01.111788 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31691): Process ended prematurely: osmo-stp_10.42.42.5(pid=31691) [trial-2370↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31691)] [trial-2370↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 05:39:01.122463 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 05:39:01.151366 run osmo-hlr_10.42.42.2(pid=31688): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31688)] 05:39:01.202604 run osmo-hlr_10.42.42.2(pid=31688): stdout: | (launched: 2022-12-10_05:38:58.074192) 05:39:01.255067 run osmo-hlr_10.42.42.2(pid=31688): stderr: | 20221210053858276 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210053858276 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210053858276 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210053858276 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210053858276 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210053858276 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210053858289 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210053858297 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210053858297 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210053858297 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:39:01.328306 run osmo-msc_10.42.42.6(pid=31694): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31694)] 05:39:01.379281 run osmo-msc_10.42.42.6(pid=31694): stdout: | (launched: 2022-12-10_05:39:00.135125) 05:39:01.431313 run osmo-msc_10.42.42.6(pid=31694): stderr: | 20221210053900460 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210053900460 DLGLOBAL DEBUG validating counter group 0x7fde1d252c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210053900460 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210053900460 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210053900460 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210053900461 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210053900462 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210053900464 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210053900464 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210053900464 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:39:01.484246 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31687): Terminating (SIGTERM) 05:39:01.526629 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31690): Terminating (SIGTERM) 05:39:01.569214 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31693): Terminating (SIGTERM) 05:39:01.614023 --- ParallelTerminationStrategy: PID 31687 died... 05:39:01.634635 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31687): Terminated: ok {rc=0} 05:39:01.682738 --- ParallelTerminationStrategy: PID 31690 died... 05:39:01.702561 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31690): Terminated: ok {rc=0} 05:39:01.748624 --- ParallelTerminationStrategy: PID 31693 died... 05:39:01.768576 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31693): Terminated: ok {rc=0} 05:39:01.856881 bus /sierra_3: Setting Powered False 05:39:02.956293 bus /sierra_3: Setting Powered False 05:39:04.071566 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2370 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 05:39:05.214190 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:39:05.226000 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 05:39:05.283047 tst mo_mt_call_osmux.py: using LAC 26223 05:39:05.405552 tst mo_mt_call_osmux.py: using RAC 213 05:39:05.536312 tst mo_mt_call_osmux.py: using CellId 26223 05:39:05.665318 tst mo_mt_call_osmux.py: using BVCI 26224 05:39:05.784744 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:39:05.796424 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:39:05.808132 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:39:05.820079 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:39:05.832018 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:39:05.843914 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 05:39:05.961942 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 05:39:06.084369 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:39:06.564396 run create_hlr_db(pid=31697): Launched 05:39:06.682057 bus /sierra_2: Setting Powered False 05:39:07.743223 run create_hlr_db(pid=31697): Terminated: ok {rc=0} 05:39:08.192009 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31699): Launched 05:39:08.523914 run osmo-hlr_10.42.42.2(pid=31700): Launched 05:39:08.649368 run osmo-stp_10.42.42.5: Starting osmo-stp 05:39:09.221995 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31702): Launched 05:39:09.552007 run osmo-stp_10.42.42.5(pid=31703): Launched 05:39:09.677822 run osmo-msc_10.42.42.6: Starting osmo-msc 05:39:10.272653 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31705): Launched 05:39:10.603052 run osmo-msc_10.42.42.6(pid=31706): Launched 05:39:10.786990 run osmo-stp_10.42.42.5(pid=31703): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31703)] 05:39:10.925122 run osmo-stp_10.42.42.5(pid=31703): stdout: | (launched: 2022-12-10_05:39:09.489925) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:39:11.063488 run osmo-stp_10.42.42.5(pid=31703): stderr: | 20221210053909685 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053909685 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053909685 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053909685 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053909688 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053909688 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053909688 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:39:11.201206 run osmo-stp_10.42.42.5(pid=31703): stdout: | (launched: 2022-12-10_05:39:09.489925) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:39:11.330780 run osmo-stp_10.42.42.5(pid=31703): stderr: | 20221210053909685 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053909685 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053909685 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053909685 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053909688 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053909688 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053909688 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:39:11.486142 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31703): Process ended prematurely: osmo-stp_10.42.42.5(pid=31703) [trial-2370↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31703)] [trial-2370↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 05:39:11.495736 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 05:39:11.523467 run osmo-hlr_10.42.42.2(pid=31700): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31700)] 05:39:11.573100 run osmo-hlr_10.42.42.2(pid=31700): stdout: | (launched: 2022-12-10_05:39:08.462254) 05:39:11.624485 run osmo-hlr_10.42.42.2(pid=31700): stderr: | 20221210053908662 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210053908662 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210053908662 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210053908662 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210053908662 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210053908662 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210053908676 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210053908686 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210053908686 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210053908686 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:39:11.696266 run osmo-msc_10.42.42.6(pid=31706): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31706)] 05:39:11.745792 run osmo-msc_10.42.42.6(pid=31706): stdout: | (launched: 2022-12-10_05:39:10.541226) 05:39:11.797076 run osmo-msc_10.42.42.6(pid=31706): stderr: | 20221210053910868 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210053910868 DLGLOBAL DEBUG validating counter group 0x7f38ae0f4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210053910868 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210053910868 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210053910868 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210053910869 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210053910871 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210053910871 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210053910871 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210053910871 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:39:11.848271 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31699): Terminating (SIGTERM) 05:39:11.889428 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31702): Terminating (SIGTERM) 05:39:11.930347 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31705): Terminating (SIGTERM) 05:39:11.971450 --- ParallelTerminationStrategy: PID 31699 died... 05:39:11.991165 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31699): Terminated: ok {rc=0} 05:39:12.036482 --- ParallelTerminationStrategy: PID 31702 died... 05:39:12.055653 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31702): Terminated: ok {rc=0} 05:39:12.101416 --- ParallelTerminationStrategy: PID 31705 died... 05:39:12.120449 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31705): Terminated: ok {rc=0} 05:39:12.207604 bus /sierra_3: Setting Powered False 05:39:13.307979 bus /sierra_3: Setting Powered False 05:39:14.423981 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 05:39:15.661707 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:39:15.669244 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 05:39:15.691342 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 05:39:15.719635 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 05:39:15.771541 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 05:39:15.792737 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 05:39:15.820926 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 05:39:16.397274 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 05:39:16.454557 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:39:16.466719 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 05:39:16.528106 tst mo_mt_call.py: using LAC 26224 05:39:16.694565 tst mo_mt_call.py: using RAC 214 05:39:16.854493 tst mo_mt_call.py: using CellId 26224 05:39:16.977538 tst mo_mt_call.py: using BVCI 26225 05:39:17.096535 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:39:17.110419 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:39:17.126275 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:39:17.142075 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:39:17.158434 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:39:17.174021 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 05:39:17.310514 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 05:39:17.435962 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:39:17.947721 run create_hlr_db(pid=31712): Launched 05:39:18.080706 bus /sierra_2: Setting Powered False 05:39:19.145271 run create_hlr_db(pid=31712): Terminated: ok {rc=0} 05:39:19.582840 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31714): Launched 05:39:19.891916 run osmo-hlr_10.42.42.2(pid=31715): Launched 05:39:20.007970 run osmo-stp_10.42.42.5: Starting osmo-stp 05:39:20.554387 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31717): Launched 05:39:20.862597 run osmo-stp_10.42.42.5(pid=31718): Launched 05:39:20.978873 run osmo-msc_10.42.42.6: Starting osmo-msc 05:39:21.535197 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31720): Launched 05:39:21.843798 run osmo-msc_10.42.42.6(pid=31721): Launched 05:39:22.015402 run osmo-stp_10.42.42.5(pid=31718): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31718)] 05:39:22.146316 run osmo-stp_10.42.42.5(pid=31718): stdout: | (launched: 2022-12-10_05:39:20.804053) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:39:22.276373 run osmo-stp_10.42.42.5(pid=31718): stderr: | 20221210053920976 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053920976 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053920976 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053920977 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053920977 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053920977 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053920977 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:39:22.404785 run osmo-stp_10.42.42.5(pid=31718): stdout: | (launched: 2022-12-10_05:39:20.804053) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:39:22.526736 run osmo-stp_10.42.42.5(pid=31718): stderr: | 20221210053920976 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053920976 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053920976 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053920977 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053920977 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053920977 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053920977 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:39:22.672655 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31718): Process ended prematurely: osmo-stp_10.42.42.5(pid=31718) [trial-2370↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31718)] [trial-2370↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 05:39:22.681882 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 05:39:22.708999 run osmo-hlr_10.42.42.2(pid=31715): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31715)] 05:39:22.756888 run osmo-hlr_10.42.42.2(pid=31715): stdout: | (launched: 2022-12-10_05:39:19.833399) 05:39:22.806375 run osmo-hlr_10.42.42.2(pid=31715): stderr: | 20221210053920012 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210053920012 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210053920012 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210053920012 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210053920012 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210053920012 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210053920025 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210053920034 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210053920034 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210053920034 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:39:22.875296 run osmo-msc_10.42.42.6(pid=31721): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31721)] 05:39:22.922969 run osmo-msc_10.42.42.6(pid=31721): stdout: | (launched: 2022-12-10_05:39:21.785147) 05:39:22.972214 run osmo-msc_10.42.42.6(pid=31721): stderr: | 20221210053922060 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210053922061 DLGLOBAL DEBUG validating counter group 0x7f08abc81c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210053922061 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210053922061 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210053922061 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210053922061 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210053922064 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210053922064 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210053922064 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210053922065 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:39:23.022182 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31714): Terminating (SIGTERM) 05:39:23.061848 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31717): Terminating (SIGTERM) 05:39:23.101515 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31720): Terminating (SIGTERM) 05:39:23.141537 --- ParallelTerminationStrategy: PID 31714 died... 05:39:23.160597 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31714): Terminated: ok {rc=0} 05:39:23.205010 --- ParallelTerminationStrategy: PID 31717 died... 05:39:23.224075 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31717): Terminated: ok {rc=0} 05:39:23.268306 --- ParallelTerminationStrategy: PID 31720 died... 05:39:23.286950 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31720): Terminated: ok {rc=0} 05:39:23.372316 bus /sierra_3: Setting Powered False 05:39:24.471451 bus /sierra_3: Setting Powered False 05:39:25.587308 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2370 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 05:39:26.739354 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:39:26.751712 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 05:39:26.809415 tst mo_mt_call_osmux.py: using LAC 26225 05:39:26.937863 tst mo_mt_call_osmux.py: using RAC 215 05:39:27.070418 tst mo_mt_call_osmux.py: using CellId 26225 05:39:27.198509 tst mo_mt_call_osmux.py: using BVCI 26226 05:39:27.317274 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:39:27.329093 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:39:27.340455 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:39:27.352202 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:39:27.363716 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:39:27.375273 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 05:39:27.493222 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 05:39:27.612361 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:39:28.123629 run create_hlr_db(pid=31723): Launched 05:39:28.255893 bus /sierra_2: Setting Powered False 05:39:29.316324 run create_hlr_db(pid=31723): Terminated: ok {rc=0} 05:39:29.777304 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31725): Launched 05:39:30.106711 run osmo-hlr_10.42.42.2(pid=31726): Launched 05:39:30.230531 run osmo-stp_10.42.42.5: Starting osmo-stp 05:39:30.800259 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31728): Launched 05:39:31.159543 run osmo-stp_10.42.42.5(pid=31729): Launched 05:39:31.406397 run osmo-msc_10.42.42.6: Starting osmo-msc 05:39:32.047225 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31731): Launched 05:39:32.362519 run osmo-msc_10.42.42.6(pid=31732): Launched 05:39:32.534542 run osmo-stp_10.42.42.5(pid=31729): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31729)] 05:39:32.664572 run osmo-stp_10.42.42.5(pid=31729): stdout: | (launched: 2022-12-10_05:39:31.093692) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:39:32.797648 run osmo-stp_10.42.42.5(pid=31729): stderr: | 20221210053931383 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053931383 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053931383 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053931384 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053931384 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053931384 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053931384 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:39:32.925815 run osmo-stp_10.42.42.5(pid=31729): stdout: | (launched: 2022-12-10_05:39:31.093692) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:39:33.048114 run osmo-stp_10.42.42.5(pid=31729): stderr: | 20221210053931383 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053931383 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053931383 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053931384 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053931384 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053931384 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053931384 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:39:33.194201 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31729): Process ended prematurely: osmo-stp_10.42.42.5(pid=31729) [trial-2370↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31729)] [trial-2370↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 05:39:33.203150 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 05:39:33.230382 run osmo-hlr_10.42.42.2(pid=31726): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31726)] 05:39:33.278523 run osmo-hlr_10.42.42.2(pid=31726): stdout: | (launched: 2022-12-10_05:39:30.045224) 05:39:33.328123 run osmo-hlr_10.42.42.2(pid=31726): stderr: | 20221210053930244 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210053930244 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210053930244 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210053930244 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210053930244 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210053930245 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210053930257 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210053930267 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210053930267 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210053930267 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:39:33.396711 run osmo-msc_10.42.42.6(pid=31732): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31732)] 05:39:33.444439 run osmo-msc_10.42.42.6(pid=31732): stdout: | (launched: 2022-12-10_05:39:32.304222) 05:39:33.493855 run osmo-msc_10.42.42.6(pid=31732): stderr: | 20221210053932577 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210053932577 DLGLOBAL DEBUG validating counter group 0x7f90559a9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210053932577 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210053932577 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210053932578 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210053932578 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210053932580 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210053932580 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210053932580 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210053932580 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:39:33.543623 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31725): Terminating (SIGTERM) 05:39:33.583130 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31728): Terminating (SIGTERM) 05:39:33.622863 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31731): Terminating (SIGTERM) 05:39:33.662990 --- ParallelTerminationStrategy: PID 31725 died... 05:39:33.681558 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31725): Terminated: ok {rc=0} 05:39:33.726038 --- ParallelTerminationStrategy: PID 31728 died... 05:39:33.744365 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31728): Terminated: ok {rc=0} 05:39:33.788803 --- ParallelTerminationStrategy: PID 31731 died... 05:39:33.807933 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31731): Terminated: ok {rc=0} 05:39:33.892612 bus /sierra_3: Setting Powered False 05:39:34.993608 bus /sierra_3: Setting Powered False 05:39:36.108909 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 05:39:37.345706 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:39:37.352832 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 05:39:37.375408 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 05:39:37.403416 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 05:39:37.458557 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 05:39:37.480200 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 05:39:37.509510 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 05:39:38.056885 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 05:39:38.110400 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:39:38.122225 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 05:39:38.180681 tst mo_mt_call.py: using LAC 26226 05:39:38.311308 tst mo_mt_call.py: using RAC 216 05:39:38.441802 tst mo_mt_call.py: using CellId 26226 05:39:38.570600 tst mo_mt_call.py: using BVCI 26227 05:39:38.691815 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:39:38.703539 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:39:38.714869 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:39:38.726231 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:39:38.737643 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:39:38.749079 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 05:39:38.867846 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 05:39:38.992242 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:39:39.469643 run create_hlr_db(pid=31737): Launched 05:39:39.587432 bus /sierra_2: Setting Powered False 05:39:40.648095 run create_hlr_db(pid=31737): Terminated: ok {rc=0} 05:39:41.097428 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31739): Launched 05:39:41.426723 run osmo-hlr_10.42.42.2(pid=31740): Launched 05:39:41.551286 run osmo-stp_10.42.42.5: Starting osmo-stp 05:39:42.116683 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31742): Launched 05:39:42.445477 run osmo-stp_10.42.42.5(pid=31743): Launched 05:39:42.571009 run osmo-msc_10.42.42.6: Starting osmo-msc 05:39:43.165172 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31745): Launched 05:39:43.494781 run osmo-msc_10.42.42.6(pid=31746): Launched 05:39:43.677546 run osmo-stp_10.42.42.5(pid=31743): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31743)] 05:39:43.815862 run osmo-stp_10.42.42.5(pid=31743): stdout: | (launched: 2022-12-10_05:39:42.383590) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:39:43.953958 run osmo-stp_10.42.42.5(pid=31743): stderr: | 20221210053942579 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053942579 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053942579 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053942579 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053942580 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053942580 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053942580 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:39:44.091580 run osmo-stp_10.42.42.5(pid=31743): stdout: | (launched: 2022-12-10_05:39:42.383590) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:39:44.221507 run osmo-stp_10.42.42.5(pid=31743): stderr: | 20221210053942579 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053942579 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053942579 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053942579 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053942580 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053942580 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053942580 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:39:44.377326 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31743): Process ended prematurely: osmo-stp_10.42.42.5(pid=31743) [trial-2370↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31743)] [trial-2370↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 05:39:44.387021 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 05:39:44.415135 run osmo-hlr_10.42.42.2(pid=31740): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31740)] 05:39:44.465763 run osmo-hlr_10.42.42.2(pid=31740): stdout: | (launched: 2022-12-10_05:39:41.365151) 05:39:44.517506 run osmo-hlr_10.42.42.2(pid=31740): stderr: | 20221210053941566 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210053941566 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210053941566 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210053941567 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210053941567 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210053941567 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210053941579 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210053941587 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210053941587 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210053941588 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:39:44.590231 run osmo-msc_10.42.42.6(pid=31746): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31746)] 05:39:44.640537 run osmo-msc_10.42.42.6(pid=31746): stdout: | (launched: 2022-12-10_05:39:43.432736) 05:39:44.692260 run osmo-msc_10.42.42.6(pid=31746): stderr: | 20221210053943760 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210053943760 DLGLOBAL DEBUG validating counter group 0x7f051d69cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210053943760 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210053943760 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210053943761 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210053943761 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210053943762 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210053943763 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210053943763 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210053943763 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:39:44.744249 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31739): Terminating (SIGTERM) 05:39:44.785557 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31742): Terminating (SIGTERM) 05:39:44.827043 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31745): Terminating (SIGTERM) 05:39:44.868826 --- ParallelTerminationStrategy: PID 31739 died... 05:39:44.888672 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31739): Terminated: ok {rc=0} 05:39:44.934625 --- ParallelTerminationStrategy: PID 31742 died... 05:39:44.954175 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31742): Terminated: ok {rc=0} 05:39:44.999596 --- ParallelTerminationStrategy: PID 31745 died... 05:39:45.019068 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31745): Terminated: ok {rc=0} 05:39:45.106616 bus /sierra_3: Setting Powered False 05:39:46.205645 bus /sierra_3: Setting Powered False 05:39:47.319812 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2370 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 05:39:48.469558 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:39:48.481766 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 05:39:48.539611 tst mo_mt_call_osmux.py: using LAC 26227 05:39:48.668438 tst mo_mt_call_osmux.py: using RAC 217 05:39:48.797221 tst mo_mt_call_osmux.py: using CellId 26227 05:39:48.924546 tst mo_mt_call_osmux.py: using BVCI 26228 05:39:49.043391 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:39:49.054937 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:39:49.066320 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:39:49.077753 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:39:49.088932 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:39:49.100310 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 05:39:49.215856 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 05:39:49.338056 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:39:49.817162 run create_hlr_db(pid=31748): Launched 05:39:49.934818 bus /sierra_2: Setting Powered False 05:39:50.994587 run create_hlr_db(pid=31748): Terminated: ok {rc=0} 05:39:51.444713 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31750): Launched 05:39:51.776011 run osmo-hlr_10.42.42.2(pid=31751): Launched 05:39:51.900546 run osmo-stp_10.42.42.5: Starting osmo-stp 05:39:52.467279 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31753): Launched 05:39:52.798399 run osmo-stp_10.42.42.5(pid=31754): Launched 05:39:52.923084 run osmo-msc_10.42.42.6: Starting osmo-msc 05:39:53.517894 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31756): Launched 05:39:53.847750 run osmo-msc_10.42.42.6(pid=31757): Launched 05:39:54.030162 run osmo-stp_10.42.42.5(pid=31754): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31754)] 05:39:54.168022 run osmo-stp_10.42.42.5(pid=31754): stdout: | (launched: 2022-12-10_05:39:52.736184) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:39:54.308202 run osmo-stp_10.42.42.5(pid=31754): stderr: | 20221210053952933 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053952933 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053952934 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053952934 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053952934 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053952934 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053952934 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:39:54.445582 run osmo-stp_10.42.42.5(pid=31754): stdout: | (launched: 2022-12-10_05:39:52.736184) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:39:54.575134 run osmo-stp_10.42.42.5(pid=31754): stderr: | 20221210053952933 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210053952933 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210053952934 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210053952934 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210053952934 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210053952934 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210053952934 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:39:54.731599 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31754): Process ended prematurely: osmo-stp_10.42.42.5(pid=31754) [trial-2370↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31754)] [trial-2370↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 05:39:54.741339 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 05:39:54.768935 run osmo-hlr_10.42.42.2(pid=31751): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31751)] 05:39:54.818771 run osmo-hlr_10.42.42.2(pid=31751): stdout: | (launched: 2022-12-10_05:39:51.714098) 05:39:54.870248 run osmo-hlr_10.42.42.2(pid=31751): stderr: | 20221210053951916 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210053951916 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210053951916 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210053951916 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210053951916 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210053951916 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210053951928 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210053951936 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210053951936 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210053951936 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:39:54.942054 run osmo-msc_10.42.42.6(pid=31757): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31757)] 05:39:54.991882 run osmo-msc_10.42.42.6(pid=31757): stdout: | (launched: 2022-12-10_05:39:53.786088) 05:39:55.043245 run osmo-msc_10.42.42.6(pid=31757): stderr: | 20221210053954110 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210053954110 DLGLOBAL DEBUG validating counter group 0x7f053f026c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210053954110 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210053954110 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210053954110 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210053954111 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210053954112 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210053954113 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210053954113 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210053954113 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:39:55.094776 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31750): Terminating (SIGTERM) 05:39:55.136001 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31753): Terminating (SIGTERM) 05:39:55.177347 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31756): Terminating (SIGTERM) 05:39:55.219135 --- ParallelTerminationStrategy: PID 31750 died... 05:39:55.239203 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31750): Terminated: ok {rc=0} 05:39:55.285259 --- ParallelTerminationStrategy: PID 31753 died... 05:39:55.305284 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31753): Terminated: ok {rc=0} 05:39:55.351301 --- ParallelTerminationStrategy: PID 31756 died... 05:39:55.370874 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31756): Terminated: ok {rc=0} 05:39:55.458517 bus /sierra_3: Setting Powered False 05:39:56.557211 bus /sierra_3: Setting Powered False 05:39:57.673751 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 05:39:58.909764 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:39:58.916775 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 05:39:58.938395 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 05:39:58.965866 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 05:39:59.019180 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 05:39:59.040230 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 05:39:59.067506 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 05:39:59.619524 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 05:39:59.671916 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:39:59.683412 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 05:39:59.741313 tst mo_mt_call.py: using LAC 26228 05:39:59.870949 tst mo_mt_call.py: using RAC 218 05:39:59.992319 tst mo_mt_call.py: using CellId 26228 05:40:00.115482 tst mo_mt_call.py: using BVCI 26229 05:40:00.226821 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:40:00.238165 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:40:00.249386 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:40:00.260803 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:40:00.272114 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:40:00.283382 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 05:40:00.398365 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 05:40:00.514051 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:40:01.002221 run create_hlr_db(pid=31762): Launched 05:40:01.132131 bus /sierra_2: Setting Powered False 05:40:02.195897 run create_hlr_db(pid=31762): Terminated: ok {rc=0} 05:40:02.657803 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31767): Launched 05:40:02.990375 run osmo-hlr_10.42.42.2(pid=31768): Launched 05:40:03.115336 run osmo-stp_10.42.42.5: Starting osmo-stp 05:40:03.687237 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31770): Launched 05:40:04.016501 run osmo-stp_10.42.42.5(pid=31771): Launched 05:40:04.141980 run osmo-msc_10.42.42.6: Starting osmo-msc 05:40:04.738534 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31773): Launched 05:40:05.068562 run osmo-msc_10.42.42.6(pid=31774): Launched 05:40:05.251726 run osmo-stp_10.42.42.5(pid=31771): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31771)] 05:40:05.390822 run osmo-stp_10.42.42.5(pid=31771): stdout: | (launched: 2022-12-10_05:40:03.954685) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:40:05.530495 run osmo-stp_10.42.42.5(pid=31771): stderr: | 20221210054004151 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054004152 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054004152 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054004152 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054004153 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054004153 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054004153 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:40:05.668405 run osmo-stp_10.42.42.5(pid=31771): stdout: | (launched: 2022-12-10_05:40:03.954685) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:40:05.798800 run osmo-stp_10.42.42.5(pid=31771): stderr: | 20221210054004151 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054004152 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054004152 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054004152 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054004153 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054004153 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054004153 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:40:05.954705 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31771): Process ended prematurely: osmo-stp_10.42.42.5(pid=31771) [trial-2370↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31771)] [trial-2370↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 05:40:05.964566 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 05:40:05.992621 run osmo-hlr_10.42.42.2(pid=31768): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31768)] 05:40:06.042556 run osmo-hlr_10.42.42.2(pid=31768): stdout: | (launched: 2022-12-10_05:40:02.928319) 05:40:06.094063 run osmo-hlr_10.42.42.2(pid=31768): stderr: | 20221210054003132 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210054003133 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210054003133 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210054003133 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210054003133 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210054003133 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210054003145 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210054003153 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210054003153 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210054003153 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:40:06.165777 run osmo-msc_10.42.42.6(pid=31774): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31774)] 05:40:06.215645 run osmo-msc_10.42.42.6(pid=31774): stdout: | (launched: 2022-12-10_05:40:05.006387) 05:40:06.266750 run osmo-msc_10.42.42.6(pid=31774): stderr: | 20221210054005330 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210054005330 DLGLOBAL DEBUG validating counter group 0x7f4f21e07c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210054005330 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210054005330 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210054005330 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210054005330 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210054005332 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210054005332 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210054005332 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210054005332 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:40:06.318430 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31767): Terminating (SIGTERM) 05:40:06.359582 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31770): Terminating (SIGTERM) 05:40:06.400775 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31773): Terminating (SIGTERM) 05:40:06.442279 --- ParallelTerminationStrategy: PID 31767 died... 05:40:06.462207 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31767): Terminated: ok {rc=0} 05:40:06.508142 --- ParallelTerminationStrategy: PID 31770 died... 05:40:06.527793 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31770): Terminated: ok {rc=0} 05:40:06.573445 --- ParallelTerminationStrategy: PID 31773 died... 05:40:06.592694 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31773): Terminated: ok {rc=0} 05:40:06.680529 bus /sierra_3: Setting Powered False 05:40:07.779145 bus /sierra_3: Setting Powered False 05:40:08.895255 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2370 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 05:40:10.046703 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:40:10.059165 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 05:40:10.117269 tst mo_mt_call_osmux.py: using LAC 26229 05:40:10.246332 tst mo_mt_call_osmux.py: using RAC 219 05:40:10.375341 tst mo_mt_call_osmux.py: using CellId 26229 05:40:10.506771 tst mo_mt_call_osmux.py: using BVCI 26230 05:40:10.620795 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:40:10.632192 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:40:10.643225 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:40:10.654770 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:40:10.666244 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:40:10.677709 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 05:40:10.793644 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 05:40:10.909227 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:40:11.385338 run create_hlr_db(pid=31776): Launched 05:40:11.501595 bus /sierra_2: Setting Powered False 05:40:12.561961 run create_hlr_db(pid=31776): Terminated: ok {rc=0} 05:40:12.990033 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31778): Launched 05:40:13.298151 run osmo-hlr_10.42.42.2(pid=31779): Launched 05:40:13.414383 run osmo-stp_10.42.42.5: Starting osmo-stp 05:40:13.941350 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31781): Launched 05:40:14.248748 run osmo-stp_10.42.42.5(pid=31782): Launched 05:40:14.366432 run osmo-msc_10.42.42.6: Starting osmo-msc 05:40:14.935090 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31784): Launched 05:40:15.242910 run osmo-msc_10.42.42.6(pid=31785): Launched 05:40:15.414089 run osmo-stp_10.42.42.5(pid=31782): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31782)] 05:40:15.544053 run osmo-stp_10.42.42.5(pid=31782): stdout: | (launched: 2022-12-10_05:40:14.190510) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:40:15.674396 run osmo-stp_10.42.42.5(pid=31782): stderr: | 20221210054014365 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054014365 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054014365 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054014366 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054014366 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054014366 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054014366 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:40:15.801921 run osmo-stp_10.42.42.5(pid=31782): stdout: | (launched: 2022-12-10_05:40:14.190510) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:40:15.960270 run osmo-stp_10.42.42.5(pid=31782): stderr: | 20221210054014365 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054014365 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054014365 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054014366 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054014366 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054014366 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054014366 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:40:16.108813 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31782): Process ended prematurely: osmo-stp_10.42.42.5(pid=31782) [trial-2370↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31782)] [trial-2370↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 05:40:16.118783 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 05:40:16.148350 run osmo-hlr_10.42.42.2(pid=31779): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31779)] 05:40:16.198222 run osmo-hlr_10.42.42.2(pid=31779): stdout: | (launched: 2022-12-10_05:40:13.239469) 05:40:16.249906 run osmo-hlr_10.42.42.2(pid=31779): stderr: | 20221210054013419 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210054013419 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210054013419 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210054013419 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210054013419 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210054013420 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210054013431 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210054013440 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210054013440 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210054013440 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:40:16.321350 run osmo-msc_10.42.42.6(pid=31785): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31785)] 05:40:16.371389 run osmo-msc_10.42.42.6(pid=31785): stdout: | (launched: 2022-12-10_05:40:15.184544) 05:40:16.423017 run osmo-msc_10.42.42.6(pid=31785): stderr: | 20221210054015460 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210054015460 DLGLOBAL DEBUG validating counter group 0x7f9afe396c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210054015460 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210054015460 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210054015461 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210054015461 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210054015462 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210054015463 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210054015463 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210054015463 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:40:16.475206 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31778): Terminating (SIGTERM) 05:40:16.516923 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31781): Terminating (SIGTERM) 05:40:16.559090 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31784): Terminating (SIGTERM) 05:40:16.602022 --- ParallelTerminationStrategy: PID 31778 died... 05:40:16.621849 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31778): Terminated: ok {rc=0} 05:40:16.669865 --- ParallelTerminationStrategy: PID 31781 died... 05:40:16.689334 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31781): Terminated: ok {rc=0} 05:40:16.736817 --- ParallelTerminationStrategy: PID 31784 died... 05:40:16.756410 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31784): Terminated: ok {rc=0} 05:40:16.847367 bus /sierra_3: Setting Powered False 05:40:17.953225 bus /sierra_3: Setting Powered False 05:40:19.066033 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 05:40:20.298891 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:40:20.305155 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 05:40:20.325946 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 05:40:20.352625 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 05:40:20.404792 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 05:40:20.424927 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 05:40:20.451485 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 05:40:21.004327 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 05:40:21.053285 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:40:21.064264 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 05:40:21.119124 tst mo_mt_call.py: using LAC 26230 05:40:21.238075 tst mo_mt_call.py: using RAC 220 05:40:21.358434 tst mo_mt_call.py: using CellId 26230 05:40:21.477752 tst mo_mt_call.py: using BVCI 26231 05:40:21.590629 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:40:21.601719 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:40:21.612584 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:40:21.623659 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:40:21.634711 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:40:21.645998 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 05:40:21.766602 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 05:40:21.886469 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:40:22.395351 run create_hlr_db(pid=31790): Launched 05:40:22.527455 bus /sierra_2: Setting Powered False 05:40:23.591640 run create_hlr_db(pid=31790): Terminated: ok {rc=0} 05:40:24.030014 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31792): Launched 05:40:24.337406 run osmo-hlr_10.42.42.2(pid=31793): Launched 05:40:24.453544 run osmo-stp_10.42.42.5: Starting osmo-stp 05:40:24.999767 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31795): Launched 05:40:25.308848 run osmo-stp_10.42.42.5(pid=31796): Launched 05:40:25.426352 run osmo-msc_10.42.42.6: Starting osmo-msc 05:40:25.981915 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31798): Launched 05:40:26.289775 run osmo-msc_10.42.42.6(pid=31799): Launched 05:40:26.460861 run osmo-stp_10.42.42.5(pid=31796): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31796)] 05:40:26.590731 run osmo-stp_10.42.42.5(pid=31796): stdout: | (launched: 2022-12-10_05:40:25.250236) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:40:26.720623 run osmo-stp_10.42.42.5(pid=31796): stderr: | 20221210054025423 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054025423 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054025424 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054025424 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054025426 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054025427 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054025427 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:40:26.848073 run osmo-stp_10.42.42.5(pid=31796): stdout: | (launched: 2022-12-10_05:40:25.250236) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:40:26.969892 run osmo-stp_10.42.42.5(pid=31796): stderr: | 20221210054025423 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054025423 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054025424 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054025424 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054025426 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054025427 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054025427 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:40:27.115258 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31796): Process ended prematurely: osmo-stp_10.42.42.5(pid=31796) [trial-2370↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31796)] [trial-2370↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 05:40:27.124253 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 05:40:27.150822 run osmo-hlr_10.42.42.2(pid=31793): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31793)] 05:40:27.198356 run osmo-hlr_10.42.42.2(pid=31793): stdout: | (launched: 2022-12-10_05:40:24.279491) 05:40:27.247501 run osmo-hlr_10.42.42.2(pid=31793): stderr: | 20221210054024459 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210054024459 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210054024459 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210054024460 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210054024460 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210054024460 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210054024471 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210054024480 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210054024480 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210054024480 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:40:27.316019 run osmo-msc_10.42.42.6(pid=31799): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31799)] 05:40:27.363574 run osmo-msc_10.42.42.6(pid=31799): stdout: | (launched: 2022-12-10_05:40:26.231567) 05:40:27.412608 run osmo-msc_10.42.42.6(pid=31799): stderr: | 20221210054026506 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210054026506 DLGLOBAL DEBUG validating counter group 0x7f67f2477c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210054026506 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210054026506 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210054026506 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210054026506 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210054026510 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210054026510 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210054026510 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210054026510 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:40:27.462137 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31792): Terminating (SIGTERM) 05:40:27.501672 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31795): Terminating (SIGTERM) 05:40:27.541174 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31798): Terminating (SIGTERM) 05:40:27.580904 --- ParallelTerminationStrategy: PID 31792 died... 05:40:27.600102 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31792): Terminated: ok {rc=0} 05:40:27.644040 --- ParallelTerminationStrategy: PID 31795 died... 05:40:27.662549 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31795): Terminated: ok {rc=0} 05:40:27.706742 --- ParallelTerminationStrategy: PID 31798 died... 05:40:27.725296 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31798): Terminated: ok {rc=0} 05:40:27.809384 bus /sierra_3: Setting Powered False 05:40:28.907989 bus /sierra_3: Setting Powered False 05:40:30.023829 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2370 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 05:40:31.210692 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:40:31.227834 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 05:40:31.289989 tst mo_mt_call_osmux.py: using LAC 26231 05:40:31.446000 tst mo_mt_call_osmux.py: using RAC 221 05:40:31.575983 tst mo_mt_call_osmux.py: using CellId 26231 05:40:31.730928 tst mo_mt_call_osmux.py: using BVCI 26232 05:40:31.872074 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:40:31.890665 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:40:31.908451 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:40:31.927452 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:40:31.946037 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:40:31.960548 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 05:40:32.087655 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 05:40:32.213832 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:40:32.733931 run create_hlr_db(pid=31801): Launched 05:40:32.869643 bus /sierra_2: Setting Powered False 05:40:33.934337 run create_hlr_db(pid=31801): Terminated: ok {rc=0} 05:40:34.393150 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31803): Launched 05:40:34.724713 run osmo-hlr_10.42.42.2(pid=31804): Launched 05:40:34.850247 run osmo-stp_10.42.42.5: Starting osmo-stp 05:40:35.422169 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31806): Launched 05:40:35.752255 run osmo-stp_10.42.42.5(pid=31807): Launched 05:40:35.876576 run osmo-msc_10.42.42.6: Starting osmo-msc 05:40:36.472234 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31809): Launched 05:40:36.804490 run osmo-msc_10.42.42.6(pid=31810): Launched 05:40:36.988080 run osmo-stp_10.42.42.5(pid=31807): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31807)] 05:40:37.127246 run osmo-stp_10.42.42.5(pid=31807): stdout: | (launched: 2022-12-10_05:40:35.690012) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:40:37.266496 run osmo-stp_10.42.42.5(pid=31807): stderr: | 20221210054035887 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054035887 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054035887 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054035888 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054035888 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054035888 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054035888 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:40:37.404136 run osmo-stp_10.42.42.5(pid=31807): stdout: | (launched: 2022-12-10_05:40:35.690012) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:40:37.534877 run osmo-stp_10.42.42.5(pid=31807): stderr: | 20221210054035887 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054035887 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054035887 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054035888 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054035888 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054035888 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054035888 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:40:37.691349 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31807): Process ended prematurely: osmo-stp_10.42.42.5(pid=31807) [trial-2370↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31807)] [trial-2370↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 05:40:37.701177 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 05:40:37.729174 run osmo-hlr_10.42.42.2(pid=31804): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31804)] 05:40:37.779147 run osmo-hlr_10.42.42.2(pid=31804): stdout: | (launched: 2022-12-10_05:40:34.662417) 05:40:37.831003 run osmo-hlr_10.42.42.2(pid=31804): stderr: | 20221210054034863 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210054034863 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210054034863 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210054034863 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210054034863 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210054034863 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210054034876 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210054034886 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210054034887 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210054034887 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:40:37.903214 run osmo-msc_10.42.42.6(pid=31810): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31810)] 05:40:37.953494 run osmo-msc_10.42.42.6(pid=31810): stdout: | (launched: 2022-12-10_05:40:36.742421) 05:40:38.005282 run osmo-msc_10.42.42.6(pid=31810): stderr: | 20221210054037069 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210054037069 DLGLOBAL DEBUG validating counter group 0x7fb7108c4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210054037069 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210054037069 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210054037069 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210054037069 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210054037071 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210054037071 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210054037071 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210054037072 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:40:38.057252 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31803): Terminating (SIGTERM) 05:40:38.098795 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31806): Terminating (SIGTERM) 05:40:38.140174 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31809): Terminating (SIGTERM) 05:40:38.181923 --- ParallelTerminationStrategy: PID 31803 died... 05:40:38.202058 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31803): Terminated: ok {rc=0} 05:40:38.248249 --- ParallelTerminationStrategy: PID 31806 died... 05:40:38.268029 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31806): Terminated: ok {rc=0} 05:40:38.314131 --- ParallelTerminationStrategy: PID 31809 died... 05:40:38.333593 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31809): Terminated: ok {rc=0} 05:40:38.421814 bus /sierra_3: Setting Powered False 05:40:39.520159 bus /sierra_3: Setting Powered False 05:40:40.635814 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 voice:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 05:40:41.874591 tst voice:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:40:41.880628 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 05:40:41.902479 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 05:40:41.930170 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 05:40:41.983225 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 05:40:42.004317 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 05:40:42.031447 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 05:40:42.581967 tst voice:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 05:40:42.634610 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:40:42.645962 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 05:40:42.704588 tst mo_mt_call.py: using LAC 26232 05:40:42.835833 tst mo_mt_call.py: using RAC 222 05:40:42.964860 tst mo_mt_call.py: using CellId 26232 05:40:43.102528 tst mo_mt_call.py: using BVCI 26233 05:40:43.222498 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:40:43.234011 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:40:43.245200 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:40:43.256370 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:40:43.267591 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:40:43.278814 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 05:40:43.394590 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 05:40:43.512491 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:40:43.988778 run create_hlr_db(pid=31815): Launched 05:40:44.106203 bus /sierra_2: Setting Powered False 05:40:45.167185 run create_hlr_db(pid=31815): Terminated: ok {rc=0} 05:40:45.594187 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31817): Launched 05:40:45.919093 run osmo-hlr_10.42.42.2(pid=31818): Launched 05:40:46.123995 run osmo-stp_10.42.42.5: Starting osmo-stp 05:40:46.760590 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31820): Launched 05:40:47.108638 run osmo-stp_10.42.42.5(pid=31821): Launched 05:40:47.363231 run osmo-msc_10.42.42.6: Starting osmo-msc 05:40:47.943744 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31823): Launched 05:40:48.251541 run osmo-msc_10.42.42.6(pid=31824): Launched 05:40:48.421929 run osmo-stp_10.42.42.5(pid=31821): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31821)] 05:40:48.552056 run osmo-stp_10.42.42.5(pid=31821): stdout: | (launched: 2022-12-10_05:40:47.041884) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:40:48.682879 run osmo-stp_10.42.42.5(pid=31821): stderr: | 20221210054047355 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054047355 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054047355 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054047356 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054047356 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054047356 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054047356 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:40:48.811292 run osmo-stp_10.42.42.5(pid=31821): stdout: | (launched: 2022-12-10_05:40:47.041884) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:40:48.933193 run osmo-stp_10.42.42.5(pid=31821): stderr: | 20221210054047355 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054047355 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054047355 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054047356 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054047356 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054047356 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054047356 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:40:49.079306 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31821): Process ended prematurely: osmo-stp_10.42.42.5(pid=31821) [trial-2370↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31821)] [trial-2370↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 05:40:49.088455 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 05:40:49.116029 run osmo-hlr_10.42.42.2(pid=31818): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31818)] 05:40:49.164153 run osmo-hlr_10.42.42.2(pid=31818): stdout: | (launched: 2022-12-10_05:40:45.857831) 05:40:49.213967 run osmo-hlr_10.42.42.2(pid=31818): stderr: | 20221210054046126 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210054046126 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210054046126 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210054046126 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210054046126 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210054046126 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210054046152 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210054046172 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210054046172 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210054046172 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:40:49.283366 run osmo-msc_10.42.42.6(pid=31824): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31824)] 05:40:49.331427 run osmo-msc_10.42.42.6(pid=31824): stdout: | (launched: 2022-12-10_05:40:48.193488) 05:40:49.380915 run osmo-msc_10.42.42.6(pid=31824): stderr: | 20221210054048470 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210054048470 DLGLOBAL DEBUG validating counter group 0x7f32b7d28c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210054048470 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210054048470 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210054048470 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210054048471 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210054048472 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210054048473 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210054048473 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210054048473 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:40:49.430630 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31817): Terminating (SIGTERM) 05:40:49.470132 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31820): Terminating (SIGTERM) 05:40:49.509729 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31823): Terminating (SIGTERM) 05:40:49.550179 --- ParallelTerminationStrategy: PID 31817 died... 05:40:49.569457 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31817): Terminated: ok {rc=0} 05:40:49.614557 --- ParallelTerminationStrategy: PID 31820 died... 05:40:49.633393 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31820): Terminated: ok {rc=0} 05:40:49.678194 --- ParallelTerminationStrategy: PID 31823 died... 05:40:49.696777 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31823): Terminated: ok {rc=0} 05:40:49.784086 bus /sierra_3: Setting Powered False 05:40:50.882862 bus /sierra_3: Setting Powered False 05:40:51.999300 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2370 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 05:40:53.147283 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:40:53.159147 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 05:40:53.216725 tst mo_mt_call_osmux.py: using LAC 26233 05:40:53.339425 tst mo_mt_call_osmux.py: using RAC 223 05:40:53.465683 tst mo_mt_call_osmux.py: using CellId 26233 05:40:53.596938 tst mo_mt_call_osmux.py: using BVCI 26234 05:40:53.715736 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:40:53.727428 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:40:53.738755 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:40:53.750176 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:40:53.761560 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:40:53.772827 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 05:40:53.889502 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 05:40:54.011303 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:40:54.520481 run create_hlr_db(pid=31826): Launched 05:40:54.652353 bus /sierra_2: Setting Powered False 05:40:55.717676 run create_hlr_db(pid=31826): Terminated: ok {rc=0} 05:40:56.155718 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31828): Launched 05:40:56.466871 run osmo-hlr_10.42.42.2(pid=31829): Launched 05:40:56.583480 run osmo-stp_10.42.42.5: Starting osmo-stp 05:40:57.127770 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31831): Launched 05:40:57.436761 run osmo-stp_10.42.42.5(pid=31832): Launched 05:40:57.554806 run osmo-msc_10.42.42.6: Starting osmo-msc 05:40:58.116415 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31834): Launched 05:40:58.425567 run osmo-msc_10.42.42.6(pid=31835): Launched 05:40:58.597330 run osmo-stp_10.42.42.5(pid=31832): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31832)] 05:40:58.727207 run osmo-stp_10.42.42.5(pid=31832): stdout: | (launched: 2022-12-10_05:40:57.378426) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:40:58.857773 run osmo-stp_10.42.42.5(pid=31832): stderr: | 20221210054057550 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054057551 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054057551 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054057551 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054057553 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054057554 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054057554 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:40:58.985368 run osmo-stp_10.42.42.5(pid=31832): stdout: | (launched: 2022-12-10_05:40:57.378426) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:40:59.107167 run osmo-stp_10.42.42.5(pid=31832): stderr: | 20221210054057550 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054057551 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054057551 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054057551 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054057553 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054057554 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054057554 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:40:59.253887 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31832): Process ended prematurely: osmo-stp_10.42.42.5(pid=31832) [trial-2370↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31832)] [trial-2370↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 05:40:59.263058 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 05:40:59.290214 run osmo-hlr_10.42.42.2(pid=31829): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31829)] 05:40:59.338307 run osmo-hlr_10.42.42.2(pid=31829): stdout: | (launched: 2022-12-10_05:40:56.407728) 05:40:59.387791 run osmo-hlr_10.42.42.2(pid=31829): stderr: | 20221210054056585 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210054056585 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210054056585 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210054056585 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210054056585 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210054056585 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210054056595 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210054056603 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210054056604 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210054056604 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:40:59.456581 run osmo-msc_10.42.42.6(pid=31835): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31835)] 05:40:59.504724 run osmo-msc_10.42.42.6(pid=31835): stdout: | (launched: 2022-12-10_05:40:58.366787) 05:40:59.554055 run osmo-msc_10.42.42.6(pid=31835): stderr: | 20221210054058640 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210054058640 DLGLOBAL DEBUG validating counter group 0x7f8e33b97c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210054058641 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210054058641 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210054058641 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210054058641 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210054058643 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210054058643 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210054058643 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210054058643 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:40:59.603986 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31828): Terminating (SIGTERM) 05:40:59.643587 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31831): Terminating (SIGTERM) 05:40:59.683319 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31834): Terminating (SIGTERM) 05:40:59.723162 --- ParallelTerminationStrategy: PID 31828 died... 05:40:59.742182 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31828): Terminated: ok {rc=0} 05:40:59.786357 --- ParallelTerminationStrategy: PID 31831 died... 05:40:59.804989 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31831): Terminated: ok {rc=0} 05:40:59.849477 --- ParallelTerminationStrategy: PID 31834 died... 05:40:59.868181 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31834): Terminated: ok {rc=0} 05:40:59.954670 bus /sierra_3: Setting Powered False 05:41:01.052209 bus /sierra_3: Setting Powered False 05:41:02.185356 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 voice:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 emergency:oc2g --------------------------------------------------------------------- 05:41:03.426999 tst emergency:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:41:03.431626 tst emergency:oc2g: Verifying 1 x bts (candidates: 11) 05:41:03.452820 tst emergency:oc2g: Verifying 6 x ip_address (candidates: 9) 05:41:03.480396 tst emergency:oc2g: Verifying 4 x modem (candidates: 12) 05:41:03.566860 tst emergency:oc2g: Reserving 1 x bts (candidates: 11) 05:41:03.588121 tst emergency:oc2g: Reserving 6 x ip_address (candidates: 9) 05:41:03.615452 tst emergency:oc2g: Reserving 4 x modem (candidates: 12) 05:41:04.198786 tst emergency:oc2g: RESERVED RESOURCES for emergency: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2370 emergency:oc2g emergency_mo_mt_call.py ---------------------------------------------- 05:41:04.204069 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 05:41:04.215256 tst emergency:oc2g: Using 1 x bts (candidates: 1) 05:41:04.252366 tst emergency_mo_mt_call.py: using LAC 26234 05:41:04.378925 tst emergency_mo_mt_call.py: using RAC 224 05:41:04.506648 tst emergency_mo_mt_call.py: using CellId 26234 05:41:04.637301 tst emergency_mo_mt_call.py: using BVCI 26235 05:41:04.757667 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 05:41:04.768778 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 05:41:04.779848 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 05:41:04.790843 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 05:41:04.801794 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 05:41:04.812684 tst emergency:oc2g: Using 1 x modem (candidates: 4) 05:41:04.928040 tst emergency:oc2g: Using 1 x modem (candidates: 4) 05:41:05.043216 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:41:05.512136 run create_hlr_db(pid=31840): Launched 05:41:05.627757 bus /sierra_2: Setting Powered False 05:41:06.688356 run create_hlr_db(pid=31840): Terminated: ok {rc=0} 05:41:07.131125 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31842): Launched 05:41:07.455691 run osmo-hlr_10.42.42.2(pid=31843): Launched 05:41:07.579037 run osmo-stp_10.42.42.5: Starting osmo-stp 05:41:08.134769 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31845): Launched 05:41:08.458274 run osmo-stp_10.42.42.5(pid=31846): Launched 05:41:08.591989 tst emergency_mo_mt_call.py: using MSISDN 7574 05:41:08.756488 run osmo-msc_10.42.42.6: Starting osmo-msc 05:41:09.337522 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31848): Launched 05:41:09.660060 run osmo-msc_10.42.42.6(pid=31849): Launched 05:41:09.838896 run osmo-stp_10.42.42.5(pid=31846): ERR: Terminated: ERROR {rc=1} [trial-2370↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31846)] 05:41:09.973666 run osmo-stp_10.42.42.5(pid=31846): stdout: | (launched: 2022-12-10_05:41:08.397191) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:41:10.108821 run osmo-stp_10.42.42.5(pid=31846): stderr: | 20221210054108591 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054108592 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054108592 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054108592 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054108593 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054108593 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054108593 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:41:10.243901 run osmo-stp_10.42.42.5(pid=31846): stdout: | (launched: 2022-12-10_05:41:08.397191) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:41:10.371355 run osmo-stp_10.42.42.5(pid=31846): stderr: | 20221210054108591 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054108592 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054108592 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054108592 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054108593 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054108593 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054108593 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:41:10.524221 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=31846): Process ended prematurely: osmo-stp_10.42.42.5(pid=31846) [trial-2370↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31846)] [trial-2370↪emergency:oc2g↪emergency_mo_mt_call.py:19] 05:41:10.533278 tst emergency_mo_mt_call.py:19: Test FAILED (6.3 sec) 05:41:10.560540 run osmo-hlr_10.42.42.2(pid=31843): ERR: Terminated: ERROR {rc=237} [trial-2370↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31843)] 05:41:10.609922 run osmo-hlr_10.42.42.2(pid=31843): stdout: | (launched: 2022-12-10_05:41:07.394769) 05:41:10.661239 run osmo-hlr_10.42.42.2(pid=31843): stderr: | 20221210054107598 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210054107598 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210054107598 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210054107598 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210054107598 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210054107598 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210054107611 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/emergency:oc2g/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210054107619 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210054107620 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210054107620 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:41:10.733193 run osmo-msc_10.42.42.6(pid=31849): ERR: Terminated: ERROR {rc=2} [trial-2370↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31849)] 05:41:10.782789 run osmo-msc_10.42.42.6(pid=31849): stdout: | (launched: 2022-12-10_05:41:09.599287) 05:41:10.833907 run osmo-msc_10.42.42.6(pid=31849): stderr: | 20221210054109925 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210054109925 DLGLOBAL DEBUG validating counter group 0x7fcee5647c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210054109925 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210054109925 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210054109926 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210054109926 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210054109928 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210054109928 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210054109928 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210054109928 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:41:10.885566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31842): Terminating (SIGTERM) 05:41:10.926719 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31845): Terminating (SIGTERM) 05:41:10.968103 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31848): Terminating (SIGTERM) 05:41:11.010208 --- ParallelTerminationStrategy: PID 31842 died... 05:41:11.030267 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31842): Terminated: ok {rc=0} 05:41:11.076242 --- ParallelTerminationStrategy: PID 31845 died... 05:41:11.096172 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31845): Terminated: ok {rc=0} 05:41:11.142274 --- ParallelTerminationStrategy: PID 31848 died... 05:41:11.161784 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31848): Terminated: ok {rc=0} 05:41:11.248791 bus /sierra_3: Setting Powered False 05:41:12.347928 bus /sierra_3: Setting Powered False 05:41:13.463527 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2370 emergency:oc2g emergency_preemptive_call.py ---------------------------------------------- 05:41:14.551513 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 05:41:14.563212 tst emergency:oc2g: Using 1 x bts (candidates: 1) 05:41:14.602254 tst emergency_preemptive_call.py: using LAC 26235 05:41:14.722261 tst emergency_preemptive_call.py: using RAC 225 05:41:14.843699 tst emergency_preemptive_call.py: using CellId 26235 05:41:14.963596 tst emergency_preemptive_call.py: using BVCI 26236 05:41:15.082036 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 05:41:15.093199 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 05:41:15.104140 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 05:41:15.115598 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 05:41:15.126625 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 05:41:15.137615 tst emergency:oc2g: Using 1 x modem (candidates: 4) 05:41:15.255019 tst emergency:oc2g: Using 1 x modem (candidates: 4) 05:41:15.370997 tst emergency:oc2g: Using 1 x modem (candidates: 4) 05:41:15.488871 tst emergency:oc2g: Using 1 x modem (candidates: 4) 05:41:15.607499 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:41:16.118775 run create_hlr_db(pid=31851): Launched 05:41:16.282858 bus /sierra_2: Setting Powered False 05:41:17.343917 run create_hlr_db(pid=31851): Terminated: ok {rc=0} 05:41:17.803753 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31853): Launched 05:41:18.128258 run osmo-hlr_10.42.42.2(pid=31854): Launched 05:41:18.250913 run osmo-stp_10.42.42.5: Starting osmo-stp 05:41:18.811072 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31856): Launched 05:41:19.134427 run osmo-stp_10.42.42.5(pid=31857): Launched 05:41:19.266745 tst emergency_preemptive_call.py: using MSISDN 7575 05:41:19.433227 run osmo-msc_10.42.42.6: Starting osmo-msc 05:41:20.012559 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31859): Launched 05:41:20.336252 run osmo-msc_10.42.42.6(pid=31860): Launched 05:41:20.515787 run osmo-stp_10.42.42.5(pid=31857): ERR: Terminated: ERROR {rc=1} [trial-2370↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31857)] 05:41:20.650946 run osmo-stp_10.42.42.5(pid=31857): stdout: | (launched: 2022-12-10_05:41:19.073381) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:41:20.787099 run osmo-stp_10.42.42.5(pid=31857): stderr: | 20221210054119270 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054119270 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054119270 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054119271 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054119271 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054119271 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054119271 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:41:20.922415 run osmo-stp_10.42.42.5(pid=31857): stdout: | (launched: 2022-12-10_05:41:19.073381) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:41:21.050661 run osmo-stp_10.42.42.5(pid=31857): stderr: | 20221210054119270 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054119270 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054119270 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054119271 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054119271 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054119271 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054119271 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:41:21.204153 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=31857): Process ended prematurely: osmo-stp_10.42.42.5(pid=31857) [trial-2370↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31857)] [trial-2370↪emergency:oc2g↪emergency_preemptive_call.py:32] 05:41:21.213364 tst emergency_preemptive_call.py:32: Test FAILED (6.7 sec) 05:41:21.241417 run osmo-hlr_10.42.42.2(pid=31854): ERR: Terminated: ERROR {rc=237} [trial-2370↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31854)] 05:41:21.291740 run osmo-hlr_10.42.42.2(pid=31854): stdout: | (launched: 2022-12-10_05:41:18.067226) 05:41:21.344527 run osmo-hlr_10.42.42.2(pid=31854): stderr: | 20221210054118270 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210054118270 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210054118270 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210054118270 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210054118270 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210054118270 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210054118283 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/emergency:oc2g/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210054118291 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210054118292 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210054118292 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:41:21.416923 run osmo-msc_10.42.42.6(pid=31860): ERR: Terminated: ERROR {rc=2} [trial-2370↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31860)] 05:41:21.466817 run osmo-msc_10.42.42.6(pid=31860): stdout: | (launched: 2022-12-10_05:41:20.275054) 05:41:21.518226 run osmo-msc_10.42.42.6(pid=31860): stderr: | 20221210054120602 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210054120602 DLGLOBAL DEBUG validating counter group 0x7f8bcf112c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210054120602 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210054120602 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210054120603 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210054120603 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210054120605 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210054120605 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210054120605 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210054120605 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:41:21.570086 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31853): Terminating (SIGTERM) 05:41:21.611452 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31856): Terminating (SIGTERM) 05:41:21.653180 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31859): Terminating (SIGTERM) 05:41:21.695432 --- ParallelTerminationStrategy: PID 31853 died... 05:41:21.715233 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31853): Terminated: ok {rc=0} 05:41:21.761635 --- ParallelTerminationStrategy: PID 31856 died... 05:41:21.781170 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31856): Terminated: ok {rc=0} 05:41:21.827076 --- ParallelTerminationStrategy: PID 31859 died... 05:41:21.846807 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31859): Terminated: ok {rc=0} 05:41:21.935204 bus /sierra_9: Setting Powered False 05:41:23.030380 bus /sierra_9: Setting Powered False 05:41:24.145601 bus /sierra_8: Setting Powered False 05:41:25.243046 bus /sierra_8: Setting Powered False 05:41:26.358825 bus /sierra_3: Setting Powered False 05:41:27.457299 bus /sierra_3: Setting Powered False 05:41:28.574975 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 emergency:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 gprs:oc2g --------------------------------------------------------------------- 05:41:29.838891 tst gprs:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:41:29.844143 tst gprs:oc2g: Verifying 1 x bts (candidates: 11) 05:41:29.865965 tst gprs:oc2g: Verifying 9 x ip_address (candidates: 9) 05:41:29.905084 tst gprs:oc2g: Verifying 4 x modem (candidates: 12) 05:41:29.991295 tst gprs:oc2g: Reserving 1 x bts (candidates: 11) 05:41:30.012917 tst gprs:oc2g: Reserving 9 x ip_address (candidates: 9) 05:41:30.054133 tst gprs:oc2g: Reserving 4 x modem (candidates: 12) 05:41:30.642954 tst gprs:oc2g: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2370 gprs:oc2g cs_paging_gprs_active.py ---------------------------------------------- 05:41:30.698098 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:41:30.709332 tst gprs:oc2g: Using 1 x bts (candidates: 1) 05:41:30.744901 tst cs_paging_gprs_active.py: using LAC 26236 05:41:30.893128 tst cs_paging_gprs_active.py: using RAC 226 05:41:31.019311 tst cs_paging_gprs_active.py: using CellId 26236 05:41:31.183496 tst cs_paging_gprs_active.py: using BVCI 26237 05:41:31.308799 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:41:31.320850 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:41:31.332821 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:41:31.345980 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:41:31.359677 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:41:31.372464 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:41:31.384347 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:41:31.397462 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:41:31.411709 tst gprs:oc2g: Using 1 x modem (candidates: 4) 05:41:31.535355 tst gprs:oc2g: Using 1 x modem (candidates: 4) 05:41:31.656169 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 05:41:31.884315 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:41:32.222419 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31865): Launched 05:41:32.511810 run iperf3-srv_10.42.42.10(pid=31866): Launched 05:41:32.635363 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 05:41:32.858375 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:41:33.191122 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31867): Launched 05:41:33.480617 run iperf3-srv_10.42.42.10(pid=31868): Launched 05:41:33.604755 tst cs_paging_gprs_active.py:38: start network... 05:41:33.827412 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:41:34.339588 run create_hlr_db(pid=31869): Launched 05:41:34.476568 bus /sierra_2: Setting Powered False 05:41:35.541889 run create_hlr_db(pid=31869): Terminated: ok {rc=0} 05:41:35.980723 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31871): Launched 05:41:36.291120 run osmo-hlr_10.42.42.2(pid=31872): Launched 05:41:36.408293 run osmo-stp_10.42.42.5: Starting osmo-stp 05:41:36.952210 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31874): Launched 05:41:37.260396 run osmo-stp_10.42.42.5(pid=31875): Launched 05:41:37.377601 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:41:37.908782 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31877): Launched 05:41:38.025786 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:41:38.286409 run patchelf(pid=31878): Launched 05:41:38.456863 run osmo-stp_10.42.42.5(pid=31875): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31875)] 05:41:38.586584 run osmo-stp_10.42.42.5(pid=31875): stdout: | (launched: 2022-12-10_05:41:37.201920) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:41:38.718311 run osmo-stp_10.42.42.5(pid=31875): stderr: | 20221210054137375 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054137375 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054137375 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054137376 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054137376 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054137376 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054137376 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:41:38.849343 run osmo-stp_10.42.42.5(pid=31875): stdout: | (launched: 2022-12-10_05:41:37.201920) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:41:38.974593 run osmo-stp_10.42.42.5(pid=31875): stderr: | 20221210054137375 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054137375 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054137375 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054137376 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054137376 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054137376 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054137376 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:41:39.123349 run patchelf(pid=31878): Terminating (SIGINT) 05:41:39.295116 run patchelf(pid=31878): Terminated: ok {rc=0} 05:41:39.419515 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=31875): Process ended prematurely: osmo-stp_10.42.42.5(pid=31875) [trial-2370↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31875)] [trial-2370↪gprs:oc2g↪cs_paging_gprs_active.py:38] 05:41:39.429032 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 05:41:39.456416 run osmo-hlr_10.42.42.2(pid=31872): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:oc2g↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31872)] 05:41:39.505237 run osmo-hlr_10.42.42.2(pid=31872): stdout: | (launched: 2022-12-10_05:41:36.232651) 05:41:39.554415 run osmo-hlr_10.42.42.2(pid=31872): stderr: | 20221210054136412 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210054136412 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210054136412 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210054136412 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210054136412 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210054136412 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210054136425 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:oc2g/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210054136433 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210054136434 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210054136434 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:41:39.604033 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31865): Terminating (SIGTERM) 05:41:39.643658 run iperf3-srv_10.42.42.10(pid=31866): Terminating (SIGTERM) 05:41:39.682966 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31867): Terminating (SIGTERM) 05:41:39.722349 run iperf3-srv_10.42.42.10(pid=31868): Terminating (SIGTERM) 05:41:39.761649 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31871): Terminating (SIGTERM) 05:41:39.801185 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31874): Terminating (SIGTERM) 05:41:39.840511 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31877): Terminating (SIGTERM) 05:41:39.880170 --- ParallelTerminationStrategy: PID 31865 died... 05:41:39.899143 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31865): Terminated: ok {rc=0} 05:41:39.943118 --- ParallelTerminationStrategy: PID 31866 died... 05:41:39.961587 run iperf3-srv_10.42.42.10(pid=31866): Terminated {rc=256} 05:41:40.005080 --- ParallelTerminationStrategy: PID 31867 died... 05:41:40.023433 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31867): Terminated: ok {rc=0} 05:41:40.067053 --- ParallelTerminationStrategy: PID 31868 died... 05:41:40.085446 run iperf3-srv_10.42.42.10(pid=31868): Terminated {rc=256} 05:41:40.129670 --- ParallelTerminationStrategy: PID 31871 died... 05:41:40.148095 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31871): Terminated: ok {rc=0} 05:41:40.192039 --- ParallelTerminationStrategy: PID 31874 died... 05:41:40.210606 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31874): Terminated: ok {rc=0} 05:41:40.254796 --- ParallelTerminationStrategy: PID 31877 died... 05:41:40.273346 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31877): Terminated: ok {rc=0} 05:41:40.357800 bus /gobi_0: Setting Powered False 05:41:41.456706 bus /gobi_0: Setting Powered False 05:41:42.568476 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:oc2g iperf3.py ---------------------------------------------- 05:41:43.710493 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:41:43.721741 tst gprs:oc2g: Using 1 x bts (candidates: 1) 05:41:43.757651 tst iperf3.py: using LAC 26237 05:41:43.887734 tst iperf3.py: using RAC 227 05:41:44.018471 tst iperf3.py: using CellId 26237 05:41:44.149586 tst iperf3.py: using BVCI 26238 05:41:44.263903 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:41:44.274520 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:41:44.285201 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:41:44.295737 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:41:44.306267 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:41:44.316770 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:41:44.327434 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:41:44.338016 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:41:44.348678 tst gprs:oc2g: Using 1 x modem (candidates: 4) 05:41:44.466108 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 05:41:44.686149 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:41:45.017256 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31879): Launched 05:41:45.305613 run iperf3-srv_10.42.42.10(pid=31880): Launched 05:41:45.427665 tst iperf3.py:8: start network... 05:41:45.648873 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:41:46.186339 run create_hlr_db(pid=31881): Launched 05:41:46.354357 bus /gobi_6: Setting Powered False 05:41:47.418965 run create_hlr_db(pid=31881): Terminated: ok {rc=0} 05:41:47.876724 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31883): Launched 05:41:48.207202 run osmo-hlr_10.42.42.2(pid=31884): Launched 05:41:48.330837 run osmo-stp_10.42.42.5: Starting osmo-stp 05:41:48.897050 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31886): Launched 05:41:49.227594 run osmo-stp_10.42.42.5(pid=31887): Launched 05:41:49.352301 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:41:49.928702 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31889): Launched 05:41:50.054447 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:41:50.333849 run patchelf(pid=31890): Launched 05:41:50.516118 run osmo-stp_10.42.42.5(pid=31887): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31887)] 05:41:50.655288 run osmo-stp_10.42.42.5(pid=31887): stdout: | (launched: 2022-12-10_05:41:49.165331) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:41:50.795979 run osmo-stp_10.42.42.5(pid=31887): stderr: | 20221210054149361 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054149361 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054149361 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054149362 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054149362 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054149362 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054149362 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:41:50.936103 run osmo-stp_10.42.42.5(pid=31887): stdout: | (launched: 2022-12-10_05:41:49.165331) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:41:51.070234 run osmo-stp_10.42.42.5(pid=31887): stderr: | 20221210054149361 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054149361 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054149361 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054149362 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054149362 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054149362 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054149362 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:41:51.229281 run patchelf(pid=31890): Terminating (SIGINT) 05:41:51.412230 run patchelf(pid=31890): Terminated: ok {rc=0} 05:41:51.544000 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31887): Process ended prematurely: osmo-stp_10.42.42.5(pid=31887) [trial-2370↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31887)] [trial-2370↪gprs:oc2g↪iperf3.py:8] 05:41:51.554341 tst iperf3.py:8: Test FAILED (7.9 sec) 05:41:51.582965 run osmo-hlr_10.42.42.2(pid=31884): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:oc2g↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31884)] 05:41:51.632302 run osmo-hlr_10.42.42.2(pid=31884): stdout: | (launched: 2022-12-10_05:41:48.145045) 05:41:51.683389 run osmo-hlr_10.42.42.2(pid=31884): stderr: | 20221210054148349 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210054148349 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210054148349 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210054148349 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210054148349 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210054148349 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210054148361 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:oc2g/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210054148369 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210054148369 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210054148369 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:41:51.735338 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31879): Terminating (SIGTERM) 05:41:51.776546 run iperf3-srv_10.42.42.10(pid=31880): Terminating (SIGTERM) 05:41:51.817750 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31883): Terminating (SIGTERM) 05:41:51.859020 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31886): Terminating (SIGTERM) 05:41:51.900423 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31889): Terminating (SIGTERM) 05:41:51.942079 --- ParallelTerminationStrategy: PID 31879 died... 05:41:51.961884 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31879): Terminated: ok {rc=0} 05:41:52.007449 --- ParallelTerminationStrategy: PID 31880 died... 05:41:52.026767 run iperf3-srv_10.42.42.10(pid=31880): Terminated {rc=256} 05:41:52.072710 --- ParallelTerminationStrategy: PID 31883 died... 05:41:52.092215 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31883): Terminated: ok {rc=0} 05:41:52.137487 --- ParallelTerminationStrategy: PID 31886 died... 05:41:52.156911 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31886): Terminated: ok {rc=0} 05:41:52.202350 --- ParallelTerminationStrategy: PID 31889 died... 05:41:52.221667 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31889): Terminated: ok {rc=0} 05:41:52.308169 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:oc2g iperf3m4.py ---------------------------------------------- 05:41:53.456882 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:41:53.468716 tst gprs:oc2g: Using 1 x bts (candidates: 1) 05:41:53.505593 tst iperf3m4.py: using LAC 26238 05:41:53.636464 tst iperf3m4.py: using RAC 228 05:41:53.765501 tst iperf3m4.py: using CellId 26238 05:41:53.894987 tst iperf3m4.py: using BVCI 26239 05:41:54.014862 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:41:54.025872 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:41:54.036730 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:41:54.047652 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:41:54.058417 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:41:54.069171 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:41:54.080008 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:41:54.090884 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:41:54.101822 tst gprs:oc2g: Using 1 x modem (candidates: 4) 05:41:54.222410 tst gprs:oc2g: Using 1 x modem (candidates: 4) 05:41:54.342240 tst gprs:oc2g: Using 1 x modem (candidates: 4) 05:41:54.461196 tst gprs:oc2g: Using 1 x modem (candidates: 4) 05:41:54.577943 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 05:41:54.783660 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:41:55.094985 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31891): Launched 05:41:55.364839 run iperf3-srv_10.42.42.10(pid=31892): Launched 05:41:55.479637 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 05:41:55.685423 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:41:55.995372 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31893): Launched 05:41:56.264653 run iperf3-srv_10.42.42.10(pid=31894): Launched 05:41:56.379344 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 05:41:56.583670 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:41:56.893294 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31895): Launched 05:41:57.162135 run iperf3-srv_10.42.42.10(pid=31896): Launched 05:41:57.276814 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 05:41:57.481493 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:41:57.792122 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31897): Launched 05:41:58.060497 run iperf3-srv_10.42.42.10(pid=31898): Launched 05:41:58.175362 tst iperf3m4.py:8: start network... 05:41:58.379715 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:41:58.856941 run create_hlr_db(pid=31899): Launched 05:41:58.991305 bus /gobi_6: Setting Powered False 05:42:00.055647 run create_hlr_db(pid=31899): Terminated: ok {rc=0} 05:42:00.494364 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31901): Launched 05:42:00.804673 run osmo-hlr_10.42.42.2(pid=31902): Launched 05:42:01.223020 run osmo-stp_10.42.42.5: Starting osmo-stp 05:42:01.842276 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31913): Launched 05:42:02.169804 run osmo-stp_10.42.42.5(pid=31914): Launched 05:42:02.393776 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:42:02.964047 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31916): Launched 05:42:03.089668 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:42:03.368819 run patchelf(pid=31917): Launched 05:42:03.550668 run osmo-stp_10.42.42.5(pid=31914): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31914)] 05:42:03.689429 run osmo-stp_10.42.42.5(pid=31914): stdout: | (launched: 2022-12-10_05:42:02.106838) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:42:03.829779 run osmo-stp_10.42.42.5(pid=31914): stderr: | 20221210054202336 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054202336 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054202345 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054202345 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054202346 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054202346 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054202346 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:42:03.969770 run osmo-stp_10.42.42.5(pid=31914): stdout: | (launched: 2022-12-10_05:42:02.106838) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:42:04.103666 run osmo-stp_10.42.42.5(pid=31914): stderr: | 20221210054202336 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054202336 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054202345 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054202345 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054202346 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054202346 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054202346 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:42:04.262569 run patchelf(pid=31917): Terminating (SIGINT) 05:42:04.445550 run patchelf(pid=31917): Terminated: ok {rc=0} 05:42:04.577255 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31914): Process ended prematurely: osmo-stp_10.42.42.5(pid=31914) [trial-2370↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31914)] [trial-2370↪gprs:oc2g↪iperf3m4.py:8] 05:42:04.587423 tst iperf3m4.py:8: Test FAILED (11.2 sec) 05:42:04.616061 run osmo-hlr_10.42.42.2(pid=31902): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:oc2g↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31902)] 05:42:04.665455 run osmo-hlr_10.42.42.2(pid=31902): stdout: | (launched: 2022-12-10_05:42:00.745578) 05:42:04.717156 run osmo-hlr_10.42.42.2(pid=31902): stderr: | 20221210054200982 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210054200982 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210054200982 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210054200982 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210054200982 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210054200982 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210054201009 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:oc2g/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210054201045 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210054201045 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210054201045 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:42:04.768768 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31891): Terminating (SIGTERM) 05:42:04.810126 run iperf3-srv_10.42.42.10(pid=31892): Terminating (SIGTERM) 05:42:04.851196 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31893): Terminating (SIGTERM) 05:42:04.892392 run iperf3-srv_10.42.42.10(pid=31894): Terminating (SIGTERM) 05:42:04.933477 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31895): Terminating (SIGTERM) 05:42:04.974772 run iperf3-srv_10.42.42.10(pid=31896): Terminating (SIGTERM) 05:42:05.015772 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31897): Terminating (SIGTERM) 05:42:05.056808 run iperf3-srv_10.42.42.10(pid=31898): Terminating (SIGTERM) 05:42:05.097978 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31901): Terminating (SIGTERM) 05:42:05.139208 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31913): Terminating (SIGTERM) 05:42:05.180313 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31916): Terminating (SIGTERM) 05:42:05.221846 --- ParallelTerminationStrategy: PID 31891 died... 05:42:05.241483 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31891): Terminated: ok {rc=0} 05:42:05.287460 --- ParallelTerminationStrategy: PID 31892 died... 05:42:05.306878 run iperf3-srv_10.42.42.10(pid=31892): Terminated {rc=256} 05:42:05.352662 --- ParallelTerminationStrategy: PID 31893 died... 05:42:05.372121 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31893): Terminated: ok {rc=0} 05:42:05.417619 --- ParallelTerminationStrategy: PID 31894 died... 05:42:05.437032 run iperf3-srv_10.42.42.10(pid=31894): Terminated {rc=256} 05:42:05.482807 --- ParallelTerminationStrategy: PID 31895 died... 05:42:05.502209 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31895): Terminated: ok {rc=0} 05:42:05.547719 --- ParallelTerminationStrategy: PID 31896 died... 05:42:05.567113 run iperf3-srv_10.42.42.10(pid=31896): Terminated {rc=256} 05:42:05.612708 --- ParallelTerminationStrategy: PID 31897 died... 05:42:05.632121 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31897): Terminated: ok {rc=0} 05:42:05.677963 --- ParallelTerminationStrategy: PID 31898 died... 05:42:05.697646 run iperf3-srv_10.42.42.10(pid=31898): Terminated {rc=256} 05:42:05.743642 --- ParallelTerminationStrategy: PID 31901 died... 05:42:05.763229 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31901): Terminated: ok {rc=0} 05:42:05.808826 --- ParallelTerminationStrategy: PID 31913 died... 05:42:05.828550 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31913): Terminated: ok {rc=0} 05:42:05.874121 --- ParallelTerminationStrategy: PID 31916 died... 05:42:05.893556 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31916): Terminated: ok {rc=0} 05:42:05.980623 bus /gobi_4: Setting Powered False 05:42:07.079067 bus /gobi_4: Setting Powered False 05:42:08.194946 bus /gobi_1: Setting Powered False 05:42:09.292071 bus /gobi_1: Setting Powered False 05:42:10.407435 bus /gobi_0: Setting Powered False 05:42:11.504498 bus /gobi_0: Setting Powered False 05:42:12.621569 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:oc2g ping.py ---------------------------------------------- 05:42:13.723044 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:42:13.734537 tst gprs:oc2g: Using 1 x bts (candidates: 1) 05:42:13.772135 tst ping.py: using LAC 26239 05:42:13.891384 tst ping.py: using RAC 229 05:42:14.009420 tst ping.py: using CellId 26239 05:42:14.136861 tst ping.py: using BVCI 26240 05:42:14.254567 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:42:14.265831 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:42:14.276837 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:42:14.288390 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:42:14.299862 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:42:14.311362 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:42:14.322855 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:42:14.334209 tst gprs:oc2g: Using 1 x modem (candidates: 4) 05:42:14.452822 tst ping.py:19: start network... 05:42:14.670731 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:42:15.171125 run create_hlr_db(pid=31918): Launched 05:42:15.300885 bus /gobi_6: Setting Powered False 05:42:16.377165 run create_hlr_db(pid=31918): Terminated: ok {rc=0} 05:42:16.906845 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31920): Launched 05:42:17.239831 run osmo-hlr_10.42.42.2(pid=31921): Launched 05:42:17.362716 run osmo-stp_10.42.42.5: Starting osmo-stp 05:42:17.923833 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31923): Launched 05:42:18.248292 run osmo-stp_10.42.42.5(pid=31924): Launched 05:42:18.370856 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:42:18.929611 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31926): Launched 05:42:19.052736 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:42:19.327092 run patchelf(pid=31927): Launched 05:42:19.506865 run osmo-stp_10.42.42.5(pid=31924): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31924)] 05:42:19.643708 run osmo-stp_10.42.42.5(pid=31924): stdout: | (launched: 2022-12-10_05:42:18.187199) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:42:19.782884 run osmo-stp_10.42.42.5(pid=31924): stderr: | 20221210054218383 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054218384 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054218384 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054218384 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054218385 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054218385 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054218385 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:42:19.922026 run osmo-stp_10.42.42.5(pid=31924): stdout: | (launched: 2022-12-10_05:42:18.187199) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:42:20.054079 run osmo-stp_10.42.42.5(pid=31924): stderr: | 20221210054218383 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054218384 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054218384 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054218384 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054218385 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054218385 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054218385 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:42:20.210733 run patchelf(pid=31927): Terminating (SIGINT) 05:42:20.391415 run patchelf(pid=31927): Terminated: ok {rc=0} 05:42:20.521608 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=31924): Process ended prematurely: osmo-stp_10.42.42.5(pid=31924) [trial-2370↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31924)] [trial-2370↪gprs:oc2g↪ping.py:22] 05:42:20.531103 tst ping.py:22: Test FAILED (6.8 sec) 05:42:20.559500 run osmo-hlr_10.42.42.2(pid=31921): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:oc2g↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31921)] 05:42:20.609536 run osmo-hlr_10.42.42.2(pid=31921): stdout: | (launched: 2022-12-10_05:42:17.177741) 05:42:20.661308 run osmo-hlr_10.42.42.2(pid=31921): stderr: | 20221210054217378 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210054217378 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210054217378 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210054217378 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210054217378 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210054217379 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210054217390 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:oc2g/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210054217399 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210054217399 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210054217399 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:42:20.713636 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31920): Terminating (SIGTERM) 05:42:20.755458 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31923): Terminating (SIGTERM) 05:42:20.797325 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31926): Terminating (SIGTERM) 05:42:20.839397 --- ParallelTerminationStrategy: PID 31920 died... 05:42:20.859439 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31920): Terminated: ok {rc=0} 05:42:20.905660 --- ParallelTerminationStrategy: PID 31923 died... 05:42:20.925322 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31923): Terminated: ok {rc=0} 05:42:20.971563 --- ParallelTerminationStrategy: PID 31926 died... 05:42:20.991139 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31926): Terminated: ok {rc=0} 05:42:21.078574 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:oc2g ping_idle_ping.py ---------------------------------------------- 05:42:22.163482 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:42:22.174937 tst gprs:oc2g: Using 1 x bts (candidates: 1) 05:42:22.214028 tst ping_idle_ping.py: using LAC 26240 05:42:22.331739 tst ping_idle_ping.py: using RAC 230 05:42:22.451716 tst ping_idle_ping.py: using CellId 26240 05:42:22.569935 tst ping_idle_ping.py: using BVCI 26241 05:42:22.679459 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:42:22.690073 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:42:22.700516 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:42:22.711531 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:42:22.722255 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:42:22.732834 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:42:22.743680 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:42:22.754381 tst gprs:oc2g: Using 1 x modem (candidates: 4) 05:42:22.875842 tst ping_idle_ping.py:24: start network... 05:42:23.094819 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:42:23.599751 run create_hlr_db(pid=31928): Launched 05:42:23.730752 bus /gobi_6: Setting Powered False 05:42:24.794722 run create_hlr_db(pid=31928): Terminated: ok {rc=0} 05:42:25.229236 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31930): Launched 05:42:25.533672 run osmo-hlr_10.42.42.2(pid=31931): Launched 05:42:25.648337 run osmo-stp_10.42.42.5: Starting osmo-stp 05:42:26.186504 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31933): Launched 05:42:26.490690 run osmo-stp_10.42.42.5(pid=31934): Launched 05:42:26.605459 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:42:27.128162 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31936): Launched 05:42:27.243824 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:42:27.501247 run patchelf(pid=31937): Launched 05:42:27.669696 run osmo-stp_10.42.42.5(pid=31934): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31934)] 05:42:27.797909 run osmo-stp_10.42.42.5(pid=31934): stdout: | (launched: 2022-12-10_05:42:26.432860) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:42:27.928507 run osmo-stp_10.42.42.5(pid=31934): stderr: | 20221210054226606 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054226606 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054226607 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054226607 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054226608 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054226608 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054226608 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:42:28.058287 run osmo-stp_10.42.42.5(pid=31934): stdout: | (launched: 2022-12-10_05:42:26.432860) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:42:28.181784 run osmo-stp_10.42.42.5(pid=31934): stderr: | 20221210054226606 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054226606 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054226607 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054226607 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054226608 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054226608 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054226608 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:42:28.327809 run patchelf(pid=31937): Terminating (SIGINT) 05:42:28.497298 run patchelf(pid=31937): Terminated: ok {rc=0} 05:42:28.619241 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=31934): Process ended prematurely: osmo-stp_10.42.42.5(pid=31934) [trial-2370↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31934)] [trial-2370↪gprs:oc2g↪ping_idle_ping.py:27] 05:42:28.628157 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 05:42:28.655560 run osmo-hlr_10.42.42.2(pid=31931): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:oc2g↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31931)] 05:42:28.703302 run osmo-hlr_10.42.42.2(pid=31931): stdout: | (launched: 2022-12-10_05:42:25.475623) 05:42:28.752489 run osmo-hlr_10.42.42.2(pid=31931): stderr: | 20221210054225655 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210054225655 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210054225655 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210054225655 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210054225655 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210054225655 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210054225666 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:oc2g/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210054225675 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210054225676 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210054225676 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:42:28.802249 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31930): Terminating (SIGTERM) 05:42:28.841831 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31933): Terminating (SIGTERM) 05:42:28.881350 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31936): Terminating (SIGTERM) 05:42:28.922615 --- ParallelTerminationStrategy: PID 31930 died... 05:42:28.941769 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31930): Terminated: ok {rc=0} 05:42:28.986079 --- ParallelTerminationStrategy: PID 31933 died... 05:42:29.004438 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31933): Terminated: ok {rc=0} 05:42:29.048897 --- ParallelTerminationStrategy: PID 31936 died... 05:42:29.067952 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31936): Terminated: ok {rc=0} 05:42:29.152060 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2370 gprs:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 gprs:oc2g+mod-bts0-egprs --------------------------------------------------------------------- 05:42:30.448554 tst gprs:oc2g+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:42:30.454905 tst gprs:oc2g+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 05:42:30.476578 tst gprs:oc2g+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 05:42:30.515974 tst gprs:oc2g+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 05:42:30.604405 tst gprs:oc2g+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 05:42:30.625330 tst gprs:oc2g+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 05:42:30.664139 tst gprs:oc2g+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 05:42:31.259090 tst gprs:oc2g+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2370 gprs:oc2g+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 05:42:31.314336 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:42:31.325585 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 05:42:31.367244 tst cs_paging_gprs_active.py: using LAC 26241 05:42:31.526837 tst cs_paging_gprs_active.py: using RAC 231 05:42:31.649448 tst cs_paging_gprs_active.py: using CellId 26241 05:42:31.802500 tst cs_paging_gprs_active.py: using BVCI 26242 05:42:31.918056 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:42:31.929965 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:42:31.941831 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:42:31.954458 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:42:31.968121 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:42:31.980788 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:42:31.992494 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:42:32.005475 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:42:32.019466 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 05:42:32.157600 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 05:42:32.281394 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 05:42:32.498448 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:42:32.823621 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31941): Launched 05:42:33.107029 run iperf3-srv_10.42.42.10(pid=31942): Launched 05:42:33.227410 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 05:42:33.443621 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:42:33.769892 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31943): Launched 05:42:34.053426 run iperf3-srv_10.42.42.10(pid=31944): Launched 05:42:34.173140 tst cs_paging_gprs_active.py:38: start network... 05:42:34.388443 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:42:34.891733 run create_hlr_db(pid=31945): Launched 05:42:35.024366 bus /gobi_6: Setting Powered False 05:42:36.087176 run create_hlr_db(pid=31945): Terminated: ok {rc=0} 05:42:36.520319 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31947): Launched 05:42:36.826018 run osmo-hlr_10.42.42.2(pid=31948): Launched 05:42:36.941970 run osmo-stp_10.42.42.5: Starting osmo-stp 05:42:37.480370 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31950): Launched 05:42:37.785354 run osmo-stp_10.42.42.5(pid=31951): Launched 05:42:37.901235 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:42:38.427666 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31953): Launched 05:42:38.543587 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:42:38.801641 run patchelf(pid=31954): Launched 05:42:38.969455 run osmo-stp_10.42.42.5(pid=31951): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31951)] 05:42:39.097726 run osmo-stp_10.42.42.5(pid=31951): stdout: | (launched: 2022-12-10_05:42:37.727312) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:42:39.227845 run osmo-stp_10.42.42.5(pid=31951): stderr: | 20221210054237901 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054237901 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054237901 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054237901 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054237902 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054237902 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054237902 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:42:39.358198 run osmo-stp_10.42.42.5(pid=31951): stdout: | (launched: 2022-12-10_05:42:37.727312) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:42:39.482226 run osmo-stp_10.42.42.5(pid=31951): stderr: | 20221210054237901 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054237901 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054237901 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054237901 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054237902 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054237902 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054237902 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:42:39.629277 run patchelf(pid=31954): Terminating (SIGINT) 05:42:39.798419 run patchelf(pid=31954): Terminated: ok {rc=0} 05:42:39.921114 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=31951): Process ended prematurely: osmo-stp_10.42.42.5(pid=31951) [trial-2370↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31951)] [trial-2370↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 05:42:39.930600 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 05:42:39.961959 run osmo-hlr_10.42.42.2(pid=31948): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31948)] 05:42:40.011718 run osmo-hlr_10.42.42.2(pid=31948): stdout: | (launched: 2022-12-10_05:42:36.768334) 05:42:40.063408 run osmo-hlr_10.42.42.2(pid=31948): stderr: | 20221210054236946 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210054236946 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210054236946 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210054236946 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210054236946 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210054236946 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210054236959 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:oc2g+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210054236969 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210054236970 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210054236970 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:42:40.115303 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31941): Terminating (SIGTERM) 05:42:40.156682 run iperf3-srv_10.42.42.10(pid=31942): Terminating (SIGTERM) 05:42:40.198403 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31943): Terminating (SIGTERM) 05:42:40.240386 run iperf3-srv_10.42.42.10(pid=31944): Terminating (SIGTERM) 05:42:40.281795 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31947): Terminating (SIGTERM) 05:42:40.323544 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31950): Terminating (SIGTERM) 05:42:40.365336 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31953): Terminating (SIGTERM) 05:42:40.406991 --- ParallelTerminationStrategy: PID 31941 died... 05:42:40.426764 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31941): Terminated: ok {rc=0} 05:42:40.472794 --- ParallelTerminationStrategy: PID 31942 died... 05:42:40.492481 run iperf3-srv_10.42.42.10(pid=31942): Terminated {rc=256} 05:42:40.537969 --- ParallelTerminationStrategy: PID 31943 died... 05:42:40.557273 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31943): Terminated: ok {rc=0} 05:42:40.603120 --- ParallelTerminationStrategy: PID 31944 died... 05:42:40.622469 run iperf3-srv_10.42.42.10(pid=31944): Terminated {rc=256} 05:42:40.667974 --- ParallelTerminationStrategy: PID 31947 died... 05:42:40.687240 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31947): Terminated: ok {rc=0} 05:42:40.733677 --- ParallelTerminationStrategy: PID 31950 died... 05:42:40.753090 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31950): Terminated: ok {rc=0} 05:42:40.798738 --- ParallelTerminationStrategy: PID 31953 died... 05:42:40.818911 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31953): Terminated: ok {rc=0} 05:42:40.906815 bus /gobi_0: Setting Powered False 05:42:42.005844 bus /gobi_0: Setting Powered False 05:42:43.124356 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:oc2g+mod-bts0-egprs iperf3.py ---------------------------------------------- 05:42:44.270876 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:42:44.282534 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 05:42:44.321090 tst iperf3.py: using LAC 26242 05:42:44.442008 tst iperf3.py: using RAC 232 05:42:44.565570 tst iperf3.py: using CellId 26242 05:42:44.684422 tst iperf3.py: using BVCI 26243 05:42:44.794202 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:42:44.804810 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:42:44.815566 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:42:44.827009 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:42:44.838273 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:42:44.849573 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:42:44.860865 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:42:44.872065 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:42:44.883597 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 05:42:45.000094 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 05:42:45.202462 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:42:45.507040 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31955): Launched 05:42:45.771618 run iperf3-srv_10.42.42.10(pid=31956): Launched 05:42:45.921907 tst iperf3.py:8: start network... 05:42:46.127527 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:42:46.606840 run create_hlr_db(pid=31957): Launched 05:42:46.784466 bus /gobi_6: Setting Powered False 05:42:47.843548 run create_hlr_db(pid=31957): Terminated: ok {rc=0} 05:42:48.299850 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31959): Launched 05:42:48.623347 run osmo-hlr_10.42.42.2(pid=31960): Launched 05:42:48.745151 run osmo-stp_10.42.42.5: Starting osmo-stp 05:42:49.302792 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31962): Launched 05:42:49.626843 run osmo-stp_10.42.42.5(pid=31963): Launched 05:42:49.750587 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:42:50.313447 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31965): Launched 05:42:50.435720 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:42:50.709523 run patchelf(pid=31966): Launched 05:42:50.888164 run osmo-stp_10.42.42.5(pid=31963): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31963)] 05:42:51.024393 run osmo-stp_10.42.42.5(pid=31963): stdout: | (launched: 2022-12-10_05:42:49.565709) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:42:51.161865 run osmo-stp_10.42.42.5(pid=31963): stderr: | 20221210054249760 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054249760 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054249760 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054249761 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054249763 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054249763 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054249763 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:42:51.299058 run osmo-stp_10.42.42.5(pid=31963): stdout: | (launched: 2022-12-10_05:42:49.565709) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:42:51.430698 run osmo-stp_10.42.42.5(pid=31963): stderr: | 20221210054249760 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054249760 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054249760 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054249761 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054249763 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054249763 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054249763 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:42:51.586420 run patchelf(pid=31966): Terminating (SIGINT) 05:42:51.765921 run patchelf(pid=31966): Terminated: ok {rc=0} 05:42:51.910819 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31963): Process ended prematurely: osmo-stp_10.42.42.5(pid=31963) [trial-2370↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31963)] [trial-2370↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8] 05:42:51.926364 tst iperf3.py:8: Test FAILED (7.7 sec) 05:42:51.956663 run osmo-hlr_10.42.42.2(pid=31960): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:oc2g+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31960)] 05:42:52.005433 run osmo-hlr_10.42.42.2(pid=31960): stdout: | (launched: 2022-12-10_05:42:48.563020) 05:42:52.056066 run osmo-hlr_10.42.42.2(pid=31960): stderr: | 20221210054248763 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210054248763 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210054248763 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210054248763 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210054248763 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210054248763 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210054248775 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:oc2g+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210054248784 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210054248784 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210054248784 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:42:52.107007 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31955): Terminating (SIGTERM) 05:42:52.147570 run iperf3-srv_10.42.42.10(pid=31956): Terminating (SIGTERM) 05:42:52.188158 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31959): Terminating (SIGTERM) 05:42:52.229306 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31962): Terminating (SIGTERM) 05:42:52.269832 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31965): Terminating (SIGTERM) 05:42:52.310020 --- ParallelTerminationStrategy: PID 31955 died... 05:42:52.329047 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31955): Terminated: ok {rc=0} 05:42:52.373500 --- ParallelTerminationStrategy: PID 31956 died... 05:42:52.392077 run iperf3-srv_10.42.42.10(pid=31956): Terminated {rc=256} 05:42:52.436405 --- ParallelTerminationStrategy: PID 31959 died... 05:42:52.455070 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31959): Terminated: ok {rc=0} 05:42:52.499358 --- ParallelTerminationStrategy: PID 31962 died... 05:42:52.517957 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31962): Terminated: ok {rc=0} 05:42:52.562404 --- ParallelTerminationStrategy: PID 31965 died... 05:42:52.580885 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31965): Terminated: ok {rc=0} 05:42:52.667099 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:oc2g+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 05:42:53.814215 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:42:53.825813 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 05:42:53.862332 tst iperf3m4.py: using LAC 26243 05:42:53.982964 tst iperf3m4.py: using RAC 233 05:42:54.102679 tst iperf3m4.py: using CellId 26243 05:42:54.223760 tst iperf3m4.py: using BVCI 26244 05:42:54.333783 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:42:54.344655 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:42:54.355377 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:42:54.366738 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:42:54.378127 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:42:54.389428 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:42:54.400814 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:42:54.412170 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:42:54.423757 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 05:42:54.543894 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 05:42:54.662683 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 05:42:54.781908 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 05:42:54.896583 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 05:42:55.098232 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:42:55.403508 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31967): Launched 05:42:55.667562 run iperf3-srv_10.42.42.10(pid=31968): Launched 05:42:55.780372 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 05:42:55.981230 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:42:56.286771 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31969): Launched 05:42:56.551592 run iperf3-srv_10.42.42.10(pid=31970): Launched 05:42:56.664198 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 05:42:56.865602 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:42:57.170235 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31971): Launched 05:42:57.435089 run iperf3-srv_10.42.42.10(pid=31972): Launched 05:42:57.547984 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 05:42:57.749730 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:42:58.054947 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31973): Launched 05:42:58.320651 run iperf3-srv_10.42.42.10(pid=31974): Launched 05:42:58.432937 tst iperf3m4.py:8: start network... 05:42:58.633611 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:42:59.103181 run create_hlr_db(pid=31975): Launched 05:42:59.218056 bus /gobi_6: Setting Powered False 05:43:00.277985 run create_hlr_db(pid=31975): Terminated: ok {rc=0} 05:43:00.720149 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31977): Launched 05:43:01.080379 run osmo-hlr_10.42.42.2(pid=31978): Launched 05:43:01.238385 run osmo-stp_10.42.42.5: Starting osmo-stp 05:43:01.957987 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31980): Launched 05:43:02.300196 run osmo-stp_10.42.42.5(pid=31981): Launched 05:43:02.423757 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:43:02.983030 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31983): Launched 05:43:03.108023 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:43:03.383265 run patchelf(pid=31984): Launched 05:43:03.565172 run osmo-stp_10.42.42.5(pid=31981): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31981)] 05:43:03.702225 run osmo-stp_10.42.42.5(pid=31981): stdout: | (launched: 2022-12-10_05:43:02.236735) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:43:03.840877 run osmo-stp_10.42.42.5(pid=31981): stderr: | 20221210054302451 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054302451 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054302452 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054302452 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054302453 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054302453 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054302453 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:43:03.979062 run osmo-stp_10.42.42.5(pid=31981): stdout: | (launched: 2022-12-10_05:43:02.236735) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:43:04.111337 run osmo-stp_10.42.42.5(pid=31981): stderr: | 20221210054302451 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054302451 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054302452 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054302452 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054302453 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054302453 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054302453 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:43:04.268788 run patchelf(pid=31984): Terminating (SIGINT) 05:43:04.449155 run patchelf(pid=31984): Terminated: ok {rc=0} 05:43:04.579131 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31981): Process ended prematurely: osmo-stp_10.42.42.5(pid=31981) [trial-2370↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31981)] [trial-2370↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8] 05:43:04.589484 tst iperf3m4.py:8: Test FAILED (10.8 sec) 05:43:04.618122 run osmo-hlr_10.42.42.2(pid=31978): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31978)] 05:43:04.668348 run osmo-hlr_10.42.42.2(pid=31978): stdout: | (launched: 2022-12-10_05:43:01.014076) 05:43:04.720012 run osmo-hlr_10.42.42.2(pid=31978): stderr: | 20221210054301371 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210054301371 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210054301371 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210054301371 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210054301371 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210054301371 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210054301395 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:oc2g+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210054301411 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210054301412 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210054301412 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:43:04.772324 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31967): Terminating (SIGTERM) 05:43:04.814367 run iperf3-srv_10.42.42.10(pid=31968): Terminating (SIGTERM) 05:43:04.856143 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31969): Terminating (SIGTERM) 05:43:04.898094 run iperf3-srv_10.42.42.10(pid=31970): Terminating (SIGTERM) 05:43:04.940601 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31971): Terminating (SIGTERM) 05:43:04.983192 run iperf3-srv_10.42.42.10(pid=31972): Terminating (SIGTERM) 05:43:05.025266 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31973): Terminating (SIGTERM) 05:43:05.067374 run iperf3-srv_10.42.42.10(pid=31974): Terminating (SIGTERM) 05:43:05.109517 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31977): Terminating (SIGTERM) 05:43:05.151559 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31980): Terminating (SIGTERM) 05:43:05.193750 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31983): Terminating (SIGTERM) 05:43:05.235741 --- ParallelTerminationStrategy: PID 31967 died... 05:43:05.255856 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31967): Terminated: ok {rc=0} 05:43:05.302603 --- ParallelTerminationStrategy: PID 31968 died... 05:43:05.322483 run iperf3-srv_10.42.42.10(pid=31968): Terminated {rc=256} 05:43:05.368838 --- ParallelTerminationStrategy: PID 31969 died... 05:43:05.388835 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31969): Terminated: ok {rc=0} 05:43:05.435304 --- ParallelTerminationStrategy: PID 31970 died... 05:43:05.455017 run iperf3-srv_10.42.42.10(pid=31970): Terminated {rc=256} 05:43:05.501234 --- ParallelTerminationStrategy: PID 31971 died... 05:43:05.520923 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31971): Terminated: ok {rc=0} 05:43:05.567086 --- ParallelTerminationStrategy: PID 31972 died... 05:43:05.586715 run iperf3-srv_10.42.42.10(pid=31972): Terminated {rc=256} 05:43:05.632924 --- ParallelTerminationStrategy: PID 31973 died... 05:43:05.652467 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31973): Terminated: ok {rc=0} 05:43:05.698844 --- ParallelTerminationStrategy: PID 31974 died... 05:43:05.718676 run iperf3-srv_10.42.42.10(pid=31974): Terminated {rc=256} 05:43:05.765237 --- ParallelTerminationStrategy: PID 31977 died... 05:43:05.784776 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31977): Terminated: ok {rc=0} 05:43:05.831416 --- ParallelTerminationStrategy: PID 31980 died... 05:43:05.851027 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31980): Terminated: ok {rc=0} 05:43:05.897345 --- ParallelTerminationStrategy: PID 31983 died... 05:43:05.917202 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31983): Terminated: ok {rc=0} 05:43:06.005677 bus /gobi_4: Setting Powered False 05:43:07.104814 bus /gobi_4: Setting Powered False 05:43:08.222275 bus /gobi_1: Setting Powered False 05:43:09.318142 bus /gobi_1: Setting Powered False 05:43:10.433249 bus /gobi_0: Setting Powered False 05:43:11.531410 bus /gobi_0: Setting Powered False 05:43:12.650843 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:oc2g+mod-bts0-egprs ping.py ---------------------------------------------- 05:43:13.754599 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:43:13.766415 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 05:43:13.805637 tst ping.py: using LAC 26244 05:43:13.924255 tst ping.py: using RAC 234 05:43:14.041157 tst ping.py: using CellId 26244 05:43:14.157772 tst ping.py: using BVCI 26245 05:43:14.265686 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:43:14.276514 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:43:14.287256 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:43:14.298331 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:43:14.309072 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:43:14.319830 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:43:14.330812 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:43:14.341707 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 05:43:14.456566 tst ping.py:19: start network... 05:43:14.655004 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:43:15.115244 run create_hlr_db(pid=31985): Launched 05:43:15.227665 bus /gobi_6: Setting Powered False 05:43:16.285374 run create_hlr_db(pid=31985): Terminated: ok {rc=0} 05:43:16.718231 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31987): Launched 05:43:17.041200 run osmo-hlr_10.42.42.2(pid=31988): Launched 05:43:17.211437 run osmo-stp_10.42.42.5: Starting osmo-stp 05:43:17.757216 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31990): Launched 05:43:18.075178 run osmo-stp_10.42.42.5(pid=31991): Launched 05:43:18.194815 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:43:18.743524 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31993): Launched 05:43:18.864311 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:43:19.134192 run patchelf(pid=31994): Launched 05:43:19.312172 run osmo-stp_10.42.42.5(pid=31991): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31991)] 05:43:19.446854 run osmo-stp_10.42.42.5(pid=31991): stdout: | (launched: 2022-12-10_05:43:18.015232) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:43:19.583129 run osmo-stp_10.42.42.5(pid=31991): stderr: | 20221210054318211 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054318211 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054318211 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054318211 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054318212 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054318212 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054318212 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:43:19.719777 run osmo-stp_10.42.42.5(pid=31991): stdout: | (launched: 2022-12-10_05:43:18.015232) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:43:19.850360 run osmo-stp_10.42.42.5(pid=31991): stderr: | 20221210054318211 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054318211 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054318211 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054318211 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054318212 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054318212 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054318212 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:43:20.004349 run patchelf(pid=31994): Terminating (SIGINT) 05:43:20.182016 run patchelf(pid=31994): Terminated: ok {rc=0} 05:43:20.309976 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=31991): Process ended prematurely: osmo-stp_10.42.42.5(pid=31991) [trial-2370↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31991)] [trial-2370↪gprs:oc2g+mod-bts0-egprs↪ping.py:22] 05:43:20.319724 tst ping.py:22: Test FAILED (6.6 sec) 05:43:20.347742 run osmo-hlr_10.42.42.2(pid=31988): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:oc2g+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31988)] 05:43:20.397803 run osmo-hlr_10.42.42.2(pid=31988): stdout: | (launched: 2022-12-10_05:43:16.979755) 05:43:20.449509 run osmo-hlr_10.42.42.2(pid=31988): stderr: | 20221210054317229 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210054317229 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210054317229 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210054317229 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210054317229 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210054317229 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210054317241 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:oc2g+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210054317249 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210054317249 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210054317249 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:43:20.501797 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31987): Terminating (SIGTERM) 05:43:20.543547 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31990): Terminating (SIGTERM) 05:43:20.585541 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31993): Terminating (SIGTERM) 05:43:20.627806 --- ParallelTerminationStrategy: PID 31987 died... 05:43:20.647922 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31987): Terminated: ok {rc=0} 05:43:20.694614 --- ParallelTerminationStrategy: PID 31990 died... 05:43:20.714257 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31990): Terminated: ok {rc=0} 05:43:20.760619 --- ParallelTerminationStrategy: PID 31993 died... 05:43:20.780282 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31993): Terminated: ok {rc=0} 05:43:20.867781 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:oc2g+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 05:43:21.956402 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:43:21.969105 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 05:43:22.009263 tst ping_idle_ping.py: using LAC 26245 05:43:22.135097 tst ping_idle_ping.py: using RAC 235 05:43:22.258690 tst ping_idle_ping.py: using CellId 26245 05:43:22.384133 tst ping_idle_ping.py: using BVCI 26246 05:43:22.494085 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:43:22.505184 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:43:22.516025 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:43:22.527557 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:43:22.538976 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:43:22.550250 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:43:22.561882 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:43:22.573496 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 05:43:22.692940 tst ping_idle_ping.py:24: start network... 05:43:22.906021 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:43:23.401491 run create_hlr_db(pid=31995): Launched 05:43:23.529797 bus /gobi_6: Setting Powered False 05:43:24.592354 run create_hlr_db(pid=31995): Terminated: ok {rc=0} 05:43:25.037048 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31997): Launched 05:43:25.355619 run osmo-hlr_10.42.42.2(pid=31998): Launched 05:43:25.476357 run osmo-stp_10.42.42.5: Starting osmo-stp 05:43:26.009084 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32000): Launched 05:43:26.309802 run osmo-stp_10.42.42.5(pid=32001): Launched 05:43:26.424286 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:43:26.944634 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32003): Launched 05:43:27.059646 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:43:27.314662 run patchelf(pid=32004): Launched 05:43:27.481874 run osmo-stp_10.42.42.5(pid=32001): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32001)] 05:43:27.609813 run osmo-stp_10.42.42.5(pid=32001): stdout: | (launched: 2022-12-10_05:43:26.252551) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:43:27.739208 run osmo-stp_10.42.42.5(pid=32001): stderr: | 20221210054326426 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054326426 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054326426 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054326426 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054326427 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054326427 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054326427 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:43:27.868635 run osmo-stp_10.42.42.5(pid=32001): stdout: | (launched: 2022-12-10_05:43:26.252551) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:43:27.991811 run osmo-stp_10.42.42.5(pid=32001): stderr: | 20221210054326426 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054326426 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054326426 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054326426 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054326427 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054326427 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054326427 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:43:28.137873 run patchelf(pid=32004): Terminating (SIGINT) 05:43:28.306053 run patchelf(pid=32004): Terminated: ok {rc=0} 05:43:28.428062 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=32001): Process ended prematurely: osmo-stp_10.42.42.5(pid=32001) [trial-2370↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32001)] [trial-2370↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27] 05:43:28.437468 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 05:43:28.464553 run osmo-hlr_10.42.42.2(pid=31998): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31998)] 05:43:28.513487 run osmo-hlr_10.42.42.2(pid=31998): stdout: | (launched: 2022-12-10_05:43:25.295592) 05:43:28.563349 run osmo-hlr_10.42.42.2(pid=31998): stderr: | 20221210054325495 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210054325495 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210054325495 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210054325495 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210054325495 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210054325495 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210054325509 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:oc2g+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210054325518 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210054325519 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210054325519 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:43:28.613735 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31997): Terminating (SIGTERM) 05:43:28.653768 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32000): Terminating (SIGTERM) 05:43:28.693788 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32003): Terminating (SIGTERM) 05:43:28.734275 --- ParallelTerminationStrategy: PID 31997 died... 05:43:28.753524 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31997): Terminated: ok {rc=0} 05:43:28.798028 --- ParallelTerminationStrategy: PID 32000 died... 05:43:28.816761 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32000): Terminated: ok {rc=0} 05:43:28.861780 --- ParallelTerminationStrategy: PID 32003 died... 05:43:28.880584 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32003): Terminated: ok {rc=0} 05:43:28.967379 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2370 gprs:oc2g+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 gprs:oc2g+mod-bts0-dynts-ipa --------------------------------------------------------------------- 05:43:30.261516 tst gprs:oc2g+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:43:30.268159 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 05:43:30.289795 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 05:43:30.328185 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 05:43:30.414609 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 05:43:30.434853 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 05:43:30.473214 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 05:43:31.090504 tst gprs:oc2g+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2370 gprs:oc2g+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 05:43:31.144521 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:43:31.156500 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 05:43:31.214947 tst cs_paging_gprs_active.py: using LAC 26246 05:43:31.340285 tst cs_paging_gprs_active.py: using RAC 236 05:43:31.466456 tst cs_paging_gprs_active.py: using CellId 26246 05:43:31.628869 tst cs_paging_gprs_active.py: using BVCI 26247 05:43:31.752894 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:43:31.765540 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:43:31.777711 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:43:31.790141 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:43:31.803087 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:43:31.815602 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:43:31.827658 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:43:31.839873 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:43:31.853476 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 05:43:31.991346 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 05:43:32.108939 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 05:43:32.320007 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:43:32.629279 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32008): Launched 05:43:32.897062 run iperf3-srv_10.42.42.10(pid=32009): Launched 05:43:33.011554 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 05:43:33.215491 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:43:33.541926 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32010): Launched 05:43:33.827187 run iperf3-srv_10.42.42.10(pid=32011): Launched 05:43:33.948569 tst cs_paging_gprs_active.py:38: start network... 05:43:34.167796 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:43:34.673258 run create_hlr_db(pid=32012): Launched 05:43:34.806193 bus /gobi_6: Setting Powered False 05:43:35.869783 run create_hlr_db(pid=32012): Terminated: ok {rc=0} 05:43:36.306719 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32014): Launched 05:43:36.614257 run osmo-hlr_10.42.42.2(pid=32015): Launched 05:43:36.730811 run osmo-stp_10.42.42.5: Starting osmo-stp 05:43:37.274549 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32017): Launched 05:43:37.581220 run osmo-stp_10.42.42.5(pid=32018): Launched 05:43:37.697304 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:43:38.224080 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32020): Launched 05:43:38.340876 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:43:38.600908 run patchelf(pid=32021): Launched 05:43:38.770340 run osmo-stp_10.42.42.5(pid=32018): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32018)] 05:43:38.899102 run osmo-stp_10.42.42.5(pid=32018): stdout: | (launched: 2022-12-10_05:43:37.523346) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:43:39.029831 run osmo-stp_10.42.42.5(pid=32018): stderr: | 20221210054337697 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054337697 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054337698 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054337698 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054337699 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054337699 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054337699 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:43:39.160558 run osmo-stp_10.42.42.5(pid=32018): stdout: | (launched: 2022-12-10_05:43:37.523346) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:43:39.285320 run osmo-stp_10.42.42.5(pid=32018): stderr: | 20221210054337697 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054337697 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054337698 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054337698 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054337699 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054337699 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054337699 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:43:39.432940 run patchelf(pid=32021): Terminating (SIGINT) 05:43:39.603696 run patchelf(pid=32021): Terminated: ok {rc=0} 05:43:39.727250 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=32018): Process ended prematurely: osmo-stp_10.42.42.5(pid=32018) [trial-2370↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32018)] [trial-2370↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 05:43:39.736691 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 05:43:39.764145 run osmo-hlr_10.42.42.2(pid=32015): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32015)] 05:43:39.811964 run osmo-hlr_10.42.42.2(pid=32015): stdout: | (launched: 2022-12-10_05:43:36.556304) 05:43:39.861336 run osmo-hlr_10.42.42.2(pid=32015): stderr: | 20221210054336735 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210054336735 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210054336735 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210054336735 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210054336735 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210054336736 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210054336747 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:oc2g+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210054336756 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210054336756 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210054336757 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:43:39.911091 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32008): Terminating (SIGTERM) 05:43:39.950805 run iperf3-srv_10.42.42.10(pid=32009): Terminating (SIGTERM) 05:43:39.990372 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32010): Terminating (SIGTERM) 05:43:40.030009 run iperf3-srv_10.42.42.10(pid=32011): Terminating (SIGTERM) 05:43:40.069554 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32014): Terminating (SIGTERM) 05:43:40.109466 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32017): Terminating (SIGTERM) 05:43:40.149174 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32020): Terminating (SIGTERM) 05:43:40.188912 --- ParallelTerminationStrategy: PID 32008 died... 05:43:40.207972 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32008): Terminated: ok {rc=0} 05:43:40.252065 --- ParallelTerminationStrategy: PID 32009 died... 05:43:40.270427 run iperf3-srv_10.42.42.10(pid=32009): Terminated {rc=256} 05:43:40.314001 --- ParallelTerminationStrategy: PID 32010 died... 05:43:40.332313 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32010): Terminated: ok {rc=0} 05:43:40.376035 --- ParallelTerminationStrategy: PID 32011 died... 05:43:40.394370 run iperf3-srv_10.42.42.10(pid=32011): Terminated {rc=256} 05:43:40.438149 --- ParallelTerminationStrategy: PID 32014 died... 05:43:40.456716 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32014): Terminated: ok {rc=0} 05:43:40.500358 --- ParallelTerminationStrategy: PID 32017 died... 05:43:40.518822 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32017): Terminated: ok {rc=0} 05:43:40.562677 --- ParallelTerminationStrategy: PID 32020 died... 05:43:40.581066 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32020): Terminated: ok {rc=0} 05:43:40.667338 bus /gobi_0: Setting Powered False 05:43:41.769084 bus /gobi_0: Setting Powered False 05:43:42.884285 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:oc2g+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 05:43:44.033683 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:43:44.045567 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 05:43:44.109083 tst iperf3.py: using LAC 26247 05:43:44.234527 tst iperf3.py: using RAC 237 05:43:44.360194 tst iperf3.py: using CellId 26247 05:43:44.485599 tst iperf3.py: using BVCI 26248 05:43:44.603472 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:43:44.614967 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:43:44.626190 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:43:44.637408 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:43:44.648432 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:43:44.659652 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:43:44.671045 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:43:44.682514 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:43:44.694659 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 05:43:44.813268 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 05:43:45.030685 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:43:45.356185 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32022): Launched 05:43:45.638848 run iperf3-srv_10.42.42.10(pid=32023): Launched 05:43:45.760042 tst iperf3.py:8: start network... 05:43:45.983404 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:43:46.474982 run create_hlr_db(pid=32024): Launched 05:43:46.639484 bus /gobi_6: Setting Powered False 05:43:47.699609 run create_hlr_db(pid=32024): Terminated: ok {rc=0} 05:43:48.153509 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32026): Launched 05:43:48.477941 run osmo-hlr_10.42.42.2(pid=32027): Launched 05:43:48.602056 run osmo-stp_10.42.42.5: Starting osmo-stp 05:43:49.161449 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32029): Launched 05:43:49.484330 run osmo-stp_10.42.42.5(pid=32030): Launched 05:43:49.607202 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:43:50.167305 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32032): Launched 05:43:50.291324 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:43:50.567505 run patchelf(pid=32033): Launched 05:43:50.747006 run osmo-stp_10.42.42.5(pid=32030): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32030)] 05:43:50.884441 run osmo-stp_10.42.42.5(pid=32030): stdout: | (launched: 2022-12-10_05:43:49.423568) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:43:51.022799 run osmo-stp_10.42.42.5(pid=32030): stderr: | 20221210054349620 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054349620 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054349620 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054349620 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054349621 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054349621 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054349621 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:43:51.161098 run osmo-stp_10.42.42.5(pid=32030): stdout: | (launched: 2022-12-10_05:43:49.423568) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:43:51.293547 run osmo-stp_10.42.42.5(pid=32030): stderr: | 20221210054349620 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054349620 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054349620 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054349620 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054349621 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054349621 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054349621 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:43:51.450478 run patchelf(pid=32033): Terminating (SIGINT) 05:43:51.630598 run patchelf(pid=32033): Terminated: ok {rc=0} 05:43:51.761242 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32030): Process ended prematurely: osmo-stp_10.42.42.5(pid=32030) [trial-2370↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32030)] [trial-2370↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8] 05:43:51.771556 tst iperf3.py:8: Test FAILED (7.8 sec) 05:43:51.800154 run osmo-hlr_10.42.42.2(pid=32027): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32027)] 05:43:51.850126 run osmo-hlr_10.42.42.2(pid=32027): stdout: | (launched: 2022-12-10_05:43:48.416767) 05:43:51.901893 run osmo-hlr_10.42.42.2(pid=32027): stderr: | 20221210054348622 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210054348622 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210054348622 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210054348622 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210054348622 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210054348622 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210054348635 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:oc2g+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210054348643 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210054348643 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210054348643 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:43:51.953925 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32022): Terminating (SIGTERM) 05:43:51.995542 run iperf3-srv_10.42.42.10(pid=32023): Terminating (SIGTERM) 05:43:52.037245 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32026): Terminating (SIGTERM) 05:43:52.078925 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32029): Terminating (SIGTERM) 05:43:52.120482 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32032): Terminating (SIGTERM) 05:43:52.162495 --- ParallelTerminationStrategy: PID 32022 died... 05:43:52.182249 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32022): Terminated: ok {rc=0} 05:43:52.228401 --- ParallelTerminationStrategy: PID 32023 died... 05:43:52.247794 run iperf3-srv_10.42.42.10(pid=32023): Terminated {rc=256} 05:43:52.293572 --- ParallelTerminationStrategy: PID 32026 died... 05:43:52.313018 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32026): Terminated: ok {rc=0} 05:43:52.359508 --- ParallelTerminationStrategy: PID 32029 died... 05:43:52.378994 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32029): Terminated: ok {rc=0} 05:43:52.424848 --- ParallelTerminationStrategy: PID 32032 died... 05:43:52.444594 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32032): Terminated: ok {rc=0} 05:43:52.533537 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:oc2g+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 05:43:53.687873 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:43:53.699971 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 05:43:53.758416 tst iperf3m4.py: using LAC 26248 05:43:53.885132 tst iperf3m4.py: using RAC 238 05:43:54.013542 tst iperf3m4.py: using CellId 26248 05:43:54.136546 tst iperf3m4.py: using BVCI 26249 05:43:54.254948 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:43:54.266448 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:43:54.277683 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:43:54.288762 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:43:54.299881 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:43:54.310930 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:43:54.322493 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:43:54.334653 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:43:54.346022 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 05:43:54.466222 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 05:43:54.591135 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 05:43:54.708374 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 05:43:54.829426 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 05:43:55.048405 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:43:55.375198 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32034): Launched 05:43:55.659901 run iperf3-srv_10.42.42.10(pid=32035): Launched 05:43:55.782302 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 05:43:56.000016 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:43:56.326090 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32036): Launched 05:43:56.612455 run iperf3-srv_10.42.42.10(pid=32037): Launched 05:43:56.733695 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 05:43:56.951817 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:43:57.278966 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32038): Launched 05:43:57.563032 run iperf3-srv_10.42.42.10(pid=32039): Launched 05:43:57.684594 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 05:43:57.902842 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:43:58.230510 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32040): Launched 05:43:58.516279 run iperf3-srv_10.42.42.10(pid=32041): Launched 05:43:58.638324 tst iperf3m4.py:8: start network... 05:43:58.857060 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:43:59.362405 run create_hlr_db(pid=32042): Launched 05:43:59.493385 bus /gobi_6: Setting Powered False 05:44:00.556782 run create_hlr_db(pid=32042): Terminated: ok {rc=0} 05:44:01.024924 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32044): Launched 05:44:01.369017 run osmo-hlr_10.42.42.2(pid=32045): Launched 05:44:01.634315 run osmo-stp_10.42.42.5: Starting osmo-stp 05:44:02.266877 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32047): Launched 05:44:02.592388 run osmo-stp_10.42.42.5(pid=32048): Launched 05:44:02.715515 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:44:03.276214 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32050): Launched 05:44:03.401982 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:44:03.677071 run patchelf(pid=32051): Launched 05:44:03.856763 run osmo-stp_10.42.42.5(pid=32048): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32048)] 05:44:03.993924 run osmo-stp_10.42.42.5(pid=32048): stdout: | (launched: 2022-12-10_05:44:02.530990) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:44:04.132118 run osmo-stp_10.42.42.5(pid=32048): stderr: | 20221210054402726 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054402726 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054402727 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054402728 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054402728 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054402728 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054402728 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:44:04.270934 run osmo-stp_10.42.42.5(pid=32048): stdout: | (launched: 2022-12-10_05:44:02.530990) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:44:04.403682 run osmo-stp_10.42.42.5(pid=32048): stderr: | 20221210054402726 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054402726 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054402727 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054402728 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054402728 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054402728 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054402728 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:44:04.560928 run patchelf(pid=32051): Terminating (SIGINT) 05:44:04.742351 run patchelf(pid=32051): Terminated: ok {rc=0} 05:44:04.872926 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32048): Process ended prematurely: osmo-stp_10.42.42.5(pid=32048) [trial-2370↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32048)] [trial-2370↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8] 05:44:04.883209 tst iperf3m4.py:8: Test FAILED (11.2 sec) 05:44:04.911864 run osmo-hlr_10.42.42.2(pid=32045): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32045)] 05:44:04.962193 run osmo-hlr_10.42.42.2(pid=32045): stdout: | (launched: 2022-12-10_05:44:01.304916) 05:44:05.014075 run osmo-hlr_10.42.42.2(pid=32045): stderr: | 20221210054401576 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210054401576 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210054401576 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210054401576 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210054401576 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210054401576 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210054401597 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:oc2g+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210054401614 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210054401614 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210054401614 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:44:05.066179 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32034): Terminating (SIGTERM) 05:44:05.108221 run iperf3-srv_10.42.42.10(pid=32035): Terminating (SIGTERM) 05:44:05.150226 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32036): Terminating (SIGTERM) 05:44:05.192418 run iperf3-srv_10.42.42.10(pid=32037): Terminating (SIGTERM) 05:44:05.234218 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32038): Terminating (SIGTERM) 05:44:05.276211 run iperf3-srv_10.42.42.10(pid=32039): Terminating (SIGTERM) 05:44:05.318031 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32040): Terminating (SIGTERM) 05:44:05.359931 run iperf3-srv_10.42.42.10(pid=32041): Terminating (SIGTERM) 05:44:05.401629 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32044): Terminating (SIGTERM) 05:44:05.443673 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32047): Terminating (SIGTERM) 05:44:05.485569 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32050): Terminating (SIGTERM) 05:44:05.527690 --- ParallelTerminationStrategy: PID 32034 died... 05:44:05.547574 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32034): Terminated: ok {rc=0} 05:44:05.593718 --- ParallelTerminationStrategy: PID 32035 died... 05:44:05.613141 run iperf3-srv_10.42.42.10(pid=32035): Terminated {rc=256} 05:44:05.659281 --- ParallelTerminationStrategy: PID 32036 died... 05:44:05.678914 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32036): Terminated: ok {rc=0} 05:44:05.724887 --- ParallelTerminationStrategy: PID 32037 died... 05:44:05.744585 run iperf3-srv_10.42.42.10(pid=32037): Terminated {rc=256} 05:44:05.791036 --- ParallelTerminationStrategy: PID 32038 died... 05:44:05.810491 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32038): Terminated: ok {rc=0} 05:44:05.856522 --- ParallelTerminationStrategy: PID 32039 died... 05:44:05.875962 run iperf3-srv_10.42.42.10(pid=32039): Terminated {rc=256} 05:44:05.921860 --- ParallelTerminationStrategy: PID 32040 died... 05:44:05.941319 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32040): Terminated: ok {rc=0} 05:44:05.987333 --- ParallelTerminationStrategy: PID 32041 died... 05:44:06.006955 run iperf3-srv_10.42.42.10(pid=32041): Terminated {rc=256} 05:44:06.053054 --- ParallelTerminationStrategy: PID 32044 died... 05:44:06.072640 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32044): Terminated: ok {rc=0} 05:44:06.118927 --- ParallelTerminationStrategy: PID 32047 died... 05:44:06.138591 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32047): Terminated: ok {rc=0} 05:44:06.184738 --- ParallelTerminationStrategy: PID 32050 died... 05:44:06.204403 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32050): Terminated: ok {rc=0} 05:44:06.292271 bus /gobi_4: Setting Powered False 05:44:07.391676 bus /gobi_4: Setting Powered False 05:44:08.506822 bus /gobi_1: Setting Powered False 05:44:09.606368 bus /gobi_1: Setting Powered False 05:44:10.723052 bus /gobi_0: Setting Powered False 05:44:11.821915 bus /gobi_0: Setting Powered False 05:44:12.937310 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:oc2g+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 05:44:14.039792 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:44:14.051803 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 05:44:14.109730 tst ping.py: using LAC 26249 05:44:14.237187 tst ping.py: using RAC 239 05:44:14.360837 tst ping.py: using CellId 26249 05:44:14.483241 tst ping.py: using BVCI 26250 05:44:14.599996 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:44:14.611395 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:44:14.622616 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:44:14.633842 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:44:14.645167 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:44:14.656106 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:44:14.667379 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:44:14.678459 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 05:44:14.797396 tst ping.py:19: start network... 05:44:15.010768 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:44:15.503727 run create_hlr_db(pid=32053): Launched 05:44:15.632427 bus /gobi_6: Setting Powered False 05:44:16.691832 run create_hlr_db(pid=32053): Terminated: ok {rc=0} 05:44:17.135413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32055): Launched 05:44:17.449641 run osmo-hlr_10.42.42.2(pid=32056): Launched 05:44:17.566780 run osmo-stp_10.42.42.5: Starting osmo-stp 05:44:18.086089 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32058): Launched 05:44:18.386276 run osmo-stp_10.42.42.5(pid=32059): Launched 05:44:18.499739 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:44:19.018679 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32061): Launched 05:44:19.133285 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:44:19.388329 run patchelf(pid=32062): Launched 05:44:19.555562 run osmo-stp_10.42.42.5(pid=32059): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32059)] 05:44:19.682507 run osmo-stp_10.42.42.5(pid=32059): stdout: | (launched: 2022-12-10_05:44:18.328729) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:44:19.811439 run osmo-stp_10.42.42.5(pid=32059): stderr: | 20221210054418499 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054418500 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054418500 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054418500 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054418501 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054418501 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054418501 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:44:19.940273 run osmo-stp_10.42.42.5(pid=32059): stdout: | (launched: 2022-12-10_05:44:18.328729) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:44:20.062681 run osmo-stp_10.42.42.5(pid=32059): stderr: | 20221210054418499 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054418500 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054418500 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054418500 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054418501 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054418501 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054418501 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:44:20.207566 run patchelf(pid=32062): Terminating (SIGINT) 05:44:20.375298 run patchelf(pid=32062): Terminated: ok {rc=0} 05:44:20.496328 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=32059): Process ended prematurely: osmo-stp_10.42.42.5(pid=32059) [trial-2370↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32059)] [trial-2370↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22] 05:44:20.505728 tst ping.py:22: Test FAILED (6.5 sec) 05:44:20.533427 run osmo-hlr_10.42.42.2(pid=32056): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32056)] 05:44:20.581585 run osmo-hlr_10.42.42.2(pid=32056): stdout: | (launched: 2022-12-10_05:44:17.392500) 05:44:20.631200 run osmo-hlr_10.42.42.2(pid=32056): stderr: | 20221210054417569 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210054417569 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210054417569 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210054417569 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210054417569 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210054417569 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210054417581 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:oc2g+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210054417590 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210054417590 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210054417590 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:44:20.681322 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32055): Terminating (SIGTERM) 05:44:20.721385 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32058): Terminating (SIGTERM) 05:44:20.762221 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32061): Terminating (SIGTERM) 05:44:20.802693 --- ParallelTerminationStrategy: PID 32055 died... 05:44:20.821996 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32055): Terminated: ok {rc=0} 05:44:20.866756 --- ParallelTerminationStrategy: PID 32058 died... 05:44:20.885506 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32058): Terminated: ok {rc=0} 05:44:20.930146 --- ParallelTerminationStrategy: PID 32061 died... 05:44:20.948925 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32061): Terminated: ok {rc=0} 05:44:21.036215 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:oc2g+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 05:44:22.124092 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:44:22.135716 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 05:44:22.193358 tst ping_idle_ping.py: using LAC 26250 05:44:22.311828 tst ping_idle_ping.py: using RAC 240 05:44:22.430879 tst ping_idle_ping.py: using CellId 26250 05:44:22.551258 tst ping_idle_ping.py: using BVCI 26251 05:44:22.661142 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:44:22.672099 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:44:22.682862 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:44:22.693915 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:44:22.704736 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:44:22.715681 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:44:22.726898 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:44:22.738322 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 05:44:22.853511 tst ping_idle_ping.py:24: start network... 05:44:23.052451 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:44:23.519852 run create_hlr_db(pid=32064): Launched 05:44:23.632843 bus /gobi_6: Setting Powered False 05:44:24.693040 run create_hlr_db(pid=32064): Terminated: ok {rc=0} 05:44:25.134476 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32066): Launched 05:44:25.456831 run osmo-hlr_10.42.42.2(pid=32067): Launched 05:44:25.580182 run osmo-stp_10.42.42.5: Starting osmo-stp 05:44:26.134030 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32069): Launched 05:44:26.454343 run osmo-stp_10.42.42.5(pid=32070): Launched 05:44:26.577700 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:44:27.133988 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32072): Launched 05:44:27.257524 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:44:27.528880 run patchelf(pid=32073): Launched 05:44:27.706599 run osmo-stp_10.42.42.5(pid=32070): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32070)] 05:44:27.842667 run osmo-stp_10.42.42.5(pid=32070): stdout: | (launched: 2022-12-10_05:44:26.393722) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:44:27.979653 run osmo-stp_10.42.42.5(pid=32070): stderr: | 20221210054426591 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054426592 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054426592 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054426592 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054426593 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054426593 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054426593 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:44:28.116619 run osmo-stp_10.42.42.5(pid=32070): stdout: | (launched: 2022-12-10_05:44:26.393722) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:44:28.247138 run osmo-stp_10.42.42.5(pid=32070): stderr: | 20221210054426591 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054426592 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054426592 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054426592 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054426593 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054426593 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054426593 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:44:28.401558 run patchelf(pid=32073): Terminating (SIGINT) 05:44:28.580013 run patchelf(pid=32073): Terminated: ok {rc=0} 05:44:28.708462 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=32070): Process ended prematurely: osmo-stp_10.42.42.5(pid=32070) [trial-2370↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32070)] [trial-2370↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 05:44:28.718167 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 05:44:28.746324 run osmo-hlr_10.42.42.2(pid=32067): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32067)] 05:44:28.796544 run osmo-hlr_10.42.42.2(pid=32067): stdout: | (launched: 2022-12-10_05:44:25.396326) 05:44:28.848716 run osmo-hlr_10.42.42.2(pid=32067): stderr: | 20221210054425597 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210054425597 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210054425597 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210054425597 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210054425597 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210054425597 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210054425608 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:oc2g+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210054425617 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210054425617 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210054425617 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:44:28.900803 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32066): Terminating (SIGTERM) 05:44:28.942708 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32069): Terminating (SIGTERM) 05:44:28.984512 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32072): Terminating (SIGTERM) 05:44:29.026680 --- ParallelTerminationStrategy: PID 32066 died... 05:44:29.046840 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32066): Terminated: ok {rc=0} 05:44:29.093215 --- ParallelTerminationStrategy: PID 32069 died... 05:44:29.112915 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32069): Terminated: ok {rc=0} 05:44:29.159177 --- ParallelTerminationStrategy: PID 32072 died... 05:44:29.178886 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32072): Terminated: ok {rc=0} 05:44:29.267461 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2370 gprs:oc2g+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 gprs:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 05:44:30.564728 tst gprs:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:44:30.571641 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 05:44:30.592719 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 05:44:30.632192 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 05:44:30.722804 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 05:44:30.744172 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 05:44:30.783823 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 05:44:31.422541 tst gprs:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2370 gprs:oc2g+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 05:44:31.475229 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:44:31.487607 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 05:44:31.548794 tst cs_paging_gprs_active.py: using LAC 26251 05:44:31.706333 tst cs_paging_gprs_active.py: using RAC 241 05:44:31.867831 tst cs_paging_gprs_active.py: using CellId 26251 05:44:32.037956 tst cs_paging_gprs_active.py: using BVCI 26252 05:44:32.152791 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:44:32.165143 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:44:32.176798 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:44:32.189525 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:44:32.202093 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:44:32.215649 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:44:32.227490 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:44:32.239761 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:44:32.252656 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 05:44:32.375045 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 05:44:32.492340 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 05:44:32.697944 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:44:33.005640 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32078): Launched 05:44:33.273252 run iperf3-srv_10.42.42.10(pid=32079): Launched 05:44:33.387649 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 05:44:33.592117 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:44:33.900564 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32080): Launched 05:44:34.169198 run iperf3-srv_10.42.42.10(pid=32081): Launched 05:44:34.283294 tst cs_paging_gprs_active.py:38: start network... 05:44:34.487536 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:44:34.963966 run create_hlr_db(pid=32082): Launched 05:44:35.080858 bus /gobi_6: Setting Powered False 05:44:36.141504 run create_hlr_db(pid=32082): Terminated: ok {rc=0} 05:44:36.587990 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32084): Launched 05:44:36.916759 run osmo-hlr_10.42.42.2(pid=32085): Launched 05:44:37.041772 run osmo-stp_10.42.42.5: Starting osmo-stp 05:44:37.609405 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32087): Launched 05:44:37.936804 run osmo-stp_10.42.42.5(pid=32088): Launched 05:44:38.060015 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:44:38.622962 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32090): Launched 05:44:38.747737 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:44:39.025507 run patchelf(pid=32091): Launched 05:44:39.205954 run osmo-stp_10.42.42.5(pid=32088): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32088)] 05:44:39.343606 run osmo-stp_10.42.42.5(pid=32088): stdout: | (launched: 2022-12-10_05:44:37.875060) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:44:39.483201 run osmo-stp_10.42.42.5(pid=32088): stderr: | 20221210054438071 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054438071 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054438071 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054438071 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054438072 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054438072 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054438072 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:44:39.622639 run osmo-stp_10.42.42.5(pid=32088): stdout: | (launched: 2022-12-10_05:44:37.875060) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:44:39.755860 run osmo-stp_10.42.42.5(pid=32088): stderr: | 20221210054438071 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054438071 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054438071 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054438071 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054438072 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054438072 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054438072 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:44:39.914392 run patchelf(pid=32091): Terminating (SIGINT) 05:44:40.096195 run patchelf(pid=32091): Terminated: ok {rc=0} 05:44:40.227671 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=32088): Process ended prematurely: osmo-stp_10.42.42.5(pid=32088) [trial-2370↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32088)] [trial-2370↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 05:44:40.237954 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 05:44:40.266384 run osmo-hlr_10.42.42.2(pid=32085): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32085)] 05:44:40.316529 run osmo-hlr_10.42.42.2(pid=32085): stdout: | (launched: 2022-12-10_05:44:36.855090) 05:44:40.368169 run osmo-hlr_10.42.42.2(pid=32085): stderr: | 20221210054437055 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210054437055 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210054437055 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210054437055 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210054437055 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210054437055 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210054437068 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:oc2g+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210054437076 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210054437076 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210054437076 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:44:40.420197 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32078): Terminating (SIGTERM) 05:44:40.461828 run iperf3-srv_10.42.42.10(pid=32079): Terminating (SIGTERM) 05:44:40.503398 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32080): Terminating (SIGTERM) 05:44:40.545050 run iperf3-srv_10.42.42.10(pid=32081): Terminating (SIGTERM) 05:44:40.586790 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32084): Terminating (SIGTERM) 05:44:40.628370 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32087): Terminating (SIGTERM) 05:44:40.669926 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32090): Terminating (SIGTERM) 05:44:40.711207 --- ParallelTerminationStrategy: PID 32078 died... 05:44:40.730855 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32078): Terminated: ok {rc=0} 05:44:40.776454 --- ParallelTerminationStrategy: PID 32079 died... 05:44:40.795890 run iperf3-srv_10.42.42.10(pid=32079): Terminated {rc=256} 05:44:40.841796 --- ParallelTerminationStrategy: PID 32080 died... 05:44:40.860920 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32080): Terminated: ok {rc=0} 05:44:40.906491 --- ParallelTerminationStrategy: PID 32081 died... 05:44:40.925765 run iperf3-srv_10.42.42.10(pid=32081): Terminated {rc=256} 05:44:40.971212 --- ParallelTerminationStrategy: PID 32084 died... 05:44:40.990390 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32084): Terminated: ok {rc=0} 05:44:41.035779 --- ParallelTerminationStrategy: PID 32087 died... 05:44:41.054988 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32087): Terminated: ok {rc=0} 05:44:41.100247 --- ParallelTerminationStrategy: PID 32090 died... 05:44:41.119550 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32090): Terminated: ok {rc=0} 05:44:41.205688 bus /gobi_0: Setting Powered False 05:44:42.304903 bus /gobi_0: Setting Powered False 05:44:43.419121 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:oc2g+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 05:44:44.567972 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:44:44.580121 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 05:44:44.645853 tst iperf3.py: using LAC 26252 05:44:44.766161 tst iperf3.py: using RAC 242 05:44:44.886123 tst iperf3.py: using CellId 26252 05:44:45.006944 tst iperf3.py: using BVCI 26253 05:44:45.118209 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:44:45.129372 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:44:45.140119 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:44:45.151726 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:44:45.163321 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:44:45.174990 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:44:45.186876 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:44:45.199092 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:44:45.210307 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 05:44:45.330789 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 05:44:45.550047 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:44:45.885891 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32092): Launched 05:44:46.176684 run iperf3-srv_10.42.42.10(pid=32093): Launched 05:44:46.299417 tst iperf3.py:8: start network... 05:44:46.521942 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:44:47.036483 run create_hlr_db(pid=32094): Launched 05:44:47.201954 bus /gobi_6: Setting Powered False 05:44:48.266203 run create_hlr_db(pid=32094): Terminated: ok {rc=0} 05:44:48.701270 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32096): Launched 05:44:49.007676 run osmo-hlr_10.42.42.2(pid=32097): Launched 05:44:49.123244 run osmo-stp_10.42.42.5: Starting osmo-stp 05:44:49.665075 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32099): Launched 05:44:49.971889 run osmo-stp_10.42.42.5(pid=32100): Launched 05:44:50.087622 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:44:50.616763 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32102): Launched 05:44:50.733845 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:44:50.993175 run patchelf(pid=32103): Launched 05:44:51.162610 run osmo-stp_10.42.42.5(pid=32100): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32100)] 05:44:51.291933 run osmo-stp_10.42.42.5(pid=32100): stdout: | (launched: 2022-12-10_05:44:49.913922) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:44:51.422623 run osmo-stp_10.42.42.5(pid=32100): stderr: | 20221210054450087 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054450087 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054450087 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054450088 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054450088 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054450088 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054450088 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:44:51.553511 run osmo-stp_10.42.42.5(pid=32100): stdout: | (launched: 2022-12-10_05:44:49.913922) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:44:51.678642 run osmo-stp_10.42.42.5(pid=32100): stderr: | 20221210054450087 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054450087 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054450087 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054450088 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054450088 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054450088 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054450088 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:44:51.826792 run patchelf(pid=32103): Terminating (SIGINT) 05:44:51.997285 run patchelf(pid=32103): Terminated: ok {rc=0} 05:44:52.120385 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32100): Process ended prematurely: osmo-stp_10.42.42.5(pid=32100) [trial-2370↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32100)] [trial-2370↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8] 05:44:52.130174 tst iperf3.py:8: Test FAILED (7.6 sec) 05:44:52.157663 run osmo-hlr_10.42.42.2(pid=32097): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32097)] 05:44:52.205483 run osmo-hlr_10.42.42.2(pid=32097): stdout: | (launched: 2022-12-10_05:44:48.949942) 05:44:52.255024 run osmo-hlr_10.42.42.2(pid=32097): stderr: | 20221210054449127 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210054449127 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210054449127 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210054449127 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210054449128 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210054449128 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210054449140 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:oc2g+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210054449149 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210054449149 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210054449149 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:44:52.304914 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32092): Terminating (SIGTERM) 05:44:52.344992 run iperf3-srv_10.42.42.10(pid=32093): Terminating (SIGTERM) 05:44:52.384713 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32096): Terminating (SIGTERM) 05:44:52.424491 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32099): Terminating (SIGTERM) 05:44:52.464252 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32102): Terminating (SIGTERM) 05:44:52.504231 --- ParallelTerminationStrategy: PID 32092 died... 05:44:52.523323 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32092): Terminated: ok {rc=0} 05:44:52.567890 --- ParallelTerminationStrategy: PID 32093 died... 05:44:52.586417 run iperf3-srv_10.42.42.10(pid=32093): Terminated {rc=256} 05:44:52.630765 --- ParallelTerminationStrategy: PID 32096 died... 05:44:52.649426 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32096): Terminated: ok {rc=0} 05:44:52.693693 --- ParallelTerminationStrategy: PID 32099 died... 05:44:52.712113 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32099): Terminated: ok {rc=0} 05:44:52.756320 --- ParallelTerminationStrategy: PID 32102 died... 05:44:52.774968 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32102): Terminated: ok {rc=0} 05:44:52.859427 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:oc2g+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 05:44:54.010443 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:44:54.022611 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 05:44:54.082963 tst iperf3m4.py: using LAC 26253 05:44:54.210993 tst iperf3m4.py: using RAC 243 05:44:54.337640 tst iperf3m4.py: using CellId 26253 05:44:54.466479 tst iperf3m4.py: using BVCI 26254 05:44:54.586281 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:44:54.597938 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:44:54.609063 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:44:54.620717 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:44:54.632309 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:44:54.643956 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:44:54.655674 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:44:54.667834 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:44:54.679221 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 05:44:54.798835 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 05:44:54.918196 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 05:44:55.037922 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 05:44:55.155927 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 05:44:55.360280 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:44:55.667274 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32104): Launched 05:44:55.934459 run iperf3-srv_10.42.42.10(pid=32105): Launched 05:44:56.049073 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 05:44:56.252037 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:44:56.559414 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32106): Launched 05:44:56.826151 run iperf3-srv_10.42.42.10(pid=32107): Launched 05:44:56.939475 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 05:44:57.142885 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:44:57.449989 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32108): Launched 05:44:57.716568 run iperf3-srv_10.42.42.10(pid=32109): Launched 05:44:57.830561 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 05:44:58.033443 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:44:58.341274 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32110): Launched 05:44:58.607436 run iperf3-srv_10.42.42.10(pid=32111): Launched 05:44:58.721066 tst iperf3m4.py:8: start network... 05:44:58.923992 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:44:59.396109 run create_hlr_db(pid=32112): Launched 05:44:59.513719 bus /gobi_6: Setting Powered False 05:45:00.573878 run create_hlr_db(pid=32112): Terminated: ok {rc=0} 05:45:01.027802 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32114): Launched 05:45:01.375015 run osmo-hlr_10.42.42.2(pid=32115): Launched 05:45:01.608159 run osmo-stp_10.42.42.5: Starting osmo-stp 05:45:02.331411 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32120): Launched 05:45:02.657833 run osmo-stp_10.42.42.5(pid=32121): Launched 05:45:02.781080 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:45:03.342389 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32123): Launched 05:45:03.466137 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:45:03.741942 run patchelf(pid=32124): Launched 05:45:03.922560 run osmo-stp_10.42.42.5(pid=32121): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32121)] 05:45:04.059391 run osmo-stp_10.42.42.5(pid=32121): stdout: | (launched: 2022-12-10_05:45:02.596173) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:45:04.197637 run osmo-stp_10.42.42.5(pid=32121): stderr: | 20221210054502790 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054502790 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054502790 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054502791 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054502791 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054502791 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054502791 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:45:04.335445 run osmo-stp_10.42.42.5(pid=32121): stdout: | (launched: 2022-12-10_05:45:02.596173) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:45:04.467713 run osmo-stp_10.42.42.5(pid=32121): stderr: | 20221210054502790 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054502790 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054502790 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054502791 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054502791 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054502791 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054502791 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:45:04.624519 run patchelf(pid=32124): Terminating (SIGINT) 05:45:04.804818 run patchelf(pid=32124): Terminated: ok {rc=0} 05:45:04.935267 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32121): Process ended prematurely: osmo-stp_10.42.42.5(pid=32121) [trial-2370↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32121)] [trial-2370↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8] 05:45:04.945470 tst iperf3m4.py:8: Test FAILED (11.0 sec) 05:45:04.974021 run osmo-hlr_10.42.42.2(pid=32115): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32115)] 05:45:05.024221 run osmo-hlr_10.42.42.2(pid=32115): stdout: | (launched: 2022-12-10_05:45:01.309566) 05:45:05.075832 run osmo-hlr_10.42.42.2(pid=32115): stderr: | 20221210054501632 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210054501632 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210054501632 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210054501632 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210054501632 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210054501632 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210054501664 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:oc2g+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210054501683 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210054501683 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210054501683 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:45:05.128277 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32104): Terminating (SIGTERM) 05:45:05.169925 run iperf3-srv_10.42.42.10(pid=32105): Terminating (SIGTERM) 05:45:05.211366 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32106): Terminating (SIGTERM) 05:45:05.252707 run iperf3-srv_10.42.42.10(pid=32107): Terminating (SIGTERM) 05:45:05.294284 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32108): Terminating (SIGTERM) 05:45:05.335982 run iperf3-srv_10.42.42.10(pid=32109): Terminating (SIGTERM) 05:45:05.377328 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32110): Terminating (SIGTERM) 05:45:05.418909 run iperf3-srv_10.42.42.10(pid=32111): Terminating (SIGTERM) 05:45:05.460251 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32114): Terminating (SIGTERM) 05:45:05.501812 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32120): Terminating (SIGTERM) 05:45:05.543214 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32123): Terminating (SIGTERM) 05:45:05.584905 --- ParallelTerminationStrategy: PID 32104 died... 05:45:05.604830 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32104): Terminated: ok {rc=0} 05:45:05.651005 --- ParallelTerminationStrategy: PID 32105 died... 05:45:05.670355 run iperf3-srv_10.42.42.10(pid=32105): Terminated {rc=256} 05:45:05.716017 --- ParallelTerminationStrategy: PID 32106 died... 05:45:05.735411 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32106): Terminated: ok {rc=0} 05:45:05.781232 --- ParallelTerminationStrategy: PID 32107 died... 05:45:05.800786 run iperf3-srv_10.42.42.10(pid=32107): Terminated {rc=256} 05:45:05.846319 --- ParallelTerminationStrategy: PID 32108 died... 05:45:05.865618 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32108): Terminated: ok {rc=0} 05:45:05.911558 --- ParallelTerminationStrategy: PID 32109 died... 05:45:05.930797 run iperf3-srv_10.42.42.10(pid=32109): Terminated {rc=256} 05:45:05.976426 --- ParallelTerminationStrategy: PID 32110 died... 05:45:05.995795 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32110): Terminated: ok {rc=0} 05:45:06.041446 --- ParallelTerminationStrategy: PID 32111 died... 05:45:06.060830 run iperf3-srv_10.42.42.10(pid=32111): Terminated {rc=256} 05:45:06.106459 --- ParallelTerminationStrategy: PID 32114 died... 05:45:06.125962 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32114): Terminated: ok {rc=0} 05:45:06.171537 --- ParallelTerminationStrategy: PID 32120 died... 05:45:06.190962 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32120): Terminated: ok {rc=0} 05:45:06.236571 --- ParallelTerminationStrategy: PID 32123 died... 05:45:06.256066 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32123): Terminated: ok {rc=0} 05:45:06.343209 bus /gobi_4: Setting Powered False 05:45:07.438514 bus /gobi_4: Setting Powered False 05:45:08.552759 bus /gobi_1: Setting Powered False 05:45:09.651816 bus /gobi_1: Setting Powered False 05:45:10.766632 bus /gobi_0: Setting Powered False 05:45:11.863632 bus /gobi_0: Setting Powered False 05:45:12.979975 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:oc2g+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 05:45:14.082690 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:45:14.094835 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 05:45:14.154168 tst ping.py: using LAC 26254 05:45:14.278593 tst ping.py: using RAC 244 05:45:14.402968 tst ping.py: using CellId 26254 05:45:14.528780 tst ping.py: using BVCI 26255 05:45:14.645680 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:45:14.657115 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:45:14.668312 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:45:14.679449 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:45:14.690611 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:45:14.701692 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:45:14.713037 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:45:14.724174 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 05:45:14.839731 tst ping.py:19: start network... 05:45:15.039510 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:45:15.502748 run create_hlr_db(pid=32125): Launched 05:45:15.616825 bus /gobi_6: Setting Powered False 05:45:16.699755 run create_hlr_db(pid=32125): Terminated: ok {rc=0} 05:45:17.185029 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32127): Launched 05:45:17.503283 run osmo-hlr_10.42.42.2(pid=32128): Launched 05:45:17.617295 run osmo-stp_10.42.42.5: Starting osmo-stp 05:45:18.143900 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32130): Launched 05:45:18.444013 run osmo-stp_10.42.42.5(pid=32131): Launched 05:45:18.556703 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:45:19.073733 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32133): Launched 05:45:19.188207 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:45:19.442570 run patchelf(pid=32134): Launched 05:45:19.608774 run osmo-stp_10.42.42.5(pid=32131): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32131)] 05:45:19.735957 run osmo-stp_10.42.42.5(pid=32131): stdout: | (launched: 2022-12-10_05:45:18.386672) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:45:19.864918 run osmo-stp_10.42.42.5(pid=32131): stderr: | 20221210054518560 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054518560 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054518560 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054518560 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054518561 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054518561 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054518561 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:45:19.993600 run osmo-stp_10.42.42.5(pid=32131): stdout: | (launched: 2022-12-10_05:45:18.386672) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:45:20.116185 run osmo-stp_10.42.42.5(pid=32131): stderr: | 20221210054518560 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054518560 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054518560 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054518560 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054518561 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054518561 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054518561 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:45:20.261252 run patchelf(pid=32134): Terminating (SIGINT) 05:45:20.428032 run patchelf(pid=32134): Terminated: ok {rc=0} 05:45:20.548390 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=32131): Process ended prematurely: osmo-stp_10.42.42.5(pid=32131) [trial-2370↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32131)] [trial-2370↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22] 05:45:20.557494 tst ping.py:22: Test FAILED (6.5 sec) 05:45:20.584667 run osmo-hlr_10.42.42.2(pid=32128): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32128)] 05:45:20.632543 run osmo-hlr_10.42.42.2(pid=32128): stdout: | (launched: 2022-12-10_05:45:17.446681) 05:45:20.682305 run osmo-hlr_10.42.42.2(pid=32128): stderr: | 20221210054517624 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210054517624 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210054517624 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210054517624 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210054517624 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210054517624 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210054517640 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:oc2g+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210054517649 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210054517649 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210054517650 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:45:20.732199 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32127): Terminating (SIGTERM) 05:45:20.772279 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32130): Terminating (SIGTERM) 05:45:20.812216 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32133): Terminating (SIGTERM) 05:45:20.852420 --- ParallelTerminationStrategy: PID 32127 died... 05:45:20.871371 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32127): Terminated: ok {rc=0} 05:45:20.915763 --- ParallelTerminationStrategy: PID 32130 died... 05:45:20.934179 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32130): Terminated: ok {rc=0} 05:45:20.979307 --- ParallelTerminationStrategy: PID 32133 died... 05:45:20.997943 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32133): Terminated: ok {rc=0} 05:45:21.085367 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:oc2g+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 05:45:22.175088 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:45:22.187067 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 05:45:22.245455 tst ping_idle_ping.py: using LAC 26255 05:45:22.363921 tst ping_idle_ping.py: using RAC 245 05:45:22.480912 tst ping_idle_ping.py: using CellId 26255 05:45:22.598195 tst ping_idle_ping.py: using BVCI 26256 05:45:22.708673 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:45:22.719650 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:45:22.730406 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:45:22.741434 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:45:22.752336 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:45:22.763215 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:45:22.774282 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:45:22.785226 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 05:45:22.903446 tst ping_idle_ping.py:24: start network... 05:45:23.118952 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:45:23.621906 run create_hlr_db(pid=32135): Launched 05:45:23.735890 bus /gobi_6: Setting Powered False 05:45:24.795767 run create_hlr_db(pid=32135): Terminated: ok {rc=0} 05:45:25.213894 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32137): Launched 05:45:25.514278 run osmo-hlr_10.42.42.2(pid=32138): Launched 05:45:25.629066 run osmo-stp_10.42.42.5: Starting osmo-stp 05:45:26.156549 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32140): Launched 05:45:26.457022 run osmo-stp_10.42.42.5(pid=32141): Launched 05:45:26.572164 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:45:27.094506 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32143): Launched 05:45:27.208728 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:45:27.463892 run patchelf(pid=32144): Launched 05:45:27.630565 run osmo-stp_10.42.42.5(pid=32141): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32141)] 05:45:27.757831 run osmo-stp_10.42.42.5(pid=32141): stdout: | (launched: 2022-12-10_05:45:26.399888) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:45:27.886786 run osmo-stp_10.42.42.5(pid=32141): stderr: | 20221210054526572 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054526572 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054526572 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054526573 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054526573 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054526573 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054526573 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:45:28.015817 run osmo-stp_10.42.42.5(pid=32141): stdout: | (launched: 2022-12-10_05:45:26.399888) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:45:28.138554 run osmo-stp_10.42.42.5(pid=32141): stderr: | 20221210054526572 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054526572 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054526572 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054526573 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054526573 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054526573 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054526573 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:45:28.283710 run patchelf(pid=32144): Terminating (SIGINT) 05:45:28.451593 run patchelf(pid=32144): Terminated: ok {rc=0} 05:45:28.572776 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=32141): Process ended prematurely: osmo-stp_10.42.42.5(pid=32141) [trial-2370↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32141)] [trial-2370↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 05:45:28.581874 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 05:45:28.608760 run osmo-hlr_10.42.42.2(pid=32138): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32138)] 05:45:28.656581 run osmo-hlr_10.42.42.2(pid=32138): stdout: | (launched: 2022-12-10_05:45:25.457568) 05:45:28.706020 run osmo-hlr_10.42.42.2(pid=32138): stderr: | 20221210054525634 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210054525634 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210054525634 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210054525634 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210054525634 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210054525634 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210054525646 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:oc2g+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210054525654 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210054525655 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210054525655 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:45:28.755756 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32137): Terminating (SIGTERM) 05:45:28.795557 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32140): Terminating (SIGTERM) 05:45:28.835404 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32143): Terminating (SIGTERM) 05:45:28.875580 --- ParallelTerminationStrategy: PID 32137 died... 05:45:28.894706 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32137): Terminated: ok {rc=0} 05:45:28.938831 --- ParallelTerminationStrategy: PID 32140 died... 05:45:28.957310 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32140): Terminated: ok {rc=0} 05:45:29.001446 --- ParallelTerminationStrategy: PID 32143 died... 05:45:29.019865 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32143): Terminated: ok {rc=0} 05:45:29.106520 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2370 gprs:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 05:45:30.395654 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:45:30.402755 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 05:45:30.423959 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 05:45:30.458637 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 05:45:30.511543 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 05:45:30.531798 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 05:45:30.566081 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 05:45:31.168051 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2370 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 05:45:31.175053 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 05:45:31.187866 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 05:45:31.250235 tst switch_tch_pdch.py: using LAC 26256 05:45:31.369136 tst switch_tch_pdch.py: using RAC 246 05:45:31.495438 tst switch_tch_pdch.py: using CellId 26256 05:45:31.651505 tst switch_tch_pdch.py: using BVCI 26257 05:45:31.800255 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 05:45:31.813404 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 05:45:31.827301 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 05:45:31.841164 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 05:45:31.854007 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 05:45:31.867695 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 05:45:31.880917 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 05:45:31.894107 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 05:45:32.039589 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 05:45:32.168864 tst switch_tch_pdch.py:51: start network... 05:45:32.381158 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:45:32.846519 run create_hlr_db(pid=32149): Launched 05:45:32.961249 bus /gobi_6: Setting Powered False 05:45:34.021206 run create_hlr_db(pid=32149): Terminated: ok {rc=0} 05:45:34.459712 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32151): Launched 05:45:34.780910 run osmo-hlr_10.42.42.2(pid=32152): Launched 05:45:34.903654 run osmo-stp_10.42.42.5: Starting osmo-stp 05:45:35.457138 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32154): Launched 05:45:35.775986 run osmo-stp_10.42.42.5(pid=32155): Launched 05:45:35.896805 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:45:36.446761 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32157): Launched 05:45:36.568240 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:45:36.839591 run patchelf(pid=32158): Launched 05:45:37.016211 run osmo-stp_10.42.42.5(pid=32155): ERR: Terminated: ERROR {rc=1} [trial-2370↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32155)] 05:45:37.151403 run osmo-stp_10.42.42.5(pid=32155): stdout: | (launched: 2022-12-10_05:45:35.716105) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:45:37.288022 run osmo-stp_10.42.42.5(pid=32155): stderr: | 20221210054535909 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054535909 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054535909 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054535910 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054535910 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054535910 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054535910 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:45:37.426056 run osmo-stp_10.42.42.5(pid=32155): stdout: | (launched: 2022-12-10_05:45:35.716105) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:45:37.556565 run osmo-stp_10.42.42.5(pid=32155): stderr: | 20221210054535909 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054535909 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054535909 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054535910 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054535910 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054535910 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054535910 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:45:37.711174 run patchelf(pid=32158): Terminating (SIGINT) 05:45:37.889347 run patchelf(pid=32158): Terminated: ok {rc=0} 05:45:38.017508 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=32155): Process ended prematurely: osmo-stp_10.42.42.5(pid=32155) [trial-2370↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32155)] [trial-2370↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 05:45:38.027039 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 05:45:38.055072 run osmo-hlr_10.42.42.2(pid=32152): ERR: Terminated: ERROR {rc=237} [trial-2370↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32152)] 05:45:38.105190 run osmo-hlr_10.42.42.2(pid=32152): stdout: | (launched: 2022-12-10_05:45:34.720507) 05:45:38.156731 run osmo-hlr_10.42.42.2(pid=32152): stderr: | 20221210054534919 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210054534919 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210054534919 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210054534919 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210054534919 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210054534919 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210054534932 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210054534941 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210054534941 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210054534941 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:45:38.208711 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32151): Terminating (SIGTERM) 05:45:38.250229 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32154): Terminating (SIGTERM) 05:45:38.291833 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32157): Terminating (SIGTERM) 05:45:38.333748 --- ParallelTerminationStrategy: PID 32151 died... 05:45:38.353881 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32151): Terminated: ok {rc=0} 05:45:38.399672 --- ParallelTerminationStrategy: PID 32154 died... 05:45:38.419284 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32154): Terminated: ok {rc=0} 05:45:38.465182 --- ParallelTerminationStrategy: PID 32157 died... 05:45:38.484521 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32157): Terminated: ok {rc=0} 05:45:38.571549 bus /gobi_0: Setting Powered False 05:45:39.670432 bus /gobi_0: Setting Powered False 05:45:40.786309 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2370 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 dynts:oc2g+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 05:45:42.026890 tst dynts:oc2g+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:45:42.033320 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 05:45:42.054758 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 05:45:42.090073 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 05:45:42.144447 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 05:45:42.165573 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 05:45:42.200627 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 05:45:42.760409 tst dynts:oc2g+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2370 dynts:oc2g+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 05:45:42.766940 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 05:45:42.778854 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 05:45:42.835478 tst switch_tch_pdch.py: using LAC 26257 05:45:42.958355 tst switch_tch_pdch.py: using RAC 247 05:45:43.081068 tst switch_tch_pdch.py: using CellId 26257 05:45:43.203923 tst switch_tch_pdch.py: using BVCI 26258 05:45:43.318920 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 05:45:43.330498 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 05:45:43.341748 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 05:45:43.352878 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 05:45:43.364022 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 05:45:43.375148 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 05:45:43.386655 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 05:45:43.397998 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 05:45:43.513378 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 05:45:43.632108 tst switch_tch_pdch.py:51: start network... 05:45:43.847835 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:45:44.315820 run create_hlr_db(pid=32162): Launched 05:45:44.446396 bus /gobi_6: Setting Powered False 05:45:45.510213 run create_hlr_db(pid=32162): Terminated: ok {rc=0} 05:45:45.935742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32164): Launched 05:45:46.271811 run osmo-hlr_10.42.42.2(pid=32165): Launched 05:45:46.504859 run osmo-stp_10.42.42.5: Starting osmo-stp 05:45:47.165774 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32167): Launched 05:45:47.489056 run osmo-stp_10.42.42.5(pid=32168): Launched 05:45:47.605081 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:45:48.097213 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32170): Launched 05:45:48.212043 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:45:48.465938 run patchelf(pid=32171): Launched 05:45:48.632028 run osmo-stp_10.42.42.5(pid=32168): ERR: Terminated: ERROR {rc=1} [trial-2370↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32168)] 05:45:48.759239 run osmo-stp_10.42.42.5(pid=32168): stdout: | (launched: 2022-12-10_05:45:47.431793) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:45:48.887492 run osmo-stp_10.42.42.5(pid=32168): stderr: | 20221210054547603 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054547604 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054547604 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054547604 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054547605 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054547605 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054547605 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:45:49.016037 run osmo-stp_10.42.42.5(pid=32168): stdout: | (launched: 2022-12-10_05:45:47.431793) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:45:49.138415 run osmo-stp_10.42.42.5(pid=32168): stderr: | 20221210054547603 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054547604 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054547604 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054547604 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054547605 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054547605 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054547605 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:45:49.283378 run patchelf(pid=32171): Terminating (SIGINT) 05:45:49.450349 run patchelf(pid=32171): Terminated: ok {rc=0} 05:45:49.571115 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=32168): Process ended prematurely: osmo-stp_10.42.42.5(pid=32168) [trial-2370↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32168)] [trial-2370↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 05:45:49.580238 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 05:45:49.606798 run osmo-hlr_10.42.42.2(pid=32165): ERR: Terminated: ERROR {rc=237} [trial-2370↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32165)] 05:45:49.654971 run osmo-hlr_10.42.42.2(pid=32165): stdout: | (launched: 2022-12-10_05:45:46.209805) 05:45:49.704417 run osmo-hlr_10.42.42.2(pid=32165): stderr: | 20221210054546442 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210054546442 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210054546442 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210054546442 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210054546442 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210054546442 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210054546464 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/dynts:oc2g+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210054546479 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210054546479 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210054546479 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:45:49.754358 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32164): Terminating (SIGTERM) 05:45:49.794343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32167): Terminating (SIGTERM) 05:45:49.834162 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32170): Terminating (SIGTERM) 05:45:49.874213 --- ParallelTerminationStrategy: PID 32164 died... 05:45:49.893269 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32164): Terminated: ok {rc=0} 05:45:49.937419 --- ParallelTerminationStrategy: PID 32167 died... 05:45:49.955789 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32167): Terminated: ok {rc=0} 05:45:49.999963 --- ParallelTerminationStrategy: PID 32170 died... 05:45:50.018598 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32170): Terminated: ok {rc=0} 05:45:50.104234 bus /gobi_0: Setting Powered False 05:45:51.204268 bus /gobi_0: Setting Powered False 05:45:52.320508 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2370 dynts:oc2g+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 nitb_sms:trx-b200 --------------------------------------------------------------------- 05:45:53.553634 tst nitb_sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:45:53.557597 tst nitb_sms:trx-b200: Verifying 1 x bts (candidates: 11) 05:45:53.591480 tst nitb_sms:trx-b200: Verifying 1 x ip_address (candidates: 9) 05:45:53.598395 tst nitb_sms:trx-b200: Verifying 2 x modem (candidates: 12) 05:45:53.651805 tst nitb_sms:trx-b200: Reserving 1 x bts (candidates: 11) 05:45:53.687256 tst nitb_sms:trx-b200: Reserving 1 x ip_address (candidates: 9) 05:45:53.694173 tst nitb_sms:trx-b200: Reserving 2 x modem (candidates: 12) 05:45:54.232418 tst nitb_sms:trx-b200: RESERVED RESOURCES for nitb_sms: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 nitb_sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 05:45:54.237706 tst nitb_sms:trx-b200: Using 1 x ip_address (candidates: 1) 05:45:54.248577 tst nitb_sms:trx-b200: Using 1 x bts (candidates: 1) 05:45:54.297186 tst mo_mt_sms.py: using LAC 26258 05:45:54.412519 tst mo_mt_sms.py: using RAC 248 05:45:54.527612 tst mo_mt_sms.py: using CellId 26258 05:45:54.643444 tst mo_mt_sms.py: using BVCI 26259 05:45:54.751761 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 05:45:54.869766 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 05:45:54.982656 tst mo_mt_sms.py:9: start nitb and bts... 05:45:55.183286 run osmo-nitb_10.42.42.2: Starting osmo-nitb 05:45:55.795663 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32175): Launched 05:45:56.095227 run osmo-nitb_10.42.42.2(pid=32176): Launched 05:45:56.260401 run osmo-nitb_10.42.42.2(pid=32176): ERR: Terminated: ERROR {rc=2} [trial-2370↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32176)] 05:45:56.395152 run osmo-nitb_10.42.42.2(pid=32176): stdout: | (launched: 2022-12-10_05:45:56.038545) 05:45:56.531491 run osmo-nitb_10.42.42.2(pid=32176): stderr: | (launched: 2022-12-10_05:45:56.082688) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 05:45:56.667795 run osmo-nitb_10.42.42.2(pid=32176): stdout: | (launched: 2022-12-10_05:45:56.038545) 05:45:56.797905 run osmo-nitb_10.42.42.2(pid=32176): stderr: | (launched: 2022-12-10_05:45:56.082688) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=32176): Process ended prematurely: osmo-nitb_10.42.42.2(pid=32176) [trial-2370↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32176)] 05:45:57.208191 tst osmo-nitb_10.42.42.2(pid=32176): stdout: | (launched: 2022-12-10_05:45:56.038545) 05:45:57.328606 tst osmo-nitb_10.42.42.2(pid=32176): stderr: | (launched: 2022-12-10_05:45:56.082688) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 05:45:57.470834 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=32176): Process ended prematurely: osmo-nitb_10.42.42.2(pid=32176) [trial-2370↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32176)] [trial-2370↪nitb_sms:trx-b200↪mo_mt_sms.py:11] 05:45:57.479179 tst mo_mt_sms.py:11: Test FAILED (3.2 sec) 05:45:57.487157 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32175): Terminating (SIGTERM) 05:45:57.696598 --- ParallelTerminationStrategy: PID 32175 died... 05:45:57.717124 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32175): Terminated: ok {rc=0} 05:45:57.803714 bus /sierra_3: Setting Powered False 05:45:58.903807 bus /sierra_3: Setting Powered False 05:46:00.020434 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 nitb_sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 sms:trx-b200 --------------------------------------------------------------------- 05:46:01.262446 tst sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:46:01.269045 tst sms:trx-b200: Verifying 1 x bts (candidates: 11) 05:46:01.311427 tst sms:trx-b200: Verifying 6 x ip_address (candidates: 9) 05:46:01.347731 tst sms:trx-b200: Verifying 2 x modem (candidates: 12) 05:46:01.404407 tst sms:trx-b200: Reserving 1 x bts (candidates: 11) 05:46:01.446263 tst sms:trx-b200: Reserving 6 x ip_address (candidates: 9) 05:46:01.478255 tst sms:trx-b200: Reserving 2 x modem (candidates: 12) 05:46:02.049288 tst sms:trx-b200: RESERVED RESOURCES for sms: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 05:46:02.056208 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 05:46:02.070477 tst sms:trx-b200: Using 1 x bts (candidates: 1) 05:46:02.130585 tst mo_mt_sms.py: using LAC 26259 05:46:02.272400 tst mo_mt_sms.py: using RAC 249 05:46:02.400184 tst mo_mt_sms.py: using CellId 26259 05:46:02.518682 tst mo_mt_sms.py: using BVCI 26260 05:46:02.627010 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 05:46:02.637902 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 05:46:02.648398 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 05:46:02.659751 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 05:46:02.672318 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 05:46:02.683342 tst sms:trx-b200: Using 1 x modem (candidates: 2) 05:46:02.803710 tst sms:trx-b200: Using 1 x modem (candidates: 2) 05:46:02.925709 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:46:03.421967 run create_hlr_db(pid=32180): Launched 05:46:03.552083 bus /sierra_2: Setting Powered False 05:46:04.614650 run create_hlr_db(pid=32180): Terminated: ok {rc=0} 05:46:05.043960 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32182): Launched 05:46:05.344123 run osmo-hlr_10.42.42.2(pid=32183): Launched 05:46:05.457445 run osmo-stp_10.42.42.5: Starting osmo-stp 05:46:05.988861 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32185): Launched 05:46:06.287938 run osmo-stp_10.42.42.5(pid=32186): Launched 05:46:06.402054 run osmo-msc_10.42.42.6: Starting osmo-msc 05:46:06.943110 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32188): Launched 05:46:07.242362 run osmo-msc_10.42.42.6(pid=32189): Launched 05:46:07.408345 run osmo-stp_10.42.42.5(pid=32186): ERR: Terminated: ERROR {rc=1} [trial-2370↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32186)] 05:46:07.535569 run osmo-stp_10.42.42.5(pid=32186): stdout: | (launched: 2022-12-10_05:46:06.231049) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:46:07.662412 run osmo-stp_10.42.42.5(pid=32186): stderr: | 20221210054606403 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054606403 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054606404 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054606404 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054606405 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054606405 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054606405 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:46:07.786733 run osmo-stp_10.42.42.5(pid=32186): stdout: | (launched: 2022-12-10_05:46:06.231049) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:46:07.904841 run osmo-stp_10.42.42.5(pid=32186): stderr: | 20221210054606403 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054606403 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054606404 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054606404 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054606405 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054606405 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054606405 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:46:08.046434 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=32186): Process ended prematurely: osmo-stp_10.42.42.5(pid=32186) [trial-2370↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32186)] [trial-2370↪sms:trx-b200↪mo_mt_sms.py:16] 05:46:08.054586 tst mo_mt_sms.py:16: Test FAILED (6.0 sec) 05:46:08.080681 run osmo-hlr_10.42.42.2(pid=32183): ERR: Terminated: ERROR {rc=237} [trial-2370↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32183)] 05:46:08.128502 run osmo-hlr_10.42.42.2(pid=32183): stdout: | (launched: 2022-12-10_05:46:05.287251) 05:46:08.177634 run osmo-hlr_10.42.42.2(pid=32183): stderr: | 20221210054605465 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210054605465 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210054605466 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210054605466 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210054605466 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210054605466 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210054605477 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/sms:trx-b200/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210054605487 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210054605487 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210054605487 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:46:08.246102 run osmo-msc_10.42.42.6(pid=32189): ERR: Terminated: ERROR {rc=2} [trial-2370↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32189)] 05:46:08.293377 run osmo-msc_10.42.42.6(pid=32189): stdout: | (launched: 2022-12-10_05:46:07.185679) 05:46:08.342230 run osmo-msc_10.42.42.6(pid=32189): stderr: | 20221210054607459 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210054607459 DLGLOBAL DEBUG validating counter group 0x7fa081441c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210054607459 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210054607459 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210054607459 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210054607459 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210054607461 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210054607462 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210054607462 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210054607462 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:46:08.391550 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32182): Terminating (SIGTERM) 05:46:08.430733 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32185): Terminating (SIGTERM) 05:46:08.470076 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32188): Terminating (SIGTERM) 05:46:08.509510 --- ParallelTerminationStrategy: PID 32182 died... 05:46:08.528381 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32182): Terminated: ok {rc=0} 05:46:08.572010 --- ParallelTerminationStrategy: PID 32185 died... 05:46:08.590235 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32185): Terminated: ok {rc=0} 05:46:08.633965 --- ParallelTerminationStrategy: PID 32188 died... 05:46:08.652275 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32188): Terminated: ok {rc=0} 05:46:08.735430 bus /sierra_3: Setting Powered False 05:46:09.834379 bus /sierra_3: Setting Powered False 05:46:10.950698 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 nitb_ussd:trx-b200 --------------------------------------------------------------------- 05:46:12.181865 tst nitb_ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:46:12.185905 tst nitb_ussd:trx-b200: Verifying 1 x bts (candidates: 11) 05:46:12.219549 tst nitb_ussd:trx-b200: Verifying 1 x ip_address (candidates: 9) 05:46:12.226590 tst nitb_ussd:trx-b200: Verifying 1 x modem (candidates: 12) 05:46:12.265090 tst nitb_ussd:trx-b200: Reserving 1 x bts (candidates: 11) 05:46:12.298089 tst nitb_ussd:trx-b200: Reserving 1 x ip_address (candidates: 9) 05:46:12.305244 tst nitb_ussd:trx-b200: Reserving 1 x modem (candidates: 12) 05:46:12.824022 tst nitb_ussd:trx-b200: RESERVED RESOURCES for nitb_ussd: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2370 nitb_ussd:trx-b200 assert_extension.py ---------------------------------------------- 05:46:12.829543 tst nitb_ussd:trx-b200: Using 1 x ip_address (candidates: 1) 05:46:12.840656 tst nitb_ussd:trx-b200: Using 1 x bts (candidates: 1) 05:46:12.889628 tst assert_extension.py: using LAC 26260 05:46:13.015144 tst assert_extension.py: using RAC 250 05:46:13.139092 tst assert_extension.py: using CellId 26260 05:46:13.267881 tst assert_extension.py: using BVCI 26261 05:46:13.384494 tst nitb_ussd:trx-b200: Using 1 x modem (candidates: 1) 05:46:13.498732 tst assert_extension.py:10: start nitb and bts... 05:46:13.699037 run osmo-nitb_10.42.42.2: Starting osmo-nitb 05:46:14.310194 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32194): Launched 05:46:14.610135 run osmo-nitb_10.42.42.2(pid=32195): Launched 05:46:14.775113 run osmo-nitb_10.42.42.2(pid=32195): ERR: Terminated: ERROR {rc=2} [trial-2370↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32195)] 05:46:14.909397 run osmo-nitb_10.42.42.2(pid=32195): stdout: | (launched: 2022-12-10_05:46:14.552774) 05:46:15.045149 run osmo-nitb_10.42.42.2(pid=32195): stderr: | (launched: 2022-12-10_05:46:14.597317) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 05:46:15.180868 run osmo-nitb_10.42.42.2(pid=32195): stdout: | (launched: 2022-12-10_05:46:14.552774) 05:46:15.310405 run osmo-nitb_10.42.42.2(pid=32195): stderr: | (launched: 2022-12-10_05:46:14.597317) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=32195): Process ended prematurely: osmo-nitb_10.42.42.2(pid=32195) [trial-2370↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32195)] 05:46:15.722561 tst osmo-nitb_10.42.42.2(pid=32195): stdout: | (launched: 2022-12-10_05:46:14.552774) 05:46:15.850584 tst osmo-nitb_10.42.42.2(pid=32195): stderr: | (launched: 2022-12-10_05:46:14.597317) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 05:46:16.014036 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=32195): Process ended prematurely: osmo-nitb_10.42.42.2(pid=32195) [trial-2370↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32195)] [trial-2370↪nitb_ussd:trx-b200↪assert_extension.py:12] 05:46:16.023511 tst assert_extension.py:12: Test FAILED (3.2 sec) 05:46:16.031707 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32194): Terminating (SIGTERM) 05:46:16.245234 --- ParallelTerminationStrategy: PID 32194 died... 05:46:16.265911 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32194): Terminated: ok {rc=0} 05:46:16.363098 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 nitb_ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 ussd:trx-b200 --------------------------------------------------------------------- 05:46:17.544278 tst ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:46:17.548691 tst ussd:trx-b200: Verifying 1 x bts (candidates: 11) 05:46:17.583330 tst ussd:trx-b200: Verifying 6 x ip_address (candidates: 9) 05:46:17.611050 tst ussd:trx-b200: Verifying 1 x modem (candidates: 12) 05:46:17.647206 tst ussd:trx-b200: Reserving 1 x bts (candidates: 11) 05:46:17.681458 tst ussd:trx-b200: Reserving 6 x ip_address (candidates: 9) 05:46:17.708741 tst ussd:trx-b200: Reserving 1 x modem (candidates: 12) 05:46:18.233600 tst ussd:trx-b200: RESERVED RESOURCES for ussd: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2370 ussd:trx-b200 assert_extension.py ---------------------------------------------- 05:46:18.240357 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 05:46:18.252469 tst ussd:trx-b200: Using 1 x bts (candidates: 1) 05:46:18.303707 tst assert_extension.py: using LAC 26261 05:46:18.430459 tst assert_extension.py: using RAC 251 05:46:18.555917 tst assert_extension.py: using CellId 26261 05:46:18.674718 tst assert_extension.py: using BVCI 26262 05:46:18.789854 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 05:46:18.801025 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 05:46:18.812201 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 05:46:18.823364 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 05:46:18.834631 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 05:46:18.845816 tst ussd:trx-b200: Using 1 x modem (candidates: 1) 05:46:18.961323 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:46:19.456493 run create_hlr_db(pid=32199): Launched 05:46:19.585858 bus /sierra_2: Setting Powered False 05:46:20.649195 run create_hlr_db(pid=32199): Terminated: ok {rc=0} 05:46:21.077663 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32201): Launched 05:46:21.377631 run osmo-hlr_10.42.42.2(pid=32202): Launched 05:46:21.490624 run osmo-stp_10.42.42.5: Starting osmo-stp 05:46:22.010615 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32204): Launched 05:46:22.310977 run osmo-stp_10.42.42.5(pid=32205): Launched 05:46:22.424101 run osmo-msc_10.42.42.6: Starting osmo-msc 05:46:22.963858 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32207): Launched 05:46:23.263102 run osmo-msc_10.42.42.6(pid=32208): Launched 05:46:23.430351 run osmo-stp_10.42.42.5(pid=32205): ERR: Terminated: ERROR {rc=1} [trial-2370↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32205)] 05:46:23.556494 run osmo-stp_10.42.42.5(pid=32205): stdout: | (launched: 2022-12-10_05:46:22.253736) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:46:23.683227 run osmo-stp_10.42.42.5(pid=32205): stderr: | 20221210054622426 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054622426 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054622426 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054622427 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054622427 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054622427 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054622427 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:46:23.808042 run osmo-stp_10.42.42.5(pid=32205): stdout: | (launched: 2022-12-10_05:46:22.253736) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:46:23.926073 run osmo-stp_10.42.42.5(pid=32205): stderr: | 20221210054622426 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054622426 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054622426 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054622427 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054622427 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054622427 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054622427 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:46:24.067695 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=32205): Process ended prematurely: osmo-stp_10.42.42.5(pid=32205) [trial-2370↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32205)] [trial-2370↪ussd:trx-b200↪assert_extension.py:17] 05:46:24.076069 tst assert_extension.py:17: Test FAILED (5.8 sec) 05:46:24.102188 run osmo-hlr_10.42.42.2(pid=32202): ERR: Terminated: ERROR {rc=237} [trial-2370↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32202)] 05:46:24.149618 run osmo-hlr_10.42.42.2(pid=32202): stdout: | (launched: 2022-12-10_05:46:21.320408) 05:46:24.198749 run osmo-hlr_10.42.42.2(pid=32202): stderr: | 20221210054621497 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210054621497 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210054621498 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210054621498 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210054621498 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210054621498 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210054621510 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/ussd:trx-b200/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210054621520 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210054621521 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210054621521 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:46:24.267072 run osmo-msc_10.42.42.6(pid=32208): ERR: Terminated: ERROR {rc=2} [trial-2370↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32208)] 05:46:24.314346 run osmo-msc_10.42.42.6(pid=32208): stdout: | (launched: 2022-12-10_05:46:23.206461) 05:46:24.363432 run osmo-msc_10.42.42.6(pid=32208): stderr: | 20221210054623479 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210054623479 DLGLOBAL DEBUG validating counter group 0x7f403c337c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210054623479 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210054623479 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210054623479 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210054623479 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210054623481 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210054623482 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210054623482 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210054623482 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:46:24.413308 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32201): Terminating (SIGTERM) 05:46:24.452671 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32204): Terminating (SIGTERM) 05:46:24.492348 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32207): Terminating (SIGTERM) 05:46:24.532114 --- ParallelTerminationStrategy: PID 32201 died... 05:46:24.551071 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32201): Terminated: ok {rc=0} 05:46:24.594883 --- ParallelTerminationStrategy: PID 32204 died... 05:46:24.613169 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32204): Terminated: ok {rc=0} 05:46:24.656744 --- ParallelTerminationStrategy: PID 32207 died... 05:46:24.675122 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32207): Terminated: ok {rc=0} 05:46:24.760233 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 05:46:25.977892 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:46:25.984546 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 05:46:26.018141 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 05:46:26.044387 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 05:46:26.097484 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 05:46:26.130880 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 05:46:26.156875 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 05:46:26.709712 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 05:46:26.760217 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:46:26.771360 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 05:46:26.839919 tst mo_mt_call.py: using LAC 26262 05:46:26.958696 tst mo_mt_call.py: using RAC 252 05:46:27.078781 tst mo_mt_call.py: using CellId 26262 05:46:27.199670 tst mo_mt_call.py: using BVCI 26263 05:46:27.311215 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:46:27.322366 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:46:27.333278 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:46:27.344813 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:46:27.356009 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:46:27.367120 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 05:46:27.486409 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 05:46:27.606779 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:46:28.112005 run create_hlr_db(pid=32213): Launched 05:46:28.244027 bus /sierra_2: Setting Powered False 05:46:29.308602 run create_hlr_db(pid=32213): Terminated: ok {rc=0} 05:46:29.746247 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32215): Launched 05:46:30.053179 run osmo-hlr_10.42.42.2(pid=32216): Launched 05:46:30.168626 run osmo-stp_10.42.42.5: Starting osmo-stp 05:46:30.709891 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32218): Launched 05:46:31.034864 run osmo-stp_10.42.42.5(pid=32219): Launched 05:46:31.380761 run osmo-msc_10.42.42.6: Starting osmo-msc 05:46:32.049633 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32221): Launched 05:46:32.368057 run osmo-msc_10.42.42.6(pid=32222): Launched 05:46:32.539247 run osmo-stp_10.42.42.5(pid=32219): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32219)] 05:46:32.669202 run osmo-stp_10.42.42.5(pid=32219): stdout: | (launched: 2022-12-10_05:46:30.972403) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:46:32.799913 run osmo-stp_10.42.42.5(pid=32219): stderr: | 20221210054631244 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054631244 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054631245 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054631247 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054631247 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054631247 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054631247 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:46:32.927922 run osmo-stp_10.42.42.5(pid=32219): stdout: | (launched: 2022-12-10_05:46:30.972403) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:46:33.048918 run osmo-stp_10.42.42.5(pid=32219): stderr: | 20221210054631244 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054631244 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054631245 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054631247 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054631247 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054631247 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054631247 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:46:33.194385 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32219): Process ended prematurely: osmo-stp_10.42.42.5(pid=32219) [trial-2370↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32219)] [trial-2370↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 05:46:33.203423 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 05:46:33.230058 run osmo-hlr_10.42.42.2(pid=32216): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32216)] 05:46:33.277828 run osmo-hlr_10.42.42.2(pid=32216): stdout: | (launched: 2022-12-10_05:46:29.995502) 05:46:33.327104 run osmo-hlr_10.42.42.2(pid=32216): stderr: | 20221210054630173 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210054630173 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210054630173 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210054630173 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210054630173 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210054630173 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210054630186 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210054630195 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210054630195 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210054630195 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:46:33.396075 run osmo-msc_10.42.42.6(pid=32222): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32222)] 05:46:33.443893 run osmo-msc_10.42.42.6(pid=32222): stdout: | (launched: 2022-12-10_05:46:32.309453) 05:46:33.493232 run osmo-msc_10.42.42.6(pid=32222): stderr: | 20221210054632584 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210054632584 DLGLOBAL DEBUG validating counter group 0x7f67a0fc5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210054632584 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210054632584 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210054632584 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210054632584 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210054632586 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210054632586 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210054632587 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210054632587 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:46:33.543092 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32215): Terminating (SIGTERM) 05:46:33.582833 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32218): Terminating (SIGTERM) 05:46:33.622571 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32221): Terminating (SIGTERM) 05:46:33.662660 --- ParallelTerminationStrategy: PID 32215 died... 05:46:33.681685 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32215): Terminated: ok {rc=0} 05:46:33.726019 --- ParallelTerminationStrategy: PID 32218 died... 05:46:33.744528 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32218): Terminated: ok {rc=0} 05:46:33.789072 --- ParallelTerminationStrategy: PID 32221 died... 05:46:33.807911 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32221): Terminated: ok {rc=0} 05:46:33.892678 bus /sierra_3: Setting Powered False 05:46:34.991710 bus /sierra_3: Setting Powered False 05:46:36.112109 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2370 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 05:46:37.260539 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:46:37.272429 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 05:46:37.342131 tst mo_mt_call_osmux.py: using LAC 26263 05:46:37.461833 tst mo_mt_call_osmux.py: using RAC 253 05:46:37.584151 tst mo_mt_call_osmux.py: using CellId 26263 05:46:37.713413 tst mo_mt_call_osmux.py: using BVCI 26264 05:46:37.831885 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:46:37.844164 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:46:37.856043 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:46:37.868319 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:46:37.880661 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:46:37.892858 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 05:46:38.010292 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 05:46:38.130748 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:46:38.638201 run create_hlr_db(pid=32224): Launched 05:46:38.770211 bus /sierra_2: Setting Powered False 05:46:39.834471 run create_hlr_db(pid=32224): Terminated: ok {rc=0} 05:46:40.275936 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32226): Launched 05:46:40.583204 run osmo-hlr_10.42.42.2(pid=32227): Launched 05:46:40.700511 run osmo-stp_10.42.42.5: Starting osmo-stp 05:46:41.239333 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32229): Launched 05:46:41.545492 run osmo-stp_10.42.42.5(pid=32230): Launched 05:46:41.661058 run osmo-msc_10.42.42.6: Starting osmo-msc 05:46:42.215508 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32232): Launched 05:46:42.521659 run osmo-msc_10.42.42.6(pid=32233): Launched 05:46:42.692119 run osmo-stp_10.42.42.5(pid=32230): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32230)] 05:46:42.821445 run osmo-stp_10.42.42.5(pid=32230): stdout: | (launched: 2022-12-10_05:46:41.487513) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:46:42.950974 run osmo-stp_10.42.42.5(pid=32230): stderr: | 20221210054641662 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054641662 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054641662 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054641662 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054641663 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054641663 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054641663 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:46:43.078343 run osmo-stp_10.42.42.5(pid=32230): stdout: | (launched: 2022-12-10_05:46:41.487513) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:46:43.199414 run osmo-stp_10.42.42.5(pid=32230): stderr: | 20221210054641662 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054641662 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054641662 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054641662 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054641663 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054641663 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054641663 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:46:43.344471 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32230): Process ended prematurely: osmo-stp_10.42.42.5(pid=32230) [trial-2370↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32230)] [trial-2370↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 05:46:43.353730 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 05:46:43.380671 run osmo-hlr_10.42.42.2(pid=32227): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32227)] 05:46:43.428694 run osmo-hlr_10.42.42.2(pid=32227): stdout: | (launched: 2022-12-10_05:46:40.525281) 05:46:43.478338 run osmo-hlr_10.42.42.2(pid=32227): stderr: | 20221210054640704 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210054640704 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210054640704 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210054640704 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210054640704 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210054640704 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210054640716 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210054640726 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210054640726 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210054640726 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:46:43.547480 run osmo-msc_10.42.42.6(pid=32233): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32233)] 05:46:43.595320 run osmo-msc_10.42.42.6(pid=32233): stdout: | (launched: 2022-12-10_05:46:42.463502) 05:46:43.645284 run osmo-msc_10.42.42.6(pid=32233): stderr: | 20221210054642739 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210054642739 DLGLOBAL DEBUG validating counter group 0x7fa30e17ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210054642739 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210054642739 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210054642739 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210054642739 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210054642742 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210054642742 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210054642742 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210054642742 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:46:43.695265 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32226): Terminating (SIGTERM) 05:46:43.735342 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32229): Terminating (SIGTERM) 05:46:43.775403 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32232): Terminating (SIGTERM) 05:46:43.815783 --- ParallelTerminationStrategy: PID 32226 died... 05:46:43.835038 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32226): Terminated: ok {rc=0} 05:46:43.879597 --- ParallelTerminationStrategy: PID 32229 died... 05:46:43.898529 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32229): Terminated: ok {rc=0} 05:46:43.942922 --- ParallelTerminationStrategy: PID 32232 died... 05:46:43.961353 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32232): Terminated: ok {rc=0} 05:46:44.047438 bus /sierra_3: Setting Powered False 05:46:45.147853 bus /sierra_3: Setting Powered False 05:46:46.264222 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 05:46:47.522556 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:46:47.529919 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 05:46:47.564801 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 05:46:47.592580 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 05:46:47.646150 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 05:46:47.680397 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 05:46:47.707930 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 05:46:48.265678 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 05:46:48.318088 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:46:48.329993 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 05:46:48.402587 tst mo_mt_call.py: using LAC 26264 05:46:48.529432 tst mo_mt_call.py: using RAC 254 05:46:48.647923 tst mo_mt_call.py: using CellId 26264 05:46:48.765589 tst mo_mt_call.py: using BVCI 26265 05:46:48.876255 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:46:48.887592 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:46:48.898639 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:46:48.909979 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:46:48.921372 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:46:48.932441 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 05:46:49.053036 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 05:46:49.170850 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:46:49.644673 run create_hlr_db(pid=32238): Launched 05:46:49.760228 bus /sierra_2: Setting Powered False 05:46:50.821182 run create_hlr_db(pid=32238): Terminated: ok {rc=0} 05:46:51.266088 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32240): Launched 05:46:51.593393 run osmo-hlr_10.42.42.2(pid=32241): Launched 05:46:51.718342 run osmo-stp_10.42.42.5: Starting osmo-stp 05:46:52.279034 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32243): Launched 05:46:52.603969 run osmo-stp_10.42.42.5(pid=32244): Launched 05:46:52.730306 run osmo-msc_10.42.42.6: Starting osmo-msc 05:46:53.319946 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32246): Launched 05:46:53.646050 run osmo-msc_10.42.42.6(pid=32247): Launched 05:46:53.828278 run osmo-stp_10.42.42.5(pid=32244): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32244)] 05:46:53.965760 run osmo-stp_10.42.42.5(pid=32244): stdout: | (launched: 2022-12-10_05:46:52.543050) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:46:54.103150 run osmo-stp_10.42.42.5(pid=32244): stderr: | 20221210054652739 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054652739 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054652739 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054652740 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054652740 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054652740 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054652740 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:46:54.239827 run osmo-stp_10.42.42.5(pid=32244): stdout: | (launched: 2022-12-10_05:46:52.543050) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:46:54.368557 run osmo-stp_10.42.42.5(pid=32244): stderr: | 20221210054652739 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054652739 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054652739 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054652740 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054652740 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054652740 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054652740 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:46:54.523024 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32244): Process ended prematurely: osmo-stp_10.42.42.5(pid=32244) [trial-2370↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32244)] [trial-2370↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 05:46:54.532749 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 05:46:54.560912 run osmo-hlr_10.42.42.2(pid=32241): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32241)] 05:46:54.610981 run osmo-hlr_10.42.42.2(pid=32241): stdout: | (launched: 2022-12-10_05:46:51.532147) 05:46:54.662762 run osmo-hlr_10.42.42.2(pid=32241): stderr: | 20221210054651732 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210054651732 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210054651732 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210054651733 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210054651733 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210054651733 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210054651746 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210054651754 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210054651754 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210054651754 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:46:54.735441 run osmo-msc_10.42.42.6(pid=32247): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32247)] 05:46:54.785473 run osmo-msc_10.42.42.6(pid=32247): stdout: | (launched: 2022-12-10_05:46:53.584700) 05:46:54.836892 run osmo-msc_10.42.42.6(pid=32247): stderr: | 20221210054653909 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210054653909 DLGLOBAL DEBUG validating counter group 0x7fd0326d5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210054653909 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210054653909 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210054653910 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210054653910 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210054653911 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210054653912 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210054653912 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210054653912 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:46:54.889176 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32240): Terminating (SIGTERM) 05:46:54.930586 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32243): Terminating (SIGTERM) 05:46:54.971975 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32246): Terminating (SIGTERM) 05:46:55.013555 --- ParallelTerminationStrategy: PID 32240 died... 05:46:55.033503 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32240): Terminated: ok {rc=0} 05:46:55.079605 --- ParallelTerminationStrategy: PID 32243 died... 05:46:55.099217 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32243): Terminated: ok {rc=0} 05:46:55.145266 --- ParallelTerminationStrategy: PID 32246 died... 05:46:55.164742 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32246): Terminated: ok {rc=0} 05:46:55.253130 bus /sierra_3: Setting Powered False 05:46:56.354403 bus /sierra_3: Setting Powered False 05:46:57.470431 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2370 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 05:46:58.621318 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:46:58.633789 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 05:46:58.704934 tst mo_mt_call_osmux.py: using LAC 26265 05:46:58.825836 tst mo_mt_call_osmux.py: using RAC 255 05:46:58.947364 tst mo_mt_call_osmux.py: using CellId 26265 05:46:59.068252 tst mo_mt_call_osmux.py: using BVCI 26266 05:46:59.178998 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:46:59.190422 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:46:59.201596 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:46:59.213090 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:46:59.224007 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:46:59.235035 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 05:46:59.354905 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 05:46:59.477891 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:46:59.983755 run create_hlr_db(pid=32249): Launched 05:47:00.119217 bus /sierra_2: Setting Powered False 05:47:01.188336 run create_hlr_db(pid=32249): Terminated: ok {rc=0} 05:47:01.647700 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32251): Launched 05:47:02.029649 run osmo-hlr_10.42.42.2(pid=32252): Launched 05:47:02.159651 run osmo-stp_10.42.42.5: Starting osmo-stp 05:47:02.777046 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32254): Launched 05:47:03.103936 run osmo-stp_10.42.42.5(pid=32255): Launched 05:47:03.226781 run osmo-msc_10.42.42.6: Starting osmo-msc 05:47:03.822334 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32257): Launched 05:47:04.151988 run osmo-msc_10.42.42.6(pid=32258): Launched 05:47:04.332064 run osmo-stp_10.42.42.5(pid=32255): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32255)] 05:47:04.470690 run osmo-stp_10.42.42.5(pid=32255): stdout: | (launched: 2022-12-10_05:47:03.042655) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:47:04.607963 run osmo-stp_10.42.42.5(pid=32255): stderr: | 20221210054703239 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054703239 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054703240 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054703240 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054703240 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054703241 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054703241 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:47:04.744176 run osmo-stp_10.42.42.5(pid=32255): stdout: | (launched: 2022-12-10_05:47:03.042655) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:47:04.873238 run osmo-stp_10.42.42.5(pid=32255): stderr: | 20221210054703239 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054703239 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054703240 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054703240 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054703240 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054703241 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054703241 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:47:05.027359 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32255): Process ended prematurely: osmo-stp_10.42.42.5(pid=32255) [trial-2370↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32255)] [trial-2370↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 05:47:05.036826 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 05:47:05.064532 run osmo-hlr_10.42.42.2(pid=32252): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32252)] 05:47:05.114294 run osmo-hlr_10.42.42.2(pid=32252): stdout: | (launched: 2022-12-10_05:47:01.966628) 05:47:05.165783 run osmo-hlr_10.42.42.2(pid=32252): stderr: | 20221210054702339 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210054702339 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210054702339 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210054702339 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210054702339 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210054702339 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210054702354 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210054702362 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210054702362 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210054702362 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:47:05.237881 run osmo-msc_10.42.42.6(pid=32258): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32258)] 05:47:05.287576 run osmo-msc_10.42.42.6(pid=32258): stdout: | (launched: 2022-12-10_05:47:04.090765) 05:47:05.339112 run osmo-msc_10.42.42.6(pid=32258): stderr: | 20221210054704413 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210054704413 DLGLOBAL DEBUG validating counter group 0x7fea38e8ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210054704413 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210054704413 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210054704413 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210054704414 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210054704417 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210054704417 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210054704418 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210054704418 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:47:05.391072 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32251): Terminating (SIGTERM) 05:47:05.432268 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32254): Terminating (SIGTERM) 05:47:05.473620 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32257): Terminating (SIGTERM) 05:47:05.515101 --- ParallelTerminationStrategy: PID 32251 died... 05:47:05.534884 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32251): Terminated: ok {rc=0} 05:47:05.581101 --- ParallelTerminationStrategy: PID 32254 died... 05:47:05.600350 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32254): Terminated: ok {rc=0} 05:47:05.645737 --- ParallelTerminationStrategy: PID 32257 died... 05:47:05.664860 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32257): Terminated: ok {rc=0} 05:47:05.752556 bus /sierra_3: Setting Powered False 05:47:06.851549 bus /sierra_3: Setting Powered False 05:47:07.971079 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 05:47:09.220363 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:47:09.227097 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 05:47:09.261299 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 05:47:09.287906 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 05:47:09.340141 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 05:47:09.373730 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 05:47:09.400384 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 05:47:09.950030 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 05:47:10.000689 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:47:10.012105 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 05:47:10.082772 tst mo_mt_call.py: using LAC 26266 05:47:10.204144 tst mo_mt_call.py: using RAC 1 05:47:10.326446 tst mo_mt_call.py: using CellId 26266 05:47:10.448928 tst mo_mt_call.py: using BVCI 26267 05:47:10.559935 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:47:10.571177 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:47:10.582159 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:47:10.593804 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:47:10.605623 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:47:10.617497 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 05:47:10.739469 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 05:47:10.856900 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:47:11.331604 run create_hlr_db(pid=32263): Launched 05:47:11.447219 bus /sierra_2: Setting Powered False 05:47:12.507575 run create_hlr_db(pid=32263): Terminated: ok {rc=0} 05:47:12.932745 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32265): Launched 05:47:13.238577 run osmo-hlr_10.42.42.2(pid=32266): Launched 05:47:13.353916 run osmo-stp_10.42.42.5: Starting osmo-stp 05:47:13.893396 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32268): Launched 05:47:14.199177 run osmo-stp_10.42.42.5(pid=32269): Launched 05:47:14.314865 run osmo-msc_10.42.42.6: Starting osmo-msc 05:47:14.867175 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32271): Launched 05:47:15.173542 run osmo-msc_10.42.42.6(pid=32272): Launched 05:47:15.343801 run osmo-stp_10.42.42.5(pid=32269): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32269)] 05:47:15.472893 run osmo-stp_10.42.42.5(pid=32269): stdout: | (launched: 2022-12-10_05:47:14.141481) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:47:15.602063 run osmo-stp_10.42.42.5(pid=32269): stderr: | 20221210054714313 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054714313 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054714313 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054714314 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054714314 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054714314 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054714314 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:47:15.728741 run osmo-stp_10.42.42.5(pid=32269): stdout: | (launched: 2022-12-10_05:47:14.141481) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:47:15.859026 run osmo-stp_10.42.42.5(pid=32269): stderr: | 20221210054714313 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054714313 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054714313 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054714314 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054714314 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054714314 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054714314 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:47:16.028548 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32269): Process ended prematurely: osmo-stp_10.42.42.5(pid=32269) [trial-2370↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32269)] [trial-2370↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 05:47:16.039755 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 05:47:16.069699 run osmo-hlr_10.42.42.2(pid=32266): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32266)] 05:47:16.121424 run osmo-hlr_10.42.42.2(pid=32266): stdout: | (launched: 2022-12-10_05:47:13.180485) 05:47:16.176490 run osmo-hlr_10.42.42.2(pid=32266): stderr: | 20221210054713360 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210054713360 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210054713360 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210054713360 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210054713360 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210054713360 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210054713372 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210054713380 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210054713381 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210054713381 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:47:16.250893 run osmo-msc_10.42.42.6(pid=32272): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32272)] 05:47:16.302392 run osmo-msc_10.42.42.6(pid=32272): stdout: | (launched: 2022-12-10_05:47:15.115267) 05:47:16.356764 run osmo-msc_10.42.42.6(pid=32272): stderr: | 20221210054715389 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210054715389 DLGLOBAL DEBUG validating counter group 0x7f5ec95eec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210054715389 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210054715389 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210054715389 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210054715390 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210054715391 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210054715392 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210054715392 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210054715392 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:47:16.410808 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32265): Terminating (SIGTERM) 05:47:16.454655 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32268): Terminating (SIGTERM) 05:47:16.499631 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32271): Terminating (SIGTERM) 05:47:16.546322 --- ParallelTerminationStrategy: PID 32265 died... 05:47:16.566999 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32265): Terminated: ok {rc=0} 05:47:16.616013 --- ParallelTerminationStrategy: PID 32268 died... 05:47:16.636148 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32268): Terminated: ok {rc=0} 05:47:16.684787 --- ParallelTerminationStrategy: PID 32271 died... 05:47:16.705635 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32271): Terminated: ok {rc=0} 05:47:16.797654 bus /sierra_3: Setting Powered False 05:47:17.901131 bus /sierra_3: Setting Powered False 05:47:19.017910 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2370 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 05:47:20.166788 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:47:20.179601 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 05:47:20.253543 tst mo_mt_call_osmux.py: using LAC 26267 05:47:20.385756 tst mo_mt_call_osmux.py: using RAC 2 05:47:20.513145 tst mo_mt_call_osmux.py: using CellId 26267 05:47:20.639266 tst mo_mt_call_osmux.py: using BVCI 26268 05:47:20.757178 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:47:20.768885 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:47:20.780584 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:47:20.792305 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:47:20.804221 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:47:20.816016 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 05:47:20.935757 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 05:47:21.053088 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:47:21.526712 run create_hlr_db(pid=32274): Launched 05:47:21.644019 bus /sierra_2: Setting Powered False 05:47:22.705187 run create_hlr_db(pid=32274): Terminated: ok {rc=0} 05:47:23.150561 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32276): Launched 05:47:23.476308 run osmo-hlr_10.42.42.2(pid=32277): Launched 05:47:23.600016 run osmo-stp_10.42.42.5: Starting osmo-stp 05:47:24.161934 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32279): Launched 05:47:24.489200 run osmo-stp_10.42.42.5(pid=32280): Launched 05:47:24.613476 run osmo-msc_10.42.42.6: Starting osmo-msc 05:47:25.203820 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32282): Launched 05:47:25.530301 run osmo-msc_10.42.42.6(pid=32283): Launched 05:47:25.710728 run osmo-stp_10.42.42.5(pid=32280): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32280)] 05:47:25.847467 run osmo-stp_10.42.42.5(pid=32280): stdout: | (launched: 2022-12-10_05:47:24.427912) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:47:25.986025 run osmo-stp_10.42.42.5(pid=32280): stderr: | 20221210054724625 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054724625 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054724625 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054724626 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054724626 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054724626 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054724626 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:47:26.123566 run osmo-stp_10.42.42.5(pid=32280): stdout: | (launched: 2022-12-10_05:47:24.427912) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:47:26.252877 run osmo-stp_10.42.42.5(pid=32280): stderr: | 20221210054724625 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054724625 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054724625 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054724626 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054724626 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054724626 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054724626 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:47:26.407715 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32280): Process ended prematurely: osmo-stp_10.42.42.5(pid=32280) [trial-2370↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32280)] [trial-2370↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 05:47:26.417379 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 05:47:26.445067 run osmo-hlr_10.42.42.2(pid=32277): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32277)] 05:47:26.494758 run osmo-hlr_10.42.42.2(pid=32277): stdout: | (launched: 2022-12-10_05:47:23.415296) 05:47:26.546324 run osmo-hlr_10.42.42.2(pid=32277): stderr: | 20221210054723617 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210054723617 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210054723617 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210054723617 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210054723617 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210054723618 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210054723630 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210054723638 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210054723638 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210054723638 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:47:26.618461 run osmo-msc_10.42.42.6(pid=32283): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32283)] 05:47:26.668130 run osmo-msc_10.42.42.6(pid=32283): stdout: | (launched: 2022-12-10_05:47:25.468732) 05:47:26.719575 run osmo-msc_10.42.42.6(pid=32283): stderr: | 20221210054725797 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210054725797 DLGLOBAL DEBUG validating counter group 0x7f7b05667c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210054725798 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210054725798 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210054725798 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210054725798 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210054725801 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210054725802 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210054725802 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210054725802 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:47:26.771394 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32276): Terminating (SIGTERM) 05:47:26.812731 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32279): Terminating (SIGTERM) 05:47:26.854422 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32282): Terminating (SIGTERM) 05:47:26.896451 --- ParallelTerminationStrategy: PID 32276 died... 05:47:26.916416 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32276): Terminated: ok {rc=0} 05:47:26.962452 --- ParallelTerminationStrategy: PID 32279 died... 05:47:26.981678 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32279): Terminated: ok {rc=0} 05:47:27.027449 --- ParallelTerminationStrategy: PID 32282 died... 05:47:27.046864 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32282): Terminated: ok {rc=0} 05:47:27.134633 bus /sierra_3: Setting Powered False 05:47:28.234697 bus /sierra_3: Setting Powered False 05:47:29.350418 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 05:47:30.604934 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:47:30.612301 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 05:47:30.646172 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 05:47:30.674572 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 05:47:30.728821 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 05:47:30.762308 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 05:47:30.788699 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 05:47:31.349834 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 05:47:31.414982 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:47:31.430499 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 05:47:31.519151 tst mo_mt_call.py: using LAC 26268 05:47:31.641505 tst mo_mt_call.py: using RAC 3 05:47:31.808930 tst mo_mt_call.py: using CellId 26268 05:47:31.939875 tst mo_mt_call.py: using BVCI 26269 05:47:32.089484 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:47:32.101565 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:47:32.113973 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:47:32.128103 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:47:32.142429 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:47:32.154343 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 05:47:32.275049 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 05:47:32.395688 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:47:32.901518 run create_hlr_db(pid=32288): Launched 05:47:33.032706 bus /sierra_2: Setting Powered False 05:47:34.096722 run create_hlr_db(pid=32288): Terminated: ok {rc=0} 05:47:34.532259 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32290): Launched 05:47:34.839830 run osmo-hlr_10.42.42.2(pid=32291): Launched 05:47:34.955952 run osmo-stp_10.42.42.5: Starting osmo-stp 05:47:35.495759 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32293): Launched 05:47:35.803765 run osmo-stp_10.42.42.5(pid=32294): Launched 05:47:35.920830 run osmo-msc_10.42.42.6: Starting osmo-msc 05:47:36.487419 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32299): Launched 05:47:36.794316 run osmo-msc_10.42.42.6(pid=32300): Launched 05:47:36.964563 run osmo-stp_10.42.42.5(pid=32294): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32294)] 05:47:37.093669 run osmo-stp_10.42.42.5(pid=32294): stdout: | (launched: 2022-12-10_05:47:35.744808) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:47:37.223343 run osmo-stp_10.42.42.5(pid=32294): stderr: | 20221210054735919 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054735920 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054735920 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054735920 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054735921 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054735921 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054735921 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:47:37.350376 run osmo-stp_10.42.42.5(pid=32294): stdout: | (launched: 2022-12-10_05:47:35.744808) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:47:37.471807 run osmo-stp_10.42.42.5(pid=32294): stderr: | 20221210054735919 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054735920 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054735920 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054735920 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054735921 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054735921 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054735921 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:47:37.617126 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32294): Process ended prematurely: osmo-stp_10.42.42.5(pid=32294) [trial-2370↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32294)] [trial-2370↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 05:47:37.626296 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 05:47:37.653253 run osmo-hlr_10.42.42.2(pid=32291): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32291)] 05:47:37.701206 run osmo-hlr_10.42.42.2(pid=32291): stdout: | (launched: 2022-12-10_05:47:34.781815) 05:47:37.750479 run osmo-hlr_10.42.42.2(pid=32291): stderr: | 20221210054734962 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210054734962 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210054734962 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210054734962 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210054734963 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210054734963 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210054734975 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210054734984 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210054734985 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210054734985 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:47:37.818560 run osmo-msc_10.42.42.6(pid=32300): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32300)] 05:47:37.866115 run osmo-msc_10.42.42.6(pid=32300): stdout: | (launched: 2022-12-10_05:47:36.736483) 05:47:37.915551 run osmo-msc_10.42.42.6(pid=32300): stderr: | 20221210054737013 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210054737013 DLGLOBAL DEBUG validating counter group 0x7f28ab6ccc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210054737013 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210054737013 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210054737013 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210054737013 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210054737015 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210054737015 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210054737016 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210054737016 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:47:37.965301 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32290): Terminating (SIGTERM) 05:47:38.004753 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32293): Terminating (SIGTERM) 05:47:38.044276 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32299): Terminating (SIGTERM) 05:47:38.084048 --- ParallelTerminationStrategy: PID 32290 died... 05:47:38.103124 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32290): Terminated: ok {rc=0} 05:47:38.147506 --- ParallelTerminationStrategy: PID 32293 died... 05:47:38.166304 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32293): Terminated: ok {rc=0} 05:47:38.210855 --- ParallelTerminationStrategy: PID 32299 died... 05:47:38.229501 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32299): Terminated: ok {rc=0} 05:47:38.316044 bus /sierra_3: Setting Powered False 05:47:39.416096 bus /sierra_3: Setting Powered False 05:47:40.532342 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2370 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 05:47:41.683534 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:47:41.695866 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 05:47:41.767581 tst mo_mt_call_osmux.py: using LAC 26269 05:47:41.895057 tst mo_mt_call_osmux.py: using RAC 4 05:47:42.016018 tst mo_mt_call_osmux.py: using CellId 26269 05:47:42.137377 tst mo_mt_call_osmux.py: using BVCI 26270 05:47:42.247610 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:47:42.259013 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:47:42.270234 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:47:42.281913 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:47:42.293451 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:47:42.304866 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 05:47:42.425093 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 05:47:42.545314 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:47:43.049630 run create_hlr_db(pid=32302): Launched 05:47:43.181171 bus /sierra_2: Setting Powered False 05:47:44.245201 run create_hlr_db(pid=32302): Terminated: ok {rc=0} 05:47:44.681547 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32304): Launched 05:47:44.985814 run osmo-hlr_10.42.42.2(pid=32305): Launched 05:47:45.100734 run osmo-stp_10.42.42.5: Starting osmo-stp 05:47:45.639400 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32307): Launched 05:47:45.979776 run osmo-stp_10.42.42.5(pid=32308): Launched 05:47:46.231035 run osmo-msc_10.42.42.6: Starting osmo-msc 05:47:46.921886 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32310): Launched 05:47:47.267149 run osmo-msc_10.42.42.6(pid=32311): Launched 05:47:47.437433 run osmo-stp_10.42.42.5(pid=32308): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32308)] 05:47:47.565892 run osmo-stp_10.42.42.5(pid=32308): stdout: | (launched: 2022-12-10_05:47:45.897668) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:47:47.695436 run osmo-stp_10.42.42.5(pid=32308): stderr: | 20221210054746276 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054746276 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054746276 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054746284 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054746285 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054746285 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054746285 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:47:47.822632 run osmo-stp_10.42.42.5(pid=32308): stdout: | (launched: 2022-12-10_05:47:45.897668) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:47:47.943516 run osmo-stp_10.42.42.5(pid=32308): stderr: | 20221210054746276 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054746276 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054746276 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054746284 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054746285 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054746285 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054746285 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:47:48.087910 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32308): Process ended prematurely: osmo-stp_10.42.42.5(pid=32308) [trial-2370↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32308)] [trial-2370↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 05:47:48.097131 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 05:47:48.123631 run osmo-hlr_10.42.42.2(pid=32305): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32305)] 05:47:48.171486 run osmo-hlr_10.42.42.2(pid=32305): stdout: | (launched: 2022-12-10_05:47:44.928015) 05:47:48.220739 run osmo-hlr_10.42.42.2(pid=32305): stderr: | 20221210054745107 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210054745107 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210054745107 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210054745107 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210054745107 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210054745107 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210054745122 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210054745133 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210054745133 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210054745133 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:47:48.289419 run osmo-msc_10.42.42.6(pid=32311): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32311)] 05:47:48.336880 run osmo-msc_10.42.42.6(pid=32311): stdout: | (launched: 2022-12-10_05:47:47.205560) 05:47:48.385922 run osmo-msc_10.42.42.6(pid=32311): stderr: | 20221210054747485 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210054747485 DLGLOBAL DEBUG validating counter group 0x7f4adfb3ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210054747485 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210054747485 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210054747485 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210054747485 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210054747487 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210054747487 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210054747488 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210054747488 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:47:48.435691 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32304): Terminating (SIGTERM) 05:47:48.475286 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32307): Terminating (SIGTERM) 05:47:48.514830 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32310): Terminating (SIGTERM) 05:47:48.554637 --- ParallelTerminationStrategy: PID 32304 died... 05:47:48.573522 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32304): Terminated: ok {rc=0} 05:47:48.618168 --- ParallelTerminationStrategy: PID 32307 died... 05:47:48.636660 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32307): Terminated: ok {rc=0} 05:47:48.680530 --- ParallelTerminationStrategy: PID 32310 died... 05:47:48.699069 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32310): Terminated: ok {rc=0} 05:47:48.784418 bus /sierra_3: Setting Powered False 05:47:49.884141 bus /sierra_3: Setting Powered False 05:47:50.997174 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 05:47:52.249111 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:47:52.256172 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 05:47:52.290313 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 05:47:52.317682 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 05:47:52.371820 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 05:47:52.406366 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 05:47:52.434046 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 05:47:52.983550 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 05:47:53.035347 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:47:53.047003 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 05:47:53.117756 tst mo_mt_call.py: using LAC 26270 05:47:53.245872 tst mo_mt_call.py: using RAC 5 05:47:53.374291 tst mo_mt_call.py: using CellId 26270 05:47:53.502400 tst mo_mt_call.py: using BVCI 26271 05:47:53.621476 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:47:53.633130 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:47:53.644536 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:47:53.656162 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:47:53.667776 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:47:53.679235 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 05:47:53.796192 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 05:47:53.915560 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:47:54.419836 run create_hlr_db(pid=32316): Launched 05:47:54.551066 bus /sierra_2: Setting Powered False 05:47:55.615679 run create_hlr_db(pid=32316): Terminated: ok {rc=0} 05:47:56.051503 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32318): Launched 05:47:56.358505 run osmo-hlr_10.42.42.2(pid=32319): Launched 05:47:56.474754 run osmo-stp_10.42.42.5: Starting osmo-stp 05:47:57.013617 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32321): Launched 05:47:57.319402 run osmo-stp_10.42.42.5(pid=32322): Launched 05:47:57.434867 run osmo-msc_10.42.42.6: Starting osmo-msc 05:47:57.986780 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32324): Launched 05:47:58.293970 run osmo-msc_10.42.42.6(pid=32325): Launched 05:47:58.463661 run osmo-stp_10.42.42.5(pid=32322): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32322)] 05:47:58.593221 run osmo-stp_10.42.42.5(pid=32322): stdout: | (launched: 2022-12-10_05:47:57.261274) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:47:58.722710 run osmo-stp_10.42.42.5(pid=32322): stderr: | 20221210054757435 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054757436 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054757436 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054757436 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054757437 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054757437 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054757437 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:47:58.850258 run osmo-stp_10.42.42.5(pid=32322): stdout: | (launched: 2022-12-10_05:47:57.261274) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:47:58.971544 run osmo-stp_10.42.42.5(pid=32322): stderr: | 20221210054757435 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054757436 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054757436 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054757436 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054757437 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054757437 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054757437 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:47:59.116821 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32322): Process ended prematurely: osmo-stp_10.42.42.5(pid=32322) [trial-2370↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32322)] [trial-2370↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 05:47:59.126157 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 05:47:59.152937 run osmo-hlr_10.42.42.2(pid=32319): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32319)] 05:47:59.201178 run osmo-hlr_10.42.42.2(pid=32319): stdout: | (launched: 2022-12-10_05:47:56.300211) 05:47:59.250417 run osmo-hlr_10.42.42.2(pid=32319): stderr: | 20221210054756478 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210054756478 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210054756478 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210054756478 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210054756478 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210054756478 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210054756490 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210054756499 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210054756499 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210054756499 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:47:59.318852 run osmo-msc_10.42.42.6(pid=32325): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32325)] 05:47:59.366319 run osmo-msc_10.42.42.6(pid=32325): stdout: | (launched: 2022-12-10_05:47:58.236020) 05:47:59.415333 run osmo-msc_10.42.42.6(pid=32325): stderr: | 20221210054758511 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210054758511 DLGLOBAL DEBUG validating counter group 0x7fdb82315c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210054758511 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210054758511 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210054758511 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210054758511 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210054758513 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210054758514 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210054758514 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210054758514 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:47:59.465044 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32318): Terminating (SIGTERM) 05:47:59.504543 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32321): Terminating (SIGTERM) 05:47:59.544101 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32324): Terminating (SIGTERM) 05:47:59.583876 --- ParallelTerminationStrategy: PID 32318 died... 05:47:59.602902 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32318): Terminated: ok {rc=0} 05:47:59.647515 --- ParallelTerminationStrategy: PID 32321 died... 05:47:59.666072 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32321): Terminated: ok {rc=0} 05:47:59.710363 --- ParallelTerminationStrategy: PID 32324 died... 05:47:59.729035 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32324): Terminated: ok {rc=0} 05:47:59.815988 bus /sierra_3: Setting Powered False 05:48:00.921542 bus /sierra_3: Setting Powered False 05:48:02.047260 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2370 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 05:48:03.198000 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:48:03.210512 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 05:48:03.282650 tst mo_mt_call_osmux.py: using LAC 26271 05:48:03.409667 tst mo_mt_call_osmux.py: using RAC 6 05:48:03.537162 tst mo_mt_call_osmux.py: using CellId 26271 05:48:03.665242 tst mo_mt_call_osmux.py: using BVCI 26272 05:48:03.782803 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:48:03.794722 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:48:03.806407 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:48:03.818305 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:48:03.830329 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:48:03.842218 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 05:48:03.964131 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 05:48:04.084637 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:48:04.590931 run create_hlr_db(pid=32327): Launched 05:48:04.722820 bus /sierra_2: Setting Powered False 05:48:05.786663 run create_hlr_db(pid=32327): Terminated: ok {rc=0} 05:48:06.222977 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32329): Launched 05:48:06.529638 run osmo-hlr_10.42.42.2(pid=32330): Launched 05:48:06.646725 run osmo-stp_10.42.42.5: Starting osmo-stp 05:48:07.191139 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32332): Launched 05:48:07.498257 run osmo-stp_10.42.42.5(pid=32333): Launched 05:48:07.614509 run osmo-msc_10.42.42.6: Starting osmo-msc 05:48:08.167658 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32335): Launched 05:48:08.475055 run osmo-msc_10.42.42.6(pid=32336): Launched 05:48:08.646909 run osmo-stp_10.42.42.5(pid=32333): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32333)] 05:48:08.776553 run osmo-stp_10.42.42.5(pid=32333): stdout: | (launched: 2022-12-10_05:48:07.440453) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:48:08.906605 run osmo-stp_10.42.42.5(pid=32333): stderr: | 20221210054807614 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054807614 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054807615 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054807615 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054807615 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054807615 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054807615 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:48:09.034505 run osmo-stp_10.42.42.5(pid=32333): stdout: | (launched: 2022-12-10_05:48:07.440453) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:48:09.155762 run osmo-stp_10.42.42.5(pid=32333): stderr: | 20221210054807614 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054807614 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054807615 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054807615 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054807615 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054807615 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054807615 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:48:09.301751 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32333): Process ended prematurely: osmo-stp_10.42.42.5(pid=32333) [trial-2370↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32333)] [trial-2370↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 05:48:09.311045 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 05:48:09.338077 run osmo-hlr_10.42.42.2(pid=32330): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32330)] 05:48:09.386236 run osmo-hlr_10.42.42.2(pid=32330): stdout: | (launched: 2022-12-10_05:48:06.471184) 05:48:09.436089 run osmo-hlr_10.42.42.2(pid=32330): stderr: | 20221210054806653 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210054806653 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210054806653 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210054806653 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210054806653 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210054806653 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210054806665 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210054806674 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210054806674 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210054806674 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:48:09.505044 run osmo-msc_10.42.42.6(pid=32336): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32336)] 05:48:09.552914 run osmo-msc_10.42.42.6(pid=32336): stdout: | (launched: 2022-12-10_05:48:08.417065) 05:48:09.602130 run osmo-msc_10.42.42.6(pid=32336): stderr: | 20221210054808692 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210054808692 DLGLOBAL DEBUG validating counter group 0x7f4569305c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210054808692 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210054808692 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210054808692 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210054808693 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210054808694 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210054808695 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210054808695 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210054808695 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:48:09.651875 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32329): Terminating (SIGTERM) 05:48:09.692047 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32332): Terminating (SIGTERM) 05:48:09.732194 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32335): Terminating (SIGTERM) 05:48:09.772220 --- ParallelTerminationStrategy: PID 32329 died... 05:48:09.791343 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32329): Terminated: ok {rc=0} 05:48:09.835747 --- ParallelTerminationStrategy: PID 32332 died... 05:48:09.854327 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32332): Terminated: ok {rc=0} 05:48:09.898495 --- ParallelTerminationStrategy: PID 32335 died... 05:48:09.917126 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32335): Terminated: ok {rc=0} 05:48:10.000815 bus /sierra_3: Setting Powered False 05:48:11.098873 bus /sierra_3: Setting Powered False 05:48:12.213985 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 05:48:13.467023 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:48:13.474376 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 05:48:13.508621 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 05:48:13.536572 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 05:48:13.591155 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 05:48:13.625421 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 05:48:13.652823 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 05:48:14.209136 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 05:48:14.261141 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:48:14.272911 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 05:48:14.349378 tst mo_mt_call.py: using LAC 26272 05:48:14.476906 tst mo_mt_call.py: using RAC 7 05:48:14.602813 tst mo_mt_call.py: using CellId 26272 05:48:14.731697 tst mo_mt_call.py: using BVCI 26273 05:48:14.851154 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:48:14.862991 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:48:14.874603 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:48:14.886185 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:48:14.898193 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:48:14.909745 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 05:48:15.027140 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 05:48:15.144037 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:48:15.617698 run create_hlr_db(pid=32341): Launched 05:48:15.733849 bus /sierra_2: Setting Powered False 05:48:16.810596 run create_hlr_db(pid=32341): Terminated: ok {rc=0} 05:48:17.320209 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32343): Launched 05:48:17.627696 run osmo-hlr_10.42.42.2(pid=32344): Launched 05:48:17.744025 run osmo-stp_10.42.42.5: Starting osmo-stp 05:48:18.270757 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32346): Launched 05:48:18.577261 run osmo-stp_10.42.42.5(pid=32347): Launched 05:48:18.694911 run osmo-msc_10.42.42.6: Starting osmo-msc 05:48:19.248200 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32349): Launched 05:48:19.555583 run osmo-msc_10.42.42.6(pid=32350): Launched 05:48:19.726268 run osmo-stp_10.42.42.5(pid=32347): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32347)] 05:48:19.855503 run osmo-stp_10.42.42.5(pid=32347): stdout: | (launched: 2022-12-10_05:48:18.519283) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:48:19.984573 run osmo-stp_10.42.42.5(pid=32347): stderr: | 20221210054818692 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054818692 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054818692 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054818693 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054818693 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054818693 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054818693 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:48:20.111817 run osmo-stp_10.42.42.5(pid=32347): stdout: | (launched: 2022-12-10_05:48:18.519283) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:48:20.233240 run osmo-stp_10.42.42.5(pid=32347): stderr: | 20221210054818692 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054818692 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054818692 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054818693 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054818693 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054818693 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054818693 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:48:20.378425 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32347): Process ended prematurely: osmo-stp_10.42.42.5(pid=32347) [trial-2370↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32347)] [trial-2370↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 05:48:20.387569 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 05:48:20.414532 run osmo-hlr_10.42.42.2(pid=32344): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32344)] 05:48:20.462514 run osmo-hlr_10.42.42.2(pid=32344): stdout: | (launched: 2022-12-10_05:48:17.569563) 05:48:20.511923 run osmo-hlr_10.42.42.2(pid=32344): stderr: | 20221210054817750 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210054817750 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210054817750 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210054817750 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210054817750 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210054817750 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210054817762 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210054817773 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210054817773 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210054817773 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:48:20.580639 run osmo-msc_10.42.42.6(pid=32350): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32350)] 05:48:20.628847 run osmo-msc_10.42.42.6(pid=32350): stdout: | (launched: 2022-12-10_05:48:19.497752) 05:48:20.679073 run osmo-msc_10.42.42.6(pid=32350): stderr: | 20221210054819772 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210054819772 DLGLOBAL DEBUG validating counter group 0x7f146f755c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210054819772 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210054819772 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210054819772 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210054819773 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210054819774 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210054819775 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210054819775 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210054819775 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:48:20.729266 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32343): Terminating (SIGTERM) 05:48:20.769158 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32346): Terminating (SIGTERM) 05:48:20.808992 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32349): Terminating (SIGTERM) 05:48:20.849042 --- ParallelTerminationStrategy: PID 32343 died... 05:48:20.868084 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32343): Terminated: ok {rc=0} 05:48:20.912813 --- ParallelTerminationStrategy: PID 32346 died... 05:48:20.931721 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32346): Terminated: ok {rc=0} 05:48:20.975750 --- ParallelTerminationStrategy: PID 32349 died... 05:48:20.994305 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32349): Terminated: ok {rc=0} 05:48:21.079938 bus /sierra_3: Setting Powered False 05:48:22.179791 bus /sierra_3: Setting Powered False 05:48:23.295528 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2370 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 05:48:24.441581 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:48:24.453691 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 05:48:24.524544 tst mo_mt_call_osmux.py: using LAC 26273 05:48:24.653868 tst mo_mt_call_osmux.py: using RAC 8 05:48:24.776207 tst mo_mt_call_osmux.py: using CellId 26273 05:48:24.897562 tst mo_mt_call_osmux.py: using BVCI 26274 05:48:25.010203 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:48:25.021776 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:48:25.032919 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:48:25.044450 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:48:25.055973 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:48:25.067315 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 05:48:25.188610 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 05:48:25.308461 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:48:25.782521 run create_hlr_db(pid=32352): Launched 05:48:25.898372 bus /sierra_2: Setting Powered False 05:48:26.958634 run create_hlr_db(pid=32352): Terminated: ok {rc=0} 05:48:27.384833 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32354): Launched 05:48:27.692508 run osmo-hlr_10.42.42.2(pid=32355): Launched 05:48:27.809275 run osmo-stp_10.42.42.5: Starting osmo-stp 05:48:28.355351 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32357): Launched 05:48:28.662096 run osmo-stp_10.42.42.5(pid=32358): Launched 05:48:28.779074 run osmo-msc_10.42.42.6: Starting osmo-msc 05:48:29.331606 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32360): Launched 05:48:29.638871 run osmo-msc_10.42.42.6(pid=32361): Launched 05:48:29.809981 run osmo-stp_10.42.42.5(pid=32358): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32358)] 05:48:29.939505 run osmo-stp_10.42.42.5(pid=32358): stdout: | (launched: 2022-12-10_05:48:28.603863) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:48:30.069185 run osmo-stp_10.42.42.5(pid=32358): stderr: | 20221210054828778 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054828779 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054828779 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054828779 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054828781 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054828782 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054828782 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:48:30.196457 run osmo-stp_10.42.42.5(pid=32358): stdout: | (launched: 2022-12-10_05:48:28.603863) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:48:30.317550 run osmo-stp_10.42.42.5(pid=32358): stderr: | 20221210054828778 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054828779 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054828779 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054828779 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054828781 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054828782 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054828782 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:48:30.462583 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32358): Process ended prematurely: osmo-stp_10.42.42.5(pid=32358) [trial-2370↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32358)] [trial-2370↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 05:48:30.471523 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 05:48:30.498337 run osmo-hlr_10.42.42.2(pid=32355): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32355)] 05:48:30.546170 run osmo-hlr_10.42.42.2(pid=32355): stdout: | (launched: 2022-12-10_05:48:27.634488) 05:48:30.595646 run osmo-hlr_10.42.42.2(pid=32355): stderr: | 20221210054827813 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210054827813 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210054827813 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210054827813 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210054827813 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210054827813 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210054827826 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210054827834 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210054827834 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210054827834 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:48:30.664676 run osmo-msc_10.42.42.6(pid=32361): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32361)] 05:48:30.712392 run osmo-msc_10.42.42.6(pid=32361): stdout: | (launched: 2022-12-10_05:48:29.580906) 05:48:30.762361 run osmo-msc_10.42.42.6(pid=32361): stderr: | 20221210054829857 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210054829857 DLGLOBAL DEBUG validating counter group 0x7ff839cb8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210054829857 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210054829858 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210054829858 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210054829858 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210054829860 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210054829861 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210054829861 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210054829861 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:48:30.812139 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32354): Terminating (SIGTERM) 05:48:30.857952 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32357): Terminating (SIGTERM) 05:48:30.898807 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32360): Terminating (SIGTERM) 05:48:30.939690 --- ParallelTerminationStrategy: PID 32354 died... 05:48:30.958779 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32354): Terminated: ok {rc=0} 05:48:31.003746 --- ParallelTerminationStrategy: PID 32357 died... 05:48:31.022808 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32357): Terminated: ok {rc=0} 05:48:31.067642 --- ParallelTerminationStrategy: PID 32360 died... 05:48:31.086619 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32360): Terminated: ok {rc=0} 05:48:31.171342 bus /sierra_3: Setting Powered False 05:48:32.270662 bus /sierra_3: Setting Powered False 05:48:33.388046 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 voice:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 05:48:34.637438 tst voice:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:48:34.643537 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 05:48:34.677721 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 05:48:34.704139 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 05:48:34.756655 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 05:48:34.790387 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 05:48:34.816854 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 05:48:35.364259 tst voice:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 05:48:35.413731 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:48:35.424814 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 05:48:35.494980 tst mo_mt_call.py: using LAC 26274 05:48:35.615536 tst mo_mt_call.py: using RAC 9 05:48:35.736524 tst mo_mt_call.py: using CellId 26274 05:48:35.857032 tst mo_mt_call.py: using BVCI 26275 05:48:35.968727 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:48:35.979671 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:48:35.990552 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:48:36.001565 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:48:36.012456 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:48:36.023649 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 05:48:36.144697 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 05:48:36.263660 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:48:36.768839 run create_hlr_db(pid=32366): Launched 05:48:36.901614 bus /sierra_2: Setting Powered False 05:48:37.965720 run create_hlr_db(pid=32366): Terminated: ok {rc=0} 05:48:38.400354 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32368): Launched 05:48:38.707188 run osmo-hlr_10.42.42.2(pid=32369): Launched 05:48:38.823969 run osmo-stp_10.42.42.5: Starting osmo-stp 05:48:39.362509 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32371): Launched 05:48:39.669406 run osmo-stp_10.42.42.5(pid=32372): Launched 05:48:39.784636 run osmo-msc_10.42.42.6: Starting osmo-msc 05:48:40.364315 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32374): Launched 05:48:40.691992 run osmo-msc_10.42.42.6(pid=32375): Launched 05:48:40.875053 run osmo-stp_10.42.42.5(pid=32372): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32372)] 05:48:41.011813 run osmo-stp_10.42.42.5(pid=32372): stdout: | (launched: 2022-12-10_05:48:39.611047) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:48:41.149236 run osmo-stp_10.42.42.5(pid=32372): stderr: | 20221210054839785 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054839786 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054839786 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054839786 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054839787 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054839787 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054839787 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:48:41.286237 run osmo-stp_10.42.42.5(pid=32372): stdout: | (launched: 2022-12-10_05:48:39.611047) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:48:41.415399 run osmo-stp_10.42.42.5(pid=32372): stderr: | 20221210054839785 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054839786 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054839786 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054839786 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054839787 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054839787 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054839787 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:48:41.570263 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32372): Process ended prematurely: osmo-stp_10.42.42.5(pid=32372) [trial-2370↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32372)] [trial-2370↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 05:48:41.580014 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 05:48:41.608035 run osmo-hlr_10.42.42.2(pid=32369): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32369)] 05:48:41.658502 run osmo-hlr_10.42.42.2(pid=32369): stdout: | (launched: 2022-12-10_05:48:38.649183) 05:48:41.710102 run osmo-hlr_10.42.42.2(pid=32369): stderr: | 20221210054838831 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210054838831 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210054838831 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210054838831 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210054838831 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210054838831 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210054838843 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210054838854 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210054838854 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210054838854 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:48:41.781832 run osmo-msc_10.42.42.6(pid=32375): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32375)] 05:48:41.831621 run osmo-msc_10.42.42.6(pid=32375): stdout: | (launched: 2022-12-10_05:48:40.630702) 05:48:41.882656 run osmo-msc_10.42.42.6(pid=32375): stderr: | 20221210054840960 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210054840960 DLGLOBAL DEBUG validating counter group 0x7f7aa6a7fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210054840960 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210054840960 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210054840960 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210054840961 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210054840962 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210054840963 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210054840963 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210054840963 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:48:41.934422 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32368): Terminating (SIGTERM) 05:48:41.975913 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32371): Terminating (SIGTERM) 05:48:42.017488 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32374): Terminating (SIGTERM) 05:48:42.059156 --- ParallelTerminationStrategy: PID 32368 died... 05:48:42.079086 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32368): Terminated: ok {rc=0} 05:48:42.125309 --- ParallelTerminationStrategy: PID 32371 died... 05:48:42.144902 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32371): Terminated: ok {rc=0} 05:48:42.191262 --- ParallelTerminationStrategy: PID 32374 died... 05:48:42.210799 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32374): Terminated: ok {rc=0} 05:48:42.299126 bus /sierra_3: Setting Powered False 05:48:43.397301 bus /sierra_3: Setting Powered False 05:48:44.512888 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2370 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 05:48:45.663530 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:48:45.675909 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 05:48:45.749112 tst mo_mt_call_osmux.py: using LAC 26275 05:48:45.883914 tst mo_mt_call_osmux.py: using RAC 10 05:48:46.027105 tst mo_mt_call_osmux.py: using CellId 26275 05:48:46.155935 tst mo_mt_call_osmux.py: using BVCI 26276 05:48:46.278722 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:48:46.290823 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:48:46.302886 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:48:46.315071 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:48:46.326984 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:48:46.339169 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 05:48:46.463382 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 05:48:46.587346 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:48:47.119456 run create_hlr_db(pid=32377): Launched 05:48:47.282850 bus /sierra_2: Setting Powered False 05:48:48.347426 run create_hlr_db(pid=32377): Terminated: ok {rc=0} 05:48:48.783862 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32379): Launched 05:48:49.091783 run osmo-hlr_10.42.42.2(pid=32380): Launched 05:48:49.207458 run osmo-stp_10.42.42.5: Starting osmo-stp 05:48:49.751088 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32382): Launched 05:48:50.058714 run osmo-stp_10.42.42.5(pid=32383): Launched 05:48:50.174700 run osmo-msc_10.42.42.6: Starting osmo-msc 05:48:50.729255 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32385): Launched 05:48:51.037405 run osmo-msc_10.42.42.6(pid=32386): Launched 05:48:51.207922 run osmo-stp_10.42.42.5(pid=32383): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32383)] 05:48:51.337778 run osmo-stp_10.42.42.5(pid=32383): stdout: | (launched: 2022-12-10_05:48:50.000423) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:48:51.467987 run osmo-stp_10.42.42.5(pid=32383): stderr: | 20221210054850175 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054850175 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054850175 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054850176 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054850176 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054850176 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054850176 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:48:51.595613 run osmo-stp_10.42.42.5(pid=32383): stdout: | (launched: 2022-12-10_05:48:50.000423) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:48:51.716792 run osmo-stp_10.42.42.5(pid=32383): stderr: | 20221210054850175 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054850175 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054850175 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054850176 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054850176 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054850176 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054850176 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:48:51.862310 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32383): Process ended prematurely: osmo-stp_10.42.42.5(pid=32383) [trial-2370↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32383)] [trial-2370↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 05:48:51.871427 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 05:48:51.899596 run osmo-hlr_10.42.42.2(pid=32380): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32380)] 05:48:51.948405 run osmo-hlr_10.42.42.2(pid=32380): stdout: | (launched: 2022-12-10_05:48:49.034000) 05:48:51.998250 run osmo-hlr_10.42.42.2(pid=32380): stderr: | 20221210054849210 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210054849211 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210054849211 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210054849211 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210054849211 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210054849211 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210054849223 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210054849231 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210054849231 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210054849232 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:48:52.067713 run osmo-msc_10.42.42.6(pid=32386): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32386)] 05:48:52.116102 run osmo-msc_10.42.42.6(pid=32386): stdout: | (launched: 2022-12-10_05:48:50.979023) 05:48:52.166029 run osmo-msc_10.42.42.6(pid=32386): stderr: | 20221210054851252 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210054851252 DLGLOBAL DEBUG validating counter group 0x7f6a7cfb5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210054851253 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210054851253 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210054851253 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210054851253 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210054851255 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210054851255 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210054851255 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210054851255 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:48:52.216289 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32379): Terminating (SIGTERM) 05:48:52.256329 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32382): Terminating (SIGTERM) 05:48:52.296073 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32385): Terminating (SIGTERM) 05:48:52.335848 --- ParallelTerminationStrategy: PID 32379 died... 05:48:52.354771 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32379): Terminated: ok {rc=0} 05:48:52.398886 --- ParallelTerminationStrategy: PID 32382 died... 05:48:52.417184 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32382): Terminated: ok {rc=0} 05:48:52.462012 --- ParallelTerminationStrategy: PID 32385 died... 05:48:52.480383 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32385): Terminated: ok {rc=0} 05:48:52.565653 bus /sierra_3: Setting Powered False 05:48:53.664898 bus /sierra_3: Setting Powered False 05:48:54.781304 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 voice:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 voice:trx-b200+mod-bts0-trxdversion0 --------------------------------------------------------------------- 05:48:56.054547 tst voice:trx-b200+mod-bts0-trxdversion0: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:48:56.061476 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 1 x bts (candidates: 11) 05:48:56.095512 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 6 x ip_address (candidates: 9) 05:48:56.122838 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 2 x modem (candidates: 12) 05:48:56.182790 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 1 x bts (candidates: 11) 05:48:56.216307 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 6 x ip_address (candidates: 9) 05:48:56.243361 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 2 x modem (candidates: 12) 05:48:56.787400 tst voice:trx-b200+mod-bts0-trxdversion0: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call.py ---------------------------------------------- 05:48:56.839148 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 05:48:56.850817 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 05:48:56.902846 tst mo_mt_call.py: using LAC 26276 05:48:57.030604 tst mo_mt_call.py: using RAC 11 05:48:57.158988 tst mo_mt_call.py: using CellId 26276 05:48:57.286630 tst mo_mt_call.py: using BVCI 26277 05:48:57.403782 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 05:48:57.415337 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 05:48:57.426679 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 05:48:57.438053 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 05:48:57.449388 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 05:48:57.460742 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 05:48:57.578486 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 05:48:57.695336 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:48:58.170555 run create_hlr_db(pid=32392): Launched 05:48:58.286974 bus /sierra_2: Setting Powered False 05:48:59.347248 run create_hlr_db(pid=32392): Terminated: ok {rc=0} 05:48:59.772112 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32394): Launched 05:49:00.078720 run osmo-hlr_10.42.42.2(pid=32395): Launched 05:49:00.194741 run osmo-stp_10.42.42.5: Starting osmo-stp 05:49:00.738843 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32397): Launched 05:49:01.091098 run osmo-stp_10.42.42.5(pid=32398): Launched 05:49:01.314441 run osmo-msc_10.42.42.6: Starting osmo-msc 05:49:01.988512 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32400): Launched 05:49:02.330207 run osmo-msc_10.42.42.6(pid=32401): Launched 05:49:02.512072 run osmo-stp_10.42.42.5(pid=32398): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32398)] 05:49:02.650612 run osmo-stp_10.42.42.5(pid=32398): stdout: | (launched: 2022-12-10_05:49:01.028042) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:49:02.790679 run osmo-stp_10.42.42.5(pid=32398): stderr: | 20221210054901263 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054901263 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054901264 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054901264 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054901264 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054901265 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054901265 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:49:02.927829 run osmo-stp_10.42.42.5(pid=32398): stdout: | (launched: 2022-12-10_05:49:01.028042) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:49:03.058300 run osmo-stp_10.42.42.5(pid=32398): stderr: | 20221210054901263 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054901263 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054901264 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054901264 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054901264 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054901265 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054901265 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:49:03.213193 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32398): Process ended prematurely: osmo-stp_10.42.42.5(pid=32398) [trial-2370↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32398)] [trial-2370↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8] 05:49:03.222836 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 05:49:03.250306 run osmo-hlr_10.42.42.2(pid=32395): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32395)] 05:49:03.300062 run osmo-hlr_10.42.42.2(pid=32395): stdout: | (launched: 2022-12-10_05:49:00.020635) 05:49:03.351745 run osmo-hlr_10.42.42.2(pid=32395): stderr: | 20221210054900198 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210054900198 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210054900198 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210054900198 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210054900198 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210054900198 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210054900213 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210054900222 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210054900222 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210054900222 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:49:03.423189 run osmo-msc_10.42.42.6(pid=32401): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32401)] 05:49:03.473131 run osmo-msc_10.42.42.6(pid=32401): stdout: | (launched: 2022-12-10_05:49:02.268851) 05:49:03.524236 run osmo-msc_10.42.42.6(pid=32401): stderr: | 20221210054902593 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210054902593 DLGLOBAL DEBUG validating counter group 0x7f1e5e9dbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210054902593 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210054902593 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210054902594 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210054902594 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210054902595 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210054902596 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210054902596 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210054902596 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:49:03.575950 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32394): Terminating (SIGTERM) 05:49:03.617176 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32397): Terminating (SIGTERM) 05:49:03.658728 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32400): Terminating (SIGTERM) 05:49:03.700396 --- ParallelTerminationStrategy: PID 32394 died... 05:49:03.720404 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32394): Terminated: ok {rc=0} 05:49:03.766781 --- ParallelTerminationStrategy: PID 32397 died... 05:49:03.786298 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32397): Terminated: ok {rc=0} 05:49:03.832099 --- ParallelTerminationStrategy: PID 32400 died... 05:49:03.851497 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32400): Terminated: ok {rc=0} 05:49:03.939059 bus /sierra_3: Setting Powered False 05:49:05.039549 bus /sierra_3: Setting Powered False 05:49:06.157495 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2370 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call_osmux.py ---------------------------------------------- 05:49:07.304735 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 05:49:07.316439 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 05:49:07.368323 tst mo_mt_call_osmux.py: using LAC 26277 05:49:07.492175 tst mo_mt_call_osmux.py: using RAC 12 05:49:07.612259 tst mo_mt_call_osmux.py: using CellId 26277 05:49:07.729954 tst mo_mt_call_osmux.py: using BVCI 26278 05:49:07.841988 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 05:49:07.852905 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 05:49:07.863791 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 05:49:07.874882 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 05:49:07.885922 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 05:49:07.896926 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 05:49:08.016193 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 05:49:08.134034 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:49:08.608883 run create_hlr_db(pid=32403): Launched 05:49:08.725820 bus /sierra_2: Setting Powered False 05:49:09.786314 run create_hlr_db(pid=32403): Terminated: ok {rc=0} 05:49:10.233700 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32405): Launched 05:49:10.561234 run osmo-hlr_10.42.42.2(pid=32406): Launched 05:49:10.686633 run osmo-stp_10.42.42.5: Starting osmo-stp 05:49:11.254020 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32408): Launched 05:49:11.583826 run osmo-stp_10.42.42.5(pid=32409): Launched 05:49:11.707473 run osmo-msc_10.42.42.6: Starting osmo-msc 05:49:12.300287 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32411): Launched 05:49:12.628557 run osmo-msc_10.42.42.6(pid=32412): Launched 05:49:12.812031 run osmo-stp_10.42.42.5(pid=32409): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32409)] 05:49:12.949953 run osmo-stp_10.42.42.5(pid=32409): stdout: | (launched: 2022-12-10_05:49:11.521717) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:49:13.087560 run osmo-stp_10.42.42.5(pid=32409): stderr: | 20221210054911715 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054911715 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054911716 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054911716 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054911718 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054911719 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054911719 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:49:13.224256 run osmo-stp_10.42.42.5(pid=32409): stdout: | (launched: 2022-12-10_05:49:11.521717) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:49:13.353575 run osmo-stp_10.42.42.5(pid=32409): stderr: | 20221210054911715 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054911715 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054911716 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054911716 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054911718 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054911719 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054911719 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:49:13.508141 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32409): Process ended prematurely: osmo-stp_10.42.42.5(pid=32409) [trial-2370↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32409)] [trial-2370↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8] 05:49:13.518024 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 05:49:13.545786 run osmo-hlr_10.42.42.2(pid=32406): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32406)] 05:49:13.595638 run osmo-hlr_10.42.42.2(pid=32406): stdout: | (launched: 2022-12-10_05:49:10.499753) 05:49:13.647100 run osmo-hlr_10.42.42.2(pid=32406): stderr: | 20221210054910701 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210054910701 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210054910701 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210054910702 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210054910702 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210054910702 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210054910714 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210054910722 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210054910722 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210054910722 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:49:13.718620 run osmo-msc_10.42.42.6(pid=32412): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32412)] 05:49:13.768403 run osmo-msc_10.42.42.6(pid=32412): stdout: | (launched: 2022-12-10_05:49:12.567001) 05:49:13.819834 run osmo-msc_10.42.42.6(pid=32412): stderr: | 20221210054912893 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210054912893 DLGLOBAL DEBUG validating counter group 0x7ff1aad8cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210054912893 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210054912893 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210054912893 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210054912893 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210054912895 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210054912895 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210054912896 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210054912896 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:49:13.871404 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32405): Terminating (SIGTERM) 05:49:13.912633 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32408): Terminating (SIGTERM) 05:49:13.954266 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32411): Terminating (SIGTERM) 05:49:13.995940 --- ParallelTerminationStrategy: PID 32405 died... 05:49:14.015863 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32405): Terminated: ok {rc=0} 05:49:14.061954 --- ParallelTerminationStrategy: PID 32408 died... 05:49:14.081500 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32408): Terminated: ok {rc=0} 05:49:14.127197 --- ParallelTerminationStrategy: PID 32411 died... 05:49:14.146550 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32411): Terminated: ok {rc=0} 05:49:14.234129 bus /sierra_3: Setting Powered False 05:49:15.331948 bus /sierra_3: Setting Powered False 05:49:16.448383 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 voice:trx-b200+mod-bts0-trxdversion0 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 05:49:17.697178 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:49:17.703234 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 05:49:17.736340 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 05:49:17.763091 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 05:49:17.815932 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 05:49:17.849030 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 05:49:17.875546 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 05:49:18.427696 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 05:49:18.476774 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 05:49:18.488071 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 05:49:18.540320 tst mo_mt_call.py: using LAC 26278 05:49:18.659994 tst mo_mt_call.py: using RAC 13 05:49:18.781148 tst mo_mt_call.py: using CellId 26278 05:49:18.900644 tst mo_mt_call.py: using BVCI 26279 05:49:19.011312 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 05:49:19.022705 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 05:49:19.033773 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 05:49:19.045204 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 05:49:19.056587 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 05:49:19.067927 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 05:49:19.189133 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 05:49:19.308718 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:49:19.815946 run create_hlr_db(pid=32417): Launched 05:49:19.948888 bus /sierra_2: Setting Powered False 05:49:21.013197 run create_hlr_db(pid=32417): Terminated: ok {rc=0} 05:49:21.451414 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32419): Launched 05:49:21.759084 run osmo-hlr_10.42.42.2(pid=32420): Launched 05:49:21.875582 run osmo-stp_10.42.42.5: Starting osmo-stp 05:49:22.403099 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32422): Launched 05:49:22.711107 run osmo-stp_10.42.42.5(pid=32423): Launched 05:49:22.826697 run osmo-msc_10.42.42.6: Starting osmo-msc 05:49:23.380515 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32426): Launched 05:49:23.688674 run osmo-msc_10.42.42.6(pid=32427): Launched 05:49:23.858295 run osmo-stp_10.42.42.5(pid=32423): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32423)] 05:49:23.987031 run osmo-stp_10.42.42.5(pid=32423): stdout: | (launched: 2022-12-10_05:49:22.653082) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:49:24.116000 run osmo-stp_10.42.42.5(pid=32423): stderr: | 20221210054922827 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054922827 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054922827 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054922828 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054922828 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054922828 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054922828 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:49:24.243622 run osmo-stp_10.42.42.5(pid=32423): stdout: | (launched: 2022-12-10_05:49:22.653082) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:49:24.364240 run osmo-stp_10.42.42.5(pid=32423): stderr: | 20221210054922827 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054922827 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054922827 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054922828 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054922828 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054922828 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054922828 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:49:24.509869 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32423): Process ended prematurely: osmo-stp_10.42.42.5(pid=32423) [trial-2370↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32423)] [trial-2370↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 05:49:24.518884 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 05:49:24.545607 run osmo-hlr_10.42.42.2(pid=32420): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32420)] 05:49:24.592879 run osmo-hlr_10.42.42.2(pid=32420): stdout: | (launched: 2022-12-10_05:49:21.700707) 05:49:24.641903 run osmo-hlr_10.42.42.2(pid=32420): stderr: | 20221210054921882 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210054921883 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210054921883 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210054921883 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210054921883 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210054921883 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210054921898 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210054921908 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210054921908 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210054921908 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:49:24.710308 run osmo-msc_10.42.42.6(pid=32427): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32427)] 05:49:24.757495 run osmo-msc_10.42.42.6(pid=32427): stdout: | (launched: 2022-12-10_05:49:23.630368) 05:49:24.806351 run osmo-msc_10.42.42.6(pid=32427): stderr: | 20221210054923907 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210054923907 DLGLOBAL DEBUG validating counter group 0x7f0029463c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210054923907 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210054923907 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210054923907 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210054923908 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210054923910 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210054923911 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210054923911 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210054923911 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:49:24.855843 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32419): Terminating (SIGTERM) 05:49:24.895240 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32422): Terminating (SIGTERM) 05:49:24.934654 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32426): Terminating (SIGTERM) 05:49:24.974199 --- ParallelTerminationStrategy: PID 32419 died... 05:49:24.992893 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32419): Terminated: ok {rc=0} 05:49:25.036897 --- ParallelTerminationStrategy: PID 32422 died... 05:49:25.055317 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32422): Terminated: ok {rc=0} 05:49:25.099282 --- ParallelTerminationStrategy: PID 32426 died... 05:49:25.117761 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32426): Terminated: ok {rc=0} 05:49:25.201252 bus /sierra_3: Setting Powered False 05:49:26.298601 bus /sierra_3: Setting Powered False 05:49:27.418549 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2370 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 05:49:28.563952 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 05:49:28.576059 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 05:49:28.633272 tst mo_mt_call_osmux.py: using LAC 26279 05:49:28.752806 tst mo_mt_call_osmux.py: using RAC 14 05:49:28.870803 tst mo_mt_call_osmux.py: using CellId 26279 05:49:28.990957 tst mo_mt_call_osmux.py: using BVCI 26280 05:49:29.103738 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 05:49:29.115165 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 05:49:29.126416 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 05:49:29.137926 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 05:49:29.149371 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 05:49:29.160624 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 05:49:29.276113 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 05:49:29.402433 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:49:29.878073 run create_hlr_db(pid=32429): Launched 05:49:29.994581 bus /sierra_2: Setting Powered False 05:49:31.059739 run create_hlr_db(pid=32429): Terminated: ok {rc=0} 05:49:31.517624 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32431): Launched 05:49:31.864569 run osmo-hlr_10.42.42.2(pid=32432): Launched 05:49:32.075957 run osmo-stp_10.42.42.5: Starting osmo-stp 05:49:32.685962 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32434): Launched 05:49:33.016242 run osmo-stp_10.42.42.5(pid=32435): Launched 05:49:33.139641 run osmo-msc_10.42.42.6: Starting osmo-msc 05:49:33.729258 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32437): Launched 05:49:34.056423 run osmo-msc_10.42.42.6(pid=32438): Launched 05:49:34.235931 run osmo-stp_10.42.42.5(pid=32435): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32435)] 05:49:34.375657 run osmo-stp_10.42.42.5(pid=32435): stdout: | (launched: 2022-12-10_05:49:32.955118) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:49:34.513500 run osmo-stp_10.42.42.5(pid=32435): stderr: | 20221210054933153 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054933153 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054933153 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054933153 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054933154 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054933154 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054933154 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:49:34.648352 run osmo-stp_10.42.42.5(pid=32435): stdout: | (launched: 2022-12-10_05:49:32.955118) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:49:34.776896 run osmo-stp_10.42.42.5(pid=32435): stderr: | 20221210054933153 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054933153 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054933153 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054933153 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054933154 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054933154 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054933154 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:49:34.930978 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32435): Process ended prematurely: osmo-stp_10.42.42.5(pid=32435) [trial-2370↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32435)] [trial-2370↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 05:49:34.940817 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 05:49:34.968240 run osmo-hlr_10.42.42.2(pid=32432): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32432)] 05:49:35.017864 run osmo-hlr_10.42.42.2(pid=32432): stdout: | (launched: 2022-12-10_05:49:31.799459) 05:49:35.068808 run osmo-hlr_10.42.42.2(pid=32432): stderr: | 20221210054932146 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210054932146 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210054932146 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210054932146 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210054932146 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210054932146 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210054932160 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210054932176 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210054932176 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210054932176 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:49:35.140142 run osmo-msc_10.42.42.6(pid=32438): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32438)] 05:49:35.189529 run osmo-msc_10.42.42.6(pid=32438): stdout: | (launched: 2022-12-10_05:49:33.995336) 05:49:35.240688 run osmo-msc_10.42.42.6(pid=32438): stderr: | 20221210054934318 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210054934318 DLGLOBAL DEBUG validating counter group 0x7f1be75cec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210054934319 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210054934319 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210054934319 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210054934319 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210054934321 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210054934321 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210054934321 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210054934321 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:49:35.292524 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32431): Terminating (SIGTERM) 05:49:35.333734 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32434): Terminating (SIGTERM) 05:49:35.374892 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32437): Terminating (SIGTERM) 05:49:35.416493 --- ParallelTerminationStrategy: PID 32431 died... 05:49:35.436388 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32431): Terminated: ok {rc=0} 05:49:35.482215 --- ParallelTerminationStrategy: PID 32434 died... 05:49:35.501583 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32434): Terminated: ok {rc=0} 05:49:35.546984 --- ParallelTerminationStrategy: PID 32437 died... 05:49:35.566387 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32437): Terminated: ok {rc=0} 05:49:35.653342 bus /sierra_3: Setting Powered False 05:49:36.751800 bus /sierra_3: Setting Powered False 05:49:37.868803 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 emergency:trx-b200 --------------------------------------------------------------------- 05:49:39.124787 tst emergency:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:49:39.129613 tst emergency:trx-b200: Verifying 1 x bts (candidates: 11) 05:49:39.163783 tst emergency:trx-b200: Verifying 6 x ip_address (candidates: 9) 05:49:39.191049 tst emergency:trx-b200: Verifying 4 x modem (candidates: 12) 05:49:39.276164 tst emergency:trx-b200: Reserving 1 x bts (candidates: 11) 05:49:39.310364 tst emergency:trx-b200: Reserving 6 x ip_address (candidates: 9) 05:49:39.337878 tst emergency:trx-b200: Reserving 4 x modem (candidates: 12) 05:49:39.923232 tst emergency:trx-b200: RESERVED RESOURCES for emergency: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2370 emergency:trx-b200 emergency_mo_mt_call.py ---------------------------------------------- 05:49:39.928342 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 05:49:39.939917 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 05:49:39.990635 tst emergency_mo_mt_call.py: using LAC 26280 05:49:40.115573 tst emergency_mo_mt_call.py: using RAC 15 05:49:40.233443 tst emergency_mo_mt_call.py: using CellId 26280 05:49:40.350981 tst emergency_mo_mt_call.py: using BVCI 26281 05:49:40.459197 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 05:49:40.470036 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 05:49:40.480528 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 05:49:40.491455 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 05:49:40.502246 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 05:49:40.512798 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 05:49:40.627801 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 05:49:40.742081 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:49:41.206884 run create_hlr_db(pid=32443): Launched 05:49:41.321353 bus /sierra_2: Setting Powered False 05:49:42.381251 run create_hlr_db(pid=32443): Terminated: ok {rc=0} 05:49:42.800905 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32445): Launched 05:49:43.101667 run osmo-hlr_10.42.42.2(pid=32446): Launched 05:49:43.215541 run osmo-stp_10.42.42.5: Starting osmo-stp 05:49:43.749397 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32448): Launched 05:49:44.050936 run osmo-stp_10.42.42.5(pid=32449): Launched 05:49:44.175320 tst emergency_mo_mt_call.py: using MSISDN 7576 05:49:44.328707 run osmo-msc_10.42.42.6: Starting osmo-msc 05:49:44.869590 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32451): Launched 05:49:45.171117 run osmo-msc_10.42.42.6(pid=32452): Launched 05:49:45.338731 run osmo-stp_10.42.42.5(pid=32449): ERR: Terminated: ERROR {rc=1} [trial-2370↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32449)] 05:49:45.466789 run osmo-stp_10.42.42.5(pid=32449): stdout: | (launched: 2022-12-10_05:49:43.993319) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:49:45.594399 run osmo-stp_10.42.42.5(pid=32449): stderr: | 20221210054944165 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054944165 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054944165 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054944166 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054944166 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054944166 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054944166 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:49:45.719183 run osmo-stp_10.42.42.5(pid=32449): stdout: | (launched: 2022-12-10_05:49:43.993319) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:49:45.848359 run osmo-stp_10.42.42.5(pid=32449): stderr: | 20221210054944165 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054944165 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054944165 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054944166 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054944166 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054944166 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054944166 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:49:46.011311 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=32449): Process ended prematurely: osmo-stp_10.42.42.5(pid=32449) [trial-2370↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32449)] [trial-2370↪emergency:trx-b200↪emergency_mo_mt_call.py:19] 05:49:46.020342 tst emergency_mo_mt_call.py:19: Test FAILED (6.1 sec) 05:49:46.056701 run osmo-hlr_10.42.42.2(pid=32446): ERR: Terminated: ERROR {rc=237} [trial-2370↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32446)] 05:49:46.105063 run osmo-hlr_10.42.42.2(pid=32446): stdout: | (launched: 2022-12-10_05:49:43.044618) 05:49:46.155598 run osmo-hlr_10.42.42.2(pid=32446): stderr: | 20221210054943223 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210054943223 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210054943223 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210054943223 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210054943224 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210054943224 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210054943235 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/emergency:trx-b200/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210054943244 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210054943244 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210054943244 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:49:46.226036 run osmo-msc_10.42.42.6(pid=32452): ERR: Terminated: ERROR {rc=2} [trial-2370↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32452)] 05:49:46.274979 run osmo-msc_10.42.42.6(pid=32452): stdout: | (launched: 2022-12-10_05:49:45.113896) 05:49:46.325494 run osmo-msc_10.42.42.6(pid=32452): stderr: | 20221210054945390 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210054945390 DLGLOBAL DEBUG validating counter group 0x7f243d890c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210054945390 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210054945390 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210054945390 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210054945390 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210054945392 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210054945393 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210054945393 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210054945393 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:49:46.376304 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32445): Terminating (SIGTERM) 05:49:46.417457 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32448): Terminating (SIGTERM) 05:49:46.458931 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32451): Terminating (SIGTERM) 05:49:46.500610 --- ParallelTerminationStrategy: PID 32445 died... 05:49:46.520043 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32445): Terminated: ok {rc=0} 05:49:46.566648 --- ParallelTerminationStrategy: PID 32448 died... 05:49:46.585787 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32448): Terminated: ok {rc=0} 05:49:46.632255 --- ParallelTerminationStrategy: PID 32451 died... 05:49:46.651504 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32451): Terminated: ok {rc=0} 05:49:46.738860 bus /sierra_3: Setting Powered False 05:49:47.838047 bus /sierra_3: Setting Powered False 05:49:48.953167 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2370 emergency:trx-b200 emergency_preemptive_call.py ---------------------------------------------- 05:49:50.041548 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 05:49:50.053569 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 05:49:50.108411 tst emergency_preemptive_call.py: using LAC 26281 05:49:50.226366 tst emergency_preemptive_call.py: using RAC 16 05:49:50.343700 tst emergency_preemptive_call.py: using CellId 26281 05:49:50.459545 tst emergency_preemptive_call.py: using BVCI 26282 05:49:50.567327 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 05:49:50.578127 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 05:49:50.588629 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 05:49:50.599510 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 05:49:50.610381 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 05:49:50.621222 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 05:49:50.738557 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 05:49:50.855759 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 05:49:50.973554 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 05:49:51.088272 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:49:51.556167 run create_hlr_db(pid=32454): Launched 05:49:51.671095 bus /sierra_2: Setting Powered False 05:49:52.731156 run create_hlr_db(pid=32454): Terminated: ok {rc=0} 05:49:53.171916 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32456): Launched 05:49:53.494357 run osmo-hlr_10.42.42.2(pid=32457): Launched 05:49:53.617298 run osmo-stp_10.42.42.5: Starting osmo-stp 05:49:54.170247 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32459): Launched 05:49:54.491786 run osmo-stp_10.42.42.5(pid=32460): Launched 05:49:54.623009 tst emergency_preemptive_call.py: using MSISDN 7577 05:49:54.787626 run osmo-msc_10.42.42.6: Starting osmo-msc 05:49:55.362769 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32462): Launched 05:49:55.683640 run osmo-msc_10.42.42.6(pid=32463): Launched 05:49:55.860673 run osmo-stp_10.42.42.5(pid=32460): ERR: Terminated: ERROR {rc=1} [trial-2370↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32460)] 05:49:55.996315 run osmo-stp_10.42.42.5(pid=32460): stdout: | (launched: 2022-12-10_05:49:54.431455) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:49:56.132034 run osmo-stp_10.42.42.5(pid=32460): stderr: | 20221210054954625 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054954625 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054954625 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054954626 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054954626 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054954626 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054954626 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:49:56.266726 run osmo-stp_10.42.42.5(pid=32460): stdout: | (launched: 2022-12-10_05:49:54.431455) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:49:56.393678 run osmo-stp_10.42.42.5(pid=32460): stderr: | 20221210054954625 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210054954625 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210054954625 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210054954626 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210054954626 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210054954626 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210054954626 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:49:56.545712 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=32460): Process ended prematurely: osmo-stp_10.42.42.5(pid=32460) [trial-2370↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32460)] [trial-2370↪emergency:trx-b200↪emergency_preemptive_call.py:32] 05:49:56.554790 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 05:49:56.582245 run osmo-hlr_10.42.42.2(pid=32457): ERR: Terminated: ERROR {rc=237} [trial-2370↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32457)] 05:49:56.632208 run osmo-hlr_10.42.42.2(pid=32457): stdout: | (launched: 2022-12-10_05:49:53.433928) 05:49:56.684010 run osmo-hlr_10.42.42.2(pid=32457): stderr: | 20221210054953633 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210054953633 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210054953633 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210054953633 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210054953633 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210054953633 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210054953645 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/emergency:trx-b200/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210054953654 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210054953654 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210054953654 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:49:56.756655 run osmo-msc_10.42.42.6(pid=32463): ERR: Terminated: ERROR {rc=2} [trial-2370↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32463)] 05:49:56.806624 run osmo-msc_10.42.42.6(pid=32463): stdout: | (launched: 2022-12-10_05:49:55.623095) 05:49:56.858434 run osmo-msc_10.42.42.6(pid=32463): stderr: | 20221210054955949 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210054955949 DLGLOBAL DEBUG validating counter group 0x7f0b9288bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210054955950 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210054955950 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210054955950 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210054955950 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210054955954 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210054955955 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210054955955 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210054955955 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:49:56.910522 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32456): Terminating (SIGTERM) 05:49:56.952384 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32459): Terminating (SIGTERM) 05:49:56.994448 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32462): Terminating (SIGTERM) 05:49:57.036378 --- ParallelTerminationStrategy: PID 32456 died... 05:49:57.056349 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32456): Terminated: ok {rc=0} 05:49:57.103030 --- ParallelTerminationStrategy: PID 32459 died... 05:49:57.122697 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32459): Terminated: ok {rc=0} 05:49:57.168704 --- ParallelTerminationStrategy: PID 32462 died... 05:49:57.188317 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32462): Terminated: ok {rc=0} 05:49:57.277282 bus /sierra_9: Setting Powered False 05:49:58.374836 bus /sierra_9: Setting Powered False 05:49:59.489435 bus /sierra_8: Setting Powered False 05:50:00.588782 bus /sierra_8: Setting Powered False 05:50:01.719117 bus /sierra_3: Setting Powered False 05:50:02.834672 bus /sierra_3: Setting Powered False 05:50:03.951227 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 emergency:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 gprs:trx-b200 --------------------------------------------------------------------- 05:50:05.235501 tst gprs:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:50:05.240330 tst gprs:trx-b200: Verifying 1 x bts (candidates: 11) 05:50:05.274076 tst gprs:trx-b200: Verifying 9 x ip_address (candidates: 9) 05:50:05.313111 tst gprs:trx-b200: Verifying 4 x modem (candidates: 12) 05:50:05.401721 tst gprs:trx-b200: Reserving 1 x bts (candidates: 11) 05:50:05.435166 tst gprs:trx-b200: Reserving 9 x ip_address (candidates: 9) 05:50:05.474106 tst gprs:trx-b200: Reserving 4 x modem (candidates: 12) 05:50:06.066526 tst gprs:trx-b200: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2370 gprs:trx-b200 cs_paging_gprs_active.py ---------------------------------------------- 05:50:06.119233 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:50:06.130365 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 05:50:06.180323 tst cs_paging_gprs_active.py: using LAC 26282 05:50:06.309499 tst cs_paging_gprs_active.py: using RAC 17 05:50:06.437557 tst cs_paging_gprs_active.py: using CellId 26282 05:50:06.565680 tst cs_paging_gprs_active.py: using BVCI 26283 05:50:06.683532 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:50:06.694766 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:50:06.705843 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:50:06.716741 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:50:06.727634 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:50:06.738506 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:50:06.749543 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:50:06.760388 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:50:06.771477 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 05:50:06.893648 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 05:50:07.011844 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 05:50:07.232842 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:50:07.563266 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32473): Launched 05:50:07.848935 run iperf3-srv_10.42.42.10(pid=32474): Launched 05:50:07.971657 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 05:50:08.192537 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:50:08.522799 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32475): Launched 05:50:08.810399 run iperf3-srv_10.42.42.10(pid=32476): Launched 05:50:08.934418 tst cs_paging_gprs_active.py:38: start network... 05:50:09.154861 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:50:09.663562 run create_hlr_db(pid=32477): Launched 05:50:09.796045 bus /sierra_2: Setting Powered False 05:50:10.860864 run create_hlr_db(pid=32477): Terminated: ok {rc=0} 05:50:11.316155 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32479): Launched 05:50:11.644547 run osmo-hlr_10.42.42.2(pid=32480): Launched 05:50:11.769314 run osmo-stp_10.42.42.5: Starting osmo-stp 05:50:12.332286 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32482): Launched 05:50:12.660325 run osmo-stp_10.42.42.5(pid=32483): Launched 05:50:12.784658 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:50:13.351720 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32485): Launched 05:50:13.476286 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:50:13.755273 run patchelf(pid=32486): Launched 05:50:13.937420 run osmo-stp_10.42.42.5(pid=32483): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32483)] 05:50:14.076372 run osmo-stp_10.42.42.5(pid=32483): stdout: | (launched: 2022-12-10_05:50:12.598701) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:50:14.216225 run osmo-stp_10.42.42.5(pid=32483): stderr: | 20221210055012796 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055012797 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055012797 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055012797 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055012798 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055012798 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055012798 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:50:14.356207 run osmo-stp_10.42.42.5(pid=32483): stdout: | (launched: 2022-12-10_05:50:12.598701) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:50:14.490408 run osmo-stp_10.42.42.5(pid=32483): stderr: | 20221210055012796 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055012797 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055012797 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055012797 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055012798 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055012798 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055012798 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:50:14.649478 run patchelf(pid=32486): Terminating (SIGINT) 05:50:14.832057 run patchelf(pid=32486): Terminated: ok {rc=0} 05:50:14.964511 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=32483): Process ended prematurely: osmo-stp_10.42.42.5(pid=32483) [trial-2370↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32483)] [trial-2370↪gprs:trx-b200↪cs_paging_gprs_active.py:38] 05:50:14.974993 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 05:50:15.003444 run osmo-hlr_10.42.42.2(pid=32480): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-b200↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32480)] 05:50:15.053243 run osmo-hlr_10.42.42.2(pid=32480): stdout: | (launched: 2022-12-10_05:50:11.583240) 05:50:15.104770 run osmo-hlr_10.42.42.2(pid=32480): stderr: | 20221210055011785 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210055011785 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210055011785 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210055011785 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210055011785 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210055011786 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210055011797 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-b200/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210055011806 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210055011806 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210055011806 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:50:15.156765 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32473): Terminating (SIGTERM) 05:50:15.198397 run iperf3-srv_10.42.42.10(pid=32474): Terminating (SIGTERM) 05:50:15.239967 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32475): Terminating (SIGTERM) 05:50:15.281670 run iperf3-srv_10.42.42.10(pid=32476): Terminating (SIGTERM) 05:50:15.323004 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32479): Terminating (SIGTERM) 05:50:15.364732 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32482): Terminating (SIGTERM) 05:50:15.406463 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32485): Terminating (SIGTERM) 05:50:15.448701 --- ParallelTerminationStrategy: PID 32473 died... 05:50:15.468795 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32473): Terminated: ok {rc=0} 05:50:15.515158 --- ParallelTerminationStrategy: PID 32474 died... 05:50:15.534532 run iperf3-srv_10.42.42.10(pid=32474): Terminated {rc=256} 05:50:15.580735 --- ParallelTerminationStrategy: PID 32475 died... 05:50:15.600417 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32475): Terminated: ok {rc=0} 05:50:15.646915 --- ParallelTerminationStrategy: PID 32476 died... 05:50:15.666508 run iperf3-srv_10.42.42.10(pid=32476): Terminated {rc=256} 05:50:15.712231 --- ParallelTerminationStrategy: PID 32479 died... 05:50:15.731731 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32479): Terminated: ok {rc=0} 05:50:15.777519 --- ParallelTerminationStrategy: PID 32482 died... 05:50:15.797083 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32482): Terminated: ok {rc=0} 05:50:15.846293 --- ParallelTerminationStrategy: PID 32485 died... 05:50:15.868700 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32485): Terminated: ok {rc=0} 05:50:15.982224 bus /gobi_0: Setting Powered False 05:50:17.092658 bus /gobi_0: Setting Powered False 05:50:18.219570 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-b200 iperf3.py ---------------------------------------------- 05:50:19.368535 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:50:19.380528 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 05:50:19.433395 tst iperf3.py: using LAC 26283 05:50:19.562822 tst iperf3.py: using RAC 18 05:50:19.691787 tst iperf3.py: using CellId 26283 05:50:19.820573 tst iperf3.py: using BVCI 26284 05:50:19.938306 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:50:19.949849 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:50:19.961289 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:50:19.972328 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:50:19.983392 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:50:19.994439 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:50:20.005750 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:50:20.016703 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:50:20.027723 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 05:50:20.144024 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 05:50:20.348827 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:50:20.656584 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32487): Launched 05:50:20.925684 run iperf3-srv_10.42.42.10(pid=32488): Launched 05:50:21.040172 tst iperf3.py:8: start network... 05:50:21.245676 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:50:21.719941 run create_hlr_db(pid=32489): Launched 05:50:21.835959 bus /gobi_6: Setting Powered False 05:50:22.895600 run create_hlr_db(pid=32489): Terminated: ok {rc=0} 05:50:23.341231 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32491): Launched 05:50:23.669483 run osmo-hlr_10.42.42.2(pid=32492): Launched 05:50:23.793849 run osmo-stp_10.42.42.5: Starting osmo-stp 05:50:24.361197 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32494): Launched 05:50:24.689379 run osmo-stp_10.42.42.5(pid=32495): Launched 05:50:24.813716 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:50:25.378506 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32497): Launched 05:50:25.504487 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:50:25.781666 run patchelf(pid=32498): Launched 05:50:25.962772 run osmo-stp_10.42.42.5(pid=32495): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32495)] 05:50:26.100688 run osmo-stp_10.42.42.5(pid=32495): stdout: | (launched: 2022-12-10_05:50:24.627562) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:50:26.239629 run osmo-stp_10.42.42.5(pid=32495): stderr: | 20221210055024824 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055024825 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055024826 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055024826 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055024826 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055024827 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055024827 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:50:26.379331 run osmo-stp_10.42.42.5(pid=32495): stdout: | (launched: 2022-12-10_05:50:24.627562) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:50:26.512256 run osmo-stp_10.42.42.5(pid=32495): stderr: | 20221210055024824 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055024825 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055024826 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055024826 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055024826 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055024827 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055024827 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:50:26.670979 run patchelf(pid=32498): Terminating (SIGINT) 05:50:26.852816 run patchelf(pid=32498): Terminated: ok {rc=0} 05:50:26.984438 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32495): Process ended prematurely: osmo-stp_10.42.42.5(pid=32495) [trial-2370↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32495)] [trial-2370↪gprs:trx-b200↪iperf3.py:8] 05:50:26.994952 tst iperf3.py:8: Test FAILED (7.7 sec) 05:50:27.023326 run osmo-hlr_10.42.42.2(pid=32492): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-b200↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32492)] 05:50:27.072811 run osmo-hlr_10.42.42.2(pid=32492): stdout: | (launched: 2022-12-10_05:50:23.607711) 05:50:27.124147 run osmo-hlr_10.42.42.2(pid=32492): stderr: | 20221210055023809 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210055023809 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210055023809 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210055023810 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210055023810 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210055023810 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210055023822 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-b200/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210055023830 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210055023830 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210055023830 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:50:27.175875 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32487): Terminating (SIGTERM) 05:50:27.217630 run iperf3-srv_10.42.42.10(pid=32488): Terminating (SIGTERM) 05:50:27.259074 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32491): Terminating (SIGTERM) 05:50:27.300767 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32494): Terminating (SIGTERM) 05:50:27.342484 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32497): Terminating (SIGTERM) 05:50:27.384784 --- ParallelTerminationStrategy: PID 32487 died... 05:50:27.404936 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32487): Terminated: ok {rc=0} 05:50:27.451378 --- ParallelTerminationStrategy: PID 32488 died... 05:50:27.470966 run iperf3-srv_10.42.42.10(pid=32488): Terminated {rc=256} 05:50:27.518246 --- ParallelTerminationStrategy: PID 32491 died... 05:50:27.537956 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32491): Terminated: ok {rc=0} 05:50:27.584049 --- ParallelTerminationStrategy: PID 32494 died... 05:50:27.603657 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32494): Terminated: ok {rc=0} 05:50:27.649701 --- ParallelTerminationStrategy: PID 32497 died... 05:50:27.669639 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32497): Terminated: ok {rc=0} 05:50:27.757394 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-b200 iperf3m4.py ---------------------------------------------- 05:50:28.905560 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:50:28.917366 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 05:50:28.967966 tst iperf3m4.py: using LAC 26284 05:50:29.090594 tst iperf3m4.py: using RAC 19 05:50:29.210640 tst iperf3m4.py: using CellId 26284 05:50:29.332688 tst iperf3m4.py: using BVCI 26285 05:50:29.447072 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:50:29.458082 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:50:29.468717 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:50:29.480146 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:50:29.491493 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:50:29.502834 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:50:29.514348 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:50:29.525777 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:50:29.537244 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 05:50:29.653140 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 05:50:29.772072 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 05:50:29.887495 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 05:50:30.005511 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 05:50:30.210893 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:50:30.519685 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32499): Launched 05:50:30.789436 run iperf3-srv_10.42.42.10(pid=32500): Launched 05:50:30.909831 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 05:50:31.121709 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:50:31.442213 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32501): Launched 05:50:31.734427 run iperf3-srv_10.42.42.10(pid=32502): Launched 05:50:31.864815 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 05:50:32.075985 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:50:32.388804 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32503): Launched 05:50:32.655967 run iperf3-srv_10.42.42.10(pid=32504): Launched 05:50:32.770606 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 05:50:32.975193 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:50:33.283485 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32505): Launched 05:50:33.550725 run iperf3-srv_10.42.42.10(pid=32506): Launched 05:50:33.665094 tst iperf3m4.py:8: start network... 05:50:33.869787 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:50:34.346462 run create_hlr_db(pid=32507): Launched 05:50:34.462965 bus /gobi_6: Setting Powered False 05:50:35.523597 run create_hlr_db(pid=32507): Terminated: ok {rc=0} 05:50:35.970671 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32509): Launched 05:50:36.299596 run osmo-hlr_10.42.42.2(pid=32510): Launched 05:50:36.423139 run osmo-stp_10.42.42.5: Starting osmo-stp 05:50:36.960845 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32512): Launched 05:50:37.269143 run osmo-stp_10.42.42.5(pid=32513): Launched 05:50:37.385166 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:50:37.911591 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32515): Launched 05:50:38.029399 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:50:38.289371 run patchelf(pid=32516): Launched 05:50:38.458643 run osmo-stp_10.42.42.5(pid=32513): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32513)] 05:50:38.588180 run osmo-stp_10.42.42.5(pid=32513): stdout: | (launched: 2022-12-10_05:50:37.211029) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:50:38.719065 run osmo-stp_10.42.42.5(pid=32513): stderr: | 20221210055037385 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055037385 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055037385 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055037386 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055037386 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055037386 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055037386 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:50:38.849845 run osmo-stp_10.42.42.5(pid=32513): stdout: | (launched: 2022-12-10_05:50:37.211029) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:50:38.975499 run osmo-stp_10.42.42.5(pid=32513): stderr: | 20221210055037385 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055037385 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055037385 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055037386 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055037386 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055037386 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055037386 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:50:39.124106 run patchelf(pid=32516): Terminating (SIGINT) 05:50:39.295442 run patchelf(pid=32516): Terminated: ok {rc=0} 05:50:39.419290 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32513): Process ended prematurely: osmo-stp_10.42.42.5(pid=32513) [trial-2370↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32513)] [trial-2370↪gprs:trx-b200↪iperf3m4.py:8] 05:50:39.428785 tst iperf3m4.py:8: Test FAILED (10.6 sec) 05:50:39.456820 run osmo-hlr_10.42.42.2(pid=32510): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-b200↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32510)] 05:50:39.504869 run osmo-hlr_10.42.42.2(pid=32510): stdout: | (launched: 2022-12-10_05:50:36.237714) 05:50:39.554592 run osmo-hlr_10.42.42.2(pid=32510): stderr: | 20221210055036440 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210055036440 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210055036440 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210055036440 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210055036441 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210055036441 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210055036452 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-b200/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210055036461 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210055036461 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210055036461 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:50:39.604575 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32499): Terminating (SIGTERM) 05:50:39.644334 run iperf3-srv_10.42.42.10(pid=32500): Terminating (SIGTERM) 05:50:39.683914 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32501): Terminating (SIGTERM) 05:50:39.723534 run iperf3-srv_10.42.42.10(pid=32502): Terminating (SIGTERM) 05:50:39.763219 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32503): Terminating (SIGTERM) 05:50:39.803046 run iperf3-srv_10.42.42.10(pid=32504): Terminating (SIGTERM) 05:50:39.842663 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32505): Terminating (SIGTERM) 05:50:39.882182 run iperf3-srv_10.42.42.10(pid=32506): Terminating (SIGTERM) 05:50:39.921628 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32509): Terminating (SIGTERM) 05:50:39.961363 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32512): Terminating (SIGTERM) 05:50:40.000870 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32515): Terminating (SIGTERM) 05:50:40.041098 --- ParallelTerminationStrategy: PID 32499 died... 05:50:40.060021 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32499): Terminated: ok {rc=0} 05:50:40.104429 --- ParallelTerminationStrategy: PID 32500 died... 05:50:40.123185 run iperf3-srv_10.42.42.10(pid=32500): Terminated {rc=256} 05:50:40.167082 --- ParallelTerminationStrategy: PID 32501 died... 05:50:40.185743 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32501): Terminated: ok {rc=0} 05:50:40.229912 --- ParallelTerminationStrategy: PID 32502 died... 05:50:40.248408 run iperf3-srv_10.42.42.10(pid=32502): Terminated {rc=256} 05:50:40.292517 --- ParallelTerminationStrategy: PID 32503 died... 05:50:40.311028 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32503): Terminated: ok {rc=0} 05:50:40.355174 --- ParallelTerminationStrategy: PID 32504 died... 05:50:40.373632 run iperf3-srv_10.42.42.10(pid=32504): Terminated {rc=256} 05:50:40.417680 --- ParallelTerminationStrategy: PID 32505 died... 05:50:40.436332 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32505): Terminated: ok {rc=0} 05:50:40.480500 --- ParallelTerminationStrategy: PID 32506 died... 05:50:40.499143 run iperf3-srv_10.42.42.10(pid=32506): Terminated {rc=256} 05:50:40.543245 --- ParallelTerminationStrategy: PID 32509 died... 05:50:40.561791 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32509): Terminated: ok {rc=0} 05:50:40.605714 --- ParallelTerminationStrategy: PID 32512 died... 05:50:40.624497 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32512): Terminated: ok {rc=0} 05:50:40.668499 --- ParallelTerminationStrategy: PID 32515 died... 05:50:40.687124 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32515): Terminated: ok {rc=0} 05:50:40.771356 bus /gobi_4: Setting Powered False 05:50:41.872364 bus /gobi_4: Setting Powered False 05:50:42.990185 bus /gobi_1: Setting Powered False 05:50:44.088589 bus /gobi_1: Setting Powered False 05:50:45.204013 bus /gobi_0: Setting Powered False 05:50:46.300388 bus /gobi_0: Setting Powered False 05:50:47.417839 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-b200 ping.py ---------------------------------------------- 05:50:48.521720 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:50:48.533792 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 05:50:48.584455 tst ping.py: using LAC 26285 05:50:48.711512 tst ping.py: using RAC 20 05:50:48.837083 tst ping.py: using CellId 26285 05:50:48.961864 tst ping.py: using BVCI 26286 05:50:49.079885 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:50:49.090958 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:50:49.101933 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:50:49.112786 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:50:49.123653 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:50:49.134597 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:50:49.145638 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:50:49.156501 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 05:50:49.273245 tst ping.py:19: start network... 05:50:49.488234 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:50:49.984325 run create_hlr_db(pid=32517): Launched 05:50:50.113922 bus /gobi_6: Setting Powered False 05:50:51.176887 run create_hlr_db(pid=32517): Terminated: ok {rc=0} 05:50:51.606740 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32519): Launched 05:50:51.908658 run osmo-hlr_10.42.42.2(pid=32520): Launched 05:50:52.022632 run osmo-stp_10.42.42.5: Starting osmo-stp 05:50:52.555535 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32522): Launched 05:50:52.858068 run osmo-stp_10.42.42.5(pid=32523): Launched 05:50:52.971954 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:50:53.491426 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32525): Launched 05:50:53.606384 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:50:53.863513 run patchelf(pid=32526): Launched 05:50:54.030798 run osmo-stp_10.42.42.5(pid=32523): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32523)] 05:50:54.158135 run osmo-stp_10.42.42.5(pid=32523): stdout: | (launched: 2022-12-10_05:50:52.800653) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:50:54.286947 run osmo-stp_10.42.42.5(pid=32523): stderr: | 20221210055052975 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055052975 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055052975 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055052976 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055052976 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055052976 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055052977 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:50:54.415633 run osmo-stp_10.42.42.5(pid=32523): stdout: | (launched: 2022-12-10_05:50:52.800653) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:50:54.538362 run osmo-stp_10.42.42.5(pid=32523): stderr: | 20221210055052975 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055052975 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055052975 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055052976 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055052976 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055052976 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055052977 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:50:54.683704 run patchelf(pid=32526): Terminating (SIGINT) 05:50:54.852135 run patchelf(pid=32526): Terminated: ok {rc=0} 05:50:54.973130 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=32523): Process ended prematurely: osmo-stp_10.42.42.5(pid=32523) [trial-2370↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32523)] [trial-2370↪gprs:trx-b200↪ping.py:22] 05:50:54.982115 tst ping.py:22: Test FAILED (6.5 sec) 05:50:55.009178 run osmo-hlr_10.42.42.2(pid=32520): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-b200↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32520)] 05:50:55.057492 run osmo-hlr_10.42.42.2(pid=32520): stdout: | (launched: 2022-12-10_05:50:51.851029) 05:50:55.107356 run osmo-hlr_10.42.42.2(pid=32520): stderr: | 20221210055052031 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210055052031 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210055052031 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210055052031 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210055052031 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210055052031 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210055052043 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-b200/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210055052052 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210055052052 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210055052052 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:50:55.157380 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32519): Terminating (SIGTERM) 05:50:55.197423 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32522): Terminating (SIGTERM) 05:50:55.237351 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32525): Terminating (SIGTERM) 05:50:55.278043 --- ParallelTerminationStrategy: PID 32519 died... 05:50:55.296896 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32519): Terminated: ok {rc=0} 05:50:55.341502 --- ParallelTerminationStrategy: PID 32522 died... 05:50:55.360089 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32522): Terminated: ok {rc=0} 05:50:55.404085 --- ParallelTerminationStrategy: PID 32525 died... 05:50:55.422783 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32525): Terminated: ok {rc=0} 05:50:55.508532 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-b200 ping_idle_ping.py ---------------------------------------------- 05:50:56.596718 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:50:56.608263 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 05:50:56.659407 tst ping_idle_ping.py: using LAC 26286 05:50:56.777371 tst ping_idle_ping.py: using RAC 21 05:50:56.895087 tst ping_idle_ping.py: using CellId 26286 05:50:57.016216 tst ping_idle_ping.py: using BVCI 26287 05:50:57.126073 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:50:57.136612 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:50:57.147287 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:50:57.158737 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:50:57.169923 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:50:57.181198 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:50:57.192495 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:50:57.203990 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 05:50:57.325226 tst ping_idle_ping.py:24: start network... 05:50:57.526958 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:50:57.997639 run create_hlr_db(pid=32527): Launched 05:50:58.112201 bus /gobi_6: Setting Powered False 05:50:59.172870 run create_hlr_db(pid=32527): Terminated: ok {rc=0} 05:50:59.614591 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32529): Launched 05:50:59.938382 run osmo-hlr_10.42.42.2(pid=32530): Launched 05:51:00.060644 run osmo-stp_10.42.42.5: Starting osmo-stp 05:51:00.616474 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32532): Launched 05:51:00.967338 run osmo-stp_10.42.42.5(pid=32533): Launched 05:51:01.433202 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:51:02.014716 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32535): Launched 05:51:02.149963 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:51:02.425179 run patchelf(pid=32536): Launched 05:51:02.603158 run osmo-stp_10.42.42.5(pid=32533): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32533)] 05:51:02.739131 run osmo-stp_10.42.42.5(pid=32533): stdout: | (launched: 2022-12-10_05:51:00.904047) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:51:02.876484 run osmo-stp_10.42.42.5(pid=32533): stderr: | 20221210055101153 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055101154 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055101154 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055101156 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055101156 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055101157 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055101157 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:51:03.014873 run osmo-stp_10.42.42.5(pid=32533): stdout: | (launched: 2022-12-10_05:51:00.904047) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:51:03.146416 run osmo-stp_10.42.42.5(pid=32533): stderr: | 20221210055101153 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055101154 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055101154 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055101156 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055101156 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055101157 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055101157 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:51:03.302064 run patchelf(pid=32536): Terminating (SIGINT) 05:51:03.481121 run patchelf(pid=32536): Terminated: ok {rc=0} 05:51:03.610024 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=32533): Process ended prematurely: osmo-stp_10.42.42.5(pid=32533) [trial-2370↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32533)] [trial-2370↪gprs:trx-b200↪ping_idle_ping.py:27] 05:51:03.619624 tst ping_idle_ping.py:27: Test FAILED (7.0 sec) 05:51:03.647699 run osmo-hlr_10.42.42.2(pid=32530): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-b200↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32530)] 05:51:03.697676 run osmo-hlr_10.42.42.2(pid=32530): stdout: | (launched: 2022-12-10_05:50:59.876033) 05:51:03.749401 run osmo-hlr_10.42.42.2(pid=32530): stderr: | 20221210055100079 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210055100079 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210055100079 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210055100079 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210055100079 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210055100080 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210055100092 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-b200/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210055100100 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210055100100 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210055100100 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:51:03.801507 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32529): Terminating (SIGTERM) 05:51:03.843268 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32532): Terminating (SIGTERM) 05:51:03.885052 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32535): Terminating (SIGTERM) 05:51:03.927203 --- ParallelTerminationStrategy: PID 32529 died... 05:51:03.947608 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32529): Terminated: ok {rc=0} 05:51:03.994903 --- ParallelTerminationStrategy: PID 32532 died... 05:51:04.014633 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32532): Terminated: ok {rc=0} 05:51:04.060800 --- ParallelTerminationStrategy: PID 32535 died... 05:51:04.080872 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32535): Terminated: ok {rc=0} 05:51:04.169326 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2370 gprs:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 gprs:trx-b200+mod-bts0-egprs --------------------------------------------------------------------- 05:51:05.482388 tst gprs:trx-b200+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:51:05.488296 tst gprs:trx-b200+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 05:51:05.522029 tst gprs:trx-b200+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 05:51:05.561644 tst gprs:trx-b200+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 05:51:05.651363 tst gprs:trx-b200+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 05:51:05.685109 tst gprs:trx-b200+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 05:51:05.723987 tst gprs:trx-b200+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 05:51:06.312331 tst gprs:trx-b200+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2370 gprs:trx-b200+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 05:51:06.363281 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:51:06.374108 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 05:51:06.425153 tst cs_paging_gprs_active.py: using LAC 26287 05:51:06.546421 tst cs_paging_gprs_active.py: using RAC 22 05:51:06.668603 tst cs_paging_gprs_active.py: using CellId 26287 05:51:06.790559 tst cs_paging_gprs_active.py: using BVCI 26288 05:51:06.904126 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:51:06.915205 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:51:06.925883 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:51:06.937435 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:51:06.948794 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:51:06.960168 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:51:06.971828 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:51:06.983181 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:51:06.994834 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 05:51:07.116095 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 05:51:07.235107 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 05:51:07.441148 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:51:07.751499 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32541): Launched 05:51:08.021644 run iperf3-srv_10.42.42.10(pid=32542): Launched 05:51:08.136388 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 05:51:08.340805 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:51:08.650559 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32543): Launched 05:51:08.919103 run iperf3-srv_10.42.42.10(pid=32544): Launched 05:51:09.034014 tst cs_paging_gprs_active.py:38: start network... 05:51:09.238398 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:51:09.713967 run create_hlr_db(pid=32545): Launched 05:51:09.830304 bus /gobi_6: Setting Powered False 05:51:10.893440 run create_hlr_db(pid=32545): Terminated: ok {rc=0} 05:51:11.349053 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32547): Launched 05:51:11.678208 run osmo-hlr_10.42.42.2(pid=32548): Launched 05:51:11.802800 run osmo-stp_10.42.42.5: Starting osmo-stp 05:51:12.371541 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32550): Launched 05:51:12.699712 run osmo-stp_10.42.42.5(pid=32551): Launched 05:51:12.824278 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:51:13.389436 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32553): Launched 05:51:13.513681 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:51:13.790366 run patchelf(pid=32554): Launched 05:51:13.972720 run osmo-stp_10.42.42.5(pid=32551): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32551)] 05:51:14.111342 run osmo-stp_10.42.42.5(pid=32551): stdout: | (launched: 2022-12-10_05:51:12.637703) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:51:14.250746 run osmo-stp_10.42.42.5(pid=32551): stderr: | 20221210055112832 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055112832 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055112833 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055112833 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055112834 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055112834 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055112834 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:51:14.390074 run osmo-stp_10.42.42.5(pid=32551): stdout: | (launched: 2022-12-10_05:51:12.637703) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:51:14.523462 run osmo-stp_10.42.42.5(pid=32551): stderr: | 20221210055112832 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055112832 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055112833 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055112833 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055112834 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055112834 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055112834 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:51:14.681750 run patchelf(pid=32554): Terminating (SIGINT) 05:51:14.863861 run patchelf(pid=32554): Terminated: ok {rc=0} 05:51:14.996342 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=32551): Process ended prematurely: osmo-stp_10.42.42.5(pid=32551) [trial-2370↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32551)] [trial-2370↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 05:51:15.006702 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 05:51:15.034990 run osmo-hlr_10.42.42.2(pid=32548): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32548)] 05:51:15.084465 run osmo-hlr_10.42.42.2(pid=32548): stdout: | (launched: 2022-12-10_05:51:11.616259) 05:51:15.135587 run osmo-hlr_10.42.42.2(pid=32548): stderr: | 20221210055111820 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210055111820 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210055111820 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210055111820 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210055111820 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210055111820 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210055111833 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-b200+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210055111841 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210055111842 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210055111842 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:51:15.187278 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32541): Terminating (SIGTERM) 05:51:15.228770 run iperf3-srv_10.42.42.10(pid=32542): Terminating (SIGTERM) 05:51:15.270354 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32543): Terminating (SIGTERM) 05:51:15.311755 run iperf3-srv_10.42.42.10(pid=32544): Terminating (SIGTERM) 05:51:15.352883 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32547): Terminating (SIGTERM) 05:51:15.394266 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32550): Terminating (SIGTERM) 05:51:15.435526 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32553): Terminating (SIGTERM) 05:51:15.477097 --- ParallelTerminationStrategy: PID 32541 died... 05:51:15.496662 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32541): Terminated: ok {rc=0} 05:51:15.542255 --- ParallelTerminationStrategy: PID 32542 died... 05:51:15.561617 run iperf3-srv_10.42.42.10(pid=32542): Terminated {rc=256} 05:51:15.607502 --- ParallelTerminationStrategy: PID 32543 died... 05:51:15.626896 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32543): Terminated: ok {rc=0} 05:51:15.672210 --- ParallelTerminationStrategy: PID 32544 died... 05:51:15.691437 run iperf3-srv_10.42.42.10(pid=32544): Terminated {rc=256} 05:51:15.736559 --- ParallelTerminationStrategy: PID 32547 died... 05:51:15.755894 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32547): Terminated: ok {rc=0} 05:51:15.801364 --- ParallelTerminationStrategy: PID 32550 died... 05:51:15.820626 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32550): Terminated: ok {rc=0} 05:51:15.866864 --- ParallelTerminationStrategy: PID 32553 died... 05:51:15.887831 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32553): Terminated: ok {rc=0} 05:51:15.996789 bus /gobi_0: Setting Powered False 05:51:17.108034 bus /gobi_0: Setting Powered False 05:51:18.239168 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-b200+mod-bts0-egprs iperf3.py ---------------------------------------------- 05:51:19.384886 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:51:19.396528 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 05:51:19.453202 tst iperf3.py: using LAC 26288 05:51:19.572242 tst iperf3.py: using RAC 23 05:51:19.690816 tst iperf3.py: using CellId 26288 05:51:19.810474 tst iperf3.py: using BVCI 26289 05:51:19.922905 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:51:19.934002 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:51:19.944816 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:51:19.955906 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:51:19.967069 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:51:19.977914 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:51:19.989099 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:51:19.999828 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:51:20.011048 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 05:51:20.126304 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 05:51:20.331340 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:51:20.640070 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32555): Launched 05:51:20.909260 run iperf3-srv_10.42.42.10(pid=32556): Launched 05:51:21.024065 tst iperf3.py:8: start network... 05:51:21.228500 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:51:21.702496 run create_hlr_db(pid=32557): Launched 05:51:21.819019 bus /gobi_6: Setting Powered False 05:51:22.879332 run create_hlr_db(pid=32557): Terminated: ok {rc=0} 05:51:23.326138 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32559): Launched 05:51:23.654103 run osmo-hlr_10.42.42.2(pid=32560): Launched 05:51:23.778505 run osmo-stp_10.42.42.5: Starting osmo-stp 05:51:24.347399 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32562): Launched 05:51:24.674550 run osmo-stp_10.42.42.5(pid=32563): Launched 05:51:24.799344 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:51:25.364696 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32565): Launched 05:51:25.489738 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:51:25.766894 run patchelf(pid=32566): Launched 05:51:25.947759 run osmo-stp_10.42.42.5(pid=32563): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32563)] 05:51:26.086301 run osmo-stp_10.42.42.5(pid=32563): stdout: | (launched: 2022-12-10_05:51:24.612838) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:51:26.225841 run osmo-stp_10.42.42.5(pid=32563): stderr: | 20221210055124807 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055124807 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055124807 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055124807 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055124808 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055124808 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055124808 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:51:26.365131 run osmo-stp_10.42.42.5(pid=32563): stdout: | (launched: 2022-12-10_05:51:24.612838) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:51:26.498320 run osmo-stp_10.42.42.5(pid=32563): stderr: | 20221210055124807 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055124807 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055124807 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055124807 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055124808 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055124808 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055124808 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:51:26.656403 run patchelf(pid=32566): Terminating (SIGINT) 05:51:26.837991 run patchelf(pid=32566): Terminated: ok {rc=0} 05:51:26.968809 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32563): Process ended prematurely: osmo-stp_10.42.42.5(pid=32563) [trial-2370↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32563)] [trial-2370↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8] 05:51:26.979158 tst iperf3.py:8: Test FAILED (7.6 sec) 05:51:27.008235 run osmo-hlr_10.42.42.2(pid=32560): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32560)] 05:51:27.057637 run osmo-hlr_10.42.42.2(pid=32560): stdout: | (launched: 2022-12-10_05:51:23.592687) 05:51:27.108767 run osmo-hlr_10.42.42.2(pid=32560): stderr: | 20221210055123795 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210055123795 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210055123795 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210055123795 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210055123795 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210055123796 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210055123807 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-b200+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210055123816 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210055123816 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210055123816 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:51:27.160625 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32555): Terminating (SIGTERM) 05:51:27.201771 run iperf3-srv_10.42.42.10(pid=32556): Terminating (SIGTERM) 05:51:27.242822 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32559): Terminating (SIGTERM) 05:51:27.283880 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32562): Terminating (SIGTERM) 05:51:27.325170 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32565): Terminating (SIGTERM) 05:51:27.366421 --- ParallelTerminationStrategy: PID 32555 died... 05:51:27.386164 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32555): Terminated: ok {rc=0} 05:51:27.432175 --- ParallelTerminationStrategy: PID 32556 died... 05:51:27.451570 run iperf3-srv_10.42.42.10(pid=32556): Terminated {rc=256} 05:51:27.497244 --- ParallelTerminationStrategy: PID 32559 died... 05:51:27.516370 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32559): Terminated: ok {rc=0} 05:51:27.561837 --- ParallelTerminationStrategy: PID 32562 died... 05:51:27.581081 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32562): Terminated: ok {rc=0} 05:51:27.626440 --- ParallelTerminationStrategy: PID 32565 died... 05:51:27.645874 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32565): Terminated: ok {rc=0} 05:51:27.732832 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-b200+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 05:51:28.879520 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:51:28.891287 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 05:51:28.944797 tst iperf3m4.py: using LAC 26289 05:51:29.065849 tst iperf3m4.py: using RAC 24 05:51:29.190784 tst iperf3m4.py: using CellId 26289 05:51:29.311870 tst iperf3m4.py: using BVCI 26290 05:51:29.423262 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:51:29.434311 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:51:29.444884 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:51:29.455967 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:51:29.466748 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:51:29.477829 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:51:29.489122 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:51:29.500142 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:51:29.511457 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 05:51:29.632108 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 05:51:29.756167 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 05:51:29.875490 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 05:51:29.997226 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 05:51:30.218142 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:51:30.548130 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32567): Launched 05:51:30.854792 run iperf3-srv_10.42.42.10(pid=32568): Launched 05:51:30.997048 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 05:51:31.210524 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:51:31.530903 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32569): Launched 05:51:31.822767 run iperf3-srv_10.42.42.10(pid=32570): Launched 05:51:31.957018 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 05:51:32.167441 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:51:32.479144 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32571): Launched 05:51:32.748181 run iperf3-srv_10.42.42.10(pid=32572): Launched 05:51:32.863370 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 05:51:33.068124 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:51:33.376416 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32573): Launched 05:51:33.644506 run iperf3-srv_10.42.42.10(pid=32574): Launched 05:51:33.759089 tst iperf3m4.py:8: start network... 05:51:33.963155 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:51:34.438273 run create_hlr_db(pid=32575): Launched 05:51:34.554915 bus /gobi_6: Setting Powered False 05:51:35.615920 run create_hlr_db(pid=32575): Terminated: ok {rc=0} 05:51:36.064560 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32577): Launched 05:51:36.396183 run osmo-hlr_10.42.42.2(pid=32578): Launched 05:51:36.519861 run osmo-stp_10.42.42.5: Starting osmo-stp 05:51:37.086108 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32580): Launched 05:51:37.415356 run osmo-stp_10.42.42.5(pid=32581): Launched 05:51:37.538938 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:51:38.104314 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32583): Launched 05:51:38.229536 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:51:38.507651 run patchelf(pid=32584): Launched 05:51:38.689085 run osmo-stp_10.42.42.5(pid=32581): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32581)] 05:51:38.827579 run osmo-stp_10.42.42.5(pid=32581): stdout: | (launched: 2022-12-10_05:51:37.353775) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:51:38.967319 run osmo-stp_10.42.42.5(pid=32581): stderr: | 20221210055137549 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055137549 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055137550 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055137550 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055137550 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055137550 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055137551 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:51:39.107685 run osmo-stp_10.42.42.5(pid=32581): stdout: | (launched: 2022-12-10_05:51:37.353775) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:51:39.241740 run osmo-stp_10.42.42.5(pid=32581): stderr: | 20221210055137549 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055137549 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055137550 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055137550 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055137550 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055137550 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055137551 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:51:39.407733 run patchelf(pid=32584): Terminating (SIGINT) 05:51:39.587081 run patchelf(pid=32584): Terminated: ok {rc=0} 05:51:39.716341 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32581): Process ended prematurely: osmo-stp_10.42.42.5(pid=32581) [trial-2370↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32581)] [trial-2370↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8] 05:51:39.726453 tst iperf3m4.py:8: Test FAILED (10.9 sec) 05:51:39.754852 run osmo-hlr_10.42.42.2(pid=32578): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32578)] 05:51:39.804022 run osmo-hlr_10.42.42.2(pid=32578): stdout: | (launched: 2022-12-10_05:51:36.334380) 05:51:39.854595 run osmo-hlr_10.42.42.2(pid=32578): stderr: | 20221210055136533 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210055136533 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210055136533 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210055136533 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210055136533 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210055136533 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210055136547 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-b200+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210055136557 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210055136557 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210055136557 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:51:39.905590 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32567): Terminating (SIGTERM) 05:51:39.946541 run iperf3-srv_10.42.42.10(pid=32568): Terminating (SIGTERM) 05:51:39.987544 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32569): Terminating (SIGTERM) 05:51:40.029032 run iperf3-srv_10.42.42.10(pid=32570): Terminating (SIGTERM) 05:51:40.070367 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32571): Terminating (SIGTERM) 05:51:40.111720 run iperf3-srv_10.42.42.10(pid=32572): Terminating (SIGTERM) 05:51:40.152739 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32573): Terminating (SIGTERM) 05:51:40.194081 run iperf3-srv_10.42.42.10(pid=32574): Terminating (SIGTERM) 05:51:40.235407 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32577): Terminating (SIGTERM) 05:51:40.276854 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32580): Terminating (SIGTERM) 05:51:40.318233 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32583): Terminating (SIGTERM) 05:51:40.359816 --- ParallelTerminationStrategy: PID 32567 died... 05:51:40.379671 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32567): Terminated: ok {rc=0} 05:51:40.425596 --- ParallelTerminationStrategy: PID 32568 died... 05:51:40.445099 run iperf3-srv_10.42.42.10(pid=32568): Terminated {rc=256} 05:51:40.490597 --- ParallelTerminationStrategy: PID 32569 died... 05:51:40.510121 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32569): Terminated: ok {rc=0} 05:51:40.555688 --- ParallelTerminationStrategy: PID 32570 died... 05:51:40.575164 run iperf3-srv_10.42.42.10(pid=32570): Terminated {rc=256} 05:51:40.620586 --- ParallelTerminationStrategy: PID 32571 died... 05:51:40.640068 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32571): Terminated: ok {rc=0} 05:51:40.685809 --- ParallelTerminationStrategy: PID 32572 died... 05:51:40.705260 run iperf3-srv_10.42.42.10(pid=32572): Terminated {rc=256} 05:51:40.750793 --- ParallelTerminationStrategy: PID 32573 died... 05:51:40.770241 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32573): Terminated: ok {rc=0} 05:51:40.815869 --- ParallelTerminationStrategy: PID 32574 died... 05:51:40.835424 run iperf3-srv_10.42.42.10(pid=32574): Terminated {rc=256} 05:51:40.883065 --- ParallelTerminationStrategy: PID 32577 died... 05:51:40.901775 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32577): Terminated: ok {rc=0} 05:51:40.947051 --- ParallelTerminationStrategy: PID 32580 died... 05:51:40.965702 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32580): Terminated: ok {rc=0} 05:51:41.010680 --- ParallelTerminationStrategy: PID 32583 died... 05:51:41.029398 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32583): Terminated: ok {rc=0} 05:51:41.115766 bus /gobi_4: Setting Powered False 05:51:42.214483 bus /gobi_4: Setting Powered False 05:51:43.328156 bus /gobi_1: Setting Powered False 05:51:44.426835 bus /gobi_1: Setting Powered False 05:51:45.542267 bus /gobi_0: Setting Powered False 05:51:46.646906 bus /gobi_0: Setting Powered False 05:51:47.776807 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-b200+mod-bts0-egprs ping.py ---------------------------------------------- 05:51:48.879259 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:51:48.890833 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 05:51:48.942396 tst ping.py: using LAC 26290 05:51:49.060399 tst ping.py: using RAC 25 05:51:49.176354 tst ping.py: using CellId 26290 05:51:49.292069 tst ping.py: using BVCI 26291 05:51:49.399217 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:51:49.410173 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:51:49.420883 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:51:49.432161 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:51:49.443256 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:51:49.454428 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:51:49.465524 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:51:49.476409 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 05:51:49.588568 tst ping.py:19: start network... 05:51:49.783643 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:51:50.239124 run create_hlr_db(pid=32585): Launched 05:51:50.350338 bus /gobi_6: Setting Powered False 05:51:51.409050 run create_hlr_db(pid=32585): Terminated: ok {rc=0} 05:51:51.841067 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32587): Launched 05:51:52.157292 run osmo-hlr_10.42.42.2(pid=32588): Launched 05:51:52.277151 run osmo-stp_10.42.42.5: Starting osmo-stp 05:51:52.822253 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32590): Launched 05:51:53.138484 run osmo-stp_10.42.42.5(pid=32591): Launched 05:51:53.257818 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:51:53.800342 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32593): Launched 05:51:53.919769 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:51:54.186684 run patchelf(pid=32594): Launched 05:51:54.362058 run osmo-stp_10.42.42.5(pid=32591): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32591)] 05:51:54.495480 run osmo-stp_10.42.42.5(pid=32591): stdout: | (launched: 2022-12-10_05:51:53.079032) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:51:54.630394 run osmo-stp_10.42.42.5(pid=32591): stderr: | 20221210055153271 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055153271 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055153271 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055153272 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055153272 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055153272 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055153272 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:51:54.764882 run osmo-stp_10.42.42.5(pid=32591): stdout: | (launched: 2022-12-10_05:51:53.079032) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:51:54.893369 run osmo-stp_10.42.42.5(pid=32591): stderr: | 20221210055153271 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055153271 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055153271 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055153272 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055153272 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055153272 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055153272 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:51:55.046149 run patchelf(pid=32594): Terminating (SIGINT) 05:51:55.221657 run patchelf(pid=32594): Terminated: ok {rc=0} 05:51:55.348011 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=32591): Process ended prematurely: osmo-stp_10.42.42.5(pid=32591) [trial-2370↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32591)] [trial-2370↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22] 05:51:55.357556 tst ping.py:22: Test FAILED (6.5 sec) 05:51:55.385518 run osmo-hlr_10.42.42.2(pid=32588): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-b200+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32588)] 05:51:55.435040 run osmo-hlr_10.42.42.2(pid=32588): stdout: | (launched: 2022-12-10_05:51:52.098210) 05:51:55.486449 run osmo-hlr_10.42.42.2(pid=32588): stderr: | 20221210055152294 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210055152294 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210055152294 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210055152294 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210055152294 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210055152295 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210055152307 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-b200+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210055152317 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210055152317 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210055152317 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:51:55.538021 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32587): Terminating (SIGTERM) 05:51:55.579405 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32590): Terminating (SIGTERM) 05:51:55.620812 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32593): Terminating (SIGTERM) 05:51:55.662712 --- ParallelTerminationStrategy: PID 32587 died... 05:51:55.682746 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32587): Terminated: ok {rc=0} 05:51:55.728572 --- ParallelTerminationStrategy: PID 32590 died... 05:51:55.748182 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32590): Terminated: ok {rc=0} 05:51:55.793923 --- ParallelTerminationStrategy: PID 32593 died... 05:51:55.813407 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32593): Terminated: ok {rc=0} 05:51:55.900187 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-b200+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 05:51:56.987336 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:51:56.999604 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 05:51:57.053542 tst ping_idle_ping.py: using LAC 26291 05:51:57.178469 tst ping_idle_ping.py: using RAC 26 05:51:57.310956 tst ping_idle_ping.py: using CellId 26291 05:51:57.434514 tst ping_idle_ping.py: using BVCI 26292 05:51:57.548365 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:51:57.559718 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:51:57.570776 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:51:57.582416 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:51:57.593911 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:51:57.605393 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:51:57.617032 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:51:57.628496 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 05:51:57.745752 tst ping_idle_ping.py:24: start network... 05:51:57.957256 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:51:58.447819 run create_hlr_db(pid=32595): Launched 05:51:58.575246 bus /gobi_6: Setting Powered False 05:51:59.637886 run create_hlr_db(pid=32595): Terminated: ok {rc=0} 05:52:00.061633 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32597): Launched 05:52:00.357284 run osmo-hlr_10.42.42.2(pid=32598): Launched 05:52:00.470665 run osmo-stp_10.42.42.5: Starting osmo-stp 05:52:01.041552 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32600): Launched 05:52:01.373420 run osmo-stp_10.42.42.5(pid=32601): Launched 05:52:01.514083 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:52:02.324339 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32603): Launched 05:52:02.458156 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:52:02.726701 run patchelf(pid=32604): Launched 05:52:02.902495 run osmo-stp_10.42.42.5(pid=32601): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32601)] 05:52:03.037271 run osmo-stp_10.42.42.5(pid=32601): stdout: | (launched: 2022-12-10_05:52:01.310758) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:52:03.173490 run osmo-stp_10.42.42.5(pid=32601): stderr: | 20221210055201683 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055201684 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055201684 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055201685 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055201690 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055201690 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055201690 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:52:03.309895 run osmo-stp_10.42.42.5(pid=32601): stdout: | (launched: 2022-12-10_05:52:01.310758) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:52:03.439665 run osmo-stp_10.42.42.5(pid=32601): stderr: | 20221210055201683 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055201684 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055201684 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055201685 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055201690 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055201690 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055201690 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:52:03.593234 run patchelf(pid=32604): Terminating (SIGINT) 05:52:03.770975 run patchelf(pid=32604): Terminated: ok {rc=0} 05:52:03.898772 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=32601): Process ended prematurely: osmo-stp_10.42.42.5(pid=32601) [trial-2370↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32601)] [trial-2370↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27] 05:52:03.908311 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 05:52:03.936787 run osmo-hlr_10.42.42.2(pid=32598): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32598)] 05:52:03.986530 run osmo-hlr_10.42.42.2(pid=32598): stdout: | (launched: 2022-12-10_05:52:00.301278) 05:52:04.038879 run osmo-hlr_10.42.42.2(pid=32598): stderr: | 20221210055200477 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210055200477 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210055200477 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210055200478 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210055200478 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210055200478 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210055200490 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-b200+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210055200501 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210055200501 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210055200501 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:52:04.091135 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32597): Terminating (SIGTERM) 05:52:04.132765 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32600): Terminating (SIGTERM) 05:52:04.175151 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32603): Terminating (SIGTERM) 05:52:04.217368 --- ParallelTerminationStrategy: PID 32597 died... 05:52:04.237326 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32597): Terminated: ok {rc=0} 05:52:04.283921 --- ParallelTerminationStrategy: PID 32600 died... 05:52:04.303619 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32600): Terminated: ok {rc=0} 05:52:04.349813 --- ParallelTerminationStrategy: PID 32603 died... 05:52:04.369408 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32603): Terminated: ok {rc=0} 05:52:04.457401 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2370 gprs:trx-b200+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 gprs:trx-b200+mod-bts0-dynts-ipa --------------------------------------------------------------------- 05:52:05.765109 tst gprs:trx-b200+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:52:05.772162 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 05:52:05.806767 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 05:52:05.845996 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 05:52:05.934101 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 05:52:05.967588 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 05:52:06.006916 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 05:52:06.604319 tst gprs:trx-b200+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2370 gprs:trx-b200+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 05:52:06.656255 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:52:06.667715 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 05:52:06.739398 tst cs_paging_gprs_active.py: using LAC 26292 05:52:06.865714 tst cs_paging_gprs_active.py: using RAC 27 05:52:06.986477 tst cs_paging_gprs_active.py: using CellId 26292 05:52:07.109683 tst cs_paging_gprs_active.py: using BVCI 26293 05:52:07.220412 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:52:07.231382 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:52:07.242214 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:52:07.253867 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:52:07.265300 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:52:07.276873 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:52:07.288511 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:52:07.299979 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:52:07.311462 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 05:52:07.426368 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 05:52:07.541501 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 05:52:07.743027 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:52:08.046286 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32608): Launched 05:52:08.308547 run iperf3-srv_10.42.42.10(pid=32609): Launched 05:52:08.420534 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 05:52:08.620728 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:52:08.921530 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32610): Launched 05:52:09.183205 run iperf3-srv_10.42.42.10(pid=32611): Launched 05:52:09.295185 tst cs_paging_gprs_active.py:38: start network... 05:52:09.494991 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:52:09.960719 run create_hlr_db(pid=32612): Launched 05:52:10.078266 bus /gobi_6: Setting Powered False 05:52:11.137150 run create_hlr_db(pid=32612): Terminated: ok {rc=0} 05:52:11.567396 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32614): Launched 05:52:11.874898 run osmo-hlr_10.42.42.2(pid=32615): Launched 05:52:11.997581 run osmo-stp_10.42.42.5: Starting osmo-stp 05:52:12.544643 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32617): Launched 05:52:12.859403 run osmo-stp_10.42.42.5(pid=32618): Launched 05:52:12.980588 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:52:13.524304 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32620): Launched 05:52:13.644647 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:52:13.911963 run patchelf(pid=32621): Launched 05:52:14.087289 run osmo-stp_10.42.42.5(pid=32618): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32618)] 05:52:14.220354 run osmo-stp_10.42.42.5(pid=32618): stdout: | (launched: 2022-12-10_05:52:12.800452) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:52:14.355123 run osmo-stp_10.42.42.5(pid=32618): stderr: | 20221210055212993 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055212993 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055212993 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055212994 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055212994 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055212994 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055212994 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:52:14.489904 run osmo-stp_10.42.42.5(pid=32618): stdout: | (launched: 2022-12-10_05:52:12.800452) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:52:14.619660 run osmo-stp_10.42.42.5(pid=32618): stderr: | 20221210055212993 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055212993 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055212993 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055212994 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055212994 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055212994 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055212994 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:52:14.772215 run patchelf(pid=32621): Terminating (SIGINT) 05:52:14.947802 run patchelf(pid=32621): Terminated: ok {rc=0} 05:52:15.075367 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=32618): Process ended prematurely: osmo-stp_10.42.42.5(pid=32618) [trial-2370↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32618)] [trial-2370↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 05:52:15.085411 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 05:52:15.113339 run osmo-hlr_10.42.42.2(pid=32615): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32615)] 05:52:15.162400 run osmo-hlr_10.42.42.2(pid=32615): stdout: | (launched: 2022-12-10_05:52:11.815934) 05:52:15.213287 run osmo-hlr_10.42.42.2(pid=32615): stderr: | 20221210055212014 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210055212014 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210055212014 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210055212014 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210055212014 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210055212014 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210055212026 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-b200+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210055212034 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210055212034 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210055212034 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:52:15.264371 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32608): Terminating (SIGTERM) 05:52:15.305579 run iperf3-srv_10.42.42.10(pid=32609): Terminating (SIGTERM) 05:52:15.346546 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32610): Terminating (SIGTERM) 05:52:15.387531 run iperf3-srv_10.42.42.10(pid=32611): Terminating (SIGTERM) 05:52:15.428307 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32614): Terminating (SIGTERM) 05:52:15.469311 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32617): Terminating (SIGTERM) 05:52:15.510084 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32620): Terminating (SIGTERM) 05:52:15.551201 --- ParallelTerminationStrategy: PID 32608 died... 05:52:15.570820 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32608): Terminated: ok {rc=0} 05:52:15.616230 --- ParallelTerminationStrategy: PID 32609 died... 05:52:15.635254 run iperf3-srv_10.42.42.10(pid=32609): Terminated {rc=256} 05:52:15.680299 --- ParallelTerminationStrategy: PID 32610 died... 05:52:15.699717 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32610): Terminated: ok {rc=0} 05:52:15.744902 --- ParallelTerminationStrategy: PID 32611 died... 05:52:15.764173 run iperf3-srv_10.42.42.10(pid=32611): Terminated {rc=256} 05:52:15.809691 --- ParallelTerminationStrategy: PID 32614 died... 05:52:15.828909 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32614): Terminated: ok {rc=0} 05:52:15.877776 --- ParallelTerminationStrategy: PID 32617 died... 05:52:15.897542 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32617): Terminated: ok {rc=0} 05:52:15.944041 --- ParallelTerminationStrategy: PID 32620 died... 05:52:15.963815 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32620): Terminated: ok {rc=0} 05:52:16.063421 bus /gobi_0: Setting Powered False 05:52:17.170320 bus /gobi_0: Setting Powered False 05:52:18.299746 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-b200+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 05:52:19.448061 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:52:19.460093 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 05:52:19.533077 tst iperf3.py: using LAC 26293 05:52:19.656934 tst iperf3.py: using RAC 28 05:52:19.779577 tst iperf3.py: using CellId 26293 05:52:19.902915 tst iperf3.py: using BVCI 26294 05:52:20.016586 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:52:20.027822 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:52:20.038863 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:52:20.049971 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:52:20.061023 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:52:20.072038 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:52:20.083131 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:52:20.094085 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:52:20.105552 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 05:52:20.222620 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 05:52:20.461199 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:52:20.776682 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32622): Launched 05:52:21.051298 run iperf3-srv_10.42.42.10(pid=32623): Launched 05:52:21.166975 tst iperf3.py:8: start network... 05:52:21.374898 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:52:21.857832 run create_hlr_db(pid=32624): Launched 05:52:21.983569 bus /gobi_6: Setting Powered False 05:52:23.044861 run create_hlr_db(pid=32624): Terminated: ok {rc=0} 05:52:23.459478 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32626): Launched 05:52:23.750193 run osmo-hlr_10.42.42.2(pid=32627): Launched 05:52:23.859452 run osmo-stp_10.42.42.5: Starting osmo-stp 05:52:24.375435 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32629): Launched 05:52:24.666546 run osmo-stp_10.42.42.5(pid=32630): Launched 05:52:24.775167 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:52:25.275171 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32632): Launched 05:52:25.385592 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:52:25.632047 run patchelf(pid=32633): Launched 05:52:25.792255 run osmo-stp_10.42.42.5(pid=32630): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32630)] 05:52:25.914964 run osmo-stp_10.42.42.5(pid=32630): stdout: | (launched: 2022-12-10_05:52:24.610265) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:52:26.038720 run osmo-stp_10.42.42.5(pid=32630): stderr: | 20221210055224781 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055224781 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055224782 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055224782 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055224783 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055224783 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055224783 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:52:26.162784 run osmo-stp_10.42.42.5(pid=32630): stdout: | (launched: 2022-12-10_05:52:24.610265) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:52:26.281870 run osmo-stp_10.42.42.5(pid=32630): stderr: | 20221210055224781 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055224781 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055224782 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055224782 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055224783 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055224783 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055224783 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:52:26.422402 run patchelf(pid=32633): Terminating (SIGINT) 05:52:26.584264 run patchelf(pid=32633): Terminated: ok {rc=0} 05:52:26.701286 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32630): Process ended prematurely: osmo-stp_10.42.42.5(pid=32630) [trial-2370↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32630)] [trial-2370↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8] 05:52:26.710617 tst iperf3.py:8: Test FAILED (7.3 sec) 05:52:26.737830 run osmo-hlr_10.42.42.2(pid=32627): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32627)] 05:52:26.785055 run osmo-hlr_10.42.42.2(pid=32627): stdout: | (launched: 2022-12-10_05:52:23.693746) 05:52:26.833953 run osmo-hlr_10.42.42.2(pid=32627): stderr: | 20221210055223871 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210055223871 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210055223871 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210055223871 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210055223871 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210055223871 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210055223884 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210055223892 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210055223892 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210055223892 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:52:26.883481 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32622): Terminating (SIGTERM) 05:52:26.922765 run iperf3-srv_10.42.42.10(pid=32623): Terminating (SIGTERM) 05:52:26.962089 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32626): Terminating (SIGTERM) 05:52:27.001415 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32629): Terminating (SIGTERM) 05:52:27.040752 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32632): Terminating (SIGTERM) 05:52:27.080269 --- ParallelTerminationStrategy: PID 32622 died... 05:52:27.099115 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32622): Terminated: ok {rc=0} 05:52:27.142934 --- ParallelTerminationStrategy: PID 32623 died... 05:52:27.161292 run iperf3-srv_10.42.42.10(pid=32623): Terminated {rc=256} 05:52:27.204763 --- ParallelTerminationStrategy: PID 32626 died... 05:52:27.223114 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32626): Terminated: ok {rc=0} 05:52:27.266658 --- ParallelTerminationStrategy: PID 32629 died... 05:52:27.285133 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32629): Terminated: ok {rc=0} 05:52:27.328694 --- ParallelTerminationStrategy: PID 32632 died... 05:52:27.347192 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32632): Terminated: ok {rc=0} 05:52:27.431818 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-b200+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 05:52:28.574788 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:52:28.586294 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 05:52:28.658906 tst iperf3m4.py: using LAC 26294 05:52:28.773443 tst iperf3m4.py: using RAC 29 05:52:28.886756 tst iperf3m4.py: using CellId 26294 05:52:28.998710 tst iperf3m4.py: using BVCI 26295 05:52:29.103402 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:52:29.114084 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:52:29.124541 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:52:29.135276 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:52:29.145903 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:52:29.156540 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:52:29.167315 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:52:29.177975 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:52:29.188844 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 05:52:29.304537 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 05:52:29.419463 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 05:52:29.536526 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 05:52:29.656278 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 05:52:29.865689 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:52:30.182575 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32634): Launched 05:52:30.456608 run iperf3-srv_10.42.42.10(pid=32635): Launched 05:52:30.572682 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 05:52:30.782534 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:52:31.117694 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32636): Launched 05:52:31.403907 run iperf3-srv_10.42.42.10(pid=32637): Launched 05:52:31.534487 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 05:52:31.746765 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:52:32.072855 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32638): Launched 05:52:32.358682 run iperf3-srv_10.42.42.10(pid=32639): Launched 05:52:32.474329 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 05:52:32.683187 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:52:32.999384 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32640): Launched 05:52:33.274139 run iperf3-srv_10.42.42.10(pid=32641): Launched 05:52:33.389918 tst iperf3m4.py:8: start network... 05:52:33.597870 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:52:34.081975 run create_hlr_db(pid=32642): Launched 05:52:34.206587 bus /gobi_6: Setting Powered False 05:52:35.267748 run create_hlr_db(pid=32642): Terminated: ok {rc=0} 05:52:35.683964 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32644): Launched 05:52:35.980323 run osmo-hlr_10.42.42.2(pid=32649): Launched 05:52:36.090512 run osmo-stp_10.42.42.5: Starting osmo-stp 05:52:36.609311 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32651): Launched 05:52:36.900896 run osmo-stp_10.42.42.5(pid=32652): Launched 05:52:37.010426 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:52:37.511975 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32654): Launched 05:52:37.622428 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:52:37.869447 run patchelf(pid=32655): Launched 05:52:38.029578 run osmo-stp_10.42.42.5(pid=32652): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32652)] 05:52:38.152480 run osmo-stp_10.42.42.5(pid=32652): stdout: | (launched: 2022-12-10_05:52:36.845213) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:52:38.276586 run osmo-stp_10.42.42.5(pid=32652): stderr: | 20221210055237016 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055237016 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055237016 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055237017 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055237019 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055237019 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055237019 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:52:38.400547 run osmo-stp_10.42.42.5(pid=32652): stdout: | (launched: 2022-12-10_05:52:36.845213) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:52:38.519228 run osmo-stp_10.42.42.5(pid=32652): stderr: | 20221210055237016 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055237016 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055237016 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055237017 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055237019 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055237019 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055237019 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:52:38.659740 run patchelf(pid=32655): Terminating (SIGINT) 05:52:38.822680 run patchelf(pid=32655): Terminated: ok {rc=0} 05:52:38.939681 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32652): Process ended prematurely: osmo-stp_10.42.42.5(pid=32652) [trial-2370↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32652)] [trial-2370↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8] 05:52:38.949395 tst iperf3m4.py:8: Test FAILED (10.4 sec) 05:52:38.976429 run osmo-hlr_10.42.42.2(pid=32649): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32649)] 05:52:39.023667 run osmo-hlr_10.42.42.2(pid=32649): stdout: | (launched: 2022-12-10_05:52:35.919327) 05:52:39.072289 run osmo-hlr_10.42.42.2(pid=32649): stderr: | 20221210055236097 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210055236097 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210055236097 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210055236097 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210055236097 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210055236097 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210055236109 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210055236118 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210055236118 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210055236118 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:52:39.121377 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32634): Terminating (SIGTERM) 05:52:39.160421 run iperf3-srv_10.42.42.10(pid=32635): Terminating (SIGTERM) 05:52:39.199396 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32636): Terminating (SIGTERM) 05:52:39.238324 run iperf3-srv_10.42.42.10(pid=32637): Terminating (SIGTERM) 05:52:39.277125 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32638): Terminating (SIGTERM) 05:52:39.316067 run iperf3-srv_10.42.42.10(pid=32639): Terminating (SIGTERM) 05:52:39.355116 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32640): Terminating (SIGTERM) 05:52:39.393985 run iperf3-srv_10.42.42.10(pid=32641): Terminating (SIGTERM) 05:52:39.432728 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32644): Terminating (SIGTERM) 05:52:39.471665 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32651): Terminating (SIGTERM) 05:52:39.510492 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32654): Terminating (SIGTERM) 05:52:39.549526 --- ParallelTerminationStrategy: PID 32634 died... 05:52:39.568036 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32634): Terminated: ok {rc=0} 05:52:39.611775 --- ParallelTerminationStrategy: PID 32635 died... 05:52:39.629854 run iperf3-srv_10.42.42.10(pid=32635): Terminated {rc=256} 05:52:39.672699 --- ParallelTerminationStrategy: PID 32636 died... 05:52:39.690776 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32636): Terminated: ok {rc=0} 05:52:39.734067 --- ParallelTerminationStrategy: PID 32637 died... 05:52:39.752225 run iperf3-srv_10.42.42.10(pid=32637): Terminated {rc=256} 05:52:39.795331 --- ParallelTerminationStrategy: PID 32638 died... 05:52:39.813411 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32638): Terminated: ok {rc=0} 05:52:39.856450 --- ParallelTerminationStrategy: PID 32639 died... 05:52:39.874522 run iperf3-srv_10.42.42.10(pid=32639): Terminated {rc=256} 05:52:39.917504 --- ParallelTerminationStrategy: PID 32640 died... 05:52:39.935515 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32640): Terminated: ok {rc=0} 05:52:39.978914 --- ParallelTerminationStrategy: PID 32641 died... 05:52:39.997149 run iperf3-srv_10.42.42.10(pid=32641): Terminated {rc=256} 05:52:40.040199 --- ParallelTerminationStrategy: PID 32644 died... 05:52:40.058196 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32644): Terminated: ok {rc=0} 05:52:40.101504 --- ParallelTerminationStrategy: PID 32651 died... 05:52:40.119742 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32651): Terminated: ok {rc=0} 05:52:40.162892 --- ParallelTerminationStrategy: PID 32654 died... 05:52:40.181053 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32654): Terminated: ok {rc=0} 05:52:40.264610 bus /gobi_4: Setting Powered False 05:52:41.362688 bus /gobi_4: Setting Powered False 05:52:42.477745 bus /gobi_1: Setting Powered False 05:52:43.573192 bus /gobi_1: Setting Powered False 05:52:44.685707 bus /gobi_0: Setting Powered False 05:52:45.781212 bus /gobi_0: Setting Powered False 05:52:46.899818 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-b200+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 05:52:48.004929 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:52:48.016760 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 05:52:48.087122 tst ping.py: using LAC 26295 05:52:48.207642 tst ping.py: using RAC 30 05:52:48.320102 tst ping.py: using CellId 26295 05:52:48.432764 tst ping.py: using BVCI 26296 05:52:48.537134 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:52:48.547881 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:52:48.558425 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:52:48.569142 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:52:48.579793 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:52:48.590462 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:52:48.601381 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:52:48.611897 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 05:52:48.722481 tst ping.py:19: start network... 05:52:48.911080 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:52:49.352812 run create_hlr_db(pid=32656): Launched 05:52:49.459842 bus /gobi_6: Setting Powered False 05:52:50.517368 run create_hlr_db(pid=32656): Terminated: ok {rc=0} 05:52:50.937886 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32658): Launched 05:52:51.245394 run osmo-hlr_10.42.42.2(pid=32659): Launched 05:52:51.360423 run osmo-stp_10.42.42.5: Starting osmo-stp 05:52:51.889644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32661): Launched 05:52:52.196084 run osmo-stp_10.42.42.5(pid=32662): Launched 05:52:52.311395 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:52:52.840384 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32664): Launched 05:52:52.956525 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:52:53.218751 run patchelf(pid=32665): Launched 05:52:53.387302 run osmo-stp_10.42.42.5(pid=32662): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32662)] 05:52:53.516353 run osmo-stp_10.42.42.5(pid=32662): stdout: | (launched: 2022-12-10_05:52:52.136733) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:52:53.647288 run osmo-stp_10.42.42.5(pid=32662): stderr: | 20221210055252328 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055252328 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055252328 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055252329 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055252329 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055252329 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055252330 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:52:53.778256 run osmo-stp_10.42.42.5(pid=32662): stdout: | (launched: 2022-12-10_05:52:52.136733) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:52:53.902513 run osmo-stp_10.42.42.5(pid=32662): stderr: | 20221210055252328 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055252328 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055252328 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055252329 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055252329 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055252329 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055252330 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:52:54.050021 run patchelf(pid=32665): Terminating (SIGINT) 05:52:54.220688 run patchelf(pid=32665): Terminated: ok {rc=0} 05:52:54.343483 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=32662): Process ended prematurely: osmo-stp_10.42.42.5(pid=32662) [trial-2370↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32662)] [trial-2370↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22] 05:52:54.352780 tst ping.py:22: Test FAILED (6.3 sec) 05:52:54.380375 run osmo-hlr_10.42.42.2(pid=32659): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32659)] 05:52:54.429575 run osmo-hlr_10.42.42.2(pid=32659): stdout: | (launched: 2022-12-10_05:52:51.185420) 05:52:54.480589 run osmo-hlr_10.42.42.2(pid=32659): stderr: | 20221210055251385 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210055251385 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210055251385 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210055251385 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210055251385 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210055251385 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210055251397 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-b200+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210055251405 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210055251405 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210055251405 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:52:54.532263 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32658): Terminating (SIGTERM) 05:52:54.573287 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32661): Terminating (SIGTERM) 05:52:54.614355 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32664): Terminating (SIGTERM) 05:52:54.655752 --- ParallelTerminationStrategy: PID 32658 died... 05:52:54.675369 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32658): Terminated: ok {rc=0} 05:52:54.720876 --- ParallelTerminationStrategy: PID 32661 died... 05:52:54.740146 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32661): Terminated: ok {rc=0} 05:52:54.785352 --- ParallelTerminationStrategy: PID 32664 died... 05:52:54.804498 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32664): Terminated: ok {rc=0} 05:52:54.891002 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-b200+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 05:52:55.977659 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:52:55.989930 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 05:52:56.065617 tst ping_idle_ping.py: using LAC 26296 05:52:56.184224 tst ping_idle_ping.py: using RAC 31 05:52:56.302508 tst ping_idle_ping.py: using CellId 26296 05:52:56.424445 tst ping_idle_ping.py: using BVCI 26297 05:52:56.534613 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:52:56.545818 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:52:56.556711 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:52:56.567852 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:52:56.578814 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:52:56.589799 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:52:56.600797 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:52:56.611831 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 05:52:56.723656 tst ping_idle_ping.py:24: start network... 05:52:56.916227 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:52:57.366020 run create_hlr_db(pid=32666): Launched 05:52:57.474374 bus /gobi_6: Setting Powered False 05:52:58.531583 run create_hlr_db(pid=32666): Terminated: ok {rc=0} 05:52:58.953585 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32668): Launched 05:52:59.261923 run osmo-hlr_10.42.42.2(pid=32669): Launched 05:52:59.378338 run osmo-stp_10.42.42.5: Starting osmo-stp 05:52:59.908498 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32671): Launched 05:53:00.216392 run osmo-stp_10.42.42.5(pid=32672): Launched 05:53:00.331487 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:53:00.865929 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32674): Launched 05:53:00.988848 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:53:01.246174 run patchelf(pid=32675): Launched 05:53:01.423303 run osmo-stp_10.42.42.5(pid=32672): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32672)] 05:53:01.548310 run osmo-stp_10.42.42.5(pid=32672): stdout: | (launched: 2022-12-10_05:53:00.156936) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:53:01.676486 run osmo-stp_10.42.42.5(pid=32672): stderr: | 20221210055300348 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055300348 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055300348 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055300348 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055300351 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055300351 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055300351 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:53:01.803492 run osmo-stp_10.42.42.5(pid=32672): stdout: | (launched: 2022-12-10_05:53:00.156936) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:53:01.925556 run osmo-stp_10.42.42.5(pid=32672): stderr: | 20221210055300348 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055300348 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055300348 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055300348 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055300351 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055300351 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055300351 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:53:02.069910 run patchelf(pid=32675): Terminating (SIGINT) 05:53:02.233795 run patchelf(pid=32675): Terminated: ok {rc=0} 05:53:02.352583 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=32672): Process ended prematurely: osmo-stp_10.42.42.5(pid=32672) [trial-2370↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32672)] [trial-2370↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 05:53:02.362102 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 05:53:02.390319 run osmo-hlr_10.42.42.2(pid=32669): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32669)] 05:53:02.438037 run osmo-hlr_10.42.42.2(pid=32669): stdout: | (launched: 2022-12-10_05:52:59.201451) 05:53:02.487435 run osmo-hlr_10.42.42.2(pid=32669): stderr: | 20221210055259402 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210055259402 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210055259402 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210055259402 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210055259402 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210055259402 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210055259414 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-b200+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210055259423 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210055259423 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210055259423 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:53:02.537332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32668): Terminating (SIGTERM) 05:53:02.577311 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32671): Terminating (SIGTERM) 05:53:02.617177 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32674): Terminating (SIGTERM) 05:53:02.657231 --- ParallelTerminationStrategy: PID 32668 died... 05:53:02.675933 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32668): Terminated: ok {rc=0} 05:53:02.720662 --- ParallelTerminationStrategy: PID 32671 died... 05:53:02.739048 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32671): Terminated: ok {rc=0} 05:53:02.786391 --- ParallelTerminationStrategy: PID 32674 died... 05:53:02.806042 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32674): Terminated: ok {rc=0} 05:53:02.891686 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2370 gprs:trx-b200+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 gprs:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 05:53:04.188306 tst gprs:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:53:04.194609 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 05:53:04.228329 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 05:53:04.266205 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 05:53:04.351668 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 05:53:04.385707 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 05:53:04.424587 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 05:53:05.012094 tst gprs:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2370 gprs:trx-b200+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 05:53:05.059554 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:53:05.070476 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 05:53:05.138668 tst cs_paging_gprs_active.py: using LAC 26297 05:53:05.254245 tst cs_paging_gprs_active.py: using RAC 32 05:53:05.370325 tst cs_paging_gprs_active.py: using CellId 26297 05:53:05.486890 tst cs_paging_gprs_active.py: using BVCI 26298 05:53:05.594085 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:53:05.604849 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:53:05.615654 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:53:05.627049 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:53:05.638459 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:53:05.649565 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:53:05.660525 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:53:05.671575 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:53:05.682803 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 05:53:05.799585 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 05:53:05.916342 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 05:53:06.127993 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:53:06.441082 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32680): Launched 05:53:06.713077 run iperf3-srv_10.42.42.10(pid=32681): Launched 05:53:06.830562 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 05:53:07.041482 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:53:07.354443 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32682): Launched 05:53:07.626633 run iperf3-srv_10.42.42.10(pid=32683): Launched 05:53:07.744149 tst cs_paging_gprs_active.py:38: start network... 05:53:07.955253 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:53:08.438923 run create_hlr_db(pid=32684): Launched 05:53:08.567475 bus /gobi_6: Setting Powered False 05:53:09.629356 run create_hlr_db(pid=32684): Terminated: ok {rc=0} 05:53:10.043817 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32686): Launched 05:53:10.334871 run osmo-hlr_10.42.42.2(pid=32687): Launched 05:53:10.446483 run osmo-stp_10.42.42.5: Starting osmo-stp 05:53:10.946087 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32689): Launched 05:53:11.259571 run osmo-stp_10.42.42.5(pid=32690): Launched 05:53:11.378219 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:53:11.914927 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32692): Launched 05:53:12.034919 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:53:12.297008 run patchelf(pid=32693): Launched 05:53:12.470806 run osmo-stp_10.42.42.5(pid=32690): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32690)] 05:53:12.603167 run osmo-stp_10.42.42.5(pid=32690): stdout: | (launched: 2022-12-10_05:53:11.203204) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:53:12.736875 run osmo-stp_10.42.42.5(pid=32690): stderr: | 20221210055311394 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055311394 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055311394 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055311394 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055311395 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055311395 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055311395 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:53:12.870864 run osmo-stp_10.42.42.5(pid=32690): stdout: | (launched: 2022-12-10_05:53:11.203204) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:53:12.999541 run osmo-stp_10.42.42.5(pid=32690): stderr: | 20221210055311394 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055311394 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055311394 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055311394 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055311395 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055311395 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055311395 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:53:13.153415 run patchelf(pid=32693): Terminating (SIGINT) 05:53:13.327778 run patchelf(pid=32693): Terminated: ok {rc=0} 05:53:13.454140 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=32690): Process ended prematurely: osmo-stp_10.42.42.5(pid=32690) [trial-2370↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32690)] [trial-2370↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 05:53:13.464094 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 05:53:13.492135 run osmo-hlr_10.42.42.2(pid=32687): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32687)] 05:53:13.541431 run osmo-hlr_10.42.42.2(pid=32687): stdout: | (launched: 2022-12-10_05:53:10.282136) 05:53:13.592220 run osmo-hlr_10.42.42.2(pid=32687): stderr: | 20221210055310457 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210055310457 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210055310457 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210055310457 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210055310457 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210055310457 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210055310470 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-b200+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210055310478 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210055310478 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210055310478 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:53:13.643161 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32680): Terminating (SIGTERM) 05:53:13.684158 run iperf3-srv_10.42.42.10(pid=32681): Terminating (SIGTERM) 05:53:13.725216 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32682): Terminating (SIGTERM) 05:53:13.766230 run iperf3-srv_10.42.42.10(pid=32683): Terminating (SIGTERM) 05:53:13.806998 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32686): Terminating (SIGTERM) 05:53:13.848033 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32689): Terminating (SIGTERM) 05:53:13.889257 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32692): Terminating (SIGTERM) 05:53:13.930563 --- ParallelTerminationStrategy: PID 32680 died... 05:53:13.950246 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32680): Terminated: ok {rc=0} 05:53:13.995663 --- ParallelTerminationStrategy: PID 32681 died... 05:53:14.014774 run iperf3-srv_10.42.42.10(pid=32681): Terminated {rc=256} 05:53:14.060133 --- ParallelTerminationStrategy: PID 32682 died... 05:53:14.079466 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32682): Terminated: ok {rc=0} 05:53:14.124659 --- ParallelTerminationStrategy: PID 32683 died... 05:53:14.143906 run iperf3-srv_10.42.42.10(pid=32683): Terminated {rc=256} 05:53:14.188633 --- ParallelTerminationStrategy: PID 32686 died... 05:53:14.207828 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32686): Terminated: ok {rc=0} 05:53:14.253027 --- ParallelTerminationStrategy: PID 32689 died... 05:53:14.272146 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32689): Terminated: ok {rc=0} 05:53:14.317590 --- ParallelTerminationStrategy: PID 32692 died... 05:53:14.336845 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32692): Terminated: ok {rc=0} 05:53:14.422823 bus /gobi_0: Setting Powered False 05:53:15.520461 bus /gobi_0: Setting Powered False 05:53:16.658253 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-b200+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 05:53:17.862424 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:53:17.875288 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 05:53:17.963515 tst iperf3.py: using LAC 26298 05:53:18.115322 tst iperf3.py: using RAC 33 05:53:18.258243 tst iperf3.py: using CellId 26298 05:53:18.400173 tst iperf3.py: using BVCI 26299 05:53:18.554460 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:53:18.569833 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:53:18.581772 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:53:18.594780 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:53:18.606563 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:53:18.620422 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:53:18.632377 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:53:18.644116 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:53:18.660106 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 05:53:18.797630 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 05:53:19.014530 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:53:19.337922 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=508): Launched 05:53:19.637721 run iperf3-srv_10.42.42.10(pid=509): Launched 05:53:19.764727 tst iperf3.py:8: start network... 05:53:19.978664 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:53:20.472389 run create_hlr_db(pid=511): Launched 05:53:20.632653 bus /gobi_6: Setting Powered False 05:53:21.695095 run create_hlr_db(pid=511): Terminated: ok {rc=0} 05:53:22.153733 run pcap-recorder_any(filters='host 10.42.42.2')(pid=514): Launched 05:53:22.489074 run osmo-hlr_10.42.42.2(pid=515): Launched 05:53:22.734440 run osmo-stp_10.42.42.5: Starting osmo-stp 05:53:23.405314 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=517): Launched 05:53:23.747420 run osmo-stp_10.42.42.5(pid=518): Launched 05:53:23.999183 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:53:24.645920 run pcap-recorder_any(filters='host 10.42.42.6')(pid=520): Launched 05:53:24.783638 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:53:25.065157 run patchelf(pid=521): Launched 05:53:25.263537 run osmo-stp_10.42.42.5(pid=518): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=518)] 05:53:25.404734 run osmo-stp_10.42.42.5(pid=518): stdout: | (launched: 2022-12-10_05:53:23.687692) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:53:25.546968 run osmo-stp_10.42.42.5(pid=518): stderr: | 20221210055323982 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055323982 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055323982 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055323983 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055323994 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055323994 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055323994 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:53:25.688727 run osmo-stp_10.42.42.5(pid=518): stdout: | (launched: 2022-12-10_05:53:23.687692) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:53:25.825793 run osmo-stp_10.42.42.5(pid=518): stderr: | 20221210055323982 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055323982 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055323982 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055323983 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055323994 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055323994 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055323994 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:53:25.988648 run patchelf(pid=521): Terminating (SIGINT) 05:53:26.174820 run patchelf(pid=521): Terminated: ok {rc=0} 05:53:26.308134 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=518): Process ended prematurely: osmo-stp_10.42.42.5(pid=518) [trial-2370↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=518)] [trial-2370↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8] 05:53:26.319616 tst iperf3.py:8: Test FAILED (8.5 sec) 05:53:26.351151 run osmo-hlr_10.42.42.2(pid=515): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=515)] 05:53:26.402905 run osmo-hlr_10.42.42.2(pid=515): stdout: | (launched: 2022-12-10_05:53:22.428309) 05:53:26.457359 run osmo-hlr_10.42.42.2(pid=515): stderr: | 20221210055322728 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210055322728 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210055322728 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210055322737 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210055322737 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210055322737 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210055322749 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210055322761 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210055322761 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210055322761 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:53:26.511463 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=508): Terminating (SIGTERM) 05:53:26.556670 run iperf3-srv_10.42.42.10(pid=509): Terminating (SIGTERM) 05:53:26.603631 run pcap-recorder_any(filters='host 10.42.42.2')(pid=514): Terminating (SIGTERM) 05:53:26.648228 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=517): Terminating (SIGTERM) 05:53:26.694678 run pcap-recorder_any(filters='host 10.42.42.6')(pid=520): Terminating (SIGTERM) 05:53:26.740177 --- ParallelTerminationStrategy: PID 508 died... 05:53:26.762198 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=508): Terminated: ok {rc=0} 05:53:26.810805 --- ParallelTerminationStrategy: PID 509 died... 05:53:26.830972 run iperf3-srv_10.42.42.10(pid=509): Terminated {rc=256} 05:53:26.878588 --- ParallelTerminationStrategy: PID 514 died... 05:53:26.898953 run pcap-recorder_any(filters='host 10.42.42.2')(pid=514): Terminated: ok {rc=0} 05:53:26.948561 --- ParallelTerminationStrategy: PID 517 died... 05:53:26.969311 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=517): Terminated: ok {rc=0} 05:53:27.017897 --- ParallelTerminationStrategy: PID 520 died... 05:53:27.038496 run pcap-recorder_any(filters='host 10.42.42.6')(pid=520): Terminated: ok {rc=0} 05:53:27.130521 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-b200+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 05:53:28.286159 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:53:28.299095 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 05:53:28.375179 tst iperf3m4.py: using LAC 26299 05:53:28.505570 tst iperf3m4.py: using RAC 34 05:53:28.638306 tst iperf3m4.py: using CellId 26299 05:53:28.770101 tst iperf3m4.py: using BVCI 26300 05:53:28.891009 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:53:28.903170 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:53:28.915274 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:53:28.927446 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:53:28.939707 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:53:28.954903 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:53:28.967427 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:53:28.979942 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:53:28.993240 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 05:53:29.118137 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 05:53:29.245371 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 05:53:29.372591 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 05:53:29.498917 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 05:53:29.725168 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:53:30.063531 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=522): Launched 05:53:30.366821 run iperf3-srv_10.42.42.10(pid=523): Launched 05:53:30.504305 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 05:53:30.730306 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:53:31.098410 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=524): Launched 05:53:31.397997 run iperf3-srv_10.42.42.10(pid=525): Launched 05:53:31.535640 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 05:53:31.761370 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:53:32.095411 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=526): Launched 05:53:32.533602 run iperf3-srv_10.42.42.10(pid=527): Launched 05:53:32.682740 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 05:53:32.906377 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:53:33.240626 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=528): Launched 05:53:33.539004 run iperf3-srv_10.42.42.10(pid=529): Launched 05:53:33.675640 tst iperf3m4.py:8: start network... 05:53:33.903529 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:53:34.420690 run create_hlr_db(pid=530): Launched 05:53:34.591682 bus /gobi_6: Setting Powered False 05:53:35.655805 run create_hlr_db(pid=530): Terminated: ok {rc=0} 05:53:36.121349 run pcap-recorder_any(filters='host 10.42.42.2')(pid=532): Launched 05:53:36.462531 run osmo-hlr_10.42.42.2(pid=533): Launched 05:53:36.711346 run osmo-stp_10.42.42.5: Starting osmo-stp 05:53:37.389485 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=535): Launched 05:53:37.734321 run osmo-stp_10.42.42.5(pid=536): Launched 05:53:37.983315 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:53:38.643241 run pcap-recorder_any(filters='host 10.42.42.6')(pid=538): Launched 05:53:38.781192 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:53:39.065109 run patchelf(pid=539): Launched 05:53:39.264044 run osmo-stp_10.42.42.5(pid=536): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=536)] 05:53:39.406181 run osmo-stp_10.42.42.5(pid=536): stdout: | (launched: 2022-12-10_05:53:37.671494) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:53:39.549271 run osmo-stp_10.42.42.5(pid=536): stderr: | 20221210055337979 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055337979 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055337979 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055337980 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055337985 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055337985 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055337985 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:53:39.692527 run osmo-stp_10.42.42.5(pid=536): stdout: | (launched: 2022-12-10_05:53:37.671494) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:53:39.829777 run osmo-stp_10.42.42.5(pid=536): stderr: | 20221210055337979 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055337979 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055337979 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055337980 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055337985 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055337985 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055337985 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:53:39.995655 run patchelf(pid=539): Terminating (SIGINT) 05:53:40.175747 run patchelf(pid=539): Terminated: ok {rc=0} 05:53:40.305107 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=536): Process ended prematurely: osmo-stp_10.42.42.5(pid=536) [trial-2370↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=536)] [trial-2370↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8] 05:53:40.315459 tst iperf3m4.py:8: Test FAILED (12.1 sec) 05:53:40.344462 run osmo-hlr_10.42.42.2(pid=533): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=533)] 05:53:40.394700 run osmo-hlr_10.42.42.2(pid=533): stdout: | (launched: 2022-12-10_05:53:36.403368) 05:53:40.446715 run osmo-hlr_10.42.42.2(pid=533): stderr: | 20221210055336717 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210055336717 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210055336718 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210055336718 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210055336718 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210055336718 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210055336732 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210055336749 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210055336749 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210055336749 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:53:40.499116 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=522): Terminating (SIGTERM) 05:53:40.541244 run iperf3-srv_10.42.42.10(pid=523): Terminating (SIGTERM) 05:53:40.583415 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=524): Terminating (SIGTERM) 05:53:40.625571 run iperf3-srv_10.42.42.10(pid=525): Terminating (SIGTERM) 05:53:40.667449 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=526): Terminating (SIGTERM) 05:53:40.709460 run iperf3-srv_10.42.42.10(pid=527): Terminating (SIGTERM) 05:53:40.751180 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=528): Terminating (SIGTERM) 05:53:40.793213 run iperf3-srv_10.42.42.10(pid=529): Terminating (SIGTERM) 05:53:40.835064 run pcap-recorder_any(filters='host 10.42.42.2')(pid=532): Terminating (SIGTERM) 05:53:40.877062 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=535): Terminating (SIGTERM) 05:53:40.918933 run pcap-recorder_any(filters='host 10.42.42.6')(pid=538): Terminating (SIGTERM) 05:53:40.960942 --- ParallelTerminationStrategy: PID 522 died... 05:53:40.981046 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=522): Terminated: ok {rc=0} 05:53:41.027224 --- ParallelTerminationStrategy: PID 523 died... 05:53:41.047161 run iperf3-srv_10.42.42.10(pid=523): Terminated {rc=256} 05:53:41.093404 --- ParallelTerminationStrategy: PID 524 died... 05:53:41.113073 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=524): Terminated: ok {rc=0} 05:53:41.159131 --- ParallelTerminationStrategy: PID 525 died... 05:53:41.178694 run iperf3-srv_10.42.42.10(pid=525): Terminated {rc=256} 05:53:41.225201 --- ParallelTerminationStrategy: PID 526 died... 05:53:41.244559 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=526): Terminated: ok {rc=0} 05:53:41.290552 --- ParallelTerminationStrategy: PID 527 died... 05:53:41.310066 run iperf3-srv_10.42.42.10(pid=527): Terminated {rc=256} 05:53:41.355980 --- ParallelTerminationStrategy: PID 528 died... 05:53:41.375565 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=528): Terminated: ok {rc=0} 05:53:41.421608 --- ParallelTerminationStrategy: PID 529 died... 05:53:41.441259 run iperf3-srv_10.42.42.10(pid=529): Terminated {rc=256} 05:53:41.487137 --- ParallelTerminationStrategy: PID 532 died... 05:53:41.506787 run pcap-recorder_any(filters='host 10.42.42.2')(pid=532): Terminated: ok {rc=0} 05:53:41.552927 --- ParallelTerminationStrategy: PID 535 died... 05:53:41.572630 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=535): Terminated: ok {rc=0} 05:53:41.618751 --- ParallelTerminationStrategy: PID 538 died... 05:53:41.638462 run pcap-recorder_any(filters='host 10.42.42.6')(pid=538): Terminated: ok {rc=0} 05:53:41.725669 bus /gobi_4: Setting Powered False 05:53:42.826546 bus /gobi_4: Setting Powered False 05:53:43.941597 bus /gobi_1: Setting Powered False 05:53:45.040150 bus /gobi_1: Setting Powered False 05:53:46.158837 bus /gobi_0: Setting Powered False 05:53:47.260321 bus /gobi_0: Setting Powered False 05:53:48.376876 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-b200+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 05:53:49.481789 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:53:49.494329 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 05:53:49.568744 tst ping.py: using LAC 26300 05:53:49.694497 tst ping.py: using RAC 35 05:53:49.819399 tst ping.py: using CellId 26300 05:53:49.942906 tst ping.py: using BVCI 26301 05:53:50.057594 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:53:50.069194 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:53:50.080453 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:53:50.091827 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:53:50.103170 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:53:50.114530 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:53:50.125834 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:53:50.137071 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 05:53:50.254965 tst ping.py:19: start network... 05:53:50.466606 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:53:50.952036 run create_hlr_db(pid=540): Launched 05:53:51.081173 bus /gobi_6: Setting Powered False 05:53:52.144103 run create_hlr_db(pid=540): Terminated: ok {rc=0} 05:53:52.567590 run pcap-recorder_any(filters='host 10.42.42.2')(pid=542): Launched 05:53:52.863559 run osmo-hlr_10.42.42.2(pid=543): Launched 05:53:52.976579 run osmo-stp_10.42.42.5: Starting osmo-stp 05:53:53.507981 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=545): Launched 05:53:53.803143 run osmo-stp_10.42.42.5(pid=546): Launched 05:53:53.917260 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:53:54.428522 run pcap-recorder_any(filters='host 10.42.42.6')(pid=548): Launched 05:53:54.542258 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:53:54.791048 run patchelf(pid=549): Launched 05:53:54.957326 run osmo-stp_10.42.42.5(pid=546): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=546)] 05:53:55.082480 run osmo-stp_10.42.42.5(pid=546): stdout: | (launched: 2022-12-10_05:53:53.749330) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:53:55.208731 run osmo-stp_10.42.42.5(pid=546): stderr: | 20221210055353918 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055353918 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055353918 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055353918 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055353921 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055353921 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055353921 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:53:55.335876 run osmo-stp_10.42.42.5(pid=546): stdout: | (launched: 2022-12-10_05:53:53.749330) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:53:55.456114 run osmo-stp_10.42.42.5(pid=546): stderr: | 20221210055353918 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055353918 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055353918 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055353918 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055353921 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055353921 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055353921 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:53:55.598743 run patchelf(pid=549): Terminating (SIGINT) 05:53:55.764230 run patchelf(pid=549): Terminated: ok {rc=0} 05:53:55.883583 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=546): Process ended prematurely: osmo-stp_10.42.42.5(pid=546) [trial-2370↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=546)] [trial-2370↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22] 05:53:55.892588 tst ping.py:22: Test FAILED (6.4 sec) 05:53:55.919656 run osmo-hlr_10.42.42.2(pid=543): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=543)] 05:53:55.966727 run osmo-hlr_10.42.42.2(pid=543): stdout: | (launched: 2022-12-10_05:53:52.809373) 05:53:56.015325 run osmo-hlr_10.42.42.2(pid=543): stderr: | 20221210055352986 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210055352986 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210055352986 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210055352986 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210055352986 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210055352986 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210055352998 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-b200+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210055353009 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210055353010 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210055353010 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:53:56.064859 run pcap-recorder_any(filters='host 10.42.42.2')(pid=542): Terminating (SIGTERM) 05:53:56.104141 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=545): Terminating (SIGTERM) 05:53:56.143415 run pcap-recorder_any(filters='host 10.42.42.6')(pid=548): Terminating (SIGTERM) 05:53:56.182771 --- ParallelTerminationStrategy: PID 542 died... 05:53:56.201671 run pcap-recorder_any(filters='host 10.42.42.2')(pid=542): Terminated: ok {rc=0} 05:53:56.245347 --- ParallelTerminationStrategy: PID 545 died... 05:53:56.263633 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=545): Terminated: ok {rc=0} 05:53:56.307085 --- ParallelTerminationStrategy: PID 548 died... 05:53:56.325355 run pcap-recorder_any(filters='host 10.42.42.6')(pid=548): Terminated: ok {rc=0} 05:53:56.410058 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-b200+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 05:53:57.498422 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:53:57.510457 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 05:53:57.582241 tst ping_idle_ping.py: using LAC 26301 05:53:57.708357 tst ping_idle_ping.py: using RAC 36 05:53:57.832503 tst ping_idle_ping.py: using CellId 26301 05:53:57.957069 tst ping_idle_ping.py: using BVCI 26302 05:53:58.073713 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:53:58.085228 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:53:58.096571 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:53:58.108288 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:53:58.119872 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:53:58.131454 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:53:58.143166 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:53:58.154718 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 05:53:58.271514 tst ping_idle_ping.py:24: start network... 05:53:58.470198 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:53:58.930497 run create_hlr_db(pid=550): Launched 05:53:59.044676 bus /gobi_6: Setting Powered False 05:54:00.103040 run create_hlr_db(pid=550): Terminated: ok {rc=0} 05:54:00.536498 run pcap-recorder_any(filters='host 10.42.42.2')(pid=552): Launched 05:54:00.860109 run osmo-hlr_10.42.42.2(pid=553): Launched 05:54:01.126658 run osmo-stp_10.42.42.5: Starting osmo-stp 05:54:01.716760 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=555): Launched 05:54:02.033675 run osmo-stp_10.42.42.5(pid=556): Launched 05:54:02.233761 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:54:02.909995 run pcap-recorder_any(filters='host 10.42.42.6')(pid=558): Launched 05:54:03.031232 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:54:03.297502 run patchelf(pid=559): Launched 05:54:03.475543 run osmo-stp_10.42.42.5(pid=556): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=556)] 05:54:03.608899 run osmo-stp_10.42.42.5(pid=556): stdout: | (launched: 2022-12-10_05:54:01.977014) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:54:03.744574 run osmo-stp_10.42.42.5(pid=556): stderr: | 20221210055402341 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055402341 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055402341 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055402342 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055402342 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055402342 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055402342 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:54:03.879802 run osmo-stp_10.42.42.5(pid=556): stdout: | (launched: 2022-12-10_05:54:01.977014) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:54:04.008795 run osmo-stp_10.42.42.5(pid=556): stderr: | 20221210055402341 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055402341 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055402341 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055402342 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055402342 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055402342 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055402342 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:54:04.162447 run patchelf(pid=559): Terminating (SIGINT) 05:54:04.338828 run patchelf(pid=559): Terminated: ok {rc=0} 05:54:04.465650 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=556): Process ended prematurely: osmo-stp_10.42.42.5(pid=556) [trial-2370↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=556)] [trial-2370↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 05:54:04.475165 tst ping_idle_ping.py:27: Test FAILED (7.0 sec) 05:54:04.502904 run osmo-hlr_10.42.42.2(pid=553): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=553)] 05:54:04.552345 run osmo-hlr_10.42.42.2(pid=553): stdout: | (launched: 2022-12-10_05:54:00.797203) 05:54:04.603627 run osmo-hlr_10.42.42.2(pid=553): stderr: | 20221210055401076 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210055401076 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210055401076 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210055401076 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210055401076 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210055401077 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210055401092 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-b200+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210055401115 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210055401116 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210055401116 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:54:04.655148 run pcap-recorder_any(filters='host 10.42.42.2')(pid=552): Terminating (SIGTERM) 05:54:04.696422 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=555): Terminating (SIGTERM) 05:54:04.737975 run pcap-recorder_any(filters='host 10.42.42.6')(pid=558): Terminating (SIGTERM) 05:54:04.779450 --- ParallelTerminationStrategy: PID 552 died... 05:54:04.799248 run pcap-recorder_any(filters='host 10.42.42.2')(pid=552): Terminated: ok {rc=0} 05:54:04.845072 --- ParallelTerminationStrategy: PID 555 died... 05:54:04.864356 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=555): Terminated: ok {rc=0} 05:54:04.910326 --- ParallelTerminationStrategy: PID 558 died... 05:54:04.929729 run pcap-recorder_any(filters='host 10.42.42.6')(pid=558): Terminated: ok {rc=0} 05:54:05.015862 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2370 gprs:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 05:54:06.316080 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:54:06.324183 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 05:54:06.358661 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 05:54:06.398462 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 05:54:06.487613 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 05:54:06.522115 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 05:54:06.561672 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 05:54:07.166483 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2370 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 05:54:07.220075 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:54:07.231928 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 05:54:07.284280 tst cs_paging_gprs_active.py: using LAC 26302 05:54:07.408157 tst cs_paging_gprs_active.py: using RAC 37 05:54:07.526316 tst cs_paging_gprs_active.py: using CellId 26302 05:54:07.642795 tst cs_paging_gprs_active.py: using BVCI 26303 05:54:07.752357 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:54:07.763582 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:54:07.774732 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:54:07.786102 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:54:07.797423 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:54:07.808528 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:54:07.819987 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:54:07.831107 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:54:07.842514 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 05:54:07.957475 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 05:54:08.077587 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 05:54:08.279832 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:54:08.583736 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=563): Launched 05:54:08.847076 run iperf3-srv_10.42.42.10(pid=564): Launched 05:54:08.960708 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 05:54:09.161961 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:54:09.465809 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=565): Launched 05:54:09.728837 run iperf3-srv_10.42.42.10(pid=566): Launched 05:54:09.842721 tst cs_paging_gprs_active.py:38: start network... 05:54:10.043804 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:54:10.512657 run create_hlr_db(pid=567): Launched 05:54:10.636243 bus /gobi_6: Setting Powered False 05:54:11.696885 run create_hlr_db(pid=567): Terminated: ok {rc=0} 05:54:12.137936 run pcap-recorder_any(filters='host 10.42.42.2')(pid=569): Launched 05:54:12.463072 run osmo-hlr_10.42.42.2(pid=570): Launched 05:54:12.588055 run osmo-stp_10.42.42.5: Starting osmo-stp 05:54:13.146188 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=572): Launched 05:54:13.470030 run osmo-stp_10.42.42.5(pid=573): Launched 05:54:13.596358 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:54:14.153435 run pcap-recorder_any(filters='host 10.42.42.6')(pid=575): Launched 05:54:14.279024 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:54:14.551789 run patchelf(pid=576): Launched 05:54:14.731746 run osmo-stp_10.42.42.5(pid=573): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=573)] 05:54:14.868625 run osmo-stp_10.42.42.5(pid=573): stdout: | (launched: 2022-12-10_05:54:13.411170) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:54:15.007208 run osmo-stp_10.42.42.5(pid=573): stderr: | 20221210055413603 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055413603 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055413603 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055413603 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055413606 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055413606 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055413606 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:54:15.146220 run osmo-stp_10.42.42.5(pid=573): stdout: | (launched: 2022-12-10_05:54:13.411170) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:54:15.278407 run osmo-stp_10.42.42.5(pid=573): stderr: | 20221210055413603 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055413603 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055413603 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055413603 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055413606 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055413606 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055413606 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:54:15.435125 run patchelf(pid=576): Terminating (SIGINT) 05:54:15.615803 run patchelf(pid=576): Terminated: ok {rc=0} 05:54:15.746131 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=573): Process ended prematurely: osmo-stp_10.42.42.5(pid=573) [trial-2370↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=573)] [trial-2370↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 05:54:15.756488 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 05:54:15.785350 run osmo-hlr_10.42.42.2(pid=570): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=570)] 05:54:15.835575 run osmo-hlr_10.42.42.2(pid=570): stdout: | (launched: 2022-12-10_05:54:12.403980) 05:54:15.890968 run osmo-hlr_10.42.42.2(pid=570): stderr: | 20221210055412603 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210055412603 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210055412603 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210055412603 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210055412604 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210055412604 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210055412616 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210055412625 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210055412626 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210055412626 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:54:15.956377 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=563): Terminating (SIGTERM) 05:54:15.999677 run iperf3-srv_10.42.42.10(pid=564): Terminating (SIGTERM) 05:54:16.045302 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=565): Terminating (SIGTERM) 05:54:16.090571 run iperf3-srv_10.42.42.10(pid=566): Terminating (SIGTERM) 05:54:16.135206 run pcap-recorder_any(filters='host 10.42.42.2')(pid=569): Terminating (SIGTERM) 05:54:16.179896 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=572): Terminating (SIGTERM) 05:54:16.224695 run pcap-recorder_any(filters='host 10.42.42.6')(pid=575): Terminating (SIGTERM) 05:54:16.270340 --- ParallelTerminationStrategy: PID 563 died... 05:54:16.290787 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=563): Terminated: ok {rc=0} 05:54:16.341389 --- ParallelTerminationStrategy: PID 564 died... 05:54:16.361636 run iperf3-srv_10.42.42.10(pid=564): Terminated {rc=256} 05:54:16.410166 --- ParallelTerminationStrategy: PID 565 died... 05:54:16.430057 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=565): Terminated: ok {rc=0} 05:54:16.478007 --- ParallelTerminationStrategy: PID 566 died... 05:54:16.497919 run iperf3-srv_10.42.42.10(pid=566): Terminated {rc=256} 05:54:16.546883 --- ParallelTerminationStrategy: PID 569 died... 05:54:16.566976 run pcap-recorder_any(filters='host 10.42.42.2')(pid=569): Terminated: ok {rc=0} 05:54:16.615331 --- ParallelTerminationStrategy: PID 572 died... 05:54:16.635213 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=572): Terminated: ok {rc=0} 05:54:16.684171 --- ParallelTerminationStrategy: PID 575 died... 05:54:16.704334 run pcap-recorder_any(filters='host 10.42.42.6')(pid=575): Terminated: ok {rc=0} 05:54:16.795713 bus /gobi_0: Setting Powered False 05:54:17.894846 bus /gobi_0: Setting Powered False 05:54:19.011545 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 05:54:20.158354 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:54:20.170523 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 05:54:20.226434 tst iperf3.py: using LAC 26303 05:54:20.346086 tst iperf3.py: using RAC 38 05:54:20.473611 tst iperf3.py: using CellId 26303 05:54:20.600630 tst iperf3.py: using BVCI 26304 05:54:20.717568 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:54:20.729455 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:54:20.741090 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:54:20.752717 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:54:20.764182 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:54:20.775567 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:54:20.787175 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:54:20.798620 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:54:20.810197 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 05:54:20.923760 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 05:54:21.125822 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:54:21.427203 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=577): Launched 05:54:21.691764 run iperf3-srv_10.42.42.10(pid=578): Launched 05:54:21.805875 tst iperf3.py:8: start network... 05:54:22.007485 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:54:22.475177 run create_hlr_db(pid=579): Launched 05:54:22.591114 bus /gobi_6: Setting Powered False 05:54:23.650990 run create_hlr_db(pid=579): Terminated: ok {rc=0} 05:54:24.092145 run pcap-recorder_any(filters='host 10.42.42.2')(pid=581): Launched 05:54:24.415056 run osmo-hlr_10.42.42.2(pid=582): Launched 05:54:24.538910 run osmo-stp_10.42.42.5: Starting osmo-stp 05:54:25.095872 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=584): Launched 05:54:25.417722 run osmo-stp_10.42.42.5(pid=585): Launched 05:54:25.542789 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:54:26.099287 run pcap-recorder_any(filters='host 10.42.42.6')(pid=587): Launched 05:54:26.224901 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:54:26.496302 run patchelf(pid=588): Launched 05:54:26.676337 run osmo-stp_10.42.42.5(pid=585): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=585)] 05:54:26.812774 run osmo-stp_10.42.42.5(pid=585): stdout: | (launched: 2022-12-10_05:54:25.359221) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:54:26.950401 run osmo-stp_10.42.42.5(pid=585): stderr: | 20221210055425553 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055425553 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055425554 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055425554 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055425555 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055425555 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055425555 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:54:27.088129 run osmo-stp_10.42.42.5(pid=585): stdout: | (launched: 2022-12-10_05:54:25.359221) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:54:27.220155 run osmo-stp_10.42.42.5(pid=585): stderr: | 20221210055425553 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055425553 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055425554 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055425554 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055425555 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055425555 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055425555 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:54:27.376477 run patchelf(pid=588): Terminating (SIGINT) 05:54:27.556913 run patchelf(pid=588): Terminated: ok {rc=0} 05:54:27.687751 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=585): Process ended prematurely: osmo-stp_10.42.42.5(pid=585) [trial-2370↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=585)] [trial-2370↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 05:54:27.698233 tst iperf3.py:8: Test FAILED (7.6 sec) 05:54:27.727100 run osmo-hlr_10.42.42.2(pid=582): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=582)] 05:54:27.777185 run osmo-hlr_10.42.42.2(pid=582): stdout: | (launched: 2022-12-10_05:54:24.356242) 05:54:27.829184 run osmo-hlr_10.42.42.2(pid=582): stderr: | 20221210055424556 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210055424556 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210055424556 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210055424556 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210055424556 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210055424556 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210055424568 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210055424576 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210055424576 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210055424576 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:54:27.881487 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=577): Terminating (SIGTERM) 05:54:27.923437 run iperf3-srv_10.42.42.10(pid=578): Terminating (SIGTERM) 05:54:27.965465 run pcap-recorder_any(filters='host 10.42.42.2')(pid=581): Terminating (SIGTERM) 05:54:28.007559 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=584): Terminating (SIGTERM) 05:54:28.049670 run pcap-recorder_any(filters='host 10.42.42.6')(pid=587): Terminating (SIGTERM) 05:54:28.092270 --- ParallelTerminationStrategy: PID 577 died... 05:54:28.112258 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=577): Terminated: ok {rc=0} 05:54:28.159150 --- ParallelTerminationStrategy: PID 578 died... 05:54:28.178906 run iperf3-srv_10.42.42.10(pid=578): Terminated {rc=256} 05:54:28.225128 --- ParallelTerminationStrategy: PID 581 died... 05:54:28.244717 run pcap-recorder_any(filters='host 10.42.42.2')(pid=581): Terminated: ok {rc=0} 05:54:28.291179 --- ParallelTerminationStrategy: PID 584 died... 05:54:28.310923 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=584): Terminated: ok {rc=0} 05:54:28.357295 --- ParallelTerminationStrategy: PID 587 died... 05:54:28.376789 run pcap-recorder_any(filters='host 10.42.42.6')(pid=587): Terminated: ok {rc=0} 05:54:28.464813 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 05:54:29.618834 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:54:29.631561 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 05:54:29.685296 tst iperf3m4.py: using LAC 26304 05:54:29.811289 tst iperf3m4.py: using RAC 39 05:54:29.937403 tst iperf3m4.py: using CellId 26304 05:54:30.062638 tst iperf3m4.py: using BVCI 26305 05:54:30.180108 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:54:30.192019 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:54:30.203784 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:54:30.215505 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:54:30.227224 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:54:30.238887 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:54:30.250639 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:54:30.262251 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:54:30.274073 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 05:54:30.394308 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 05:54:30.513957 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 05:54:30.630917 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 05:54:30.748315 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 05:54:30.978668 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:54:31.301984 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=589): Launched 05:54:31.574082 run iperf3-srv_10.42.42.10(pid=590): Launched 05:54:31.705275 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 05:54:31.912047 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:54:32.222526 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=591): Launched 05:54:32.485140 run iperf3-srv_10.42.42.10(pid=592): Launched 05:54:32.598863 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 05:54:32.799962 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:54:33.103320 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=593): Launched 05:54:33.367658 run iperf3-srv_10.42.42.10(pid=594): Launched 05:54:33.481238 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 05:54:33.682854 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:54:33.985945 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=595): Launched 05:54:34.248788 run iperf3-srv_10.42.42.10(pid=596): Launched 05:54:34.362346 tst iperf3m4.py:8: start network... 05:54:34.563378 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:54:35.029309 run create_hlr_db(pid=597): Launched 05:54:35.146335 bus /gobi_6: Setting Powered False 05:54:36.206525 run create_hlr_db(pid=597): Terminated: ok {rc=0} 05:54:36.646645 run pcap-recorder_any(filters='host 10.42.42.2')(pid=599): Launched 05:54:36.968463 run osmo-hlr_10.42.42.2(pid=600): Launched 05:54:37.093858 run osmo-stp_10.42.42.5: Starting osmo-stp 05:54:37.657686 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=602): Launched 05:54:37.979824 run osmo-stp_10.42.42.5(pid=603): Launched 05:54:38.102485 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:54:38.656933 run pcap-recorder_any(filters='host 10.42.42.6')(pid=605): Launched 05:54:38.781135 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:54:39.053188 run patchelf(pid=606): Launched 05:54:39.233192 run osmo-stp_10.42.42.5(pid=603): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=603)] 05:54:39.369200 run osmo-stp_10.42.42.5(pid=603): stdout: | (launched: 2022-12-10_05:54:37.920766) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:54:39.506135 run osmo-stp_10.42.42.5(pid=603): stderr: | 20221210055438113 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055438113 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055438114 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055438114 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055438116 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055438117 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055438117 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:54:39.642921 run osmo-stp_10.42.42.5(pid=603): stdout: | (launched: 2022-12-10_05:54:37.920766) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:54:39.775299 run osmo-stp_10.42.42.5(pid=603): stderr: | 20221210055438113 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055438113 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055438114 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055438114 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055438116 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055438117 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055438117 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:54:39.931042 run patchelf(pid=606): Terminating (SIGINT) 05:54:40.111632 run patchelf(pid=606): Terminated: ok {rc=0} 05:54:40.241367 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=603): Process ended prematurely: osmo-stp_10.42.42.5(pid=603) [trial-2370↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=603)] [trial-2370↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 05:54:40.252105 tst iperf3m4.py:8: Test FAILED (10.7 sec) 05:54:40.281120 run osmo-hlr_10.42.42.2(pid=600): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=600)] 05:54:40.331021 run osmo-hlr_10.42.42.2(pid=600): stdout: | (launched: 2022-12-10_05:54:36.909780) 05:54:40.382544 run osmo-hlr_10.42.42.2(pid=600): stderr: | 20221210055437106 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210055437106 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210055437106 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210055437106 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210055437107 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210055437107 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210055437120 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210055437130 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210055437130 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210055437130 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:54:40.434451 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=589): Terminating (SIGTERM) 05:54:40.476085 run iperf3-srv_10.42.42.10(pid=590): Terminating (SIGTERM) 05:54:40.517527 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=591): Terminating (SIGTERM) 05:54:40.558969 run iperf3-srv_10.42.42.10(pid=592): Terminating (SIGTERM) 05:54:40.600393 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=593): Terminating (SIGTERM) 05:54:40.642007 run iperf3-srv_10.42.42.10(pid=594): Terminating (SIGTERM) 05:54:40.683347 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=595): Terminating (SIGTERM) 05:54:40.724914 run iperf3-srv_10.42.42.10(pid=596): Terminating (SIGTERM) 05:54:40.766546 run pcap-recorder_any(filters='host 10.42.42.2')(pid=599): Terminating (SIGTERM) 05:54:40.807982 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=602): Terminating (SIGTERM) 05:54:40.849491 run pcap-recorder_any(filters='host 10.42.42.6')(pid=605): Terminating (SIGTERM) 05:54:40.891233 --- ParallelTerminationStrategy: PID 589 died... 05:54:40.911076 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=589): Terminated: ok {rc=0} 05:54:40.957157 --- ParallelTerminationStrategy: PID 590 died... 05:54:40.976497 run iperf3-srv_10.42.42.10(pid=590): Terminated {rc=256} 05:54:41.022333 --- ParallelTerminationStrategy: PID 591 died... 05:54:41.041753 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=591): Terminated: ok {rc=0} 05:54:41.087915 --- ParallelTerminationStrategy: PID 592 died... 05:54:41.107451 run iperf3-srv_10.42.42.10(pid=592): Terminated {rc=256} 05:54:41.153367 --- ParallelTerminationStrategy: PID 593 died... 05:54:41.172915 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=593): Terminated: ok {rc=0} 05:54:41.218821 --- ParallelTerminationStrategy: PID 594 died... 05:54:41.238452 run iperf3-srv_10.42.42.10(pid=594): Terminated {rc=256} 05:54:41.283963 --- ParallelTerminationStrategy: PID 595 died... 05:54:41.303509 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=595): Terminated: ok {rc=0} 05:54:41.349302 --- ParallelTerminationStrategy: PID 596 died... 05:54:41.368700 run iperf3-srv_10.42.42.10(pid=596): Terminated {rc=256} 05:54:41.414306 --- ParallelTerminationStrategy: PID 599 died... 05:54:41.433871 run pcap-recorder_any(filters='host 10.42.42.2')(pid=599): Terminated: ok {rc=0} 05:54:41.479399 --- ParallelTerminationStrategy: PID 602 died... 05:54:41.498891 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=602): Terminated: ok {rc=0} 05:54:41.544362 --- ParallelTerminationStrategy: PID 605 died... 05:54:41.563959 run pcap-recorder_any(filters='host 10.42.42.6')(pid=605): Terminated: ok {rc=0} 05:54:41.651033 bus /gobi_4: Setting Powered False 05:54:42.750716 bus /gobi_4: Setting Powered False 05:54:43.865563 bus /gobi_1: Setting Powered False 05:54:44.963363 bus /gobi_1: Setting Powered False 05:54:46.080668 bus /gobi_0: Setting Powered False 05:54:47.182645 bus /gobi_0: Setting Powered False 05:54:48.302052 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 05:54:49.404560 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:54:49.416726 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 05:54:49.469582 tst ping.py: using LAC 26305 05:54:49.593464 tst ping.py: using RAC 40 05:54:49.716403 tst ping.py: using CellId 26305 05:54:49.835308 tst ping.py: using BVCI 26306 05:54:49.943067 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:54:49.954494 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:54:49.965559 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:54:49.977587 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:54:49.989173 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:54:50.000898 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:54:50.012811 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:54:50.024914 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 05:54:50.146519 tst ping.py:19: start network... 05:54:50.359973 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:54:50.847144 run create_hlr_db(pid=607): Launched 05:54:50.975908 bus /gobi_6: Setting Powered False 05:54:52.038813 run create_hlr_db(pid=607): Terminated: ok {rc=0} 05:54:52.478935 run pcap-recorder_any(filters='host 10.42.42.2')(pid=609): Launched 05:54:52.794126 run osmo-hlr_10.42.42.2(pid=610): Launched 05:54:52.916168 run osmo-stp_10.42.42.5: Starting osmo-stp 05:54:53.461106 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=612): Launched 05:54:53.777815 run osmo-stp_10.42.42.5(pid=613): Launched 05:54:53.898298 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:54:54.443060 run pcap-recorder_any(filters='host 10.42.42.6')(pid=615): Launched 05:54:54.565309 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:54:54.832406 run patchelf(pid=616): Launched 05:54:55.008736 run osmo-stp_10.42.42.5(pid=613): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=613)] 05:54:55.143353 run osmo-stp_10.42.42.5(pid=613): stdout: | (launched: 2022-12-10_05:54:53.719780) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:54:55.279196 run osmo-stp_10.42.42.5(pid=613): stderr: | 20221210055453912 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055453913 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055453913 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055453913 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055453914 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055453914 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055453914 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:54:55.415109 run osmo-stp_10.42.42.5(pid=613): stdout: | (launched: 2022-12-10_05:54:53.719780) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:54:55.544659 run osmo-stp_10.42.42.5(pid=613): stderr: | 20221210055453912 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055453913 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055453913 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055453913 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055453914 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055453914 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055453914 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:54:55.698411 run patchelf(pid=616): Terminating (SIGINT) 05:54:55.875601 run patchelf(pid=616): Terminated: ok {rc=0} 05:54:56.002989 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=613): Process ended prematurely: osmo-stp_10.42.42.5(pid=613) [trial-2370↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=613)] [trial-2370↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 05:54:56.012865 tst ping.py:22: Test FAILED (6.6 sec) 05:54:56.041418 run osmo-hlr_10.42.42.2(pid=610): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=610)] 05:54:56.091628 run osmo-hlr_10.42.42.2(pid=610): stdout: | (launched: 2022-12-10_05:54:52.736571) 05:54:56.143306 run osmo-hlr_10.42.42.2(pid=610): stderr: | 20221210055452933 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210055452933 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210055452934 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210055452934 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210055452934 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210055452934 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210055452973 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210055452983 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210055452983 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210055452983 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:54:56.195304 run pcap-recorder_any(filters='host 10.42.42.2')(pid=609): Terminating (SIGTERM) 05:54:56.236654 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=612): Terminating (SIGTERM) 05:54:56.278267 run pcap-recorder_any(filters='host 10.42.42.6')(pid=615): Terminating (SIGTERM) 05:54:56.319963 --- ParallelTerminationStrategy: PID 609 died... 05:54:56.339945 run pcap-recorder_any(filters='host 10.42.42.2')(pid=609): Terminated: ok {rc=0} 05:54:56.386017 --- ParallelTerminationStrategy: PID 612 died... 05:54:56.405624 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=612): Terminated: ok {rc=0} 05:54:56.452245 --- ParallelTerminationStrategy: PID 615 died... 05:54:56.471996 run pcap-recorder_any(filters='host 10.42.42.6')(pid=615): Terminated: ok {rc=0} 05:54:56.560118 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 05:54:57.647798 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:54:57.660090 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 05:54:57.715882 tst ping_idle_ping.py: using LAC 26306 05:54:57.841346 tst ping_idle_ping.py: using RAC 41 05:54:57.965390 tst ping_idle_ping.py: using CellId 26306 05:54:58.090378 tst ping_idle_ping.py: using BVCI 26307 05:54:58.206873 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:54:58.218733 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:54:58.230520 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:54:58.242747 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:54:58.254906 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:54:58.266944 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:54:58.279101 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:54:58.291198 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 05:54:58.408802 tst ping_idle_ping.py:24: start network... 05:54:58.608175 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:54:59.069522 run create_hlr_db(pid=617): Launched 05:54:59.184024 bus /gobi_6: Setting Powered False 05:55:00.244095 run create_hlr_db(pid=617): Terminated: ok {rc=0} 05:55:00.680195 run pcap-recorder_any(filters='host 10.42.42.2')(pid=619): Launched 05:55:01.026471 run osmo-hlr_10.42.42.2(pid=620): Launched 05:55:01.328450 run osmo-stp_10.42.42.5: Starting osmo-stp 05:55:01.987366 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=625): Launched 05:55:02.323058 run osmo-stp_10.42.42.5(pid=627): Launched 05:55:02.615577 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:55:03.156643 run pcap-recorder_any(filters='host 10.42.42.6')(pid=635): Launched 05:55:03.277642 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:55:03.545042 run patchelf(pid=636): Launched 05:55:03.721697 run osmo-stp_10.42.42.5(pid=627): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=627)] 05:55:03.856067 run osmo-stp_10.42.42.5(pid=627): stdout: | (launched: 2022-12-10_05:55:02.262013) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:55:03.992056 run osmo-stp_10.42.42.5(pid=627): stderr: | 20221210055502488 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055502488 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055502488 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055502489 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055502489 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055502489 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055502489 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:55:04.128383 run osmo-stp_10.42.42.5(pid=627): stdout: | (launched: 2022-12-10_05:55:02.262013) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:55:04.258299 run osmo-stp_10.42.42.5(pid=627): stderr: | 20221210055502488 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055502488 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055502488 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055502489 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055502489 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055502489 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055502489 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:55:04.412065 run patchelf(pid=636): Terminating (SIGINT) 05:55:04.589214 run patchelf(pid=636): Terminated: ok {rc=0} 05:55:04.716813 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=627): Process ended prematurely: osmo-stp_10.42.42.5(pid=627) [trial-2370↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=627)] [trial-2370↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 05:55:04.726625 tst ping_idle_ping.py:27: Test FAILED (7.1 sec) 05:55:04.754634 run osmo-hlr_10.42.42.2(pid=620): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=620)] 05:55:04.804092 run osmo-hlr_10.42.42.2(pid=620): stdout: | (launched: 2022-12-10_05:55:00.968237) 05:55:04.855569 run osmo-hlr_10.42.42.2(pid=620): stderr: | 20221210055501285 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210055501285 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210055501285 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210055501286 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210055501286 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210055501286 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210055501301 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210055501316 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210055501316 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210055501319 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:55:04.907137 run pcap-recorder_any(filters='host 10.42.42.2')(pid=619): Terminating (SIGTERM) 05:55:04.948323 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=625): Terminating (SIGTERM) 05:55:04.989879 run pcap-recorder_any(filters='host 10.42.42.6')(pid=635): Terminating (SIGTERM) 05:55:05.031495 --- ParallelTerminationStrategy: PID 619 died... 05:55:05.051275 run pcap-recorder_any(filters='host 10.42.42.2')(pid=619): Terminated: ok {rc=0} 05:55:05.097339 --- ParallelTerminationStrategy: PID 625 died... 05:55:05.116628 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=625): Terminated: ok {rc=0} 05:55:05.162288 --- ParallelTerminationStrategy: PID 635 died... 05:55:05.181704 run pcap-recorder_any(filters='host 10.42.42.6')(pid=635): Terminated: ok {rc=0} 05:55:05.268663 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2370 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 05:55:06.574604 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:55:06.581356 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 05:55:06.615750 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 05:55:06.650323 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 05:55:06.701111 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 05:55:06.734293 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 05:55:06.769331 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 05:55:07.327495 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2370 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 05:55:07.332833 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 05:55:07.344533 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 05:55:07.412850 tst switch_tch_pdch.py: using LAC 26307 05:55:07.527318 tst switch_tch_pdch.py: using RAC 42 05:55:07.641101 tst switch_tch_pdch.py: using CellId 26307 05:55:07.758439 tst switch_tch_pdch.py: using BVCI 26308 05:55:07.866641 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 05:55:07.878043 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 05:55:07.889488 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 05:55:07.901399 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 05:55:07.913284 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 05:55:07.925289 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 05:55:07.937470 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 05:55:07.948842 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 05:55:08.068850 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 05:55:08.188407 tst switch_tch_pdch.py:51: start network... 05:55:08.401559 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:55:08.889865 run create_hlr_db(pid=640): Launched 05:55:09.019508 bus /gobi_6: Setting Powered False 05:55:10.081842 run create_hlr_db(pid=640): Terminated: ok {rc=0} 05:55:10.505606 run pcap-recorder_any(filters='host 10.42.42.2')(pid=642): Launched 05:55:10.800855 run osmo-hlr_10.42.42.2(pid=643): Launched 05:55:10.912757 run osmo-stp_10.42.42.5: Starting osmo-stp 05:55:11.421707 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=645): Launched 05:55:11.716310 run osmo-stp_10.42.42.5(pid=646): Launched 05:55:11.828691 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:55:12.335982 run pcap-recorder_any(filters='host 10.42.42.6')(pid=648): Launched 05:55:12.449110 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:55:12.696919 run patchelf(pid=649): Launched 05:55:12.863656 run osmo-stp_10.42.42.5(pid=646): ERR: Terminated: ERROR {rc=1} [trial-2370↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=646)] 05:55:12.992408 run osmo-stp_10.42.42.5(pid=646): stdout: | (launched: 2022-12-10_05:55:11.661976) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:55:13.124853 run osmo-stp_10.42.42.5(pid=646): stderr: | 20221210055511830 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055511830 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055511830 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055511831 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055511833 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055511833 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055511833 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:55:13.256282 run osmo-stp_10.42.42.5(pid=646): stdout: | (launched: 2022-12-10_05:55:11.661976) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:55:13.388092 run osmo-stp_10.42.42.5(pid=646): stderr: | 20221210055511830 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055511830 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055511830 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055511831 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055511833 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055511833 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055511833 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:55:13.546629 run patchelf(pid=649): Terminating (SIGINT) 05:55:13.729360 run patchelf(pid=649): Terminated: ok {rc=0} 05:55:13.859211 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=646): Process ended prematurely: osmo-stp_10.42.42.5(pid=646) [trial-2370↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=646)] [trial-2370↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 05:55:13.869712 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 05:55:13.899606 run osmo-hlr_10.42.42.2(pid=643): ERR: Terminated: ERROR {rc=237} [trial-2370↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=643)] 05:55:13.953379 run osmo-hlr_10.42.42.2(pid=643): stdout: | (launched: 2022-12-10_05:55:10.746796) 05:55:14.006329 run osmo-hlr_10.42.42.2(pid=643): stderr: | 20221210055510924 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210055510924 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210055510924 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210055510924 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210055510924 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210055510924 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210055510936 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210055510944 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210055510944 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210055510944 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:55:14.061505 run pcap-recorder_any(filters='host 10.42.42.2')(pid=642): Terminating (SIGTERM) 05:55:14.105245 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=645): Terminating (SIGTERM) 05:55:14.151628 run pcap-recorder_any(filters='host 10.42.42.6')(pid=648): Terminating (SIGTERM) 05:55:14.196897 --- ParallelTerminationStrategy: PID 642 died... 05:55:14.217883 run pcap-recorder_any(filters='host 10.42.42.2')(pid=642): Terminated: ok {rc=0} 05:55:14.267031 --- ParallelTerminationStrategy: PID 645 died... 05:55:14.289607 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=645): Terminated: ok {rc=0} 05:55:14.337094 --- ParallelTerminationStrategy: PID 648 died... 05:55:14.356805 run pcap-recorder_any(filters='host 10.42.42.6')(pid=648): Terminated: ok {rc=0} 05:55:14.443483 bus /gobi_0: Setting Powered False 05:55:15.541789 bus /gobi_0: Setting Powered False 05:55:16.656728 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2370 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 dynts:trx-b200+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 05:55:17.930165 tst dynts:trx-b200+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:55:17.937339 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 05:55:17.970833 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 05:55:18.005227 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 05:55:18.062720 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 05:55:18.095807 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 05:55:18.130014 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 05:55:18.678812 tst dynts:trx-b200+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2370 dynts:trx-b200+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 05:55:18.683761 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 05:55:18.694789 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 05:55:18.767922 tst switch_tch_pdch.py: using LAC 26308 05:55:18.886909 tst switch_tch_pdch.py: using RAC 43 05:55:19.003410 tst switch_tch_pdch.py: using CellId 26308 05:55:19.117743 tst switch_tch_pdch.py: using BVCI 26309 05:55:19.227171 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 05:55:19.238160 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 05:55:19.248903 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 05:55:19.259874 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 05:55:19.270767 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 05:55:19.281771 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 05:55:19.292817 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 05:55:19.303764 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 05:55:19.418798 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 05:55:19.533559 tst switch_tch_pdch.py:51: start network... 05:55:19.745666 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:55:20.207781 run create_hlr_db(pid=1034): Launched 05:55:20.337210 bus /gobi_6: Setting Powered False 05:55:21.399738 run create_hlr_db(pid=1034): Terminated: ok {rc=0} 05:55:21.811417 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1036): Launched 05:55:22.128260 run osmo-hlr_10.42.42.2(pid=1037): Launched 05:55:22.248014 run osmo-stp_10.42.42.5: Starting osmo-stp 05:55:22.766049 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1039): Launched 05:55:23.082545 run osmo-stp_10.42.42.5(pid=1040): Launched 05:55:23.203999 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:55:23.765803 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1070): Launched 05:55:23.893610 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:55:24.153646 run patchelf(pid=1160): Launched 05:55:24.328013 run osmo-stp_10.42.42.5(pid=1040): ERR: Terminated: ERROR {rc=1} [trial-2370↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1040)] 05:55:24.461442 run osmo-stp_10.42.42.5(pid=1040): stdout: | (launched: 2022-12-10_05:55:23.024882) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:55:24.592794 run osmo-stp_10.42.42.5(pid=1040): stderr: | 20221210055523217 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055523217 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055523217 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055523218 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055523218 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055523218 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055523218 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:55:24.724483 run osmo-stp_10.42.42.5(pid=1040): stdout: | (launched: 2022-12-10_05:55:23.024882) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:55:24.848094 run osmo-stp_10.42.42.5(pid=1040): stderr: | 20221210055523217 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055523217 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055523217 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055523218 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055523218 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055523218 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055523218 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:55:24.995785 run patchelf(pid=1160): Terminating (SIGINT) 05:55:25.167132 run patchelf(pid=1160): Terminated: ok {rc=0} 05:55:25.289109 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=1040): Process ended prematurely: osmo-stp_10.42.42.5(pid=1040) [trial-2370↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1040)] [trial-2370↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 05:55:25.299200 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 05:55:25.330511 run osmo-hlr_10.42.42.2(pid=1037): ERR: Terminated: ERROR {rc=237} [trial-2370↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1037)] 05:55:25.381175 run osmo-hlr_10.42.42.2(pid=1037): stdout: | (launched: 2022-12-10_05:55:22.069945) 05:55:25.432721 run osmo-hlr_10.42.42.2(pid=1037): stderr: | 20221210055522266 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210055522266 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210055522266 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210055522266 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210055522266 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210055522266 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210055522278 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/dynts:trx-b200+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210055522287 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210055522287 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210055522287 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:55:25.485228 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1036): Terminating (SIGTERM) 05:55:25.528896 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1039): Terminating (SIGTERM) 05:55:25.572845 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1070): Terminating (SIGTERM) 05:55:25.617935 --- ParallelTerminationStrategy: PID 1036 died... 05:55:25.637373 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1036): Terminated: ok {rc=0} 05:55:25.686555 --- ParallelTerminationStrategy: PID 1039 died... 05:55:25.706279 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1039): Terminated: ok {rc=0} 05:55:25.754454 --- ParallelTerminationStrategy: PID 1070 died... 05:55:25.774178 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1070): Terminated: ok {rc=0} 05:55:25.863049 bus /gobi_0: Setting Powered False 05:55:26.963960 bus /gobi_0: Setting Powered False 05:55:28.080014 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2370 dynts:trx-b200+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 nitb_sms:trx-sysmocell5000 --------------------------------------------------------------------- 05:55:29.333358 tst nitb_sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:55:29.337250 tst nitb_sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 05:55:29.370564 tst nitb_sms:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 05:55:29.377236 tst nitb_sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 05:55:29.430181 tst nitb_sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 05:55:29.464245 tst nitb_sms:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 05:55:29.470851 tst nitb_sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 05:55:30.007458 tst nitb_sms:trx-sysmocell5000: RESERVED RESOURCES for nitb_sms: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 nitb_sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 05:55:30.012279 tst nitb_sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 05:55:30.023107 tst nitb_sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 05:55:30.070407 tst mo_mt_sms.py: using LAC 26309 05:55:30.186749 tst mo_mt_sms.py: using RAC 44 05:55:30.302432 tst mo_mt_sms.py: using CellId 26309 05:55:30.420073 tst mo_mt_sms.py: using BVCI 26310 05:55:30.527361 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 05:55:30.643364 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 05:55:30.759314 tst mo_mt_sms.py:9: start nitb and bts... 05:55:30.976391 run osmo-nitb_10.42.42.2: Starting osmo-nitb 05:55:31.595561 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1240): Launched 05:55:31.913947 run osmo-nitb_10.42.42.2(pid=1241): Launched 05:55:32.103909 run osmo-nitb_10.42.42.2(pid=1241): ERR: Terminated: ERROR {rc=2} [trial-2370↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1241)] 05:55:32.248695 run osmo-nitb_10.42.42.2(pid=1241): stdout: | (launched: 2022-12-10_05:55:31.855843) 05:55:32.392303 run osmo-nitb_10.42.42.2(pid=1241): stderr: | (launched: 2022-12-10_05:55:31.901388) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 05:55:32.535631 run osmo-nitb_10.42.42.2(pid=1241): stdout: | (launched: 2022-12-10_05:55:31.855843) 05:55:32.672353 run osmo-nitb_10.42.42.2(pid=1241): stderr: | (launched: 2022-12-10_05:55:31.901388) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=1241): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1241) [trial-2370↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1241)] 05:55:33.048271 tst osmo-nitb_10.42.42.2(pid=1241): stdout: | (launched: 2022-12-10_05:55:31.855843) 05:55:33.176082 tst osmo-nitb_10.42.42.2(pid=1241): stderr: | (launched: 2022-12-10_05:55:31.901388) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 05:55:33.326495 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=1241): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1241) [trial-2370↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1241)] [trial-2370↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11] 05:55:33.335640 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 05:55:33.342843 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1240): Terminating (SIGTERM) 05:55:33.552873 --- ParallelTerminationStrategy: PID 1240 died... 05:55:33.573989 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1240): Terminated: ok {rc=0} 05:55:33.662550 bus /sierra_3: Setting Powered False 05:55:34.764447 bus /sierra_3: Setting Powered False 05:55:35.882019 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 nitb_sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 sms:trx-sysmocell5000 --------------------------------------------------------------------- 05:55:37.080394 tst sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:55:37.084736 tst sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 05:55:37.119592 tst sms:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 05:55:37.146914 tst sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 05:55:37.199030 tst sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 05:55:37.232834 tst sms:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 05:55:37.259313 tst sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 05:55:37.806546 tst sms:trx-sysmocell5000: RESERVED RESOURCES for sms: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 05:55:37.811462 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 05:55:37.822139 tst sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 05:55:37.870225 tst mo_mt_sms.py: using LAC 26310 05:55:37.986489 tst mo_mt_sms.py: using RAC 45 05:55:38.102378 tst mo_mt_sms.py: using CellId 26310 05:55:38.216603 tst mo_mt_sms.py: using BVCI 26311 05:55:38.323609 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 05:55:38.334379 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 05:55:38.345019 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 05:55:38.355753 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 05:55:38.366437 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 05:55:38.377095 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 05:55:38.495529 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 05:55:38.616183 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:55:39.106291 run create_hlr_db(pid=1245): Launched 05:55:39.236418 bus /sierra_2: Setting Powered False 05:55:40.299542 run create_hlr_db(pid=1245): Terminated: ok {rc=0} 05:55:40.724489 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1247): Launched 05:55:41.041760 run osmo-hlr_10.42.42.2(pid=1248): Launched 05:55:41.162625 run osmo-stp_10.42.42.5: Starting osmo-stp 05:55:41.709496 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1250): Launched 05:55:42.024760 run osmo-stp_10.42.42.5(pid=1251): Launched 05:55:42.145136 run osmo-msc_10.42.42.6: Starting osmo-msc 05:55:42.717946 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1253): Launched 05:55:43.032277 run osmo-msc_10.42.42.6(pid=1254): Launched 05:55:43.209819 run osmo-stp_10.42.42.5(pid=1251): ERR: Terminated: ERROR {rc=1} [trial-2370↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1251)] 05:55:43.343120 run osmo-stp_10.42.42.5(pid=1251): stdout: | (launched: 2022-12-10_05:55:41.967145) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:55:43.476818 run osmo-stp_10.42.42.5(pid=1251): stderr: | 20221210055542158 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055542158 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055542159 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055542159 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055542159 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055542159 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055542160 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:55:43.609888 run osmo-stp_10.42.42.5(pid=1251): stdout: | (launched: 2022-12-10_05:55:41.967145) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:55:43.735678 run osmo-stp_10.42.42.5(pid=1251): stderr: | 20221210055542158 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055542158 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055542159 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055542159 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055542159 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055542159 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055542160 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:55:43.886307 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=1251): Process ended prematurely: osmo-stp_10.42.42.5(pid=1251) [trial-2370↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1251)] [trial-2370↪sms:trx-sysmocell5000↪mo_mt_sms.py:16] 05:55:43.895485 tst mo_mt_sms.py:16: Test FAILED (6.1 sec) 05:55:43.922945 run osmo-hlr_10.42.42.2(pid=1248): ERR: Terminated: ERROR {rc=237} [trial-2370↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1248)] 05:55:43.973247 run osmo-hlr_10.42.42.2(pid=1248): stdout: | (launched: 2022-12-10_05:55:40.984304) 05:55:44.025248 run osmo-hlr_10.42.42.2(pid=1248): stderr: | 20221210055541182 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210055541182 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210055541182 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210055541182 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210055541182 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210055541182 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210055541196 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/sms:trx-sysmocell5000/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210055541204 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210055541204 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210055541204 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:55:44.097490 run osmo-msc_10.42.42.6(pid=1254): ERR: Terminated: ERROR {rc=2} [trial-2370↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1254)] 05:55:44.147947 run osmo-msc_10.42.42.6(pid=1254): stdout: | (launched: 2022-12-10_05:55:42.974735) 05:55:44.200058 run osmo-msc_10.42.42.6(pid=1254): stderr: | 20221210055543297 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210055543297 DLGLOBAL DEBUG validating counter group 0x7f6b52c06c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210055543297 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210055543297 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210055543297 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210055543298 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210055543299 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210055543300 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210055543300 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210055543300 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:55:44.252112 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1247): Terminating (SIGTERM) 05:55:44.293866 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1250): Terminating (SIGTERM) 05:55:44.335539 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1253): Terminating (SIGTERM) 05:55:44.377778 --- ParallelTerminationStrategy: PID 1247 died... 05:55:44.397822 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1247): Terminated: ok {rc=0} 05:55:44.444084 --- ParallelTerminationStrategy: PID 1250 died... 05:55:44.463816 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1250): Terminated: ok {rc=0} 05:55:44.509793 --- ParallelTerminationStrategy: PID 1253 died... 05:55:44.529500 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1253): Terminated: ok {rc=0} 05:55:44.617101 bus /sierra_3: Setting Powered False 05:55:45.716699 bus /sierra_3: Setting Powered False 05:55:46.850420 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 nitb_ussd:trx-sysmocell5000 --------------------------------------------------------------------- 05:55:48.081147 tst nitb_ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:55:48.084895 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 05:55:48.119408 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 05:55:48.126853 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 05:55:48.161776 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 05:55:48.195898 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 05:55:48.202936 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 05:55:48.721808 tst nitb_ussd:trx-sysmocell5000: RESERVED RESOURCES for nitb_ussd: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2370 nitb_ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 05:55:48.726893 tst nitb_ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 05:55:48.737866 tst nitb_ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 05:55:48.787246 tst assert_extension.py: using LAC 26311 05:55:48.905570 tst assert_extension.py: using RAC 46 05:55:49.030632 tst assert_extension.py: using CellId 26311 05:55:49.156734 tst assert_extension.py: using BVCI 26312 05:55:49.272429 tst nitb_ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 05:55:49.386579 tst assert_extension.py:10: start nitb and bts... 05:55:49.599977 run osmo-nitb_10.42.42.2: Starting osmo-nitb 05:55:50.246482 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1259): Launched 05:55:50.564842 run osmo-nitb_10.42.42.2(pid=1260): Launched 05:55:50.741800 run osmo-nitb_10.42.42.2(pid=1260): ERR: Terminated: ERROR {rc=2} [trial-2370↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1260)] 05:55:50.883954 run osmo-nitb_10.42.42.2(pid=1260): stdout: | (launched: 2022-12-10_05:55:50.507092) 05:55:51.028406 run osmo-nitb_10.42.42.2(pid=1260): stderr: | (launched: 2022-12-10_05:55:50.554083) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 05:55:51.172869 run osmo-nitb_10.42.42.2(pid=1260): stdout: | (launched: 2022-12-10_05:55:50.507092) 05:55:51.311498 run osmo-nitb_10.42.42.2(pid=1260): stderr: | (launched: 2022-12-10_05:55:50.554083) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=1260): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1260) [trial-2370↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1260)] 05:55:51.685877 tst osmo-nitb_10.42.42.2(pid=1260): stdout: | (launched: 2022-12-10_05:55:50.507092) 05:55:51.814930 tst osmo-nitb_10.42.42.2(pid=1260): stderr: | (launched: 2022-12-10_05:55:50.554083) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 05:55:51.966142 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=1260): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1260) [trial-2370↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1260)] [trial-2370↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12] 05:55:51.975207 tst assert_extension.py:12: Test FAILED (3.2 sec) 05:55:51.982403 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1259): Terminating (SIGTERM) 05:55:52.192749 --- ParallelTerminationStrategy: PID 1259 died... 05:55:52.214134 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1259): Terminated: ok {rc=0} 05:55:52.302145 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 nitb_ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 ussd:trx-sysmocell5000 --------------------------------------------------------------------- 05:55:53.478279 tst ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:55:53.483073 tst ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 05:55:53.517561 tst ussd:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 05:55:53.544581 tst ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 05:55:53.581804 tst ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 05:55:53.615491 tst ussd:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 05:55:53.641927 tst ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 05:55:54.176589 tst ussd:trx-sysmocell5000: RESERVED RESOURCES for ussd: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2370 ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 05:55:54.182015 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 05:55:54.193460 tst ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 05:55:54.242851 tst assert_extension.py: using LAC 26312 05:55:54.368762 tst assert_extension.py: using RAC 47 05:55:54.492345 tst assert_extension.py: using CellId 26312 05:55:54.615922 tst assert_extension.py: using BVCI 26313 05:55:54.730418 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 05:55:54.741591 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 05:55:54.752538 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 05:55:54.763531 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 05:55:54.774613 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 05:55:54.785597 tst ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 05:55:54.901162 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:55:55.357854 run create_hlr_db(pid=1264): Launched 05:55:55.470620 bus /sierra_2: Setting Powered False 05:55:56.529631 run create_hlr_db(pid=1264): Terminated: ok {rc=0} 05:55:56.963902 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1266): Launched 05:55:57.281208 run osmo-hlr_10.42.42.2(pid=1267): Launched 05:55:57.404034 run osmo-stp_10.42.42.5: Starting osmo-stp 05:55:58.045792 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1269): Launched 05:55:58.357122 run osmo-stp_10.42.42.5(pid=1270): Launched 05:55:58.475842 run osmo-msc_10.42.42.6: Starting osmo-msc 05:55:59.037940 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1272): Launched 05:55:59.350925 run osmo-msc_10.42.42.6(pid=1273): Launched 05:55:59.523768 run osmo-stp_10.42.42.5(pid=1270): ERR: Terminated: ERROR {rc=1} [trial-2370↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1270)] 05:55:59.654536 run osmo-stp_10.42.42.5(pid=1270): stdout: | (launched: 2022-12-10_05:55:58.300337) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:55:59.785845 run osmo-stp_10.42.42.5(pid=1270): stderr: | 20221210055558489 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055558489 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055558490 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055558490 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055558490 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055558491 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055558491 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:55:59.916759 run osmo-stp_10.42.42.5(pid=1270): stdout: | (launched: 2022-12-10_05:55:58.300337) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:56:00.040287 run osmo-stp_10.42.42.5(pid=1270): stderr: | 20221210055558489 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055558489 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055558490 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055558490 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055558490 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055558491 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055558491 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:56:00.188789 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=1270): Process ended prematurely: osmo-stp_10.42.42.5(pid=1270) [trial-2370↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1270)] [trial-2370↪ussd:trx-sysmocell5000↪assert_extension.py:17] 05:56:00.198016 tst assert_extension.py:17: Test FAILED (6.0 sec) 05:56:00.225638 run osmo-hlr_10.42.42.2(pid=1267): ERR: Terminated: ERROR {rc=237} [trial-2370↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1267)] 05:56:00.276166 run osmo-hlr_10.42.42.2(pid=1267): stdout: | (launched: 2022-12-10_05:55:57.223755) 05:56:00.328657 run osmo-hlr_10.42.42.2(pid=1267): stderr: | 20221210055557421 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210055557421 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210055557421 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210055557421 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210055557421 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210055557421 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210055557434 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/ussd:trx-sysmocell5000/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210055557442 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210055557442 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210055557443 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:56:00.400929 run osmo-msc_10.42.42.6(pid=1273): ERR: Terminated: ERROR {rc=2} [trial-2370↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1273)] 05:56:00.451204 run osmo-msc_10.42.42.6(pid=1273): stdout: | (launched: 2022-12-10_05:55:59.293815) 05:56:00.502853 run osmo-msc_10.42.42.6(pid=1273): stderr: | 20221210055559613 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210055559614 DLGLOBAL DEBUG validating counter group 0x7f08055d6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210055559614 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210055559614 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210055559614 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210055559614 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210055559616 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210055559616 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210055559616 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210055559616 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:56:00.555075 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1266): Terminating (SIGTERM) 05:56:00.596734 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1269): Terminating (SIGTERM) 05:56:00.638635 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1272): Terminating (SIGTERM) 05:56:00.680668 --- ParallelTerminationStrategy: PID 1266 died... 05:56:00.700722 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1266): Terminated: ok {rc=0} 05:56:00.746929 --- ParallelTerminationStrategy: PID 1269 died... 05:56:00.766546 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1269): Terminated: ok {rc=0} 05:56:00.812374 --- ParallelTerminationStrategy: PID 1272 died... 05:56:00.831930 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1272): Terminated: ok {rc=0} 05:56:00.942107 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 05:56:02.279794 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:56:02.290227 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 05:56:02.329225 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 05:56:02.357731 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 05:56:02.408846 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 05:56:02.443089 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 05:56:02.470179 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 05:56:03.027623 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 05:56:03.079125 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:56:03.090957 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 05:56:03.162383 tst mo_mt_call.py: using LAC 26313 05:56:03.287564 tst mo_mt_call.py: using RAC 48 05:56:03.409427 tst mo_mt_call.py: using CellId 26313 05:56:03.531917 tst mo_mt_call.py: using BVCI 26314 05:56:03.646057 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:56:03.657692 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:56:03.669093 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:56:03.680395 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:56:03.691915 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:56:03.703335 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 05:56:03.817422 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 05:56:03.936753 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:56:04.429608 run create_hlr_db(pid=1278): Launched 05:56:04.559106 bus /sierra_2: Setting Powered False 05:56:05.621489 run create_hlr_db(pid=1278): Terminated: ok {rc=0} 05:56:06.045559 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1280): Launched 05:56:06.342929 run osmo-hlr_10.42.42.2(pid=1281): Launched 05:56:06.457957 run osmo-stp_10.42.42.5: Starting osmo-stp 05:56:06.969379 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1283): Launched 05:56:07.266379 run osmo-stp_10.42.42.5(pid=1284): Launched 05:56:07.380757 run osmo-msc_10.42.42.6: Starting osmo-msc 05:56:07.919568 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1286): Launched 05:56:08.218101 run osmo-msc_10.42.42.6(pid=1287): Launched 05:56:08.385797 run osmo-stp_10.42.42.5(pid=1284): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1284)] 05:56:08.512450 run osmo-stp_10.42.42.5(pid=1284): stdout: | (launched: 2022-12-10_05:56:07.212388) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:56:08.639576 run osmo-stp_10.42.42.5(pid=1284): stderr: | 20221210055607381 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055607381 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055607381 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055607382 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055607382 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055607382 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055607382 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:56:08.764656 run osmo-stp_10.42.42.5(pid=1284): stdout: | (launched: 2022-12-10_05:56:07.212388) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:56:08.883192 run osmo-stp_10.42.42.5(pid=1284): stderr: | 20221210055607381 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055607381 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055607381 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055607382 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055607382 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055607382 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055607382 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:56:09.025633 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1284): Process ended prematurely: osmo-stp_10.42.42.5(pid=1284) [trial-2370↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1284)] [trial-2370↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 05:56:09.034854 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 05:56:09.061946 run osmo-hlr_10.42.42.2(pid=1281): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1281)] 05:56:09.110126 run osmo-hlr_10.42.42.2(pid=1281): stdout: | (launched: 2022-12-10_05:56:06.288166) 05:56:09.160613 run osmo-hlr_10.42.42.2(pid=1281): stderr: | 20221210055606463 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210055606463 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210055606464 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210055606464 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210055606464 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210055606464 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210055606608 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210055606616 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210055606617 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210055606617 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:56:09.230134 run osmo-msc_10.42.42.6(pid=1287): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1287)] 05:56:09.278202 run osmo-msc_10.42.42.6(pid=1287): stdout: | (launched: 2022-12-10_05:56:08.163733) 05:56:09.327743 run osmo-msc_10.42.42.6(pid=1287): stderr: | 20221210055608433 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210055608433 DLGLOBAL DEBUG validating counter group 0x7f9a5241ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210055608433 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210055608433 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210055608433 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210055608434 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210055608436 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210055608436 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210055608436 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210055608437 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:56:09.377864 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1280): Terminating (SIGTERM) 05:56:09.417597 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1283): Terminating (SIGTERM) 05:56:09.457408 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1286): Terminating (SIGTERM) 05:56:09.497360 --- ParallelTerminationStrategy: PID 1280 died... 05:56:09.516460 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1280): Terminated: ok {rc=0} 05:56:09.560653 --- ParallelTerminationStrategy: PID 1283 died... 05:56:09.579257 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1283): Terminated: ok {rc=0} 05:56:09.623830 --- ParallelTerminationStrategy: PID 1286 died... 05:56:09.642464 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1286): Terminated: ok {rc=0} 05:56:09.728159 bus /sierra_3: Setting Powered False 05:56:10.827370 bus /sierra_3: Setting Powered False 05:56:11.943164 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2370 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 05:56:13.091833 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:56:13.106434 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 05:56:13.177329 tst mo_mt_call_osmux.py: using LAC 26314 05:56:13.297364 tst mo_mt_call_osmux.py: using RAC 49 05:56:13.415520 tst mo_mt_call_osmux.py: using CellId 26314 05:56:13.538196 tst mo_mt_call_osmux.py: using BVCI 26315 05:56:13.647619 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:56:13.658980 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:56:13.670253 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:56:13.681721 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:56:13.693026 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:56:13.704371 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 05:56:13.821063 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 05:56:13.940261 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:56:14.433781 run create_hlr_db(pid=1289): Launched 05:56:14.565675 bus /sierra_2: Setting Powered False 05:56:15.628181 run create_hlr_db(pid=1289): Terminated: ok {rc=0} 05:56:16.104370 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1291): Launched 05:56:16.433137 run osmo-hlr_10.42.42.2(pid=1292): Launched 05:56:16.642490 run osmo-stp_10.42.42.5: Starting osmo-stp 05:56:17.281754 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1294): Launched 05:56:17.607603 run osmo-stp_10.42.42.5(pid=1295): Launched 05:56:17.728513 run osmo-msc_10.42.42.6: Starting osmo-msc 05:56:18.305118 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1297): Launched 05:56:18.623233 run osmo-msc_10.42.42.6(pid=1298): Launched 05:56:18.801906 run osmo-stp_10.42.42.5(pid=1295): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1295)] 05:56:18.935766 run osmo-stp_10.42.42.5(pid=1295): stdout: | (launched: 2022-12-10_05:56:17.548943) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:56:19.070414 run osmo-stp_10.42.42.5(pid=1295): stderr: | 20221210055617741 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055617741 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055617742 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055617742 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055617743 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055617743 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055617743 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:56:19.205063 run osmo-stp_10.42.42.5(pid=1295): stdout: | (launched: 2022-12-10_05:56:17.548943) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:56:19.330960 run osmo-stp_10.42.42.5(pid=1295): stderr: | 20221210055617741 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055617741 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055617742 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055617742 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055617743 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055617743 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055617743 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:56:19.481796 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1295): Process ended prematurely: osmo-stp_10.42.42.5(pid=1295) [trial-2370↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1295)] [trial-2370↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 05:56:19.491459 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 05:56:19.519026 run osmo-hlr_10.42.42.2(pid=1292): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1292)] 05:56:19.569126 run osmo-hlr_10.42.42.2(pid=1292): stdout: | (launched: 2022-12-10_05:56:16.374534) 05:56:19.620847 run osmo-hlr_10.42.42.2(pid=1292): stderr: | 20221210055616707 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210055616707 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210055616707 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210055616707 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210055616708 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210055616708 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210055616728 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210055616744 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210055616746 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210055616746 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:56:19.692816 run osmo-msc_10.42.42.6(pid=1298): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1298)] 05:56:19.742649 run osmo-msc_10.42.42.6(pid=1298): stdout: | (launched: 2022-12-10_05:56:18.565297) 05:56:19.794051 run osmo-msc_10.42.42.6(pid=1298): stderr: | 20221210055618886 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210055618886 DLGLOBAL DEBUG validating counter group 0x7f7a55077c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210055618886 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210055618886 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210055618886 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210055618887 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210055618890 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210055618890 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210055618891 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210055618891 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:56:19.845975 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1291): Terminating (SIGTERM) 05:56:19.887534 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1294): Terminating (SIGTERM) 05:56:19.929171 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1297): Terminating (SIGTERM) 05:56:19.971006 --- ParallelTerminationStrategy: PID 1291 died... 05:56:19.990846 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1291): Terminated: ok {rc=0} 05:56:20.036764 --- ParallelTerminationStrategy: PID 1294 died... 05:56:20.056184 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1294): Terminated: ok {rc=0} 05:56:20.101965 --- ParallelTerminationStrategy: PID 1297 died... 05:56:20.121582 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1297): Terminated: ok {rc=0} 05:56:20.209448 bus /sierra_3: Setting Powered False 05:56:21.308375 bus /sierra_3: Setting Powered False 05:56:22.425040 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 05:56:23.675321 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:56:23.683507 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 05:56:23.717880 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 05:56:23.745225 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 05:56:23.799059 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 05:56:23.833552 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 05:56:23.860653 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 05:56:24.412036 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 05:56:24.462558 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:56:24.474180 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 05:56:24.545339 tst mo_mt_call.py: using LAC 26315 05:56:24.669121 tst mo_mt_call.py: using RAC 50 05:56:24.794896 tst mo_mt_call.py: using CellId 26315 05:56:24.920284 tst mo_mt_call.py: using BVCI 26316 05:56:25.035238 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:56:25.046901 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:56:25.058407 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:56:25.069896 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:56:25.081514 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:56:25.092880 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 05:56:25.209966 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 05:56:25.325874 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:56:25.787319 run create_hlr_db(pid=1303): Launched 05:56:25.900874 bus /sierra_2: Setting Powered False 05:56:26.960215 run create_hlr_db(pid=1303): Terminated: ok {rc=0} 05:56:27.375323 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1305): Launched 05:56:27.673361 run osmo-hlr_10.42.42.2(pid=1306): Launched 05:56:27.787318 run osmo-stp_10.42.42.5: Starting osmo-stp 05:56:28.296492 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1308): Launched 05:56:28.595060 run osmo-stp_10.42.42.5(pid=1309): Launched 05:56:28.709645 run osmo-msc_10.42.42.6: Starting osmo-msc 05:56:29.253922 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1311): Launched 05:56:29.551125 run osmo-msc_10.42.42.6(pid=1312): Launched 05:56:29.718532 run osmo-stp_10.42.42.5(pid=1309): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1309)] 05:56:29.845080 run osmo-stp_10.42.42.5(pid=1309): stdout: | (launched: 2022-12-10_05:56:28.540634) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:56:29.971803 run osmo-stp_10.42.42.5(pid=1309): stderr: | 20221210055628709 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055628709 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055628709 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055628710 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055628710 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055628710 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055628710 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:56:30.096224 run osmo-stp_10.42.42.5(pid=1309): stdout: | (launched: 2022-12-10_05:56:28.540634) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:56:30.215118 run osmo-stp_10.42.42.5(pid=1309): stderr: | 20221210055628709 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055628709 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055628709 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055628710 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055628710 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055628710 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055628710 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:56:30.357085 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1309): Process ended prematurely: osmo-stp_10.42.42.5(pid=1309) [trial-2370↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1309)] [trial-2370↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 05:56:30.366068 tst mo_mt_call.py:8: Test FAILED (5.9 sec) 05:56:30.392721 run osmo-hlr_10.42.42.2(pid=1306): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1306)] 05:56:30.440120 run osmo-hlr_10.42.42.2(pid=1306): stdout: | (launched: 2022-12-10_05:56:27.618851) 05:56:30.489448 run osmo-hlr_10.42.42.2(pid=1306): stderr: | 20221210055627794 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210055627795 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210055627795 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210055627795 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210055627795 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210055627795 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210055627810 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210055627823 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210055627823 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210055627823 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:56:30.558196 run osmo-msc_10.42.42.6(pid=1312): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1312)] 05:56:30.605965 run osmo-msc_10.42.42.6(pid=1312): stdout: | (launched: 2022-12-10_05:56:29.496565) 05:56:30.655012 run osmo-msc_10.42.42.6(pid=1312): stderr: | 20221210055629766 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210055629766 DLGLOBAL DEBUG validating counter group 0x7ff94072bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210055629766 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210055629766 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210055629766 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210055629766 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210055629768 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210055629769 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210055629769 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210055629769 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:56:30.704434 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1305): Terminating (SIGTERM) 05:56:30.743619 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1308): Terminating (SIGTERM) 05:56:30.782934 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1311): Terminating (SIGTERM) 05:56:30.822370 --- ParallelTerminationStrategy: PID 1305 died... 05:56:30.845346 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1305): Terminated: ok {rc=0} 05:56:30.899202 --- ParallelTerminationStrategy: PID 1308 died... 05:56:30.922598 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1308): Terminated: ok {rc=0} 05:56:30.967721 --- ParallelTerminationStrategy: PID 1311 died... 05:56:30.986553 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1311): Terminated: ok {rc=0} 05:56:31.072486 bus /sierra_3: Setting Powered False 05:56:32.174370 bus /sierra_3: Setting Powered False 05:56:33.288593 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2370 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 05:56:34.436865 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:56:34.449555 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 05:56:34.522658 tst mo_mt_call_osmux.py: using LAC 26316 05:56:34.641642 tst mo_mt_call_osmux.py: using RAC 51 05:56:34.768649 tst mo_mt_call_osmux.py: using CellId 26316 05:56:34.896325 tst mo_mt_call_osmux.py: using BVCI 26317 05:56:35.011550 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:56:35.023393 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:56:35.035182 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:56:35.047080 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:56:35.059218 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:56:35.071114 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 05:56:35.190886 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 05:56:35.307856 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:56:35.769493 run create_hlr_db(pid=1314): Launched 05:56:35.883958 bus /sierra_2: Setting Powered False 05:56:36.944109 run create_hlr_db(pid=1314): Terminated: ok {rc=0} 05:56:37.378852 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1316): Launched 05:56:37.698246 run osmo-hlr_10.42.42.2(pid=1317): Launched 05:56:37.818947 run osmo-stp_10.42.42.5: Starting osmo-stp 05:56:38.367406 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1319): Launched 05:56:38.686227 run osmo-stp_10.42.42.5(pid=1320): Launched 05:56:38.807780 run osmo-msc_10.42.42.6: Starting osmo-msc 05:56:39.385263 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1322): Launched 05:56:39.703643 run osmo-msc_10.42.42.6(pid=1323): Launched 05:56:39.882000 run osmo-stp_10.42.42.5(pid=1320): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1320)] 05:56:40.017076 run osmo-stp_10.42.42.5(pid=1320): stdout: | (launched: 2022-12-10_05:56:38.628284) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:56:40.152710 run osmo-stp_10.42.42.5(pid=1320): stderr: | 20221210055638819 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055638819 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055638819 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055638820 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055638820 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055638820 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055638820 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:56:40.287298 run osmo-stp_10.42.42.5(pid=1320): stdout: | (launched: 2022-12-10_05:56:38.628284) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:56:40.414112 run osmo-stp_10.42.42.5(pid=1320): stderr: | 20221210055638819 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055638819 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055638819 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055638820 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055638820 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055638820 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055638820 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:56:40.565901 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1320): Process ended prematurely: osmo-stp_10.42.42.5(pid=1320) [trial-2370↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1320)] [trial-2370↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 05:56:40.575738 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 05:56:40.603471 run osmo-hlr_10.42.42.2(pid=1317): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1317)] 05:56:40.653233 run osmo-hlr_10.42.42.2(pid=1317): stdout: | (launched: 2022-12-10_05:56:37.639958) 05:56:40.704556 run osmo-hlr_10.42.42.2(pid=1317): stderr: | 20221210055637838 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210055637838 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210055637838 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210055637838 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210055637838 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210055637838 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210055637851 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210055637861 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210055637861 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210055637861 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:56:40.775865 run osmo-msc_10.42.42.6(pid=1323): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1323)] 05:56:40.825189 run osmo-msc_10.42.42.6(pid=1323): stdout: | (launched: 2022-12-10_05:56:39.645637) 05:56:40.876043 run osmo-msc_10.42.42.6(pid=1323): stderr: | 20221210055639969 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210055639969 DLGLOBAL DEBUG validating counter group 0x7ffb5442ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210055639969 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210055639969 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210055639969 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210055639969 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210055639971 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210055639971 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210055639972 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210055639972 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:56:40.927467 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1316): Terminating (SIGTERM) 05:56:40.968330 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1319): Terminating (SIGTERM) 05:56:41.009468 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1322): Terminating (SIGTERM) 05:56:41.050780 --- ParallelTerminationStrategy: PID 1316 died... 05:56:41.070608 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1316): Terminated: ok {rc=0} 05:56:41.116037 --- ParallelTerminationStrategy: PID 1319 died... 05:56:41.135768 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1319): Terminated: ok {rc=0} 05:56:41.181086 --- ParallelTerminationStrategy: PID 1322 died... 05:56:41.200313 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1322): Terminated: ok {rc=0} 05:56:41.286244 bus /sierra_3: Setting Powered False 05:56:42.384128 bus /sierra_3: Setting Powered False 05:56:43.498329 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 05:56:44.753480 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:56:44.760578 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 05:56:44.795184 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 05:56:44.822567 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 05:56:44.875262 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 05:56:44.909394 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 05:56:44.936435 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 05:56:45.489410 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 05:56:45.539988 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:56:45.551686 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 05:56:45.628381 tst mo_mt_call.py: using LAC 26317 05:56:45.753684 tst mo_mt_call.py: using RAC 52 05:56:45.886182 tst mo_mt_call.py: using CellId 26317 05:56:46.024838 tst mo_mt_call.py: using BVCI 26318 05:56:46.143919 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:56:46.156241 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:56:46.168305 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:56:46.180615 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:56:46.192712 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:56:46.204782 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 05:56:46.328594 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 05:56:46.477033 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:56:46.960234 run create_hlr_db(pid=1329): Launched 05:56:47.113393 bus /sierra_2: Setting Powered False 05:56:48.176451 run create_hlr_db(pid=1329): Terminated: ok {rc=0} 05:56:48.602035 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1331): Launched 05:56:48.901974 run osmo-hlr_10.42.42.2(pid=1332): Launched 05:56:49.015705 run osmo-stp_10.42.42.5: Starting osmo-stp 05:56:49.543805 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1334): Launched 05:56:49.842499 run osmo-stp_10.42.42.5(pid=1335): Launched 05:56:49.956615 run osmo-msc_10.42.42.6: Starting osmo-msc 05:56:50.497013 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1337): Launched 05:56:50.801798 run osmo-msc_10.42.42.6(pid=1338): Launched 05:56:50.973406 run osmo-stp_10.42.42.5(pid=1335): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1335)] 05:56:51.100842 run osmo-stp_10.42.42.5(pid=1335): stdout: | (launched: 2022-12-10_05:56:49.787883) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:56:51.228083 run osmo-stp_10.42.42.5(pid=1335): stderr: | 20221210055649958 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055649958 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055649958 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055649959 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055649959 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055649959 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055649959 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:56:51.353495 run osmo-stp_10.42.42.5(pid=1335): stdout: | (launched: 2022-12-10_05:56:49.787883) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:56:51.472078 run osmo-stp_10.42.42.5(pid=1335): stderr: | 20221210055649958 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055649958 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055649958 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055649959 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055649959 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055649959 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055649959 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:56:51.615183 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1335): Process ended prematurely: osmo-stp_10.42.42.5(pid=1335) [trial-2370↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1335)] [trial-2370↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 05:56:51.624434 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 05:56:51.651867 run osmo-hlr_10.42.42.2(pid=1332): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1332)] 05:56:51.699754 run osmo-hlr_10.42.42.2(pid=1332): stdout: | (launched: 2022-12-10_05:56:48.847181) 05:56:51.749243 run osmo-hlr_10.42.42.2(pid=1332): stderr: | 20221210055649021 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210055649021 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210055649021 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210055649022 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210055649022 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210055649022 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210055649034 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210055649043 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210055649043 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210055649043 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:56:51.818173 run osmo-msc_10.42.42.6(pid=1338): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1338)] 05:56:51.865958 run osmo-msc_10.42.42.6(pid=1338): stdout: | (launched: 2022-12-10_05:56:50.743147) 05:56:51.915560 run osmo-msc_10.42.42.6(pid=1338): stderr: | 20221210055651017 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210055651017 DLGLOBAL DEBUG validating counter group 0x7f3cd9716c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210055651017 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210055651017 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210055651018 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210055651018 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210055651019 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210055651020 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210055651020 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210055651020 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:56:51.965238 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1331): Terminating (SIGTERM) 05:56:52.004938 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1334): Terminating (SIGTERM) 05:56:52.044750 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1337): Terminating (SIGTERM) 05:56:52.084756 --- ParallelTerminationStrategy: PID 1331 died... 05:56:52.103763 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1331): Terminated: ok {rc=0} 05:56:52.148213 --- ParallelTerminationStrategy: PID 1334 died... 05:56:52.166842 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1334): Terminated: ok {rc=0} 05:56:52.211151 --- ParallelTerminationStrategy: PID 1337 died... 05:56:52.229695 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1337): Terminated: ok {rc=0} 05:56:52.315707 bus /sierra_3: Setting Powered False 05:56:53.415506 bus /sierra_3: Setting Powered False 05:56:54.531415 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2370 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 05:56:55.677187 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:56:55.689426 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 05:56:55.759607 tst mo_mt_call_osmux.py: using LAC 26318 05:56:55.877632 tst mo_mt_call_osmux.py: using RAC 53 05:56:55.996906 tst mo_mt_call_osmux.py: using CellId 26318 05:56:56.114622 tst mo_mt_call_osmux.py: using BVCI 26319 05:56:56.224800 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:56:56.236347 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:56:56.247486 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:56:56.258893 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:56:56.270494 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:56:56.281992 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 05:56:56.396132 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 05:56:56.515573 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:56:57.010161 run create_hlr_db(pid=1340): Launched 05:56:57.141258 bus /sierra_2: Setting Powered False 05:56:58.204739 run create_hlr_db(pid=1340): Terminated: ok {rc=0} 05:56:58.649103 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1342): Launched 05:56:58.970582 run osmo-hlr_10.42.42.2(pid=1343): Launched 05:56:59.093262 run osmo-stp_10.42.42.5: Starting osmo-stp 05:56:59.642382 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1345): Launched 05:56:59.963488 run osmo-stp_10.42.42.5(pid=1346): Launched 05:57:00.085396 run osmo-msc_10.42.42.6: Starting osmo-msc 05:57:00.664234 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1348): Launched 05:57:01.023087 run osmo-msc_10.42.42.6(pid=1349): Launched 05:57:01.372423 run osmo-stp_10.42.42.5(pid=1346): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1346)] 05:57:01.646052 run osmo-stp_10.42.42.5(pid=1346): stdout: | (launched: 2022-12-10_05:56:59.905262) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:57:01.924057 run osmo-stp_10.42.42.5(pid=1346): stderr: | 20221210055700096 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055700097 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055700097 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055700097 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055700098 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055700098 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055700098 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:57:02.089625 run osmo-stp_10.42.42.5(pid=1346): stdout: | (launched: 2022-12-10_05:56:59.905262) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:57:02.221204 run osmo-stp_10.42.42.5(pid=1346): stderr: | 20221210055700096 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055700097 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055700097 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055700097 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055700098 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055700098 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055700098 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:57:02.364159 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1346): Process ended prematurely: osmo-stp_10.42.42.5(pid=1346) [trial-2370↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1346)] [trial-2370↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 05:57:02.373588 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 05:57:02.400845 run osmo-hlr_10.42.42.2(pid=1343): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1343)] 05:57:02.448660 run osmo-hlr_10.42.42.2(pid=1343): stdout: | (launched: 2022-12-10_05:56:58.912457) 05:57:02.498395 run osmo-hlr_10.42.42.2(pid=1343): stderr: | 20221210055659109 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210055659109 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210055659109 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210055659109 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210055659109 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210055659109 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210055659123 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210055659132 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210055659132 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210055659132 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:57:02.567377 run osmo-msc_10.42.42.6(pid=1349): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1349)] 05:57:02.615622 run osmo-msc_10.42.42.6(pid=1349): stdout: | (launched: 2022-12-10_05:57:00.961238) 05:57:02.665170 run osmo-msc_10.42.42.6(pid=1349): stderr: | 20221210055701527 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210055701528 DLGLOBAL DEBUG validating counter group 0x7ff4b32b7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210055701528 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210055701528 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210055701528 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210055701528 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210055701538 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210055701539 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210055701539 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210055701539 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:57:02.714874 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1342): Terminating (SIGTERM) 05:57:02.754986 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1345): Terminating (SIGTERM) 05:57:02.795319 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1348): Terminating (SIGTERM) 05:57:02.835592 --- ParallelTerminationStrategy: PID 1342 died... 05:57:02.854386 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1342): Terminated: ok {rc=0} 05:57:02.898806 --- ParallelTerminationStrategy: PID 1345 died... 05:57:02.917404 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1345): Terminated: ok {rc=0} 05:57:02.961566 --- ParallelTerminationStrategy: PID 1348 died... 05:57:02.980387 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1348): Terminated: ok {rc=0} 05:57:03.067046 bus /sierra_3: Setting Powered False 05:57:04.168432 bus /sierra_3: Setting Powered False 05:57:05.286170 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 05:57:06.541716 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:57:06.548888 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 05:57:06.583653 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 05:57:06.610763 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 05:57:06.663300 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 05:57:06.697342 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 05:57:06.724368 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 05:57:07.281943 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 05:57:07.332385 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:57:07.343735 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 05:57:07.413645 tst mo_mt_call.py: using LAC 26319 05:57:07.539956 tst mo_mt_call.py: using RAC 54 05:57:07.665736 tst mo_mt_call.py: using CellId 26319 05:57:07.793215 tst mo_mt_call.py: using BVCI 26320 05:57:07.909878 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:57:07.921533 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:57:07.933536 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:57:07.945128 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:57:07.956662 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:57:07.968221 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 05:57:08.082701 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 05:57:08.199259 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:57:08.660105 run create_hlr_db(pid=1354): Launched 05:57:08.774928 bus /sierra_2: Setting Powered False 05:57:09.833996 run create_hlr_db(pid=1354): Terminated: ok {rc=0} 05:57:10.270261 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1356): Launched 05:57:10.590035 run osmo-hlr_10.42.42.2(pid=1357): Launched 05:57:10.712680 run osmo-stp_10.42.42.5: Starting osmo-stp 05:57:11.264244 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1359): Launched 05:57:11.582542 run osmo-stp_10.42.42.5(pid=1360): Launched 05:57:11.704491 run osmo-msc_10.42.42.6: Starting osmo-msc 05:57:12.282286 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1362): Launched 05:57:12.603361 run osmo-msc_10.42.42.6(pid=1363): Launched 05:57:12.780314 run osmo-stp_10.42.42.5(pid=1360): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1360)] 05:57:12.914141 run osmo-stp_10.42.42.5(pid=1360): stdout: | (launched: 2022-12-10_05:57:11.524310) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:57:13.048337 run osmo-stp_10.42.42.5(pid=1360): stderr: | 20221210055711716 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055711716 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055711717 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055711717 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055711718 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055711718 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055711718 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:57:13.182828 run osmo-stp_10.42.42.5(pid=1360): stdout: | (launched: 2022-12-10_05:57:11.524310) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:57:13.309279 run osmo-stp_10.42.42.5(pid=1360): stderr: | 20221210055711716 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055711716 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055711717 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055711717 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055711718 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055711718 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055711718 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:57:13.460847 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1360): Process ended prematurely: osmo-stp_10.42.42.5(pid=1360) [trial-2370↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1360)] [trial-2370↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 05:57:13.470742 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 05:57:13.498387 run osmo-hlr_10.42.42.2(pid=1357): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1357)] 05:57:13.547886 run osmo-hlr_10.42.42.2(pid=1357): stdout: | (launched: 2022-12-10_05:57:10.532178) 05:57:13.599264 run osmo-hlr_10.42.42.2(pid=1357): stderr: | 20221210055710730 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210055710730 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210055710730 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210055710730 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210055710730 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210055710730 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210055710743 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210055710751 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210055710751 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210055710751 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:57:13.670782 run osmo-msc_10.42.42.6(pid=1363): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1363)] 05:57:13.720529 run osmo-msc_10.42.42.6(pid=1363): stdout: | (launched: 2022-12-10_05:57:12.544699) 05:57:13.771926 run osmo-msc_10.42.42.6(pid=1363): stderr: | 20221210055712870 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210055712870 DLGLOBAL DEBUG validating counter group 0x7fcec858cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210055712871 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210055712871 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210055712871 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210055712871 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210055712873 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210055712874 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210055712874 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210055712874 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:57:13.823448 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1356): Terminating (SIGTERM) 05:57:13.864644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1359): Terminating (SIGTERM) 05:57:13.906412 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1362): Terminating (SIGTERM) 05:57:13.948122 --- ParallelTerminationStrategy: PID 1356 died... 05:57:13.967553 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1356): Terminated: ok {rc=0} 05:57:14.013195 --- ParallelTerminationStrategy: PID 1359 died... 05:57:14.032541 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1359): Terminated: ok {rc=0} 05:57:14.078207 --- ParallelTerminationStrategy: PID 1362 died... 05:57:14.097731 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1362): Terminated: ok {rc=0} 05:57:14.184597 bus /sierra_3: Setting Powered False 05:57:15.281929 bus /sierra_3: Setting Powered False 05:57:16.396448 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2370 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 05:57:17.540467 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:57:17.552573 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 05:57:17.623251 tst mo_mt_call_osmux.py: using LAC 26320 05:57:17.749513 tst mo_mt_call_osmux.py: using RAC 55 05:57:17.874317 tst mo_mt_call_osmux.py: using CellId 26320 05:57:17.999319 tst mo_mt_call_osmux.py: using BVCI 26321 05:57:18.116003 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:57:18.127823 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:57:18.139470 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:57:18.151438 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:57:18.163107 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:57:18.174699 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 05:57:18.293169 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 05:57:18.414349 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:57:18.907541 run create_hlr_db(pid=1365): Launched 05:57:19.037994 bus /sierra_2: Setting Powered False 05:57:20.101637 run create_hlr_db(pid=1365): Terminated: ok {rc=0} 05:57:20.529007 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1367): Launched 05:57:20.827567 run osmo-hlr_10.42.42.2(pid=1368): Launched 05:57:20.941166 run osmo-stp_10.42.42.5: Starting osmo-stp 05:57:21.465489 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1370): Launched 05:57:21.764779 run osmo-stp_10.42.42.5(pid=1371): Launched 05:57:21.879222 run osmo-msc_10.42.42.6: Starting osmo-msc 05:57:22.420811 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1373): Launched 05:57:22.720624 run osmo-msc_10.42.42.6(pid=1374): Launched 05:57:22.888422 run osmo-stp_10.42.42.5(pid=1371): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1371)] 05:57:23.016439 run osmo-stp_10.42.42.5(pid=1371): stdout: | (launched: 2022-12-10_05:57:21.709853) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:57:23.144449 run osmo-stp_10.42.42.5(pid=1371): stderr: | 20221210055721881 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055721882 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055721882 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055721882 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055721883 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055721883 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055721883 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:57:23.269633 run osmo-stp_10.42.42.5(pid=1371): stdout: | (launched: 2022-12-10_05:57:21.709853) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:57:23.388449 run osmo-stp_10.42.42.5(pid=1371): stderr: | 20221210055721881 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055721882 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055721882 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055721882 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055721883 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055721883 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055721883 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:57:23.531215 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1371): Process ended prematurely: osmo-stp_10.42.42.5(pid=1371) [trial-2370↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1371)] [trial-2370↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 05:57:23.540330 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 05:57:23.567219 run osmo-hlr_10.42.42.2(pid=1368): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1368)] 05:57:23.614453 run osmo-hlr_10.42.42.2(pid=1368): stdout: | (launched: 2022-12-10_05:57:20.773203) 05:57:23.663311 run osmo-hlr_10.42.42.2(pid=1368): stderr: | 20221210055720949 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210055720949 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210055720949 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210055720949 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210055720949 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210055720949 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210055720962 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210055720971 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210055720971 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210055720971 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:57:23.731542 run osmo-msc_10.42.42.6(pid=1374): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1374)] 05:57:23.778606 run osmo-msc_10.42.42.6(pid=1374): stdout: | (launched: 2022-12-10_05:57:22.665473) 05:57:23.827276 run osmo-msc_10.42.42.6(pid=1374): stderr: | 20221210055722940 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210055722940 DLGLOBAL DEBUG validating counter group 0x7f9a44e97c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210055722940 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210055722940 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210055722941 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210055722941 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210055722943 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210055722943 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210055722943 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210055722943 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:57:23.876593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1367): Terminating (SIGTERM) 05:57:23.916293 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1370): Terminating (SIGTERM) 05:57:23.955864 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1373): Terminating (SIGTERM) 05:57:23.995355 --- ParallelTerminationStrategy: PID 1367 died... 05:57:24.014046 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1367): Terminated: ok {rc=0} 05:57:24.057835 --- ParallelTerminationStrategy: PID 1370 died... 05:57:24.076144 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1370): Terminated: ok {rc=0} 05:57:24.119897 --- ParallelTerminationStrategy: PID 1373 died... 05:57:24.138259 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1373): Terminated: ok {rc=0} 05:57:24.220676 bus /sierra_3: Setting Powered False 05:57:25.314926 bus /sierra_3: Setting Powered False 05:57:26.428934 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 05:57:27.678309 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:57:27.685234 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 05:57:27.718876 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 05:57:27.745008 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 05:57:27.796938 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 05:57:27.830287 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 05:57:27.856568 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 05:57:28.410911 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 05:57:28.458925 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:57:28.470253 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 05:57:28.537954 tst mo_mt_call.py: using LAC 26321 05:57:28.655194 tst mo_mt_call.py: using RAC 56 05:57:28.770316 tst mo_mt_call.py: using CellId 26321 05:57:28.885345 tst mo_mt_call.py: using BVCI 26322 05:57:28.992733 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:57:29.004244 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:57:29.015300 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:57:29.026746 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:57:29.038136 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:57:29.049569 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 05:57:29.163095 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 05:57:29.281484 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:57:29.775359 run create_hlr_db(pid=1379): Launched 05:57:29.906700 bus /sierra_2: Setting Powered False 05:57:30.972634 run create_hlr_db(pid=1379): Terminated: ok {rc=0} 05:57:31.420106 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1381): Launched 05:57:31.739445 run osmo-hlr_10.42.42.2(pid=1382): Launched 05:57:31.993371 run osmo-stp_10.42.42.5: Starting osmo-stp 05:57:32.666931 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1384): Launched 05:57:32.988783 run osmo-stp_10.42.42.5(pid=1385): Launched 05:57:33.111631 run osmo-msc_10.42.42.6: Starting osmo-msc 05:57:33.691519 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1387): Launched 05:57:34.011845 run osmo-msc_10.42.42.6(pid=1388): Launched 05:57:34.190194 run osmo-stp_10.42.42.5(pid=1385): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1385)] 05:57:34.325168 run osmo-stp_10.42.42.5(pid=1385): stdout: | (launched: 2022-12-10_05:57:32.930332) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:57:34.461725 run osmo-stp_10.42.42.5(pid=1385): stderr: | 20221210055733121 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055733123 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055733123 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055733123 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055733124 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055733124 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055733124 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:57:34.596232 run osmo-stp_10.42.42.5(pid=1385): stdout: | (launched: 2022-12-10_05:57:32.930332) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:57:34.723560 run osmo-stp_10.42.42.5(pid=1385): stderr: | 20221210055733121 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055733123 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055733123 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055733123 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055733124 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055733124 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055733124 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:57:34.875599 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1385): Process ended prematurely: osmo-stp_10.42.42.5(pid=1385) [trial-2370↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1385)] [trial-2370↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 05:57:34.885266 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 05:57:34.913051 run osmo-hlr_10.42.42.2(pid=1382): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1382)] 05:57:34.962889 run osmo-hlr_10.42.42.2(pid=1382): stdout: | (launched: 2022-12-10_05:57:31.683194) 05:57:35.014672 run osmo-hlr_10.42.42.2(pid=1382): stderr: | 20221210055731901 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210055731901 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210055731901 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210055731901 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210055731901 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210055731901 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210055731921 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210055731945 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210055731946 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210055731946 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:57:35.087033 run osmo-msc_10.42.42.6(pid=1388): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1388)] 05:57:35.136737 run osmo-msc_10.42.42.6(pid=1388): stdout: | (launched: 2022-12-10_05:57:33.953312) 05:57:35.188362 run osmo-msc_10.42.42.6(pid=1388): stderr: | 20221210055734275 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210055734275 DLGLOBAL DEBUG validating counter group 0x7f725c161c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210055734275 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210055734275 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210055734275 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210055734275 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210055734277 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210055734278 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210055734278 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210055734278 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:57:35.239916 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1381): Terminating (SIGTERM) 05:57:35.281204 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1384): Terminating (SIGTERM) 05:57:35.322597 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1387): Terminating (SIGTERM) 05:57:35.364112 --- ParallelTerminationStrategy: PID 1381 died... 05:57:35.383774 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1381): Terminated: ok {rc=0} 05:57:35.429482 --- ParallelTerminationStrategy: PID 1384 died... 05:57:35.448625 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1384): Terminated: ok {rc=0} 05:57:35.493933 --- ParallelTerminationStrategy: PID 1387 died... 05:57:35.513198 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1387): Terminated: ok {rc=0} 05:57:35.601925 bus /sierra_3: Setting Powered False 05:57:36.699371 bus /sierra_3: Setting Powered False 05:57:37.814333 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2370 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 05:57:38.962818 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:57:38.975207 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 05:57:39.047661 tst mo_mt_call_osmux.py: using LAC 26322 05:57:39.166788 tst mo_mt_call_osmux.py: using RAC 57 05:57:39.295785 tst mo_mt_call_osmux.py: using CellId 26322 05:57:39.419518 tst mo_mt_call_osmux.py: using BVCI 26323 05:57:39.536460 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:57:39.548154 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:57:39.559638 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:57:39.571094 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:57:39.582771 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:57:39.594214 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 05:57:39.710025 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 05:57:39.829088 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:57:40.325592 run create_hlr_db(pid=1392): Launched 05:57:40.455599 bus /sierra_2: Setting Powered False 05:57:41.518432 run create_hlr_db(pid=1392): Terminated: ok {rc=0} 05:57:41.945599 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1394): Launched 05:57:42.246142 run osmo-hlr_10.42.42.2(pid=1395): Launched 05:57:42.360934 run osmo-stp_10.42.42.5: Starting osmo-stp 05:57:42.889644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1397): Launched 05:57:43.189298 run osmo-stp_10.42.42.5(pid=1398): Launched 05:57:43.303119 run osmo-msc_10.42.42.6: Starting osmo-msc 05:57:43.845733 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1400): Launched 05:57:44.146755 run osmo-msc_10.42.42.6(pid=1401): Launched 05:57:44.315488 run osmo-stp_10.42.42.5(pid=1398): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1398)] 05:57:44.443358 run osmo-stp_10.42.42.5(pid=1398): stdout: | (launched: 2022-12-10_05:57:43.134383) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:57:44.571310 run osmo-stp_10.42.42.5(pid=1398): stderr: | 20221210055743305 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055743305 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055743305 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055743306 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055743306 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055743306 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055743306 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:57:44.696620 run osmo-stp_10.42.42.5(pid=1398): stdout: | (launched: 2022-12-10_05:57:43.134383) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:57:44.815571 run osmo-stp_10.42.42.5(pid=1398): stderr: | 20221210055743305 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055743305 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055743305 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055743306 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055743306 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055743306 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055743306 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:57:44.958458 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1398): Process ended prematurely: osmo-stp_10.42.42.5(pid=1398) [trial-2370↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1398)] [trial-2370↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 05:57:44.967459 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 05:57:44.993955 run osmo-hlr_10.42.42.2(pid=1395): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1395)] 05:57:45.041583 run osmo-hlr_10.42.42.2(pid=1395): stdout: | (launched: 2022-12-10_05:57:42.190670) 05:57:45.090436 run osmo-hlr_10.42.42.2(pid=1395): stderr: | 20221210055742370 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210055742370 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210055742370 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210055742370 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210055742370 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210055742370 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210055742385 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210055742393 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210055742393 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210055742393 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:57:45.158977 run osmo-msc_10.42.42.6(pid=1401): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1401)] 05:57:45.206287 run osmo-msc_10.42.42.6(pid=1401): stdout: | (launched: 2022-12-10_05:57:44.091770) 05:57:45.254952 run osmo-msc_10.42.42.6(pid=1401): stderr: | 20221210055744362 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210055744362 DLGLOBAL DEBUG validating counter group 0x7f8adb25bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210055744363 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210055744363 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210055744363 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210055744363 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210055744365 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210055744366 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210055744366 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210055744366 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:57:45.304239 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1394): Terminating (SIGTERM) 05:57:45.343781 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1397): Terminating (SIGTERM) 05:57:45.382995 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1400): Terminating (SIGTERM) 05:57:45.422701 --- ParallelTerminationStrategy: PID 1394 died... 05:57:45.441548 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1394): Terminated: ok {rc=0} 05:57:45.485345 --- ParallelTerminationStrategy: PID 1397 died... 05:57:45.503617 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1397): Terminated: ok {rc=0} 05:57:45.547436 --- ParallelTerminationStrategy: PID 1400 died... 05:57:45.565800 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1400): Terminated: ok {rc=0} 05:57:45.649610 bus /sierra_3: Setting Powered False 05:57:46.744291 bus /sierra_3: Setting Powered False 05:57:47.857677 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 05:57:49.113718 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:57:49.120125 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 05:57:49.153718 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 05:57:49.180268 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 05:57:49.232683 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 05:57:49.266485 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 05:57:49.292574 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 05:57:49.843168 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 05:57:49.891220 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:57:49.902456 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 05:57:49.971894 tst mo_mt_call.py: using LAC 26323 05:57:50.087815 tst mo_mt_call.py: using RAC 58 05:57:50.204515 tst mo_mt_call.py: using CellId 26323 05:57:50.320435 tst mo_mt_call.py: using BVCI 26324 05:57:50.428388 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:57:50.439618 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:57:50.450672 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:57:50.462150 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:57:50.473453 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:57:50.484628 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 05:57:50.601608 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 05:57:50.717096 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:57:51.178945 run create_hlr_db(pid=1406): Launched 05:57:51.293234 bus /sierra_2: Setting Powered False 05:57:52.351373 run create_hlr_db(pid=1406): Terminated: ok {rc=0} 05:57:52.787353 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1408): Launched 05:57:53.106251 run osmo-hlr_10.42.42.2(pid=1409): Launched 05:57:53.230182 run osmo-stp_10.42.42.5: Starting osmo-stp 05:57:53.777712 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1411): Launched 05:57:54.095757 run osmo-stp_10.42.42.5(pid=1412): Launched 05:57:54.218692 run osmo-msc_10.42.42.6: Starting osmo-msc 05:57:54.796682 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1414): Launched 05:57:55.115841 run osmo-msc_10.42.42.6(pid=1415): Launched 05:57:55.295057 run osmo-stp_10.42.42.5(pid=1412): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1412)] 05:57:55.429513 run osmo-stp_10.42.42.5(pid=1412): stdout: | (launched: 2022-12-10_05:57:54.037934) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:57:55.564710 run osmo-stp_10.42.42.5(pid=1412): stderr: | 20221210055754232 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055754232 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055754232 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055754233 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055754233 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055754233 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055754233 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:57:55.699563 run osmo-stp_10.42.42.5(pid=1412): stdout: | (launched: 2022-12-10_05:57:54.037934) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:57:55.826959 run osmo-stp_10.42.42.5(pid=1412): stderr: | 20221210055754232 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055754232 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055754232 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055754233 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055754233 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055754233 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055754233 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:57:55.979163 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1412): Process ended prematurely: osmo-stp_10.42.42.5(pid=1412) [trial-2370↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1412)] [trial-2370↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 05:57:55.988755 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 05:57:56.016464 run osmo-hlr_10.42.42.2(pid=1409): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1409)] 05:57:56.066213 run osmo-hlr_10.42.42.2(pid=1409): stdout: | (launched: 2022-12-10_05:57:53.048230) 05:57:56.117881 run osmo-hlr_10.42.42.2(pid=1409): stderr: | 20221210055753247 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210055753247 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210055753247 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210055753247 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210055753247 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210055753247 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210055753259 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210055753267 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210055753267 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210055753267 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:57:56.189736 run osmo-msc_10.42.42.6(pid=1415): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1415)] 05:57:56.239428 run osmo-msc_10.42.42.6(pid=1415): stdout: | (launched: 2022-12-10_05:57:55.057671) 05:57:56.290842 run osmo-msc_10.42.42.6(pid=1415): stderr: | 20221210055755384 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210055755384 DLGLOBAL DEBUG validating counter group 0x7f421e110c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210055755384 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210055755384 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210055755384 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210055755385 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210055755386 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210055755387 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210055755387 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210055755387 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:57:56.343133 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1408): Terminating (SIGTERM) 05:57:56.384401 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1411): Terminating (SIGTERM) 05:57:56.425722 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1414): Terminating (SIGTERM) 05:57:56.467121 --- ParallelTerminationStrategy: PID 1408 died... 05:57:56.486461 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1408): Terminated: ok {rc=0} 05:57:56.532154 --- ParallelTerminationStrategy: PID 1411 died... 05:57:56.551551 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1411): Terminated: ok {rc=0} 05:57:56.597098 --- ParallelTerminationStrategy: PID 1414 died... 05:57:56.616391 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1414): Terminated: ok {rc=0} 05:57:56.703605 bus /sierra_3: Setting Powered False 05:57:57.802088 bus /sierra_3: Setting Powered False 05:57:58.917687 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2370 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 05:58:00.061330 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:58:00.073372 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 05:58:00.146857 tst mo_mt_call_osmux.py: using LAC 26324 05:58:00.263806 tst mo_mt_call_osmux.py: using RAC 59 05:58:00.379462 tst mo_mt_call_osmux.py: using CellId 26324 05:58:00.494296 tst mo_mt_call_osmux.py: using BVCI 26325 05:58:00.603822 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:58:00.615217 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:58:00.626465 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:58:00.637809 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:58:00.649206 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:58:00.660530 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 05:58:00.777800 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 05:58:00.918179 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:58:01.479986 run create_hlr_db(pid=1417): Launched 05:58:01.601490 bus /sierra_2: Setting Powered False 05:58:02.661190 run create_hlr_db(pid=1417): Terminated: ok {rc=0} 05:58:03.077818 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1419): Launched 05:58:03.377034 run osmo-hlr_10.42.42.2(pid=1420): Launched 05:58:03.491309 run osmo-stp_10.42.42.5: Starting osmo-stp 05:58:04.007711 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1422): Launched 05:58:04.306066 run osmo-stp_10.42.42.5(pid=1423): Launched 05:58:04.421252 run osmo-msc_10.42.42.6: Starting osmo-msc 05:58:04.962664 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1425): Launched 05:58:05.263725 run osmo-msc_10.42.42.6(pid=1426): Launched 05:58:05.431377 run osmo-stp_10.42.42.5(pid=1423): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1423)] 05:58:05.558083 run osmo-stp_10.42.42.5(pid=1423): stdout: | (launched: 2022-12-10_05:58:04.251408) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:58:05.685213 run osmo-stp_10.42.42.5(pid=1423): stderr: | 20221210055804423 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055804424 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055804424 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055804424 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055804425 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055804425 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055804425 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:58:05.810077 run osmo-stp_10.42.42.5(pid=1423): stdout: | (launched: 2022-12-10_05:58:04.251408) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:58:05.928165 run osmo-stp_10.42.42.5(pid=1423): stderr: | 20221210055804423 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055804424 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055804424 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055804424 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055804425 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055804425 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055804425 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:58:06.070396 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1423): Process ended prematurely: osmo-stp_10.42.42.5(pid=1423) [trial-2370↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1423)] [trial-2370↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 05:58:06.079572 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 05:58:06.106298 run osmo-hlr_10.42.42.2(pid=1420): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1420)] 05:58:06.153283 run osmo-hlr_10.42.42.2(pid=1420): stdout: | (launched: 2022-12-10_05:58:03.322366) 05:58:06.202254 run osmo-hlr_10.42.42.2(pid=1420): stderr: | 20221210055803498 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210055803498 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210055803499 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210055803499 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210055803499 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210055803499 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210055803511 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210055803519 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210055803520 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210055803520 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:58:06.270503 run osmo-msc_10.42.42.6(pid=1426): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1426)] 05:58:06.317860 run osmo-msc_10.42.42.6(pid=1426): stdout: | (launched: 2022-12-10_05:58:05.208365) 05:58:06.367228 run osmo-msc_10.42.42.6(pid=1426): stderr: | 20221210055805482 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210055805483 DLGLOBAL DEBUG validating counter group 0x7faf7e799c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210055805483 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210055805483 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210055805483 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210055805483 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210055805485 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210055805486 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210055805486 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210055805486 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:58:06.416495 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1419): Terminating (SIGTERM) 05:58:06.455797 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1422): Terminating (SIGTERM) 05:58:06.495083 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1425): Terminating (SIGTERM) 05:58:06.534651 --- ParallelTerminationStrategy: PID 1419 died... 05:58:06.553418 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1419): Terminated: ok {rc=0} 05:58:06.597568 --- ParallelTerminationStrategy: PID 1422 died... 05:58:06.615745 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1422): Terminated: ok {rc=0} 05:58:06.659331 --- ParallelTerminationStrategy: PID 1425 died... 05:58:06.677632 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1425): Terminated: ok {rc=0} 05:58:06.760374 bus /sierra_3: Setting Powered False 05:58:07.857821 bus /sierra_3: Setting Powered False 05:58:08.973119 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 voice:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 05:58:10.229247 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:58:10.235521 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 05:58:10.270037 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 05:58:10.297260 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 05:58:10.354347 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 05:58:10.388874 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 05:58:10.415901 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 05:58:10.962024 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 05:58:11.012654 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:58:11.024232 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 05:58:11.095849 tst mo_mt_call.py: using LAC 26325 05:58:11.220832 tst mo_mt_call.py: using RAC 60 05:58:11.350967 tst mo_mt_call.py: using CellId 26325 05:58:11.475773 tst mo_mt_call.py: using BVCI 26326 05:58:11.591129 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:58:11.602655 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:58:11.613915 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:58:11.625182 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:58:11.636439 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:58:11.647677 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 05:58:11.763734 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 05:58:11.882922 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:58:12.377894 run create_hlr_db(pid=1431): Launched 05:58:12.508717 bus /sierra_2: Setting Powered False 05:58:13.571942 run create_hlr_db(pid=1431): Terminated: ok {rc=0} 05:58:14.000394 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1433): Launched 05:58:14.300890 run osmo-hlr_10.42.42.2(pid=1434): Launched 05:58:14.415795 run osmo-stp_10.42.42.5: Starting osmo-stp 05:58:14.946835 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1436): Launched 05:58:15.248732 run osmo-stp_10.42.42.5(pid=1437): Launched 05:58:15.366207 run osmo-msc_10.42.42.6: Starting osmo-msc 05:58:15.925699 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1439): Launched 05:58:16.246876 run osmo-msc_10.42.42.6(pid=1440): Launched 05:58:16.694098 run osmo-stp_10.42.42.5(pid=1437): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1437)] 05:58:16.929779 run osmo-stp_10.42.42.5(pid=1437): stdout: | (launched: 2022-12-10_05:58:15.193320) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:58:17.058335 run osmo-stp_10.42.42.5(pid=1437): stderr: | 20221210055815366 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055815366 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055815367 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055815367 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055815367 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055815368 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055815368 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:58:17.186990 run osmo-stp_10.42.42.5(pid=1437): stdout: | (launched: 2022-12-10_05:58:15.193320) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:58:17.308840 run osmo-stp_10.42.42.5(pid=1437): stderr: | 20221210055815366 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055815366 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055815367 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055815367 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055815367 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055815368 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055815368 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:58:17.455470 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1437): Process ended prematurely: osmo-stp_10.42.42.5(pid=1437) [trial-2370↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1437)] [trial-2370↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 05:58:17.465279 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 05:58:17.494066 run osmo-hlr_10.42.42.2(pid=1434): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1434)] 05:58:17.542454 run osmo-hlr_10.42.42.2(pid=1434): stdout: | (launched: 2022-12-10_05:58:14.246125) 05:58:17.592676 run osmo-hlr_10.42.42.2(pid=1434): stderr: | 20221210055814419 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210055814419 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210055814419 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210055814419 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210055814419 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210055814419 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210055814432 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210055814442 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210055814442 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210055814442 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:58:17.662079 run osmo-msc_10.42.42.6(pid=1440): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1440)] 05:58:17.710259 run osmo-msc_10.42.42.6(pid=1440): stdout: | (launched: 2022-12-10_05:58:16.188623) 05:58:17.759934 run osmo-msc_10.42.42.6(pid=1440): stderr: | 20221210055816576 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210055816578 DLGLOBAL DEBUG validating counter group 0x7f3dea53cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210055816578 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210055816578 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210055816580 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210055816582 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210055816589 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210055816589 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210055816590 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210055816590 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:58:17.809973 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1433): Terminating (SIGTERM) 05:58:17.850276 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1436): Terminating (SIGTERM) 05:58:17.890702 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1439): Terminating (SIGTERM) 05:58:17.931336 --- ParallelTerminationStrategy: PID 1433 died... 05:58:17.950424 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1433): Terminated: ok {rc=0} 05:58:17.995920 --- ParallelTerminationStrategy: PID 1436 died... 05:58:18.014606 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1436): Terminated: ok {rc=0} 05:58:18.059906 --- ParallelTerminationStrategy: PID 1439 died... 05:58:18.078725 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1439): Terminated: ok {rc=0} 05:58:18.165578 bus /sierra_3: Setting Powered False 05:58:19.265449 bus /sierra_3: Setting Powered False 05:58:20.382780 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2370 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 05:58:21.533892 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:58:21.546148 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 05:58:21.619509 tst mo_mt_call_osmux.py: using LAC 26326 05:58:21.750574 tst mo_mt_call_osmux.py: using RAC 61 05:58:21.876488 tst mo_mt_call_osmux.py: using CellId 26326 05:58:21.994942 tst mo_mt_call_osmux.py: using BVCI 26327 05:58:22.105509 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:58:22.116627 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:58:22.127815 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:58:22.138890 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:58:22.150064 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:58:22.161187 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 05:58:22.277620 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 05:58:22.400455 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:58:22.893629 run create_hlr_db(pid=1442): Launched 05:58:23.023872 bus /sierra_2: Setting Powered False 05:58:24.086571 run create_hlr_db(pid=1442): Terminated: ok {rc=0} 05:58:24.514023 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1445): Launched 05:58:24.813626 run osmo-hlr_10.42.42.2(pid=1446): Launched 05:58:24.928296 run osmo-stp_10.42.42.5: Starting osmo-stp 05:58:25.455287 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1448): Launched 05:58:25.754415 run osmo-stp_10.42.42.5(pid=1449): Launched 05:58:25.868490 run osmo-msc_10.42.42.6: Starting osmo-msc 05:58:26.410536 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1451): Launched 05:58:26.710282 run osmo-msc_10.42.42.6(pid=1452): Launched 05:58:26.877603 run osmo-stp_10.42.42.5(pid=1449): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1449)] 05:58:27.004201 run osmo-stp_10.42.42.5(pid=1449): stdout: | (launched: 2022-12-10_05:58:25.699429) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:58:27.131830 run osmo-stp_10.42.42.5(pid=1449): stderr: | 20221210055825868 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055825868 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055825868 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055825869 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055825871 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055825871 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055825871 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:58:27.256913 run osmo-stp_10.42.42.5(pid=1449): stdout: | (launched: 2022-12-10_05:58:25.699429) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:58:27.376116 run osmo-stp_10.42.42.5(pid=1449): stderr: | 20221210055825868 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055825868 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055825868 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055825869 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055825871 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055825871 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055825871 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:58:27.519133 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1449): Process ended prematurely: osmo-stp_10.42.42.5(pid=1449) [trial-2370↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1449)] [trial-2370↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 05:58:27.528241 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 05:58:27.555083 run osmo-hlr_10.42.42.2(pid=1446): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1446)] 05:58:27.602365 run osmo-hlr_10.42.42.2(pid=1446): stdout: | (launched: 2022-12-10_05:58:24.758937) 05:58:27.651291 run osmo-hlr_10.42.42.2(pid=1446): stderr: | 20221210055824935 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210055824936 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210055824936 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210055824936 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210055824936 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210055824936 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210055824948 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210055824957 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210055824958 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210055824958 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:58:27.719393 run osmo-msc_10.42.42.6(pid=1452): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1452)] 05:58:27.766959 run osmo-msc_10.42.42.6(pid=1452): stdout: | (launched: 2022-12-10_05:58:26.654753) 05:58:27.815719 run osmo-msc_10.42.42.6(pid=1452): stderr: | 20221210055826926 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210055826926 DLGLOBAL DEBUG validating counter group 0x7f19f6236c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210055826926 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210055826926 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210055826927 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210055826927 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210055826930 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210055826930 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210055826930 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210055826930 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:58:27.865193 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1445): Terminating (SIGTERM) 05:58:27.904512 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1448): Terminating (SIGTERM) 05:58:27.943889 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1451): Terminating (SIGTERM) 05:58:27.983553 --- ParallelTerminationStrategy: PID 1445 died... 05:58:28.002462 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1445): Terminated: ok {rc=0} 05:58:28.046290 --- ParallelTerminationStrategy: PID 1448 died... 05:58:28.064625 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1448): Terminated: ok {rc=0} 05:58:28.108237 --- ParallelTerminationStrategy: PID 1451 died... 05:58:28.126629 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1451): Terminated: ok {rc=0} 05:58:28.211764 bus /sierra_3: Setting Powered False 05:58:29.309771 bus /sierra_3: Setting Powered False 05:58:30.420551 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 voice:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 emergency:trx-sysmocell5000 --------------------------------------------------------------------- 05:58:31.692472 tst emergency:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:58:31.698242 tst emergency:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 05:58:31.740266 tst emergency:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 05:58:31.775296 tst emergency:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 05:58:31.873956 tst emergency:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 05:58:31.909925 tst emergency:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 05:58:31.939289 tst emergency:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 05:58:32.517197 tst emergency:trx-sysmocell5000: RESERVED RESOURCES for emergency: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2370 emergency:trx-sysmocell5000 emergency_mo_mt_call.py ---------------------------------------------- 05:58:32.523564 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 05:58:32.535185 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 05:58:32.587701 tst emergency_mo_mt_call.py: using LAC 26327 05:58:32.710194 tst emergency_mo_mt_call.py: using RAC 62 05:58:32.834848 tst emergency_mo_mt_call.py: using CellId 26327 05:58:32.956914 tst emergency_mo_mt_call.py: using BVCI 26328 05:58:33.070033 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 05:58:33.081312 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 05:58:33.092319 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 05:58:33.103460 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 05:58:33.114595 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 05:58:33.125578 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 05:58:33.244504 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 05:58:33.360319 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:58:33.817280 run create_hlr_db(pid=1457): Launched 05:58:33.930493 bus /sierra_2: Setting Powered False 05:58:34.989377 run create_hlr_db(pid=1457): Terminated: ok {rc=0} 05:58:35.399330 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1459): Launched 05:58:35.692921 run osmo-hlr_10.42.42.2(pid=1460): Launched 05:58:35.804156 run osmo-stp_10.42.42.5: Starting osmo-stp 05:58:36.322387 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1462): Launched 05:58:36.616487 run osmo-stp_10.42.42.5(pid=1463): Launched 05:58:36.739627 tst emergency_mo_mt_call.py: using MSISDN 7578 05:58:36.905604 run osmo-msc_10.42.42.6: Starting osmo-msc 05:58:37.437460 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1465): Launched 05:58:37.732234 run osmo-msc_10.42.42.6(pid=1466): Launched 05:58:37.897682 run osmo-stp_10.42.42.5(pid=1463): ERR: Terminated: ERROR {rc=1} [trial-2370↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1463)] 05:58:38.023731 run osmo-stp_10.42.42.5(pid=1463): stdout: | (launched: 2022-12-10_05:58:36.561924) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:58:38.148940 run osmo-stp_10.42.42.5(pid=1463): stderr: | 20221210055836733 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055836733 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055836734 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055836734 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055836735 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055836735 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055836735 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:58:38.271908 run osmo-stp_10.42.42.5(pid=1463): stdout: | (launched: 2022-12-10_05:58:36.561924) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:58:38.388534 run osmo-stp_10.42.42.5(pid=1463): stderr: | 20221210055836733 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055836733 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055836734 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055836734 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055836735 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055836735 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055836735 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:58:38.528357 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=1463): Process ended prematurely: osmo-stp_10.42.42.5(pid=1463) [trial-2370↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1463)] [trial-2370↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19] 05:58:38.536845 tst emergency_mo_mt_call.py:19: Test FAILED (6.0 sec) 05:58:38.563554 run osmo-hlr_10.42.42.2(pid=1460): ERR: Terminated: ERROR {rc=237} [trial-2370↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1460)] 05:58:38.611462 run osmo-hlr_10.42.42.2(pid=1460): stdout: | (launched: 2022-12-10_05:58:35.639261) 05:58:38.660940 run osmo-hlr_10.42.42.2(pid=1460): stderr: | 20221210055835816 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210055835816 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210055835816 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210055835816 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210055835816 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210055835816 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210055835829 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/emergency:trx-sysmocell5000/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210055835837 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210055835838 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210055835838 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:58:38.729989 run osmo-msc_10.42.42.6(pid=1466): ERR: Terminated: ERROR {rc=2} [trial-2370↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1466)] 05:58:38.778016 run osmo-msc_10.42.42.6(pid=1466): stdout: | (launched: 2022-12-10_05:58:37.678299) 05:58:38.827543 run osmo-msc_10.42.42.6(pid=1466): stderr: | 20221210055837948 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210055837948 DLGLOBAL DEBUG validating counter group 0x7f9137304c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210055837949 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210055837949 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210055837949 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210055837949 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210055837951 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210055837951 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210055837951 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210055837952 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:58:38.877271 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1459): Terminating (SIGTERM) 05:58:38.917229 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1462): Terminating (SIGTERM) 05:58:38.957127 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1465): Terminating (SIGTERM) 05:58:38.996985 --- ParallelTerminationStrategy: PID 1459 died... 05:58:39.015911 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1459): Terminated: ok {rc=0} 05:58:39.060035 --- ParallelTerminationStrategy: PID 1462 died... 05:58:39.078634 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1462): Terminated: ok {rc=0} 05:58:39.122567 --- ParallelTerminationStrategy: PID 1465 died... 05:58:39.141081 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1465): Terminated: ok {rc=0} 05:58:39.226509 bus /sierra_3: Setting Powered False 05:58:40.327266 bus /sierra_3: Setting Powered False 05:58:41.443170 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2370 emergency:trx-sysmocell5000 emergency_preemptive_call.py ---------------------------------------------- 05:58:42.532002 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 05:58:42.543615 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 05:58:42.595093 tst emergency_preemptive_call.py: using LAC 26328 05:58:42.709894 tst emergency_preemptive_call.py: using RAC 63 05:58:42.825202 tst emergency_preemptive_call.py: using CellId 26328 05:58:42.941750 tst emergency_preemptive_call.py: using BVCI 26329 05:58:43.047568 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 05:58:43.058409 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 05:58:43.069167 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 05:58:43.080000 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 05:58:43.090893 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 05:58:43.101773 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 05:58:43.215205 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 05:58:43.333801 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 05:58:43.447139 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 05:58:43.559119 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:58:44.016586 run create_hlr_db(pid=1468): Launched 05:58:44.128060 bus /sierra_2: Setting Powered False 05:58:45.186571 run create_hlr_db(pid=1468): Terminated: ok {rc=0} 05:58:45.598653 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1470): Launched 05:58:45.903310 run osmo-hlr_10.42.42.2(pid=1471): Launched 05:58:46.129797 run osmo-stp_10.42.42.5: Starting osmo-stp 05:58:46.813077 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1473): Launched 05:58:47.143590 run osmo-stp_10.42.42.5(pid=1474): Launched 05:58:47.313678 tst emergency_preemptive_call.py: using MSISDN 7579 05:58:47.501897 run osmo-msc_10.42.42.6: Starting osmo-msc 05:58:48.067264 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1476): Launched 05:58:48.381962 run osmo-msc_10.42.42.6(pid=1477): Launched 05:58:48.558087 run osmo-stp_10.42.42.5(pid=1474): ERR: Terminated: ERROR {rc=1} [trial-2370↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1474)] 05:58:48.689668 run osmo-stp_10.42.42.5(pid=1474): stdout: | (launched: 2022-12-10_05:58:47.085158) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:58:48.822742 run osmo-stp_10.42.42.5(pid=1474): stderr: | 20221210055847389 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055847389 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055847389 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055847390 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055847390 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055847390 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055847390 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:58:48.955200 run osmo-stp_10.42.42.5(pid=1474): stdout: | (launched: 2022-12-10_05:58:47.085158) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:58:49.080193 run osmo-stp_10.42.42.5(pid=1474): stderr: | 20221210055847389 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055847389 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055847389 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055847390 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055847390 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055847390 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055847390 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:58:49.230413 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=1474): Process ended prematurely: osmo-stp_10.42.42.5(pid=1474) [trial-2370↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1474)] [trial-2370↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32] 05:58:49.239773 tst emergency_preemptive_call.py:32: Test FAILED (6.7 sec) 05:58:49.267503 run osmo-hlr_10.42.42.2(pid=1471): ERR: Terminated: ERROR {rc=237} [trial-2370↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1471)] 05:58:49.317779 run osmo-hlr_10.42.42.2(pid=1471): stdout: | (launched: 2022-12-10_05:58:45.840089) 05:58:49.369961 run osmo-hlr_10.42.42.2(pid=1471): stderr: | 20221210055846183 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210055846183 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210055846183 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210055846183 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210055846184 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210055846184 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210055846209 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/emergency:trx-sysmocell5000/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210055846235 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210055846235 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210055846235 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:58:49.442757 run osmo-msc_10.42.42.6(pid=1477): ERR: Terminated: ERROR {rc=2} [trial-2370↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1477)] 05:58:49.493302 run osmo-msc_10.42.42.6(pid=1477): stdout: | (launched: 2022-12-10_05:58:48.324583) 05:58:49.545227 run osmo-msc_10.42.42.6(pid=1477): stderr: | 20221210055848645 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210055848646 DLGLOBAL DEBUG validating counter group 0x7fdb027b1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210055848646 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210055848646 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210055848646 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210055848646 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210055848648 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210055848648 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210055848648 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210055848649 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:58:49.597390 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1470): Terminating (SIGTERM) 05:58:49.639023 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1473): Terminating (SIGTERM) 05:58:49.681264 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1476): Terminating (SIGTERM) 05:58:49.723256 --- ParallelTerminationStrategy: PID 1470 died... 05:58:49.743266 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1470): Terminated: ok {rc=0} 05:58:49.789636 --- ParallelTerminationStrategy: PID 1473 died... 05:58:49.809352 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1473): Terminated: ok {rc=0} 05:58:49.855323 --- ParallelTerminationStrategy: PID 1476 died... 05:58:49.874973 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1476): Terminated: ok {rc=0} 05:58:49.962899 bus /sierra_9: Setting Powered False 05:58:51.063211 bus /sierra_9: Setting Powered False 05:58:52.179035 bus /sierra_8: Setting Powered False 05:58:53.277562 bus /sierra_8: Setting Powered False 05:58:54.393337 bus /sierra_3: Setting Powered False 05:58:55.491397 bus /sierra_3: Setting Powered False 05:58:56.608452 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 emergency:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 gprs:trx-sysmocell5000 --------------------------------------------------------------------- 05:58:57.885511 tst gprs:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:58:57.890024 tst gprs:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 05:58:57.923706 tst gprs:trx-sysmocell5000: Verifying 9 x ip_address (candidates: 9) 05:58:57.961547 tst gprs:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 05:58:58.047296 tst gprs:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 05:58:58.080202 tst gprs:trx-sysmocell5000: Reserving 9 x ip_address (candidates: 9) 05:58:58.118163 tst gprs:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 05:58:58.709463 tst gprs:trx-sysmocell5000: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2370 gprs:trx-sysmocell5000 cs_paging_gprs_active.py ---------------------------------------------- 05:58:58.758776 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 05:58:58.769519 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 05:58:58.818371 tst cs_paging_gprs_active.py: using LAC 26329 05:58:58.938468 tst cs_paging_gprs_active.py: using RAC 64 05:58:59.057663 tst cs_paging_gprs_active.py: using CellId 26329 05:58:59.175814 tst cs_paging_gprs_active.py: using BVCI 26330 05:58:59.286471 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 05:58:59.297273 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 05:58:59.307790 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 05:58:59.318606 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 05:58:59.329425 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 05:58:59.339996 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 05:58:59.350960 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 05:58:59.361662 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 05:58:59.372600 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 05:58:59.487697 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 05:58:59.604532 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 05:58:59.805594 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:59:00.106258 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1483): Launched 05:59:00.371633 run iperf3-srv_10.42.42.10(pid=1484): Launched 05:59:00.484774 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 05:59:00.685766 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:59:01.020089 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1485): Launched 05:59:01.302451 run iperf3-srv_10.42.42.10(pid=1486): Launched 05:59:01.431884 tst cs_paging_gprs_active.py:38: start network... 05:59:01.637344 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:59:02.112222 run create_hlr_db(pid=1487): Launched 05:59:02.256469 bus /sierra_2: Setting Powered False 05:59:03.316704 run create_hlr_db(pid=1487): Terminated: ok {rc=0} 05:59:03.735104 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1489): Launched 05:59:04.035618 run osmo-hlr_10.42.42.2(pid=1490): Launched 05:59:04.150866 run osmo-stp_10.42.42.5: Starting osmo-stp 05:59:04.682008 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1492): Launched 05:59:04.982327 run osmo-stp_10.42.42.5(pid=1493): Launched 05:59:05.097762 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:59:05.617410 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1495): Launched 05:59:05.733370 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:59:05.987103 run patchelf(pid=1496): Launched 05:59:06.155590 run osmo-stp_10.42.42.5(pid=1493): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1493)] 05:59:06.283092 run osmo-stp_10.42.42.5(pid=1493): stdout: | (launched: 2022-12-10_05:59:04.927202) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:59:06.412159 run osmo-stp_10.42.42.5(pid=1493): stderr: | 20221210055905094 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055905094 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055905094 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055905095 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055905097 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055905097 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055905097 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:59:06.541486 run osmo-stp_10.42.42.5(pid=1493): stdout: | (launched: 2022-12-10_05:59:04.927202) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:59:06.664825 run osmo-stp_10.42.42.5(pid=1493): stderr: | 20221210055905094 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055905094 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055905094 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055905095 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055905097 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055905097 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055905097 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:59:06.810903 run patchelf(pid=1496): Terminating (SIGINT) 05:59:06.979362 run patchelf(pid=1496): Terminated: ok {rc=0} 05:59:07.100932 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=1493): Process ended prematurely: osmo-stp_10.42.42.5(pid=1493) [trial-2370↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1493)] [trial-2370↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38] 05:59:07.110595 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 05:59:07.138045 run osmo-hlr_10.42.42.2(pid=1490): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1490)] 05:59:07.185082 run osmo-hlr_10.42.42.2(pid=1490): stdout: | (launched: 2022-12-10_05:59:03.980646) 05:59:07.233920 run osmo-hlr_10.42.42.2(pid=1490): stderr: | 20221210055904158 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210055904158 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210055904158 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210055904158 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210055904158 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210055904158 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210055904170 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-sysmocell5000/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210055904179 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210055904179 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210055904179 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:59:07.283380 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1483): Terminating (SIGTERM) 05:59:07.322664 run iperf3-srv_10.42.42.10(pid=1484): Terminating (SIGTERM) 05:59:07.361942 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1485): Terminating (SIGTERM) 05:59:07.401286 run iperf3-srv_10.42.42.10(pid=1486): Terminating (SIGTERM) 05:59:07.440484 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1489): Terminating (SIGTERM) 05:59:07.479847 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1492): Terminating (SIGTERM) 05:59:07.519101 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1495): Terminating (SIGTERM) 05:59:07.558689 --- ParallelTerminationStrategy: PID 1483 died... 05:59:07.577579 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1483): Terminated: ok {rc=0} 05:59:07.621916 --- ParallelTerminationStrategy: PID 1484 died... 05:59:07.640240 run iperf3-srv_10.42.42.10(pid=1484): Terminated {rc=256} 05:59:07.684041 --- ParallelTerminationStrategy: PID 1485 died... 05:59:07.702380 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1485): Terminated: ok {rc=0} 05:59:07.745872 --- ParallelTerminationStrategy: PID 1486 died... 05:59:07.764131 run iperf3-srv_10.42.42.10(pid=1486): Terminated {rc=256} 05:59:07.807848 --- ParallelTerminationStrategy: PID 1489 died... 05:59:07.826271 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1489): Terminated: ok {rc=0} 05:59:07.869888 --- ParallelTerminationStrategy: PID 1492 died... 05:59:07.888238 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1492): Terminated: ok {rc=0} 05:59:07.932741 --- ParallelTerminationStrategy: PID 1495 died... 05:59:07.951683 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1495): Terminated: ok {rc=0} 05:59:08.038098 bus /gobi_0: Setting Powered False 05:59:09.136914 bus /gobi_0: Setting Powered False 05:59:10.250458 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-sysmocell5000 iperf3.py ---------------------------------------------- 05:59:11.399513 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 05:59:11.411573 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 05:59:11.469442 tst iperf3.py: using LAC 26330 05:59:11.595006 tst iperf3.py: using RAC 65 05:59:11.719549 tst iperf3.py: using CellId 26330 05:59:11.843844 tst iperf3.py: using BVCI 26331 05:59:11.960376 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 05:59:11.971682 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 05:59:11.982893 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 05:59:11.994194 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 05:59:12.005371 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 05:59:12.016465 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 05:59:12.027844 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 05:59:12.039019 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 05:59:12.050360 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 05:59:12.164636 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 05:59:12.366788 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:59:12.668307 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1497): Launched 05:59:12.930802 run iperf3-srv_10.42.42.10(pid=1498): Launched 05:59:13.055906 tst iperf3.py:8: start network... 05:59:13.272331 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:59:13.770143 run create_hlr_db(pid=1499): Launched 05:59:13.901575 bus /gobi_6: Setting Powered False 05:59:14.965022 run create_hlr_db(pid=1499): Terminated: ok {rc=0} 05:59:15.412039 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1501): Launched 05:59:15.734047 run osmo-hlr_10.42.42.2(pid=1502): Launched 05:59:15.892175 run osmo-stp_10.42.42.5: Starting osmo-stp 05:59:16.573164 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1504): Launched 05:59:16.913019 run osmo-stp_10.42.42.5(pid=1505): Launched 05:59:17.140240 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:59:17.735188 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1507): Launched 05:59:17.850856 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:59:18.105466 run patchelf(pid=1508): Launched 05:59:18.273367 run osmo-stp_10.42.42.5(pid=1505): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1505)] 05:59:18.400932 run osmo-stp_10.42.42.5(pid=1505): stdout: | (launched: 2022-12-10_05:59:16.854535) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:59:18.529730 run osmo-stp_10.42.42.5(pid=1505): stderr: | 20221210055917152 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055917152 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055917152 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055917153 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055917153 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055917153 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055917153 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:59:18.658655 run osmo-stp_10.42.42.5(pid=1505): stdout: | (launched: 2022-12-10_05:59:16.854535) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:59:18.782193 run osmo-stp_10.42.42.5(pid=1505): stderr: | 20221210055917152 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055917152 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055917152 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055917153 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055917153 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055917153 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055917153 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:59:18.928391 run patchelf(pid=1508): Terminating (SIGINT) 05:59:19.096404 run patchelf(pid=1508): Terminated: ok {rc=0} 05:59:19.218345 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1505): Process ended prematurely: osmo-stp_10.42.42.5(pid=1505) [trial-2370↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1505)] [trial-2370↪gprs:trx-sysmocell5000↪iperf3.py:8] 05:59:19.227961 tst iperf3.py:8: Test FAILED (7.9 sec) 05:59:19.255541 run osmo-hlr_10.42.42.2(pid=1502): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-sysmocell5000↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1502)] 05:59:19.303578 run osmo-hlr_10.42.42.2(pid=1502): stdout: | (launched: 2022-12-10_05:59:15.675053) 05:59:19.352858 run osmo-hlr_10.42.42.2(pid=1502): stderr: | 20221210055915898 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210055915898 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210055915898 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210055915898 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210055915898 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210055915898 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210055915917 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-sysmocell5000/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210055915926 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210055915926 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210055915926 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:59:19.402616 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1497): Terminating (SIGTERM) 05:59:19.442428 run iperf3-srv_10.42.42.10(pid=1498): Terminating (SIGTERM) 05:59:19.482073 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1501): Terminating (SIGTERM) 05:59:19.522615 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1504): Terminating (SIGTERM) 05:59:19.562857 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1507): Terminating (SIGTERM) 05:59:19.602930 --- ParallelTerminationStrategy: PID 1497 died... 05:59:19.621960 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1497): Terminated: ok {rc=0} 05:59:19.666306 --- ParallelTerminationStrategy: PID 1498 died... 05:59:19.684708 run iperf3-srv_10.42.42.10(pid=1498): Terminated {rc=256} 05:59:19.728437 --- ParallelTerminationStrategy: PID 1501 died... 05:59:19.746962 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1501): Terminated: ok {rc=0} 05:59:19.790623 --- ParallelTerminationStrategy: PID 1504 died... 05:59:19.809128 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1504): Terminated: ok {rc=0} 05:59:19.852808 --- ParallelTerminationStrategy: PID 1507 died... 05:59:19.871305 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1507): Terminated: ok {rc=0} 05:59:19.954274 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-sysmocell5000 iperf3m4.py ---------------------------------------------- 05:59:21.103512 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 05:59:21.115601 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 05:59:21.166708 tst iperf3m4.py: using LAC 26331 05:59:21.295019 tst iperf3m4.py: using RAC 66 05:59:21.419818 tst iperf3m4.py: using CellId 26331 05:59:21.538910 tst iperf3m4.py: using BVCI 26332 05:59:21.647744 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 05:59:21.658777 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 05:59:21.669544 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 05:59:21.680467 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 05:59:21.691367 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 05:59:21.702165 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 05:59:21.713085 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 05:59:21.723815 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 05:59:21.734758 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 05:59:21.853738 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 05:59:21.972293 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 05:59:22.092076 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 05:59:22.214628 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 05:59:22.430827 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:59:22.753286 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1509): Launched 05:59:23.033036 run iperf3-srv_10.42.42.10(pid=1510): Launched 05:59:23.155131 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 05:59:23.372180 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:59:23.694748 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1511): Launched 05:59:23.976833 run iperf3-srv_10.42.42.10(pid=1512): Launched 05:59:24.097810 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 05:59:24.314901 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:59:24.637789 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1513): Launched 05:59:24.918658 run iperf3-srv_10.42.42.10(pid=1514): Launched 05:59:25.039638 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 05:59:25.256758 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:59:25.579417 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1515): Launched 05:59:25.859060 run iperf3-srv_10.42.42.10(pid=1516): Launched 05:59:25.980286 tst iperf3m4.py:8: start network... 05:59:26.195959 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:59:26.694903 run create_hlr_db(pid=1517): Launched 05:59:26.824624 bus /gobi_6: Setting Powered False 05:59:27.888287 run create_hlr_db(pid=1517): Terminated: ok {rc=0} 05:59:28.317607 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1519): Launched 05:59:28.618428 run osmo-hlr_10.42.42.2(pid=1520): Launched 05:59:28.732678 run osmo-stp_10.42.42.5: Starting osmo-stp 05:59:29.269714 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1522): Launched 05:59:29.570246 run osmo-stp_10.42.42.5(pid=1523): Launched 05:59:29.687055 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:59:30.205810 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1525): Launched 05:59:30.321646 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:59:30.575383 run patchelf(pid=1526): Launched 05:59:30.743367 run osmo-stp_10.42.42.5(pid=1523): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1523)] 05:59:30.884760 run osmo-stp_10.42.42.5(pid=1523): stdout: | (launched: 2022-12-10_05:59:29.515095) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:59:31.028119 run osmo-stp_10.42.42.5(pid=1523): stderr: | 20221210055929683 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055929684 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055929684 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055929684 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055929685 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055929685 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055929685 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:59:31.172255 run osmo-stp_10.42.42.5(pid=1523): stdout: | (launched: 2022-12-10_05:59:29.515095) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:59:31.308723 run osmo-stp_10.42.42.5(pid=1523): stderr: | 20221210055929683 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055929684 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055929684 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055929684 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055929685 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055929685 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055929685 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:59:31.470714 run patchelf(pid=1526): Terminating (SIGINT) 05:59:31.660372 run patchelf(pid=1526): Terminated: ok {rc=0} 05:59:31.823899 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1523): Process ended prematurely: osmo-stp_10.42.42.5(pid=1523) [trial-2370↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1523)] [trial-2370↪gprs:trx-sysmocell5000↪iperf3m4.py:8] 05:59:31.837248 tst iperf3m4.py:8: Test FAILED (10.8 sec) 05:59:31.874985 run osmo-hlr_10.42.42.2(pid=1520): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-sysmocell5000↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1520)] 05:59:31.933470 run osmo-hlr_10.42.42.2(pid=1520): stdout: | (launched: 2022-12-10_05:59:28.563027) 05:59:31.996806 run osmo-hlr_10.42.42.2(pid=1520): stderr: | 20221210055928738 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210055928738 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210055928738 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210055928738 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210055928738 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210055928738 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210055928751 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-sysmocell5000/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210055928759 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210055928760 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210055928760 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:59:32.061227 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1509): Terminating (SIGTERM) 05:59:32.108749 run iperf3-srv_10.42.42.10(pid=1510): Terminating (SIGTERM) 05:59:32.151798 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1511): Terminating (SIGTERM) 05:59:32.193431 run iperf3-srv_10.42.42.10(pid=1512): Terminating (SIGTERM) 05:59:32.236648 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1513): Terminating (SIGTERM) 05:59:32.279608 run iperf3-srv_10.42.42.10(pid=1514): Terminating (SIGTERM) 05:59:32.320472 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1515): Terminating (SIGTERM) 05:59:32.361995 run iperf3-srv_10.42.42.10(pid=1516): Terminating (SIGTERM) 05:59:32.402740 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1519): Terminating (SIGTERM) 05:59:32.443734 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1522): Terminating (SIGTERM) 05:59:32.485073 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1525): Terminating (SIGTERM) 05:59:32.526535 --- ParallelTerminationStrategy: PID 1509 died... 05:59:32.546299 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1509): Terminated: ok {rc=0} 05:59:32.592551 --- ParallelTerminationStrategy: PID 1510 died... 05:59:32.611719 run iperf3-srv_10.42.42.10(pid=1510): Terminated {rc=256} 05:59:32.656658 --- ParallelTerminationStrategy: PID 1511 died... 05:59:32.675892 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1511): Terminated: ok {rc=0} 05:59:32.720872 --- ParallelTerminationStrategy: PID 1512 died... 05:59:32.740003 run iperf3-srv_10.42.42.10(pid=1512): Terminated {rc=256} 05:59:32.785102 --- ParallelTerminationStrategy: PID 1513 died... 05:59:32.804347 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1513): Terminated: ok {rc=0} 05:59:32.849831 --- ParallelTerminationStrategy: PID 1514 died... 05:59:32.868885 run iperf3-srv_10.42.42.10(pid=1514): Terminated {rc=256} 05:59:32.913965 --- ParallelTerminationStrategy: PID 1515 died... 05:59:32.933195 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1515): Terminated: ok {rc=0} 05:59:32.978271 --- ParallelTerminationStrategy: PID 1516 died... 05:59:32.997483 run iperf3-srv_10.42.42.10(pid=1516): Terminated {rc=256} 05:59:33.042896 --- ParallelTerminationStrategy: PID 1519 died... 05:59:33.062148 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1519): Terminated: ok {rc=0} 05:59:33.107597 --- ParallelTerminationStrategy: PID 1522 died... 05:59:33.126910 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1522): Terminated: ok {rc=0} 05:59:33.172175 --- ParallelTerminationStrategy: PID 1525 died... 05:59:33.191736 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1525): Terminated: ok {rc=0} 05:59:33.279220 bus /gobi_4: Setting Powered False 05:59:34.378954 bus /gobi_4: Setting Powered False 05:59:35.493849 bus /gobi_1: Setting Powered False 05:59:36.590741 bus /gobi_1: Setting Powered False 05:59:37.705850 bus /gobi_0: Setting Powered False 05:59:38.803374 bus /gobi_0: Setting Powered False 05:59:39.919733 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-sysmocell5000 ping.py ---------------------------------------------- 05:59:41.022363 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 05:59:41.034090 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 05:59:41.088034 tst ping.py: using LAC 26332 05:59:41.206476 tst ping.py: using RAC 67 05:59:41.322512 tst ping.py: using CellId 26332 05:59:41.437787 tst ping.py: using BVCI 26333 05:59:41.552506 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 05:59:41.563955 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 05:59:41.575144 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 05:59:41.586357 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 05:59:41.597453 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 05:59:41.608735 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 05:59:41.620031 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 05:59:41.631149 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 05:59:41.746324 tst ping.py:19: start network... 05:59:41.942897 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:59:42.398339 run create_hlr_db(pid=1527): Launched 05:59:42.513334 bus /gobi_6: Setting Powered False 05:59:43.571729 run create_hlr_db(pid=1527): Terminated: ok {rc=0} 05:59:44.002979 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1529): Launched 05:59:44.318848 run osmo-hlr_10.42.42.2(pid=1530): Launched 05:59:44.438787 run osmo-stp_10.42.42.5: Starting osmo-stp 05:59:44.984433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1532): Launched 05:59:45.299375 run osmo-stp_10.42.42.5(pid=1533): Launched 05:59:45.421549 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:59:45.976231 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1535): Launched 05:59:46.129310 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:59:46.442224 run patchelf(pid=1536): Launched 05:59:46.634655 run osmo-stp_10.42.42.5(pid=1533): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1533)] 05:59:46.771405 run osmo-stp_10.42.42.5(pid=1533): stdout: | (launched: 2022-12-10_05:59:45.241734) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:59:46.909535 run osmo-stp_10.42.42.5(pid=1533): stderr: | 20221210055945431 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055945431 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055945432 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055945432 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055945432 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055945433 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055945433 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:59:47.048497 run osmo-stp_10.42.42.5(pid=1533): stdout: | (launched: 2022-12-10_05:59:45.241734) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:59:47.185892 run osmo-stp_10.42.42.5(pid=1533): stderr: | 20221210055945431 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055945431 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055945432 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055945432 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055945432 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055945433 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055945433 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:59:47.341838 run patchelf(pid=1536): Terminating (SIGINT) 05:59:47.518502 run patchelf(pid=1536): Terminated: ok {rc=0} 05:59:47.645764 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=1533): Process ended prematurely: osmo-stp_10.42.42.5(pid=1533) [trial-2370↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1533)] [trial-2370↪gprs:trx-sysmocell5000↪ping.py:22] 05:59:47.655349 tst ping.py:22: Test FAILED (6.6 sec) 05:59:47.683691 run osmo-hlr_10.42.42.2(pid=1530): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-sysmocell5000↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1530)] 05:59:47.733898 run osmo-hlr_10.42.42.2(pid=1530): stdout: | (launched: 2022-12-10_05:59:44.261255) 05:59:47.785935 run osmo-hlr_10.42.42.2(pid=1530): stderr: | 20221210055944461 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210055944461 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210055944461 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210055944461 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210055944461 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210055944461 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210055944473 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-sysmocell5000/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210055944482 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210055944482 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210055944482 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:59:47.838294 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1529): Terminating (SIGTERM) 05:59:47.879911 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1532): Terminating (SIGTERM) 05:59:47.921386 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1535): Terminating (SIGTERM) 05:59:47.962998 --- ParallelTerminationStrategy: PID 1529 died... 05:59:47.982989 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1529): Terminated: ok {rc=0} 05:59:48.029119 --- ParallelTerminationStrategy: PID 1532 died... 05:59:48.048601 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1532): Terminated: ok {rc=0} 05:59:48.094406 --- ParallelTerminationStrategy: PID 1535 died... 05:59:48.114053 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1535): Terminated: ok {rc=0} 05:59:48.202180 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-sysmocell5000 ping_idle_ping.py ---------------------------------------------- 05:59:49.290847 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 05:59:49.303282 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 05:59:49.356194 tst ping_idle_ping.py: using LAC 26333 05:59:49.486494 tst ping_idle_ping.py: using RAC 68 05:59:49.612576 tst ping_idle_ping.py: using CellId 26333 05:59:49.735749 tst ping_idle_ping.py: using BVCI 26334 05:59:49.845859 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 05:59:49.856710 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 05:59:49.867615 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 05:59:49.879195 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 05:59:49.891077 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 05:59:49.902480 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 05:59:49.914062 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 05:59:49.925451 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 05:59:50.039819 tst ping_idle_ping.py:24: start network... 05:59:50.236566 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:59:50.695653 run create_hlr_db(pid=1537): Launched 05:59:50.808439 bus /gobi_6: Setting Powered False 05:59:51.867985 run create_hlr_db(pid=1537): Terminated: ok {rc=0} 05:59:52.302078 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1539): Launched 05:59:52.619511 run osmo-hlr_10.42.42.2(pid=1540): Launched 05:59:52.742192 run osmo-stp_10.42.42.5: Starting osmo-stp 05:59:53.285726 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1542): Launched 05:59:53.602530 run osmo-stp_10.42.42.5(pid=1543): Launched 05:59:53.725143 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:59:54.271089 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1545): Launched 05:59:54.392552 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:59:54.658826 run patchelf(pid=1546): Launched 05:59:54.836441 run osmo-stp_10.42.42.5(pid=1543): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1543)] 05:59:54.970337 run osmo-stp_10.42.42.5(pid=1543): stdout: | (launched: 2022-12-10_05:59:53.544936) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:59:55.106017 run osmo-stp_10.42.42.5(pid=1543): stderr: | 20221210055953737 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055953738 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055953738 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055953738 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055953739 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055953739 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055953739 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:59:55.242182 run osmo-stp_10.42.42.5(pid=1543): stdout: | (launched: 2022-12-10_05:59:53.544936) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:59:55.371634 run osmo-stp_10.42.42.5(pid=1543): stderr: | 20221210055953737 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210055953738 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210055953738 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210055953738 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210055953739 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210055953739 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210055953739 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:59:55.524750 run patchelf(pid=1546): Terminating (SIGINT) 05:59:55.701581 run patchelf(pid=1546): Terminated: ok {rc=0} 05:59:55.828574 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=1543): Process ended prematurely: osmo-stp_10.42.42.5(pid=1543) [trial-2370↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1543)] [trial-2370↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27] 05:59:55.838223 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 05:59:55.866213 run osmo-hlr_10.42.42.2(pid=1540): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-sysmocell5000↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1540)] 05:59:55.916327 run osmo-hlr_10.42.42.2(pid=1540): stdout: | (launched: 2022-12-10_05:59:52.561387) 05:59:55.968071 run osmo-hlr_10.42.42.2(pid=1540): stderr: | 20221210055952762 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210055952762 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210055952762 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210055952762 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210055952762 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210055952762 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210055952775 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-sysmocell5000/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210055952785 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210055952785 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210055952785 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:59:56.020190 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1539): Terminating (SIGTERM) 05:59:56.062060 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1542): Terminating (SIGTERM) 05:59:56.104010 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1545): Terminating (SIGTERM) 05:59:56.146005 --- ParallelTerminationStrategy: PID 1539 died... 05:59:56.166085 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1539): Terminated: ok {rc=0} 05:59:56.213071 --- ParallelTerminationStrategy: PID 1542 died... 05:59:56.233317 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1542): Terminated: ok {rc=0} 05:59:56.279443 --- ParallelTerminationStrategy: PID 1545 died... 05:59:56.299056 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1545): Terminated: ok {rc=0} 05:59:56.387024 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2370 gprs:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 gprs:trx-sysmocell5000+mod-bts0-egprs --------------------------------------------------------------------- 05:59:57.699703 tst gprs:trx-sysmocell5000+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:59:57.706148 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 05:59:57.740674 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 05:59:57.779859 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 05:59:57.872625 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 05:59:57.906822 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 05:59:57.946158 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 05:59:58.537729 tst gprs:trx-sysmocell5000+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2370 gprs:trx-sysmocell5000+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 05:59:58.589062 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:59:58.600312 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 05:59:58.651031 tst cs_paging_gprs_active.py: using LAC 26334 05:59:58.776536 tst cs_paging_gprs_active.py: using RAC 69 05:59:58.900450 tst cs_paging_gprs_active.py: using CellId 26334 05:59:59.028255 tst cs_paging_gprs_active.py: using BVCI 26335 05:59:59.145686 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:59:59.157157 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:59:59.168235 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:59:59.179427 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:59:59.190595 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:59:59.201843 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:59:59.213116 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:59:59.224182 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:59:59.235808 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 05:59:59.352217 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 05:59:59.470559 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 05:59:59.687438 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:00:00.009410 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1550): Launched 06:00:00.289864 run iperf3-srv_10.42.42.10(pid=1551): Launched 06:00:00.412099 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 06:00:00.627704 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:00:00.950355 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1552): Launched 06:00:01.298104 run iperf3-srv_10.42.42.10(pid=1560): Launched 06:00:01.429400 tst cs_paging_gprs_active.py:38: start network... 06:00:01.649556 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:00:02.230634 run create_hlr_db(pid=1577): Launched 06:00:02.427313 bus /gobi_6: Setting Powered False 06:00:03.486716 run create_hlr_db(pid=1577): Terminated: ok {rc=0} 06:00:03.937509 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1598): Launched 06:00:04.241180 run osmo-hlr_10.42.42.2(pid=1599): Launched 06:00:04.358760 run osmo-stp_10.42.42.5: Starting osmo-stp 06:00:04.888131 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1601): Launched 06:00:05.189462 run osmo-stp_10.42.42.5(pid=1602): Launched 06:00:05.303791 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:00:05.825521 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1604): Launched 06:00:05.940911 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:00:06.195222 run patchelf(pid=1605): Launched 06:00:06.363990 run osmo-stp_10.42.42.5(pid=1602): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1602)] 06:00:06.491706 run osmo-stp_10.42.42.5(pid=1602): stdout: | (launched: 2022-12-10_06:00:05.133997) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:00:06.621545 run osmo-stp_10.42.42.5(pid=1602): stderr: | 20221210060005305 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060005305 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060005305 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060005306 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060005308 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060005308 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060005308 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:00:06.751432 run osmo-stp_10.42.42.5(pid=1602): stdout: | (launched: 2022-12-10_06:00:05.133997) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:00:06.875279 run osmo-stp_10.42.42.5(pid=1602): stderr: | 20221210060005305 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060005305 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060005305 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060005306 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060005308 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060005308 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060005308 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:00:07.022172 run patchelf(pid=1605): Terminating (SIGINT) 06:00:07.191122 run patchelf(pid=1605): Terminated: ok {rc=0} 06:00:07.313190 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=1602): Process ended prematurely: osmo-stp_10.42.42.5(pid=1602) [trial-2370↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1602)] [trial-2370↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 06:00:07.323202 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 06:00:07.350767 run osmo-hlr_10.42.42.2(pid=1599): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1599)] 06:00:07.398513 run osmo-hlr_10.42.42.2(pid=1599): stdout: | (launched: 2022-12-10_06:00:04.186157) 06:00:07.447771 run osmo-hlr_10.42.42.2(pid=1599): stderr: | 20221210060004363 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210060004363 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210060004363 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210060004363 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210060004363 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210060004363 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210060004375 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-sysmocell5000+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210060004384 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210060004385 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210060004385 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:00:07.497712 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1550): Terminating (SIGTERM) 06:00:07.537570 run iperf3-srv_10.42.42.10(pid=1551): Terminating (SIGTERM) 06:00:07.577348 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1552): Terminating (SIGTERM) 06:00:07.617142 run iperf3-srv_10.42.42.10(pid=1560): Terminating (SIGTERM) 06:00:07.656694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1598): Terminating (SIGTERM) 06:00:07.696335 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1601): Terminating (SIGTERM) 06:00:07.735718 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1604): Terminating (SIGTERM) 06:00:07.775379 --- ParallelTerminationStrategy: PID 1550 died... 06:00:07.794237 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1550): Terminated: ok {rc=0} 06:00:07.838339 --- ParallelTerminationStrategy: PID 1551 died... 06:00:07.856522 run iperf3-srv_10.42.42.10(pid=1551): Terminated {rc=256} 06:00:07.900394 --- ParallelTerminationStrategy: PID 1552 died... 06:00:07.918770 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1552): Terminated: ok {rc=0} 06:00:07.962605 --- ParallelTerminationStrategy: PID 1560 died... 06:00:07.980941 run iperf3-srv_10.42.42.10(pid=1560): Terminated {rc=256} 06:00:08.024871 --- ParallelTerminationStrategy: PID 1598 died... 06:00:08.043438 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1598): Terminated: ok {rc=0} 06:00:08.087353 --- ParallelTerminationStrategy: PID 1601 died... 06:00:08.105835 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1601): Terminated: ok {rc=0} 06:00:08.149663 --- ParallelTerminationStrategy: PID 1604 died... 06:00:08.168047 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1604): Terminated: ok {rc=0} 06:00:08.251791 bus /gobi_0: Setting Powered False 06:00:09.348362 bus /gobi_0: Setting Powered False 06:00:10.463689 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3.py ---------------------------------------------- 06:00:11.612486 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:00:11.624702 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:00:11.680345 tst iperf3.py: using LAC 26335 06:00:11.798474 tst iperf3.py: using RAC 70 06:00:11.918757 tst iperf3.py: using CellId 26335 06:00:12.036368 tst iperf3.py: using BVCI 26336 06:00:12.145125 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:00:12.156072 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:00:12.166777 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:00:12.177944 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:00:12.188828 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:00:12.199762 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:00:12.210767 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:00:12.221658 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:00:12.232657 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:00:12.349356 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 06:00:12.550267 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:00:12.850668 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1607): Launched 06:00:13.113583 run iperf3-srv_10.42.42.10(pid=1608): Launched 06:00:13.225677 tst iperf3.py:8: start network... 06:00:13.425379 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:00:13.892056 run create_hlr_db(pid=1610): Launched 06:00:14.007025 bus /gobi_6: Setting Powered False 06:00:15.066707 run create_hlr_db(pid=1610): Terminated: ok {rc=0} 06:00:15.510525 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1612): Launched 06:00:15.841094 run osmo-hlr_10.42.42.2(pid=1613): Launched 06:00:16.019735 run osmo-stp_10.42.42.5: Starting osmo-stp 06:00:16.793454 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1615): Launched 06:00:17.133725 run osmo-stp_10.42.42.5(pid=1616): Launched 06:00:17.366896 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:00:17.881475 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1618): Launched 06:00:17.996426 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:00:18.249378 run patchelf(pid=1619): Launched 06:00:18.417333 run osmo-stp_10.42.42.5(pid=1616): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1616)] 06:00:18.544374 run osmo-stp_10.42.42.5(pid=1616): stdout: | (launched: 2022-12-10_06:00:17.068376) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:00:18.672935 run osmo-stp_10.42.42.5(pid=1616): stderr: | 20221210060017267 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060017267 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060017267 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060017268 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060017268 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060017268 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060017268 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:00:18.801799 run osmo-stp_10.42.42.5(pid=1616): stdout: | (launched: 2022-12-10_06:00:17.068376) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:00:18.924687 run osmo-stp_10.42.42.5(pid=1616): stderr: | 20221210060017267 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060017267 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060017267 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060017268 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060017268 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060017268 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060017268 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:00:19.070665 run patchelf(pid=1619): Terminating (SIGINT) 06:00:19.238471 run patchelf(pid=1619): Terminated: ok {rc=0} 06:00:19.359420 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1616): Process ended prematurely: osmo-stp_10.42.42.5(pid=1616) [trial-2370↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1616)] [trial-2370↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8] 06:00:19.369111 tst iperf3.py:8: Test FAILED (7.8 sec) 06:00:19.396653 run osmo-hlr_10.42.42.2(pid=1613): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1613)] 06:00:19.443945 run osmo-hlr_10.42.42.2(pid=1613): stdout: | (launched: 2022-12-10_06:00:15.774675) 06:00:19.492941 run osmo-hlr_10.42.42.2(pid=1613): stderr: | 20221210060016160 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210060016160 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210060016161 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210060016161 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210060016161 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210060016161 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210060016191 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210060016211 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210060016212 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210060016212 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:00:19.542523 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1607): Terminating (SIGTERM) 06:00:19.582097 run iperf3-srv_10.42.42.10(pid=1608): Terminating (SIGTERM) 06:00:19.621579 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1612): Terminating (SIGTERM) 06:00:19.661132 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1615): Terminating (SIGTERM) 06:00:19.700524 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1618): Terminating (SIGTERM) 06:00:19.740258 --- ParallelTerminationStrategy: PID 1607 died... 06:00:19.759043 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1607): Terminated: ok {rc=0} 06:00:19.803256 --- ParallelTerminationStrategy: PID 1608 died... 06:00:19.821704 run iperf3-srv_10.42.42.10(pid=1608): Terminated {rc=256} 06:00:19.865265 --- ParallelTerminationStrategy: PID 1612 died... 06:00:19.883599 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1612): Terminated: ok {rc=0} 06:00:19.927317 --- ParallelTerminationStrategy: PID 1615 died... 06:00:19.945670 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1615): Terminated: ok {rc=0} 06:00:19.989372 --- ParallelTerminationStrategy: PID 1618 died... 06:00:20.007883 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1618): Terminated: ok {rc=0} 06:00:20.091804 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 06:00:21.242808 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:00:21.255084 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:00:21.307872 tst iperf3m4.py: using LAC 26336 06:00:21.433562 tst iperf3m4.py: using RAC 71 06:00:21.559636 tst iperf3m4.py: using CellId 26336 06:00:21.684558 tst iperf3m4.py: using BVCI 26337 06:00:21.802699 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:00:21.814317 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:00:21.825579 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:00:21.836785 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:00:21.847977 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:00:21.859226 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:00:21.870720 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:00:21.882077 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:00:21.893467 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:00:22.010533 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:00:22.132220 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:00:22.249306 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:00:22.365957 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 06:00:22.567866 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:00:22.870118 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1620): Launched 06:00:23.132383 run iperf3-srv_10.42.42.10(pid=1621): Launched 06:00:23.245129 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 06:00:23.445724 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:00:23.747702 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1622): Launched 06:00:24.009240 run iperf3-srv_10.42.42.10(pid=1623): Launched 06:00:24.122115 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 06:00:24.322400 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:00:24.624709 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1624): Launched 06:00:24.886929 run iperf3-srv_10.42.42.10(pid=1625): Launched 06:00:24.999518 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 06:00:25.199583 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:00:25.501332 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1626): Launched 06:00:25.763509 run iperf3-srv_10.42.42.10(pid=1627): Launched 06:00:25.876021 tst iperf3m4.py:8: start network... 06:00:26.077045 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:00:26.543485 run create_hlr_db(pid=1628): Launched 06:00:26.659289 bus /gobi_6: Setting Powered False 06:00:27.718720 run create_hlr_db(pid=1628): Terminated: ok {rc=0} 06:00:28.158420 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1630): Launched 06:00:28.481677 run osmo-hlr_10.42.42.2(pid=1631): Launched 06:00:28.606816 run osmo-stp_10.42.42.5: Starting osmo-stp 06:00:29.162814 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1633): Launched 06:00:29.486381 run osmo-stp_10.42.42.5(pid=1634): Launched 06:00:29.609187 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:00:30.163413 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1636): Launched 06:00:30.287651 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:00:30.560369 run patchelf(pid=1637): Launched 06:00:30.739730 run osmo-stp_10.42.42.5(pid=1634): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1634)] 06:00:30.876412 run osmo-stp_10.42.42.5(pid=1634): stdout: | (launched: 2022-12-10_06:00:29.427306) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:00:31.016112 run osmo-stp_10.42.42.5(pid=1634): stderr: | 20221210060029619 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060029619 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060029619 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060029620 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060029620 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060029620 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060029620 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:00:31.156448 run osmo-stp_10.42.42.5(pid=1634): stdout: | (launched: 2022-12-10_06:00:29.427306) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:00:31.291425 run osmo-stp_10.42.42.5(pid=1634): stderr: | 20221210060029619 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060029619 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060029619 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060029620 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060029620 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060029620 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060029620 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:00:31.451298 run patchelf(pid=1637): Terminating (SIGINT) 06:00:31.634222 run patchelf(pid=1637): Terminated: ok {rc=0} 06:00:31.766401 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1634): Process ended prematurely: osmo-stp_10.42.42.5(pid=1634) [trial-2370↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1634)] [trial-2370↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8] 06:00:31.777492 tst iperf3m4.py:8: Test FAILED (10.6 sec) 06:00:31.807083 run osmo-hlr_10.42.42.2(pid=1631): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1631)] 06:00:31.857842 run osmo-hlr_10.42.42.2(pid=1631): stdout: | (launched: 2022-12-10_06:00:28.422384) 06:00:31.910772 run osmo-hlr_10.42.42.2(pid=1631): stderr: | 20221210060028622 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210060028622 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210060028622 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210060028622 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210060028622 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210060028622 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210060028635 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210060028643 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210060028644 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210060028644 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:00:31.964499 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1620): Terminating (SIGTERM) 06:00:32.007350 run iperf3-srv_10.42.42.10(pid=1621): Terminating (SIGTERM) 06:00:32.052616 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1622): Terminating (SIGTERM) 06:00:32.095872 run iperf3-srv_10.42.42.10(pid=1623): Terminating (SIGTERM) 06:00:32.141253 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1624): Terminating (SIGTERM) 06:00:32.184097 run iperf3-srv_10.42.42.10(pid=1625): Terminating (SIGTERM) 06:00:32.229416 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1626): Terminating (SIGTERM) 06:00:32.271676 run iperf3-srv_10.42.42.10(pid=1627): Terminating (SIGTERM) 06:00:32.314535 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1630): Terminating (SIGTERM) 06:00:32.356464 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1633): Terminating (SIGTERM) 06:00:32.397943 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1636): Terminating (SIGTERM) 06:00:32.439802 --- ParallelTerminationStrategy: PID 1620 died... 06:00:32.460033 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1620): Terminated: ok {rc=0} 06:00:32.506667 --- ParallelTerminationStrategy: PID 1621 died... 06:00:32.526078 run iperf3-srv_10.42.42.10(pid=1621): Terminated {rc=256} 06:00:32.571470 --- ParallelTerminationStrategy: PID 1622 died... 06:00:32.590868 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1622): Terminated: ok {rc=0} 06:00:32.636249 --- ParallelTerminationStrategy: PID 1623 died... 06:00:32.655628 run iperf3-srv_10.42.42.10(pid=1623): Terminated {rc=256} 06:00:32.701221 --- ParallelTerminationStrategy: PID 1624 died... 06:00:32.720427 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1624): Terminated: ok {rc=0} 06:00:32.766051 --- ParallelTerminationStrategy: PID 1625 died... 06:00:32.785426 run iperf3-srv_10.42.42.10(pid=1625): Terminated {rc=256} 06:00:32.830748 --- ParallelTerminationStrategy: PID 1626 died... 06:00:32.850199 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1626): Terminated: ok {rc=0} 06:00:32.895715 --- ParallelTerminationStrategy: PID 1627 died... 06:00:32.915086 run iperf3-srv_10.42.42.10(pid=1627): Terminated {rc=256} 06:00:32.960911 --- ParallelTerminationStrategy: PID 1630 died... 06:00:32.980566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1630): Terminated: ok {rc=0} 06:00:33.026156 --- ParallelTerminationStrategy: PID 1633 died... 06:00:33.045414 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1633): Terminated: ok {rc=0} 06:00:33.090951 --- ParallelTerminationStrategy: PID 1636 died... 06:00:33.110621 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1636): Terminated: ok {rc=0} 06:00:33.198744 bus /gobi_4: Setting Powered False 06:00:34.298738 bus /gobi_4: Setting Powered False 06:00:35.414623 bus /gobi_1: Setting Powered False 06:00:36.513680 bus /gobi_1: Setting Powered False 06:00:37.629139 bus /gobi_0: Setting Powered False 06:00:38.728195 bus /gobi_0: Setting Powered False 06:00:39.844247 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-sysmocell5000+mod-bts0-egprs ping.py ---------------------------------------------- 06:00:40.946125 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:00:40.958444 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:00:41.010354 tst ping.py: using LAC 26337 06:00:41.129662 tst ping.py: using RAC 72 06:00:41.253940 tst ping.py: using CellId 26337 06:00:41.379762 tst ping.py: using BVCI 26338 06:00:41.493868 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:00:41.505581 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:00:41.516901 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:00:41.528309 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:00:41.539687 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:00:41.550803 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:00:41.562587 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:00:41.573812 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:00:41.693203 tst ping.py:19: start network... 06:00:41.904902 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:00:42.391657 run create_hlr_db(pid=1638): Launched 06:00:42.516047 bus /gobi_6: Setting Powered False 06:00:43.574984 run create_hlr_db(pid=1638): Terminated: ok {rc=0} 06:00:44.007200 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1640): Launched 06:00:44.306404 run osmo-hlr_10.42.42.2(pid=1641): Launched 06:00:44.419361 run osmo-stp_10.42.42.5: Starting osmo-stp 06:00:44.931619 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1643): Launched 06:00:45.225559 run osmo-stp_10.42.42.5(pid=1644): Launched 06:00:45.338659 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:00:45.849780 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1646): Launched 06:00:46.004074 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:00:46.257986 run patchelf(pid=1647): Launched 06:00:46.440647 run osmo-stp_10.42.42.5(pid=1644): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1644)] 06:00:46.568678 run osmo-stp_10.42.42.5(pid=1644): stdout: | (launched: 2022-12-10_06:00:45.170689) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:00:46.700189 run osmo-stp_10.42.42.5(pid=1644): stderr: | 20221210060045342 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060045342 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060045342 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060045343 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060045343 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060045343 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060045343 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:00:46.831031 run osmo-stp_10.42.42.5(pid=1644): stdout: | (launched: 2022-12-10_06:00:45.170689) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:00:46.955078 run osmo-stp_10.42.42.5(pid=1644): stderr: | 20221210060045342 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060045342 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060045342 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060045343 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060045343 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060045343 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060045343 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:00:47.102081 run patchelf(pid=1647): Terminating (SIGINT) 06:00:47.270779 run patchelf(pid=1647): Terminated: ok {rc=0} 06:00:47.390277 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=1644): Process ended prematurely: osmo-stp_10.42.42.5(pid=1644) [trial-2370↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1644)] [trial-2370↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22] 06:00:47.399110 tst ping.py:22: Test FAILED (6.4 sec) 06:00:47.426357 run osmo-hlr_10.42.42.2(pid=1641): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1641)] 06:00:47.474162 run osmo-hlr_10.42.42.2(pid=1641): stdout: | (launched: 2022-12-10_06:00:44.251925) 06:00:47.523403 run osmo-hlr_10.42.42.2(pid=1641): stderr: | 20221210060044427 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210060044428 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210060044428 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210060044428 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210060044428 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210060044428 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210060044438 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-sysmocell5000+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210060044447 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210060044447 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210060044447 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:00:47.573419 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1640): Terminating (SIGTERM) 06:00:47.612886 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1643): Terminating (SIGTERM) 06:00:47.652648 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1646): Terminating (SIGTERM) 06:00:47.692406 --- ParallelTerminationStrategy: PID 1640 died... 06:00:47.711362 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1640): Terminated: ok {rc=0} 06:00:47.755358 --- ParallelTerminationStrategy: PID 1643 died... 06:00:47.773781 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1643): Terminated: ok {rc=0} 06:00:47.817764 --- ParallelTerminationStrategy: PID 1646 died... 06:00:47.836239 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1646): Terminated: ok {rc=0} 06:00:47.922037 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-sysmocell5000+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 06:00:49.009277 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:00:49.020847 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:00:49.071928 tst ping_idle_ping.py: using LAC 26338 06:00:49.187955 tst ping_idle_ping.py: using RAC 73 06:00:49.302158 tst ping_idle_ping.py: using CellId 26338 06:00:49.417431 tst ping_idle_ping.py: using BVCI 26339 06:00:49.532452 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:00:49.544077 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:00:49.555450 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:00:49.567109 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:00:49.578445 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:00:49.590136 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:00:49.602030 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:00:49.613397 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:00:49.730576 tst ping_idle_ping.py:24: start network... 06:00:49.942017 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:00:50.433362 run create_hlr_db(pid=1648): Launched 06:00:50.562379 bus /gobi_6: Setting Powered False 06:00:51.625737 run create_hlr_db(pid=1648): Terminated: ok {rc=0} 06:00:52.067991 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1650): Launched 06:00:52.384669 run osmo-hlr_10.42.42.2(pid=1651): Launched 06:00:52.505557 run osmo-stp_10.42.42.5: Starting osmo-stp 06:00:53.052308 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1653): Launched 06:00:53.368711 run osmo-stp_10.42.42.5(pid=1654): Launched 06:00:53.489511 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:00:54.035392 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1656): Launched 06:00:54.157216 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:00:54.425622 run patchelf(pid=1657): Launched 06:00:54.603463 run osmo-stp_10.42.42.5(pid=1654): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1654)] 06:00:54.738106 run osmo-stp_10.42.42.5(pid=1654): stdout: | (launched: 2022-12-10_06:00:53.310712) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:00:54.873655 run osmo-stp_10.42.42.5(pid=1654): stderr: | 20221210060053501 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060053501 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060053502 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060053502 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060053502 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060053502 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060053502 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:00:55.009336 run osmo-stp_10.42.42.5(pid=1654): stdout: | (launched: 2022-12-10_06:00:53.310712) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:00:55.138605 run osmo-stp_10.42.42.5(pid=1654): stderr: | 20221210060053501 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060053501 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060053502 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060053502 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060053502 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060053502 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060053502 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:00:55.292175 run patchelf(pid=1657): Terminating (SIGINT) 06:00:55.469084 run patchelf(pid=1657): Terminated: ok {rc=0} 06:00:55.596280 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=1654): Process ended prematurely: osmo-stp_10.42.42.5(pid=1654) [trial-2370↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1654)] [trial-2370↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27] 06:00:55.606011 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 06:00:55.633972 run osmo-hlr_10.42.42.2(pid=1651): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1651)] 06:00:55.683512 run osmo-hlr_10.42.42.2(pid=1651): stdout: | (launched: 2022-12-10_06:00:52.326919) 06:00:55.734833 run osmo-hlr_10.42.42.2(pid=1651): stderr: | 20221210060052524 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210060052524 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210060052524 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210060052524 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210060052524 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210060052524 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210060052539 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-sysmocell5000+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210060052550 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210060052550 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210060052550 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:00:55.786852 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1650): Terminating (SIGTERM) 06:00:55.828222 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1653): Terminating (SIGTERM) 06:00:55.869615 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1656): Terminating (SIGTERM) 06:00:55.911325 --- ParallelTerminationStrategy: PID 1650 died... 06:00:55.931244 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1650): Terminated: ok {rc=0} 06:00:55.977334 --- ParallelTerminationStrategy: PID 1653 died... 06:00:55.996863 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1653): Terminated: ok {rc=0} 06:00:56.043104 --- ParallelTerminationStrategy: PID 1656 died... 06:00:56.062736 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1656): Terminated: ok {rc=0} 06:00:56.151218 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2370 gprs:trx-sysmocell5000+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa --------------------------------------------------------------------- 06:00:57.458565 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:00:57.464596 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 06:00:57.498923 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 06:00:57.537366 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 06:00:57.623171 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 06:00:57.656273 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 06:00:57.694205 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 06:00:58.288768 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2370 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 06:00:58.337494 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:00:58.348373 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:00:58.418182 tst cs_paging_gprs_active.py: using LAC 26339 06:00:58.536644 tst cs_paging_gprs_active.py: using RAC 74 06:00:58.654464 tst cs_paging_gprs_active.py: using CellId 26339 06:00:58.774380 tst cs_paging_gprs_active.py: using BVCI 26340 06:00:58.883460 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:00:58.894554 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:00:58.905431 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:00:58.916501 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:00:58.927964 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:00:58.939109 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:00:58.950167 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:00:58.961190 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:00:58.972344 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:00:59.091825 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:00:59.213249 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 06:00:59.429314 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:00:59.750181 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1661): Launched 06:01:00.030328 run iperf3-srv_10.42.42.10(pid=1662): Launched 06:01:00.152397 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 06:01:00.368058 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:01:00.689762 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1663): Launched 06:01:00.979996 run iperf3-srv_10.42.42.10(pid=1664): Launched 06:01:01.118023 tst cs_paging_gprs_active.py:38: start network... 06:01:01.336417 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:01:01.837817 run create_hlr_db(pid=1665): Launched 06:01:01.997485 bus /gobi_6: Setting Powered False 06:01:03.060546 run create_hlr_db(pid=1665): Terminated: ok {rc=0} 06:01:03.505734 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1667): Launched 06:01:03.806423 run osmo-hlr_10.42.42.2(pid=1668): Launched 06:01:03.921901 run osmo-stp_10.42.42.5: Starting osmo-stp 06:01:04.437271 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1670): Launched 06:01:04.738680 run osmo-stp_10.42.42.5(pid=1671): Launched 06:01:04.853414 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:01:05.377936 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1673): Launched 06:01:05.493790 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:01:05.748536 run patchelf(pid=1674): Launched 06:01:05.916470 run osmo-stp_10.42.42.5(pid=1671): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1671)] 06:01:06.044273 run osmo-stp_10.42.42.5(pid=1671): stdout: | (launched: 2022-12-10_06:01:04.682957) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:01:06.173662 run osmo-stp_10.42.42.5(pid=1671): stderr: | 20221210060104852 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060104852 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060104852 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060104853 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060104855 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060104855 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060104855 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:01:06.302959 run osmo-stp_10.42.42.5(pid=1671): stdout: | (launched: 2022-12-10_06:01:04.682957) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:01:06.426313 run osmo-stp_10.42.42.5(pid=1671): stderr: | 20221210060104852 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060104852 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060104852 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060104853 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060104855 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060104855 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060104855 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:01:06.572507 run patchelf(pid=1674): Terminating (SIGINT) 06:01:06.740935 run patchelf(pid=1674): Terminated: ok {rc=0} 06:01:06.863185 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=1671): Process ended prematurely: osmo-stp_10.42.42.5(pid=1671) [trial-2370↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1671)] [trial-2370↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 06:01:06.872785 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 06:01:06.900308 run osmo-hlr_10.42.42.2(pid=1668): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1668)] 06:01:06.947768 run osmo-hlr_10.42.42.2(pid=1668): stdout: | (launched: 2022-12-10_06:01:03.751606) 06:01:06.996831 run osmo-hlr_10.42.42.2(pid=1668): stderr: | 20221210060103927 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210060103927 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210060103927 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210060103927 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210060103927 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210060103927 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210060103939 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210060103949 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210060103949 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210060103949 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:01:07.046354 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1661): Terminating (SIGTERM) 06:01:07.085919 run iperf3-srv_10.42.42.10(pid=1662): Terminating (SIGTERM) 06:01:07.125367 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1663): Terminating (SIGTERM) 06:01:07.165226 run iperf3-srv_10.42.42.10(pid=1664): Terminating (SIGTERM) 06:01:07.204421 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1667): Terminating (SIGTERM) 06:01:07.243724 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1670): Terminating (SIGTERM) 06:01:07.282987 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1673): Terminating (SIGTERM) 06:01:07.322446 --- ParallelTerminationStrategy: PID 1661 died... 06:01:07.341208 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1661): Terminated: ok {rc=0} 06:01:07.385517 --- ParallelTerminationStrategy: PID 1662 died... 06:01:07.403669 run iperf3-srv_10.42.42.10(pid=1662): Terminated {rc=256} 06:01:07.447259 --- ParallelTerminationStrategy: PID 1663 died... 06:01:07.465503 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1663): Terminated: ok {rc=0} 06:01:07.508775 --- ParallelTerminationStrategy: PID 1664 died... 06:01:07.527047 run iperf3-srv_10.42.42.10(pid=1664): Terminated {rc=256} 06:01:07.570316 --- ParallelTerminationStrategy: PID 1667 died... 06:01:07.588498 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1667): Terminated: ok {rc=0} 06:01:07.631972 --- ParallelTerminationStrategy: PID 1670 died... 06:01:07.650337 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1670): Terminated: ok {rc=0} 06:01:07.693792 --- ParallelTerminationStrategy: PID 1673 died... 06:01:07.712027 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1673): Terminated: ok {rc=0} 06:01:07.796051 bus /gobi_0: Setting Powered False 06:01:08.894514 bus /gobi_0: Setting Powered False 06:01:10.009418 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 06:01:11.157413 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:01:11.169557 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:01:11.245635 tst iperf3.py: using LAC 26340 06:01:11.373109 tst iperf3.py: using RAC 75 06:01:11.498828 tst iperf3.py: using CellId 26340 06:01:11.626834 tst iperf3.py: using BVCI 26341 06:01:11.742961 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:01:11.754542 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:01:11.765891 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:01:11.777397 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:01:11.788613 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:01:11.799945 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:01:11.811336 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:01:11.822609 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:01:11.834175 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:01:11.951747 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 06:01:12.167346 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:01:12.488812 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1675): Launched 06:01:12.768316 run iperf3-srv_10.42.42.10(pid=1676): Launched 06:01:12.889425 tst iperf3.py:8: start network... 06:01:13.104916 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:01:13.601722 run create_hlr_db(pid=1677): Launched 06:01:13.731887 bus /gobi_6: Setting Powered False 06:01:14.795194 run create_hlr_db(pid=1677): Terminated: ok {rc=0} 06:01:15.240100 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1679): Launched 06:01:15.561159 run osmo-hlr_10.42.42.2(pid=1680): Launched 06:01:15.685890 run osmo-stp_10.42.42.5: Starting osmo-stp 06:01:16.264608 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1682): Launched 06:01:16.679171 run osmo-stp_10.42.42.5(pid=1683): Launched 06:01:16.949472 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:01:17.506579 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1685): Launched 06:01:17.629636 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:01:17.900503 run patchelf(pid=1686): Launched 06:01:18.078913 run osmo-stp_10.42.42.5(pid=1683): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1683)] 06:01:18.214918 run osmo-stp_10.42.42.5(pid=1683): stdout: | (launched: 2022-12-10_06:01:16.613535) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:01:18.352355 run osmo-stp_10.42.42.5(pid=1683): stderr: | 20221210060116814 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060116814 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060116814 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060116815 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060116817 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060116817 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060116817 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:01:18.489450 run osmo-stp_10.42.42.5(pid=1683): stdout: | (launched: 2022-12-10_06:01:16.613535) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:01:18.620891 run osmo-stp_10.42.42.5(pid=1683): stderr: | 20221210060116814 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060116814 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060116814 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060116815 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060116817 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060116817 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060116817 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:01:18.776357 run patchelf(pid=1686): Terminating (SIGINT) 06:01:18.956183 run patchelf(pid=1686): Terminated: ok {rc=0} 06:01:19.085740 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1683): Process ended prematurely: osmo-stp_10.42.42.5(pid=1683) [trial-2370↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1683)] [trial-2370↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8] 06:01:19.096038 tst iperf3.py:8: Test FAILED (8.0 sec) 06:01:19.124432 run osmo-hlr_10.42.42.2(pid=1680): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1680)] 06:01:19.173835 run osmo-hlr_10.42.42.2(pid=1680): stdout: | (launched: 2022-12-10_06:01:15.502721) 06:01:19.225337 run osmo-hlr_10.42.42.2(pid=1680): stderr: | 20221210060115702 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210060115702 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210060115702 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210060115702 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210060115702 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210060115702 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210060115715 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210060115723 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210060115723 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210060115723 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:01:19.277500 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1675): Terminating (SIGTERM) 06:01:19.319033 run iperf3-srv_10.42.42.10(pid=1676): Terminating (SIGTERM) 06:01:19.360232 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1679): Terminating (SIGTERM) 06:01:19.401616 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1682): Terminating (SIGTERM) 06:01:19.442883 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1685): Terminating (SIGTERM) 06:01:19.484365 --- ParallelTerminationStrategy: PID 1675 died... 06:01:19.504208 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1675): Terminated: ok {rc=0} 06:01:19.549929 --- ParallelTerminationStrategy: PID 1676 died... 06:01:19.569365 run iperf3-srv_10.42.42.10(pid=1676): Terminated {rc=256} 06:01:19.614731 --- ParallelTerminationStrategy: PID 1679 died... 06:01:19.634021 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1679): Terminated: ok {rc=0} 06:01:19.679852 --- ParallelTerminationStrategy: PID 1682 died... 06:01:19.699274 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1682): Terminated: ok {rc=0} 06:01:19.744574 --- ParallelTerminationStrategy: PID 1685 died... 06:01:19.763936 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1685): Terminated: ok {rc=0} 06:01:19.850206 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 06:01:20.996804 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:01:21.008532 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:01:21.080341 tst iperf3m4.py: using LAC 26341 06:01:21.198492 tst iperf3m4.py: using RAC 76 06:01:21.318340 tst iperf3m4.py: using CellId 26341 06:01:21.439481 tst iperf3m4.py: using BVCI 26342 06:01:21.549111 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:01:21.560161 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:01:21.571054 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:01:21.582878 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:01:21.594441 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:01:21.606148 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:01:21.617827 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:01:21.629239 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:01:21.640920 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:01:21.762869 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:01:21.881269 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:01:22.004235 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:01:22.124534 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 06:01:22.341204 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:01:22.663005 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1687): Launched 06:01:22.944422 run iperf3-srv_10.42.42.10(pid=1688): Launched 06:01:23.065161 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 06:01:23.281799 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:01:23.604151 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1689): Launched 06:01:23.883019 run iperf3-srv_10.42.42.10(pid=1690): Launched 06:01:24.005445 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 06:01:24.221437 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:01:24.544149 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1691): Launched 06:01:24.822869 run iperf3-srv_10.42.42.10(pid=1692): Launched 06:01:24.945300 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 06:01:25.161119 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:01:25.483036 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1693): Launched 06:01:25.762132 run iperf3-srv_10.42.42.10(pid=1694): Launched 06:01:25.883552 tst iperf3m4.py:8: start network... 06:01:26.099881 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:01:26.599458 run create_hlr_db(pid=1695): Launched 06:01:26.729989 bus /gobi_6: Setting Powered False 06:01:27.793297 run create_hlr_db(pid=1695): Terminated: ok {rc=0} 06:01:28.238836 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1697): Launched 06:01:28.560692 run osmo-hlr_10.42.42.2(pid=1698): Launched 06:01:28.684799 run osmo-stp_10.42.42.5: Starting osmo-stp 06:01:29.237958 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1700): Launched 06:01:29.558926 run osmo-stp_10.42.42.5(pid=1701): Launched 06:01:29.680661 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:01:30.235046 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1703): Launched 06:01:30.360338 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:01:30.631497 run patchelf(pid=1704): Launched 06:01:30.812073 run osmo-stp_10.42.42.5(pid=1701): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1701)] 06:01:30.950643 run osmo-stp_10.42.42.5(pid=1701): stdout: | (launched: 2022-12-10_06:01:29.500484) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:01:31.090442 run osmo-stp_10.42.42.5(pid=1701): stderr: | 20221210060129691 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060129691 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060129692 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060129692 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060129692 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060129693 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060129693 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:01:31.229824 run osmo-stp_10.42.42.5(pid=1701): stdout: | (launched: 2022-12-10_06:01:29.500484) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:01:31.364004 run osmo-stp_10.42.42.5(pid=1701): stderr: | 20221210060129691 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060129691 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060129692 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060129692 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060129692 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060129693 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060129693 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:01:31.522505 run patchelf(pid=1704): Terminating (SIGINT) 06:01:31.704292 run patchelf(pid=1704): Terminated: ok {rc=0} 06:01:31.836553 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1701): Process ended prematurely: osmo-stp_10.42.42.5(pid=1701) [trial-2370↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1701)] [trial-2370↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8] 06:01:31.848114 tst iperf3m4.py:8: Test FAILED (10.9 sec) 06:01:31.877945 run osmo-hlr_10.42.42.2(pid=1698): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1698)] 06:01:31.928931 run osmo-hlr_10.42.42.2(pid=1698): stdout: | (launched: 2022-12-10_06:01:28.502098) 06:01:31.981623 run osmo-hlr_10.42.42.2(pid=1698): stderr: | 20221210060128701 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210060128701 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210060128701 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210060128701 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210060128701 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210060128701 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210060128714 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210060128722 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210060128722 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210060128722 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:01:32.034703 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1687): Terminating (SIGTERM) 06:01:32.076804 run iperf3-srv_10.42.42.10(pid=1688): Terminating (SIGTERM) 06:01:32.120677 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1689): Terminating (SIGTERM) 06:01:32.162758 run iperf3-srv_10.42.42.10(pid=1690): Terminating (SIGTERM) 06:01:32.204469 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1691): Terminating (SIGTERM) 06:01:32.246271 run iperf3-srv_10.42.42.10(pid=1692): Terminating (SIGTERM) 06:01:32.287516 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1693): Terminating (SIGTERM) 06:01:32.328584 run iperf3-srv_10.42.42.10(pid=1694): Terminating (SIGTERM) 06:01:32.369523 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1697): Terminating (SIGTERM) 06:01:32.410376 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1700): Terminating (SIGTERM) 06:01:32.451219 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1703): Terminating (SIGTERM) 06:01:32.492549 --- ParallelTerminationStrategy: PID 1687 died... 06:01:32.512404 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1687): Terminated: ok {rc=0} 06:01:32.558381 --- ParallelTerminationStrategy: PID 1688 died... 06:01:32.577585 run iperf3-srv_10.42.42.10(pid=1688): Terminated {rc=256} 06:01:32.622876 --- ParallelTerminationStrategy: PID 1689 died... 06:01:32.642004 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1689): Terminated: ok {rc=0} 06:01:32.687496 --- ParallelTerminationStrategy: PID 1690 died... 06:01:32.706748 run iperf3-srv_10.42.42.10(pid=1690): Terminated {rc=256} 06:01:32.751794 --- ParallelTerminationStrategy: PID 1691 died... 06:01:32.771003 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1691): Terminated: ok {rc=0} 06:01:32.816165 --- ParallelTerminationStrategy: PID 1692 died... 06:01:32.835248 run iperf3-srv_10.42.42.10(pid=1692): Terminated {rc=256} 06:01:32.880444 --- ParallelTerminationStrategy: PID 1693 died... 06:01:32.899656 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1693): Terminated: ok {rc=0} 06:01:32.945140 --- ParallelTerminationStrategy: PID 1694 died... 06:01:32.964430 run iperf3-srv_10.42.42.10(pid=1694): Terminated {rc=256} 06:01:33.009596 --- ParallelTerminationStrategy: PID 1697 died... 06:01:33.028822 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1697): Terminated: ok {rc=0} 06:01:33.074261 --- ParallelTerminationStrategy: PID 1700 died... 06:01:33.093566 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1700): Terminated: ok {rc=0} 06:01:33.139068 --- ParallelTerminationStrategy: PID 1703 died... 06:01:33.158635 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1703): Terminated: ok {rc=0} 06:01:33.246310 bus /gobi_4: Setting Powered False 06:01:34.345492 bus /gobi_4: Setting Powered False 06:01:35.462152 bus /gobi_1: Setting Powered False 06:01:36.560434 bus /gobi_1: Setting Powered False 06:01:37.675971 bus /gobi_0: Setting Powered False 06:01:38.774264 bus /gobi_0: Setting Powered False 06:01:39.892040 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 06:01:40.993743 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:01:41.006065 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:01:41.078475 tst ping.py: using LAC 26342 06:01:41.208211 tst ping.py: using RAC 77 06:01:41.336709 tst ping.py: using CellId 26342 06:01:41.464271 tst ping.py: using BVCI 26343 06:01:41.578161 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:01:41.589842 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:01:41.601311 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:01:41.613272 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:01:41.624581 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:01:41.635992 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:01:41.647459 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:01:41.659130 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:01:41.771528 tst ping.py:19: start network... 06:01:41.969518 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:01:42.424774 run create_hlr_db(pid=1705): Launched 06:01:42.538609 bus /gobi_6: Setting Powered False 06:01:43.597784 run create_hlr_db(pid=1705): Terminated: ok {rc=0} 06:01:44.031342 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1707): Launched 06:01:44.348793 run osmo-hlr_10.42.42.2(pid=1708): Launched 06:01:44.469878 run osmo-stp_10.42.42.5: Starting osmo-stp 06:01:45.017700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1710): Launched 06:01:45.332805 run osmo-stp_10.42.42.5(pid=1711): Launched 06:01:45.454481 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:01:46.010144 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1713): Launched 06:01:46.141817 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:01:46.417714 run patchelf(pid=1714): Launched 06:01:46.654952 run osmo-stp_10.42.42.5(pid=1711): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1711)] 06:01:46.805594 run osmo-stp_10.42.42.5(pid=1711): stdout: | (launched: 2022-12-10_06:01:45.274997) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:01:46.937760 run osmo-stp_10.42.42.5(pid=1711): stderr: | 20221210060145466 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060145466 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060145467 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060145467 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060145467 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060145467 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060145467 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:01:47.070968 run osmo-stp_10.42.42.5(pid=1711): stdout: | (launched: 2022-12-10_06:01:45.274997) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:01:47.196937 run osmo-stp_10.42.42.5(pid=1711): stderr: | 20221210060145466 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060145466 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060145467 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060145467 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060145467 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060145467 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060145467 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:01:47.342804 run patchelf(pid=1714): Terminating (SIGINT) 06:01:47.509790 run patchelf(pid=1714): Terminated: ok {rc=0} 06:01:47.629424 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=1711): Process ended prematurely: osmo-stp_10.42.42.5(pid=1711) [trial-2370↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1711)] [trial-2370↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22] 06:01:47.638696 tst ping.py:22: Test FAILED (6.6 sec) 06:01:47.666359 run osmo-hlr_10.42.42.2(pid=1708): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1708)] 06:01:47.714314 run osmo-hlr_10.42.42.2(pid=1708): stdout: | (launched: 2022-12-10_06:01:44.290617) 06:01:47.764075 run osmo-hlr_10.42.42.2(pid=1708): stderr: | 20221210060144491 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210060144491 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210060144491 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210060144491 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210060144491 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210060144491 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210060144503 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210060144513 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210060144514 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210060144514 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:01:47.814141 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1707): Terminating (SIGTERM) 06:01:47.854150 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1710): Terminating (SIGTERM) 06:01:47.893919 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1713): Terminating (SIGTERM) 06:01:47.934272 --- ParallelTerminationStrategy: PID 1707 died... 06:01:47.953541 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1707): Terminated: ok {rc=0} 06:01:47.998605 --- ParallelTerminationStrategy: PID 1710 died... 06:01:48.017433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1710): Terminated: ok {rc=0} 06:01:48.062624 --- ParallelTerminationStrategy: PID 1713 died... 06:01:48.081428 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1713): Terminated: ok {rc=0} 06:01:48.167878 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 06:01:49.257751 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:01:49.270206 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:01:49.342520 tst ping_idle_ping.py: using LAC 26343 06:01:49.461271 tst ping_idle_ping.py: using RAC 78 06:01:49.585567 tst ping_idle_ping.py: using CellId 26343 06:01:49.712377 tst ping_idle_ping.py: using BVCI 26344 06:01:49.828067 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:01:49.839602 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:01:49.850984 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:01:49.862902 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:01:49.874780 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:01:49.886721 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:01:49.898667 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:01:49.910418 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:01:50.025453 tst ping_idle_ping.py:24: start network... 06:01:50.224528 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:01:50.689282 run create_hlr_db(pid=1715): Launched 06:01:50.803117 bus /gobi_6: Setting Powered False 06:01:51.862620 run create_hlr_db(pid=1715): Terminated: ok {rc=0} 06:01:52.276711 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1717): Launched 06:01:52.573177 run osmo-hlr_10.42.42.2(pid=1718): Launched 06:01:52.686193 run osmo-stp_10.42.42.5: Starting osmo-stp 06:01:53.199555 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1720): Launched 06:01:53.494398 run osmo-stp_10.42.42.5(pid=1721): Launched 06:01:53.606933 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:01:54.115095 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1723): Launched 06:01:54.228078 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:01:54.477473 run patchelf(pid=1724): Launched 06:01:54.641595 run osmo-stp_10.42.42.5(pid=1721): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1721)] 06:01:54.766703 run osmo-stp_10.42.42.5(pid=1721): stdout: | (launched: 2022-12-10_06:01:53.440213) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:01:54.893385 run osmo-stp_10.42.42.5(pid=1721): stderr: | 20221210060153610 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060153610 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060153611 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060153611 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060153611 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060153612 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060153612 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:01:55.020241 run osmo-stp_10.42.42.5(pid=1721): stdout: | (launched: 2022-12-10_06:01:53.440213) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:01:55.141148 run osmo-stp_10.42.42.5(pid=1721): stderr: | 20221210060153610 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060153610 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060153611 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060153611 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060153611 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060153612 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060153612 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:01:55.284196 run patchelf(pid=1724): Terminating (SIGINT) 06:01:55.449561 run patchelf(pid=1724): Terminated: ok {rc=0} 06:01:55.568136 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=1721): Process ended prematurely: osmo-stp_10.42.42.5(pid=1721) [trial-2370↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1721)] [trial-2370↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 06:01:55.577205 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 06:01:55.604139 run osmo-hlr_10.42.42.2(pid=1718): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1718)] 06:01:55.651593 run osmo-hlr_10.42.42.2(pid=1718): stdout: | (launched: 2022-12-10_06:01:52.519030) 06:01:55.700549 run osmo-hlr_10.42.42.2(pid=1718): stderr: | 20221210060152695 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210060152695 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210060152695 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210060152695 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210060152695 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210060152695 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210060152707 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210060152715 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210060152716 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210060152716 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:01:55.749939 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1717): Terminating (SIGTERM) 06:01:55.789638 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1720): Terminating (SIGTERM) 06:01:55.829289 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1723): Terminating (SIGTERM) 06:01:55.869746 --- ParallelTerminationStrategy: PID 1717 died... 06:01:55.888568 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1717): Terminated: ok {rc=0} 06:01:55.932592 --- ParallelTerminationStrategy: PID 1720 died... 06:01:55.951028 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1720): Terminated: ok {rc=0} 06:01:55.994828 --- ParallelTerminationStrategy: PID 1723 died... 06:01:56.013259 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1723): Terminated: ok {rc=0} 06:01:56.098821 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2370 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 06:01:57.400585 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:01:57.406777 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 06:01:57.440191 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 06:01:57.478797 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 06:01:57.564681 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 06:01:57.597932 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 06:01:57.635867 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 06:01:58.230877 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2370 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 06:01:58.279776 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:01:58.290827 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 06:01:58.360317 tst cs_paging_gprs_active.py: using LAC 26344 06:01:58.480429 tst cs_paging_gprs_active.py: using RAC 79 06:01:58.598424 tst cs_paging_gprs_active.py: using CellId 26344 06:01:58.716768 tst cs_paging_gprs_active.py: using BVCI 26345 06:01:58.826347 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:01:58.837348 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:01:58.848265 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:01:58.859383 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:01:58.870450 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:01:58.881391 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:01:58.892719 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:01:58.903705 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:01:58.914964 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:01:59.031859 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:01:59.149735 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 06:01:59.352097 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:01:59.654194 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1728): Launched 06:01:59.919308 run iperf3-srv_10.42.42.10(pid=1729): Launched 06:02:00.033081 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 06:02:00.234821 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:02:00.537634 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1730): Launched 06:02:00.799709 run iperf3-srv_10.42.42.10(pid=1731): Launched 06:02:00.914312 tst cs_paging_gprs_active.py:38: start network... 06:02:01.120201 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:02:01.595302 run create_hlr_db(pid=1732): Launched 06:02:01.764429 bus /gobi_6: Setting Powered False 06:02:02.827584 run create_hlr_db(pid=1732): Terminated: ok {rc=0} 06:02:03.261586 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1734): Launched 06:02:03.562756 run osmo-hlr_10.42.42.2(pid=1735): Launched 06:02:03.677080 run osmo-stp_10.42.42.5: Starting osmo-stp 06:02:04.235545 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1737): Launched 06:02:04.579975 run osmo-stp_10.42.42.5(pid=1738): Launched 06:02:04.733948 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:02:05.333519 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1740): Launched 06:02:05.467632 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:02:05.746603 run patchelf(pid=1741): Launched 06:02:05.925803 run osmo-stp_10.42.42.5(pid=1738): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1738)] 06:02:06.062290 run osmo-stp_10.42.42.5(pid=1738): stdout: | (launched: 2022-12-10_06:02:04.519118) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:02:06.200192 run osmo-stp_10.42.42.5(pid=1738): stderr: | 20221210060204712 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060204712 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060204712 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060204712 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060204713 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060204713 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060204713 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:02:06.338774 run osmo-stp_10.42.42.5(pid=1738): stdout: | (launched: 2022-12-10_06:02:04.519118) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:02:06.471105 run osmo-stp_10.42.42.5(pid=1738): stderr: | 20221210060204712 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060204712 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060204712 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060204712 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060204713 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060204713 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060204713 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:02:06.627454 run patchelf(pid=1741): Terminating (SIGINT) 06:02:06.807264 run patchelf(pid=1741): Terminated: ok {rc=0} 06:02:06.937365 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=1738): Process ended prematurely: osmo-stp_10.42.42.5(pid=1738) [trial-2370↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1738)] [trial-2370↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 06:02:06.947974 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 06:02:06.976614 run osmo-hlr_10.42.42.2(pid=1735): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1735)] 06:02:07.026749 run osmo-hlr_10.42.42.2(pid=1735): stdout: | (launched: 2022-12-10_06:02:03.507147) 06:02:07.078954 run osmo-hlr_10.42.42.2(pid=1735): stderr: | 20221210060203682 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210060203682 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210060203682 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210060203682 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210060203682 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210060203682 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210060203694 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210060203703 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210060203703 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210060203703 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:02:07.131358 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1728): Terminating (SIGTERM) 06:02:07.173144 run iperf3-srv_10.42.42.10(pid=1729): Terminating (SIGTERM) 06:02:07.214837 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1730): Terminating (SIGTERM) 06:02:07.257329 run iperf3-srv_10.42.42.10(pid=1731): Terminating (SIGTERM) 06:02:07.299283 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1734): Terminating (SIGTERM) 06:02:07.341191 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1737): Terminating (SIGTERM) 06:02:07.383384 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1740): Terminating (SIGTERM) 06:02:07.425322 --- ParallelTerminationStrategy: PID 1728 died... 06:02:07.444891 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1728): Terminated: ok {rc=0} 06:02:07.491095 --- ParallelTerminationStrategy: PID 1729 died... 06:02:07.510523 run iperf3-srv_10.42.42.10(pid=1729): Terminated {rc=256} 06:02:07.556511 --- ParallelTerminationStrategy: PID 1730 died... 06:02:07.576048 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1730): Terminated: ok {rc=0} 06:02:07.622284 --- ParallelTerminationStrategy: PID 1731 died... 06:02:07.641777 run iperf3-srv_10.42.42.10(pid=1731): Terminated {rc=256} 06:02:07.687766 --- ParallelTerminationStrategy: PID 1734 died... 06:02:07.707266 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1734): Terminated: ok {rc=0} 06:02:07.753419 --- ParallelTerminationStrategy: PID 1737 died... 06:02:07.772786 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1737): Terminated: ok {rc=0} 06:02:07.818965 --- ParallelTerminationStrategy: PID 1740 died... 06:02:07.838533 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1740): Terminated: ok {rc=0} 06:02:07.926217 bus /gobi_0: Setting Powered False 06:02:09.024415 bus /gobi_0: Setting Powered False 06:02:10.139710 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 06:02:11.285983 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:02:11.297890 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 06:02:11.371043 tst iperf3.py: using LAC 26345 06:02:11.493346 tst iperf3.py: using RAC 80 06:02:11.610704 tst iperf3.py: using CellId 26345 06:02:11.727325 tst iperf3.py: using BVCI 26346 06:02:11.837347 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:02:11.848246 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:02:11.859149 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:02:11.870287 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:02:11.881426 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:02:11.892765 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:02:11.904010 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:02:11.915037 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:02:11.926307 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:02:12.040596 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 06:02:12.241628 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:02:12.543231 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1742): Launched 06:02:12.807073 run iperf3-srv_10.42.42.10(pid=1743): Launched 06:02:12.920412 tst iperf3.py:8: start network... 06:02:13.121862 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:02:13.589798 run create_hlr_db(pid=1744): Launched 06:02:13.704200 bus /gobi_6: Setting Powered False 06:02:14.764142 run create_hlr_db(pid=1744): Terminated: ok {rc=0} 06:02:15.203201 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1746): Launched 06:02:15.526516 run osmo-hlr_10.42.42.2(pid=1747): Launched 06:02:15.651041 run osmo-stp_10.42.42.5: Starting osmo-stp 06:02:16.308896 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1749): Launched 06:02:16.656548 run osmo-stp_10.42.42.5(pid=1750): Launched 06:02:16.829773 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:02:17.494269 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1752): Launched 06:02:17.619261 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:02:17.890781 run patchelf(pid=1753): Launched 06:02:18.071514 run osmo-stp_10.42.42.5(pid=1750): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1750)] 06:02:18.208367 run osmo-stp_10.42.42.5(pid=1750): stdout: | (launched: 2022-12-10_06:02:16.597583) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:02:18.347022 run osmo-stp_10.42.42.5(pid=1750): stderr: | 20221210060216954 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060216954 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060216955 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060216955 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060216956 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060216956 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060216956 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:02:18.485161 run osmo-stp_10.42.42.5(pid=1750): stdout: | (launched: 2022-12-10_06:02:16.597583) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:02:18.617372 run osmo-stp_10.42.42.5(pid=1750): stderr: | 20221210060216954 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060216954 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060216955 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060216955 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060216956 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060216956 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060216956 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:02:18.773679 run patchelf(pid=1753): Terminating (SIGINT) 06:02:18.953707 run patchelf(pid=1753): Terminated: ok {rc=0} 06:02:19.083721 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1750): Process ended prematurely: osmo-stp_10.42.42.5(pid=1750) [trial-2370↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1750)] [trial-2370↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8] 06:02:19.094176 tst iperf3.py:8: Test FAILED (7.8 sec) 06:02:19.122621 run osmo-hlr_10.42.42.2(pid=1747): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1747)] 06:02:19.172182 run osmo-hlr_10.42.42.2(pid=1747): stdout: | (launched: 2022-12-10_06:02:15.468256) 06:02:19.223378 run osmo-hlr_10.42.42.2(pid=1747): stderr: | 20221210060215668 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210060215668 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210060215668 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210060215669 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210060215669 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210060215669 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210060215681 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210060215689 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210060215689 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210060215689 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:02:19.274884 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1742): Terminating (SIGTERM) 06:02:19.317685 run iperf3-srv_10.42.42.10(pid=1743): Terminating (SIGTERM) 06:02:19.359804 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1746): Terminating (SIGTERM) 06:02:19.401611 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1749): Terminating (SIGTERM) 06:02:19.443296 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1752): Terminating (SIGTERM) 06:02:19.485176 --- ParallelTerminationStrategy: PID 1742 died... 06:02:19.505044 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1742): Terminated: ok {rc=0} 06:02:19.551192 --- ParallelTerminationStrategy: PID 1743 died... 06:02:19.570667 run iperf3-srv_10.42.42.10(pid=1743): Terminated {rc=256} 06:02:19.616559 --- ParallelTerminationStrategy: PID 1746 died... 06:02:19.636059 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1746): Terminated: ok {rc=0} 06:02:19.682172 --- ParallelTerminationStrategy: PID 1749 died... 06:02:19.701726 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1749): Terminated: ok {rc=0} 06:02:19.748030 --- ParallelTerminationStrategy: PID 1752 died... 06:02:19.767751 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1752): Terminated: ok {rc=0} 06:02:19.856066 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 06:02:21.006592 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:02:21.018988 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 06:02:21.092449 tst iperf3m4.py: using LAC 26346 06:02:21.221922 tst iperf3m4.py: using RAC 81 06:02:21.349410 tst iperf3m4.py: using CellId 26346 06:02:21.468825 tst iperf3m4.py: using BVCI 26347 06:02:21.581546 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:02:21.592568 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:02:21.603441 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:02:21.614697 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:02:21.626231 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:02:21.637262 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:02:21.648329 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:02:21.659373 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:02:21.670667 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:02:21.790232 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:02:21.912303 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:02:22.030554 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:02:22.150402 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 06:02:22.367688 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:02:22.690393 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1754): Launched 06:02:22.971270 run iperf3-srv_10.42.42.10(pid=1755): Launched 06:02:23.091804 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 06:02:23.308008 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:02:23.630890 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1756): Launched 06:02:23.910238 run iperf3-srv_10.42.42.10(pid=1757): Launched 06:02:24.031992 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 06:02:24.247578 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:02:24.570428 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1758): Launched 06:02:24.850107 run iperf3-srv_10.42.42.10(pid=1759): Launched 06:02:24.971622 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 06:02:25.186916 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:02:25.509706 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1760): Launched 06:02:25.788192 run iperf3-srv_10.42.42.10(pid=1761): Launched 06:02:25.908647 tst iperf3m4.py:8: start network... 06:02:26.124536 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:02:26.625183 run create_hlr_db(pid=1762): Launched 06:02:26.757074 bus /gobi_6: Setting Powered False 06:02:27.820668 run create_hlr_db(pid=1762): Terminated: ok {rc=0} 06:02:28.249940 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1764): Launched 06:02:28.551882 run osmo-hlr_10.42.42.2(pid=1765): Launched 06:02:28.667825 run osmo-stp_10.42.42.5: Starting osmo-stp 06:02:29.191421 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1767): Launched 06:02:29.494889 run osmo-stp_10.42.42.5(pid=1768): Launched 06:02:29.610426 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:02:30.131297 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1770): Launched 06:02:30.247100 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:02:30.501737 run patchelf(pid=1771): Launched 06:02:30.670332 run osmo-stp_10.42.42.5(pid=1768): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1768)] 06:02:30.798293 run osmo-stp_10.42.42.5(pid=1768): stdout: | (launched: 2022-12-10_06:02:29.438597) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:02:30.960536 run osmo-stp_10.42.42.5(pid=1768): stderr: | 20221210060229610 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060229610 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060229610 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060229611 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060229611 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060229611 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060229611 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:02:31.111615 run osmo-stp_10.42.42.5(pid=1768): stdout: | (launched: 2022-12-10_06:02:29.438597) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:02:31.246980 run osmo-stp_10.42.42.5(pid=1768): stderr: | 20221210060229610 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060229610 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060229610 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060229611 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060229611 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060229611 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060229611 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:02:31.408564 run patchelf(pid=1771): Terminating (SIGINT) 06:02:31.594332 run patchelf(pid=1771): Terminated: ok {rc=0} 06:02:31.727305 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1768): Process ended prematurely: osmo-stp_10.42.42.5(pid=1768) [trial-2370↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1768)] [trial-2370↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8] 06:02:31.738740 tst iperf3m4.py:8: Test FAILED (10.8 sec) 06:02:31.770027 run osmo-hlr_10.42.42.2(pid=1765): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1765)] 06:02:31.821250 run osmo-hlr_10.42.42.2(pid=1765): stdout: | (launched: 2022-12-10_06:02:28.496085) 06:02:31.874035 run osmo-hlr_10.42.42.2(pid=1765): stderr: | 20221210060228670 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210060228670 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210060228670 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210060228670 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210060228670 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210060228670 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210060228682 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210060228691 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210060228691 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210060228691 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:02:31.929522 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1754): Terminating (SIGTERM) 06:02:31.975325 run iperf3-srv_10.42.42.10(pid=1755): Terminating (SIGTERM) 06:02:32.021365 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1756): Terminating (SIGTERM) 06:02:32.064411 run iperf3-srv_10.42.42.10(pid=1757): Terminating (SIGTERM) 06:02:32.108567 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1758): Terminating (SIGTERM) 06:02:32.150541 run iperf3-srv_10.42.42.10(pid=1759): Terminating (SIGTERM) 06:02:32.191601 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1760): Terminating (SIGTERM) 06:02:32.232710 run iperf3-srv_10.42.42.10(pid=1761): Terminating (SIGTERM) 06:02:32.273702 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1764): Terminating (SIGTERM) 06:02:32.315276 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1767): Terminating (SIGTERM) 06:02:32.357450 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1770): Terminating (SIGTERM) 06:02:32.399230 --- ParallelTerminationStrategy: PID 1754 died... 06:02:32.418823 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1754): Terminated: ok {rc=0} 06:02:32.465209 --- ParallelTerminationStrategy: PID 1755 died... 06:02:32.484469 run iperf3-srv_10.42.42.10(pid=1755): Terminated {rc=256} 06:02:32.530011 --- ParallelTerminationStrategy: PID 1756 died... 06:02:32.549476 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1756): Terminated: ok {rc=0} 06:02:32.595478 --- ParallelTerminationStrategy: PID 1757 died... 06:02:32.615015 run iperf3-srv_10.42.42.10(pid=1757): Terminated {rc=256} 06:02:32.660475 --- ParallelTerminationStrategy: PID 1758 died... 06:02:32.680010 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1758): Terminated: ok {rc=0} 06:02:32.726342 --- ParallelTerminationStrategy: PID 1759 died... 06:02:32.745782 run iperf3-srv_10.42.42.10(pid=1759): Terminated {rc=256} 06:02:32.791191 --- ParallelTerminationStrategy: PID 1760 died... 06:02:32.810773 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1760): Terminated: ok {rc=0} 06:02:32.856697 --- ParallelTerminationStrategy: PID 1761 died... 06:02:32.876240 run iperf3-srv_10.42.42.10(pid=1761): Terminated {rc=256} 06:02:32.921534 --- ParallelTerminationStrategy: PID 1764 died... 06:02:32.940851 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1764): Terminated: ok {rc=0} 06:02:32.986744 --- ParallelTerminationStrategy: PID 1767 died... 06:02:33.006311 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1767): Terminated: ok {rc=0} 06:02:33.052173 --- ParallelTerminationStrategy: PID 1770 died... 06:02:33.071728 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1770): Terminated: ok {rc=0} 06:02:33.160244 bus /gobi_4: Setting Powered False 06:02:34.260436 bus /gobi_4: Setting Powered False 06:02:35.375726 bus /gobi_1: Setting Powered False 06:02:36.475276 bus /gobi_1: Setting Powered False 06:02:37.590519 bus /gobi_0: Setting Powered False 06:02:38.689517 bus /gobi_0: Setting Powered False 06:02:39.805597 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 06:02:40.907868 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:02:40.919867 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 06:02:40.992081 tst ping.py: using LAC 26347 06:02:41.109216 tst ping.py: using RAC 82 06:02:41.224225 tst ping.py: using CellId 26347 06:02:41.339562 tst ping.py: using BVCI 26348 06:02:41.446186 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:02:41.457413 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:02:41.468129 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:02:41.479270 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:02:41.490682 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:02:41.501910 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:02:41.513288 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:02:41.524309 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:02:41.642303 tst ping.py:19: start network... 06:02:41.852540 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:02:42.337164 run create_hlr_db(pid=1774): Launched 06:02:42.467328 bus /gobi_6: Setting Powered False 06:02:43.530156 run create_hlr_db(pid=1774): Terminated: ok {rc=0} 06:02:43.951489 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1776): Launched 06:02:44.246528 run osmo-hlr_10.42.42.2(pid=1777): Launched 06:02:44.359390 run osmo-stp_10.42.42.5: Starting osmo-stp 06:02:44.878028 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1780): Launched 06:02:45.173035 run osmo-stp_10.42.42.5(pid=1781): Launched 06:02:45.285489 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:02:45.795340 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1783): Launched 06:02:45.935777 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:02:46.209975 run patchelf(pid=1784): Launched 06:02:46.402213 run osmo-stp_10.42.42.5(pid=1781): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1781)] 06:02:46.539247 run osmo-stp_10.42.42.5(pid=1781): stdout: | (launched: 2022-12-10_06:02:45.118853) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:02:46.670643 run osmo-stp_10.42.42.5(pid=1781): stderr: | 20221210060245288 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060245288 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060245289 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060245290 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060245290 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060245290 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060245290 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:02:46.824059 run osmo-stp_10.42.42.5(pid=1781): stdout: | (launched: 2022-12-10_06:02:45.118853) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:02:46.949489 run osmo-stp_10.42.42.5(pid=1781): stderr: | 20221210060245288 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060245288 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060245289 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060245290 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060245290 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060245290 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060245290 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:02:47.097414 run patchelf(pid=1784): Terminating (SIGINT) 06:02:47.275657 run patchelf(pid=1784): Terminated: ok {rc=0} 06:02:47.396738 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=1781): Process ended prematurely: osmo-stp_10.42.42.5(pid=1781) [trial-2370↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1781)] [trial-2370↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22] 06:02:47.406052 tst ping.py:22: Test FAILED (6.5 sec) 06:02:47.434605 run osmo-hlr_10.42.42.2(pid=1777): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1777)] 06:02:47.482827 run osmo-hlr_10.42.42.2(pid=1777): stdout: | (launched: 2022-12-10_06:02:44.192504) 06:02:47.532778 run osmo-hlr_10.42.42.2(pid=1777): stderr: | 20221210060244367 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210060244367 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210060244367 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210060244367 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210060244367 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210060244367 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210060244380 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210060244389 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210060244389 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210060244389 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:02:47.583238 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1776): Terminating (SIGTERM) 06:02:47.623230 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1780): Terminating (SIGTERM) 06:02:47.663185 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1783): Terminating (SIGTERM) 06:02:47.703376 --- ParallelTerminationStrategy: PID 1776 died... 06:02:47.722305 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1776): Terminated: ok {rc=0} 06:02:47.767298 --- ParallelTerminationStrategy: PID 1780 died... 06:02:47.785810 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1780): Terminated: ok {rc=0} 06:02:47.830617 --- ParallelTerminationStrategy: PID 1783 died... 06:02:47.849144 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1783): Terminated: ok {rc=0} 06:02:47.934714 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 06:02:49.023200 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:02:49.035446 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 06:02:49.108693 tst ping_idle_ping.py: using LAC 26348 06:02:49.227143 tst ping_idle_ping.py: using RAC 83 06:02:49.343358 tst ping_idle_ping.py: using CellId 26348 06:02:49.462839 tst ping_idle_ping.py: using BVCI 26349 06:02:49.571450 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:02:49.582693 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:02:49.593931 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:02:49.605652 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:02:49.617250 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:02:49.628782 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:02:49.640611 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:02:49.652433 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:02:49.771894 tst ping_idle_ping.py:24: start network... 06:02:49.985151 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:02:50.475890 run create_hlr_db(pid=1785): Launched 06:02:50.605921 bus /gobi_6: Setting Powered False 06:02:51.669322 run create_hlr_db(pid=1785): Terminated: ok {rc=0} 06:02:52.095191 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1787): Launched 06:02:52.391107 run osmo-hlr_10.42.42.2(pid=1788): Launched 06:02:52.503735 run osmo-stp_10.42.42.5: Starting osmo-stp 06:02:53.024413 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1790): Launched 06:02:53.319777 run osmo-stp_10.42.42.5(pid=1791): Launched 06:02:53.432808 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:02:53.942633 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1793): Launched 06:02:54.056137 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:02:54.306287 run patchelf(pid=1794): Launched 06:02:54.473231 run osmo-stp_10.42.42.5(pid=1791): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1791)] 06:02:54.599057 run osmo-stp_10.42.42.5(pid=1791): stdout: | (launched: 2022-12-10_06:02:53.265621) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:02:54.726542 run osmo-stp_10.42.42.5(pid=1791): stderr: | 20221210060253437 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060253437 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060253437 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060253438 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060253438 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060253438 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060253439 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:02:54.854148 run osmo-stp_10.42.42.5(pid=1791): stdout: | (launched: 2022-12-10_06:02:53.265621) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:02:54.975380 run osmo-stp_10.42.42.5(pid=1791): stderr: | 20221210060253437 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060253437 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060253437 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060253438 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060253438 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060253438 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060253439 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:02:55.119413 run patchelf(pid=1794): Terminating (SIGINT) 06:02:55.285777 run patchelf(pid=1794): Terminated: ok {rc=0} 06:02:55.405833 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=1791): Process ended prematurely: osmo-stp_10.42.42.5(pid=1791) [trial-2370↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1791)] [trial-2370↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 06:02:55.414978 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 06:02:55.442113 run osmo-hlr_10.42.42.2(pid=1788): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1788)] 06:02:55.490226 run osmo-hlr_10.42.42.2(pid=1788): stdout: | (launched: 2022-12-10_06:02:52.336690) 06:02:55.539247 run osmo-hlr_10.42.42.2(pid=1788): stderr: | 20221210060252514 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210060252514 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210060252514 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210060252514 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210060252515 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210060252515 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210060252529 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210060252538 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210060252538 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210060252539 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:02:55.589309 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1787): Terminating (SIGTERM) 06:02:55.629174 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1790): Terminating (SIGTERM) 06:02:55.669334 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1793): Terminating (SIGTERM) 06:02:55.709768 --- ParallelTerminationStrategy: PID 1787 died... 06:02:55.728756 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1787): Terminated: ok {rc=0} 06:02:55.772816 --- ParallelTerminationStrategy: PID 1790 died... 06:02:55.791754 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1790): Terminated: ok {rc=0} 06:02:55.835831 --- ParallelTerminationStrategy: PID 1793 died... 06:02:55.854419 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1793): Terminated: ok {rc=0} 06:02:55.937476 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2370 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 06:02:57.250113 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:02:57.257993 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 06:02:57.294393 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 06:02:57.330417 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 06:02:57.384282 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 06:02:57.418850 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 06:02:57.454179 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 06:02:58.015653 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2370 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 06:02:58.021323 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:02:58.033302 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 06:02:58.103494 tst switch_tch_pdch.py: using LAC 26349 06:02:58.225357 tst switch_tch_pdch.py: using RAC 84 06:02:58.346896 tst switch_tch_pdch.py: using CellId 26349 06:02:58.463037 tst switch_tch_pdch.py: using BVCI 26350 06:02:58.570055 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:02:58.581493 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:02:58.592652 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:02:58.604366 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:02:58.616142 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:02:58.627761 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:02:58.639493 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:02:58.651371 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:02:58.766050 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:02:58.885671 tst switch_tch_pdch.py:51: start network... 06:02:59.097108 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:02:59.584673 run create_hlr_db(pid=1798): Launched 06:02:59.713500 bus /gobi_6: Setting Powered False 06:03:00.776508 run create_hlr_db(pid=1798): Terminated: ok {rc=0} 06:03:01.257771 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1801): Launched 06:03:01.570108 run osmo-hlr_10.42.42.2(pid=1802): Launched 06:03:01.776344 run osmo-stp_10.42.42.5: Starting osmo-stp 06:03:02.436707 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1804): Launched 06:03:02.732135 run osmo-stp_10.42.42.5(pid=1805): Launched 06:03:02.845169 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:03:03.354355 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1807): Launched 06:03:03.469228 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:03:03.718643 run patchelf(pid=1808): Launched 06:03:03.883585 run osmo-stp_10.42.42.5(pid=1805): ERR: Terminated: ERROR {rc=1} [trial-2370↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1805)] 06:03:04.008733 run osmo-stp_10.42.42.5(pid=1805): stdout: | (launched: 2022-12-10_06:03:02.678254) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:03:04.135939 run osmo-stp_10.42.42.5(pid=1805): stderr: | 20221210060302847 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060302847 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060302847 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060302848 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060302850 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060302850 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060302850 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:03:04.263425 run osmo-stp_10.42.42.5(pid=1805): stdout: | (launched: 2022-12-10_06:03:02.678254) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:03:04.384379 run osmo-stp_10.42.42.5(pid=1805): stderr: | 20221210060302847 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060302847 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060302847 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060302848 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060302850 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060302850 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060302850 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:03:04.527505 run patchelf(pid=1808): Terminating (SIGINT) 06:03:04.693264 run patchelf(pid=1808): Terminated: ok {rc=0} 06:03:04.812668 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=1805): Process ended prematurely: osmo-stp_10.42.42.5(pid=1805) [trial-2370↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1805)] [trial-2370↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 06:03:04.822112 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 06:03:04.849542 run osmo-hlr_10.42.42.2(pid=1802): ERR: Terminated: ERROR {rc=237} [trial-2370↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1802)] 06:03:04.897441 run osmo-hlr_10.42.42.2(pid=1802): stdout: | (launched: 2022-12-10_06:03:01.512409) 06:03:04.947005 run osmo-hlr_10.42.42.2(pid=1802): stderr: | 20221210060301847 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210060301847 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210060301850 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210060301850 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210060301850 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210060301850 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210060301881 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210060301898 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210060301898 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210060301898 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:03:04.997120 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1801): Terminating (SIGTERM) 06:03:05.037050 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1804): Terminating (SIGTERM) 06:03:05.076913 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1807): Terminating (SIGTERM) 06:03:05.117038 --- ParallelTerminationStrategy: PID 1801 died... 06:03:05.135830 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1801): Terminated: ok {rc=0} 06:03:05.180235 --- ParallelTerminationStrategy: PID 1804 died... 06:03:05.198735 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1804): Terminated: ok {rc=0} 06:03:05.242536 --- ParallelTerminationStrategy: PID 1807 died... 06:03:05.260848 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1807): Terminated: ok {rc=0} 06:03:05.346285 bus /gobi_0: Setting Powered False 06:03:06.444474 bus /gobi_0: Setting Powered False 06:03:07.555897 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2370 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 06:03:08.811931 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:03:08.818494 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 06:03:08.853776 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 06:03:08.889433 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 06:03:08.943438 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 06:03:08.978223 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 06:03:09.013540 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 06:03:09.571266 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2370 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 06:03:09.576844 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:03:09.588618 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 06:03:09.661796 tst switch_tch_pdch.py: using LAC 26350 06:03:09.786879 tst switch_tch_pdch.py: using RAC 85 06:03:09.913117 tst switch_tch_pdch.py: using CellId 26350 06:03:10.037407 tst switch_tch_pdch.py: using BVCI 26351 06:03:10.151449 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:03:10.162969 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:03:10.174373 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:03:10.185925 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:03:10.197426 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:03:10.208613 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:03:10.220060 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:03:10.231351 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 06:03:10.352693 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 06:03:10.468421 tst switch_tch_pdch.py:51: start network... 06:03:10.666083 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:03:11.096745 run create_hlr_db(pid=1813): Launched 06:03:11.211884 bus /gobi_6: Setting Powered False 06:03:12.271363 run create_hlr_db(pid=1813): Terminated: ok {rc=0} 06:03:12.676621 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1816): Launched 06:03:12.991312 run osmo-hlr_10.42.42.2(pid=1817): Launched 06:03:13.111393 run osmo-stp_10.42.42.5: Starting osmo-stp 06:03:13.625721 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1820): Launched 06:03:13.941552 run osmo-stp_10.42.42.5(pid=1821): Launched 06:03:14.062730 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:03:14.578546 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1823): Launched 06:03:14.699045 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:03:14.964752 run patchelf(pid=1824): Launched 06:03:15.141690 run osmo-stp_10.42.42.5(pid=1821): ERR: Terminated: ERROR {rc=1} [trial-2370↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1821)] 06:03:15.275777 run osmo-stp_10.42.42.5(pid=1821): stdout: | (launched: 2022-12-10_06:03:13.884132) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:03:15.411935 run osmo-stp_10.42.42.5(pid=1821): stderr: | 20221210060314075 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060314075 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060314076 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060314076 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060314076 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060314076 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060314077 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:03:15.547574 run osmo-stp_10.42.42.5(pid=1821): stdout: | (launched: 2022-12-10_06:03:13.884132) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:03:15.676733 run osmo-stp_10.42.42.5(pid=1821): stderr: | 20221210060314075 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060314075 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060314076 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060314076 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060314076 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060314076 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060314077 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:03:15.838541 run patchelf(pid=1824): Terminating (SIGINT) 06:03:16.020156 run patchelf(pid=1824): Terminated: ok {rc=0} 06:03:16.143496 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=1821): Process ended prematurely: osmo-stp_10.42.42.5(pid=1821) [trial-2370↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1821)] [trial-2370↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 06:03:16.154683 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 06:03:16.184842 run osmo-hlr_10.42.42.2(pid=1817): ERR: Terminated: ERROR {rc=237} [trial-2370↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1817)] 06:03:16.235188 run osmo-hlr_10.42.42.2(pid=1817): stdout: | (launched: 2022-12-10_06:03:12.933990) 06:03:16.286914 run osmo-hlr_10.42.42.2(pid=1817): stderr: | 20221210060313130 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210060313130 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210060313130 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210060313130 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210060313130 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210060313130 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210060313143 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210060313154 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210060313154 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210060313154 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:03:16.339334 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1816): Terminating (SIGTERM) 06:03:16.383499 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1820): Terminating (SIGTERM) 06:03:16.427389 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1823): Terminating (SIGTERM) 06:03:16.471529 --- ParallelTerminationStrategy: PID 1816 died... 06:03:16.491779 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1816): Terminated: ok {rc=0} 06:03:16.541760 --- ParallelTerminationStrategy: PID 1820 died... 06:03:16.562582 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1820): Terminated: ok {rc=0} 06:03:16.608520 --- ParallelTerminationStrategy: PID 1823 died... 06:03:16.629303 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1823): Terminated: ok {rc=0} 06:03:16.717274 bus /gobi_0: Setting Powered False 06:03:17.814861 bus /gobi_0: Setting Powered False 06:03:18.928881 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2370 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 nitb_sms:trx-umtrx --------------------------------------------------------------------- 06:03:20.185910 tst nitb_sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:03:20.190275 tst nitb_sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 06:03:20.224020 tst nitb_sms:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 06:03:20.231172 tst nitb_sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 06:03:20.285774 tst nitb_sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 06:03:20.319196 tst nitb_sms:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 06:03:20.326226 tst nitb_sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 06:03:20.862851 tst nitb_sms:trx-umtrx: RESERVED RESOURCES for nitb_sms: bts UmTRX ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 nitb_sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 06:03:20.868335 tst nitb_sms:trx-umtrx: Using 1 x ip_address (candidates: 1) 06:03:20.879664 tst nitb_sms:trx-umtrx: Using 1 x bts (candidates: 1) 06:03:20.928519 tst mo_mt_sms.py: using LAC 26351 06:03:21.051849 tst mo_mt_sms.py: using RAC 86 06:03:21.177077 tst mo_mt_sms.py: using CellId 26351 06:03:21.299922 tst mo_mt_sms.py: using BVCI 26352 06:03:21.409168 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 06:03:21.526810 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 06:03:21.640924 tst mo_mt_sms.py:9: start nitb and bts... 06:03:21.840131 run osmo-nitb_10.42.42.2: Starting osmo-nitb 06:03:22.441793 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1828): Launched 06:03:22.736323 run osmo-nitb_10.42.42.2(pid=1829): Launched 06:03:22.900108 run osmo-nitb_10.42.42.2(pid=1829): ERR: Terminated: ERROR {rc=2} [trial-2370↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1829)] 06:03:23.033158 run osmo-nitb_10.42.42.2(pid=1829): stdout: | (launched: 2022-12-10_06:03:22.682374) 06:03:23.167524 run osmo-nitb_10.42.42.2(pid=1829): stderr: | (launched: 2022-12-10_06:03:22.726112) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:03:23.302142 run osmo-nitb_10.42.42.2(pid=1829): stdout: | (launched: 2022-12-10_06:03:22.682374) 06:03:23.430683 run osmo-nitb_10.42.42.2(pid=1829): stderr: | (launched: 2022-12-10_06:03:22.726112) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=1829): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1829) [trial-2370↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1829)] 06:03:23.848458 tst osmo-nitb_10.42.42.2(pid=1829): stdout: | (launched: 2022-12-10_06:03:22.682374) 06:03:23.969516 tst osmo-nitb_10.42.42.2(pid=1829): stderr: | (launched: 2022-12-10_06:03:22.726112) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:03:24.111036 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=1829): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1829) [trial-2370↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1829)] [trial-2370↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11] 06:03:24.119859 tst mo_mt_sms.py:11: Test FAILED (3.2 sec) 06:03:24.126705 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1828): Terminating (SIGTERM) 06:03:24.336842 --- ParallelTerminationStrategy: PID 1828 died... 06:03:24.358869 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1828): Terminated: ok {rc=0} 06:03:24.445443 bus /sierra_3: Setting Powered False 06:03:25.545435 bus /sierra_3: Setting Powered False 06:03:26.662292 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 nitb_sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 sms:trx-umtrx --------------------------------------------------------------------- 06:03:27.862702 tst sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:03:27.867435 tst sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 06:03:27.902533 tst sms:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 06:03:27.929165 tst sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 06:03:27.983624 tst sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 06:03:28.017455 tst sms:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 06:03:28.044595 tst sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 06:03:28.588885 tst sms:trx-umtrx: RESERVED RESOURCES for sms: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 06:03:28.594237 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 06:03:28.605191 tst sms:trx-umtrx: Using 1 x bts (candidates: 1) 06:03:28.655652 tst mo_mt_sms.py: using LAC 26352 06:03:28.773643 tst mo_mt_sms.py: using RAC 87 06:03:28.897422 tst mo_mt_sms.py: using CellId 26352 06:03:29.019450 tst mo_mt_sms.py: using BVCI 26353 06:03:29.133383 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 06:03:29.144598 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 06:03:29.156281 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 06:03:29.167277 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 06:03:29.178307 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 06:03:29.189342 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 06:03:29.303777 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 06:03:29.420885 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:03:29.906435 run create_hlr_db(pid=1833): Launched 06:03:30.035752 bus /sierra_2: Setting Powered False 06:03:31.112658 run create_hlr_db(pid=1833): Terminated: ok {rc=0} 06:03:31.595612 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1835): Launched 06:03:31.911434 run osmo-hlr_10.42.42.2(pid=1836): Launched 06:03:32.158075 run osmo-stp_10.42.42.5: Starting osmo-stp 06:03:32.724877 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1838): Launched 06:03:33.040803 run osmo-stp_10.42.42.5(pid=1839): Launched 06:03:33.162063 run osmo-msc_10.42.42.6: Starting osmo-msc 06:03:33.730818 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1841): Launched 06:03:34.047312 run osmo-msc_10.42.42.6(pid=1842): Launched 06:03:34.224325 run osmo-stp_10.42.42.5(pid=1839): ERR: Terminated: ERROR {rc=1} [trial-2370↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1839)] 06:03:34.357463 run osmo-stp_10.42.42.5(pid=1839): stdout: | (launched: 2022-12-10_06:03:32.983500) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:03:34.490586 run osmo-stp_10.42.42.5(pid=1839): stderr: | 20221210060333176 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060333176 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060333176 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060333176 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060333177 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060333177 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060333177 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:03:34.623607 run osmo-stp_10.42.42.5(pid=1839): stdout: | (launched: 2022-12-10_06:03:32.983500) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:03:34.748713 run osmo-stp_10.42.42.5(pid=1839): stderr: | 20221210060333176 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060333176 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060333176 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060333176 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060333177 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060333177 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060333177 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:03:34.898815 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=1839): Process ended prematurely: osmo-stp_10.42.42.5(pid=1839) [trial-2370↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1839)] [trial-2370↪sms:trx-umtrx↪mo_mt_sms.py:16] 06:03:34.907950 tst mo_mt_sms.py:16: Test FAILED (6.3 sec) 06:03:34.935410 run osmo-hlr_10.42.42.2(pid=1836): ERR: Terminated: ERROR {rc=237} [trial-2370↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1836)] 06:03:34.985602 run osmo-hlr_10.42.42.2(pid=1836): stdout: | (launched: 2022-12-10_06:03:31.855108) 06:03:35.037146 run osmo-hlr_10.42.42.2(pid=1836): stderr: | 20221210060332178 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210060332178 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210060332178 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210060332179 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210060332179 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210060332179 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210060332198 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/sms:trx-umtrx/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210060332211 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210060332211 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210060332211 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:03:35.108853 run osmo-msc_10.42.42.6(pid=1842): ERR: Terminated: ERROR {rc=2} [trial-2370↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1842)] 06:03:35.158855 run osmo-msc_10.42.42.6(pid=1842): stdout: | (launched: 2022-12-10_06:03:33.989991) 06:03:35.210108 run osmo-msc_10.42.42.6(pid=1842): stderr: | 20221210060334312 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210060334312 DLGLOBAL DEBUG validating counter group 0x7f29ccb76c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210060334312 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210060334312 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210060334312 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210060334312 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210060334314 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210060334315 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210060334315 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210060334315 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:03:35.261829 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1835): Terminating (SIGTERM) 06:03:35.303228 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1838): Terminating (SIGTERM) 06:03:35.345084 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1841): Terminating (SIGTERM) 06:03:35.387008 --- ParallelTerminationStrategy: PID 1835 died... 06:03:35.406973 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1835): Terminated: ok {rc=0} 06:03:35.452925 --- ParallelTerminationStrategy: PID 1838 died... 06:03:35.472253 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1838): Terminated: ok {rc=0} 06:03:35.518165 --- ParallelTerminationStrategy: PID 1841 died... 06:03:35.537575 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1841): Terminated: ok {rc=0} 06:03:35.624451 bus /sierra_3: Setting Powered False 06:03:36.724127 bus /sierra_3: Setting Powered False 06:03:37.839295 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 nitb_ussd:trx-umtrx --------------------------------------------------------------------- 06:03:39.072693 tst nitb_ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:03:39.077491 tst nitb_ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 06:03:39.111494 tst nitb_ussd:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 06:03:39.118626 tst nitb_ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 06:03:39.154270 tst nitb_ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 06:03:39.188114 tst nitb_ussd:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 06:03:39.195193 tst nitb_ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 06:03:39.714121 tst nitb_ussd:trx-umtrx: RESERVED RESOURCES for nitb_ussd: bts UmTRX ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2370 nitb_ussd:trx-umtrx assert_extension.py ---------------------------------------------- 06:03:39.719478 tst nitb_ussd:trx-umtrx: Using 1 x ip_address (candidates: 1) 06:03:39.730824 tst nitb_ussd:trx-umtrx: Using 1 x bts (candidates: 1) 06:03:39.783086 tst assert_extension.py: using LAC 26353 06:03:39.899542 tst assert_extension.py: using RAC 88 06:03:40.023586 tst assert_extension.py: using CellId 26353 06:03:40.145837 tst assert_extension.py: using BVCI 26354 06:03:40.259973 tst nitb_ussd:trx-umtrx: Using 1 x modem (candidates: 1) 06:03:40.374827 tst assert_extension.py:10: start nitb and bts... 06:03:40.571648 run osmo-nitb_10.42.42.2: Starting osmo-nitb 06:03:41.173289 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1848): Launched 06:03:41.467518 run osmo-nitb_10.42.42.2(pid=1849): Launched 06:03:41.633651 run osmo-nitb_10.42.42.2(pid=1849): ERR: Terminated: ERROR {rc=2} [trial-2370↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1849)] 06:03:41.766717 run osmo-nitb_10.42.42.2(pid=1849): stdout: | (launched: 2022-12-10_06:03:41.413641) 06:03:41.901611 run osmo-nitb_10.42.42.2(pid=1849): stderr: | (launched: 2022-12-10_06:03:41.457272) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:03:42.036615 run osmo-nitb_10.42.42.2(pid=1849): stdout: | (launched: 2022-12-10_06:03:41.413641) 06:03:42.165397 run osmo-nitb_10.42.42.2(pid=1849): stderr: | (launched: 2022-12-10_06:03:41.457272) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=1849): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1849) [trial-2370↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1849)] 06:03:42.581293 tst osmo-nitb_10.42.42.2(pid=1849): stdout: | (launched: 2022-12-10_06:03:41.413641) 06:03:42.700921 tst osmo-nitb_10.42.42.2(pid=1849): stderr: | (launched: 2022-12-10_06:03:41.457272) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:03:42.842608 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=1849): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1849) [trial-2370↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1849)] [trial-2370↪nitb_ussd:trx-umtrx↪assert_extension.py:12] 06:03:42.851107 tst assert_extension.py:12: Test FAILED (3.1 sec) 06:03:42.857909 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1848): Terminating (SIGTERM) 06:03:43.067072 --- ParallelTerminationStrategy: PID 1848 died... 06:03:43.087658 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1848): Terminated: ok {rc=0} 06:03:43.173346 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 nitb_ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 ussd:trx-umtrx --------------------------------------------------------------------- 06:03:44.347474 tst ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:03:44.351547 tst ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 06:03:44.384669 tst ussd:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 06:03:44.411293 tst ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 06:03:44.452093 tst ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 06:03:44.486327 tst ussd:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 06:03:44.513773 tst ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 06:03:45.034026 tst ussd:trx-umtrx: RESERVED RESOURCES for ussd: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2370 ussd:trx-umtrx assert_extension.py ---------------------------------------------- 06:03:45.039663 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 06:03:45.050434 tst ussd:trx-umtrx: Using 1 x bts (candidates: 1) 06:03:45.097603 tst assert_extension.py: using LAC 26354 06:03:45.214587 tst assert_extension.py: using RAC 89 06:03:45.328309 tst assert_extension.py: using CellId 26354 06:03:45.443447 tst assert_extension.py: using BVCI 26355 06:03:45.550488 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 06:03:45.561317 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 06:03:45.571948 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 06:03:45.582826 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 06:03:45.593686 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 06:03:45.604432 tst ussd:trx-umtrx: Using 1 x modem (candidates: 1) 06:03:45.720581 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:03:46.233486 run create_hlr_db(pid=1853): Launched 06:03:46.397950 bus /sierra_2: Setting Powered False 06:03:47.459466 run create_hlr_db(pid=1853): Terminated: ok {rc=0} 06:03:47.900759 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1855): Launched 06:03:48.216741 run osmo-hlr_10.42.42.2(pid=1856): Launched 06:03:48.336885 run osmo-stp_10.42.42.5: Starting osmo-stp 06:03:48.885055 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1858): Launched 06:03:49.199759 run osmo-stp_10.42.42.5(pid=1859): Launched 06:03:49.319973 run osmo-msc_10.42.42.6: Starting osmo-msc 06:03:49.889750 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1861): Launched 06:03:50.206061 run osmo-msc_10.42.42.6(pid=1862): Launched 06:03:50.382033 run osmo-stp_10.42.42.5(pid=1859): ERR: Terminated: ERROR {rc=1} [trial-2370↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1859)] 06:03:50.514414 run osmo-stp_10.42.42.5(pid=1859): stdout: | (launched: 2022-12-10_06:03:49.142343) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:03:50.647660 run osmo-stp_10.42.42.5(pid=1859): stderr: | 20221210060349332 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060349332 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060349333 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060349333 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060349333 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060349334 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060349334 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:03:50.780140 run osmo-stp_10.42.42.5(pid=1859): stdout: | (launched: 2022-12-10_06:03:49.142343) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:03:50.905722 run osmo-stp_10.42.42.5(pid=1859): stderr: | 20221210060349332 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060349332 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060349333 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060349333 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060349333 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060349334 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060349334 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:03:51.055850 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=1859): Process ended prematurely: osmo-stp_10.42.42.5(pid=1859) [trial-2370↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1859)] [trial-2370↪ussd:trx-umtrx↪assert_extension.py:17] 06:03:51.065101 tst assert_extension.py:17: Test FAILED (6.0 sec) 06:03:51.092920 run osmo-hlr_10.42.42.2(pid=1856): ERR: Terminated: ERROR {rc=237} [trial-2370↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1856)] 06:03:51.143391 run osmo-hlr_10.42.42.2(pid=1856): stdout: | (launched: 2022-12-10_06:03:48.159223) 06:03:51.195243 run osmo-hlr_10.42.42.2(pid=1856): stderr: | 20221210060348357 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210060348357 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210060348357 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210060348357 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210060348357 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210060348357 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210060348370 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/ussd:trx-umtrx/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210060348378 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210060348378 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210060348378 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:03:51.267591 run osmo-msc_10.42.42.6(pid=1862): ERR: Terminated: ERROR {rc=2} [trial-2370↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1862)] 06:03:51.317818 run osmo-msc_10.42.42.6(pid=1862): stdout: | (launched: 2022-12-10_06:03:50.148135) 06:03:51.369881 run osmo-msc_10.42.42.6(pid=1862): stderr: | 20221210060350468 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210060350468 DLGLOBAL DEBUG validating counter group 0x7ffb8660fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210060350468 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210060350469 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210060350469 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210060350469 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210060350471 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210060350471 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210060350471 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210060350471 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:03:51.422014 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1855): Terminating (SIGTERM) 06:03:51.463825 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1858): Terminating (SIGTERM) 06:03:51.505777 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1861): Terminating (SIGTERM) 06:03:51.548055 --- ParallelTerminationStrategy: PID 1855 died... 06:03:51.568042 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1855): Terminated: ok {rc=0} 06:03:51.614440 --- ParallelTerminationStrategy: PID 1858 died... 06:03:51.633993 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1858): Terminated: ok {rc=0} 06:03:51.679770 --- ParallelTerminationStrategy: PID 1861 died... 06:03:51.699316 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1861): Terminated: ok {rc=0} 06:03:51.786277 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 06:03:52.995134 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:03:53.002083 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 06:03:53.036504 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 06:03:53.063646 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 06:03:53.116790 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 06:03:53.150417 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 06:03:53.177391 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 06:03:53.724085 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 06:03:53.774782 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:03:53.785944 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 06:03:53.854880 tst mo_mt_call.py: using LAC 26355 06:03:53.973295 tst mo_mt_call.py: using RAC 90 06:03:54.091046 tst mo_mt_call.py: using CellId 26355 06:03:54.209758 tst mo_mt_call.py: using BVCI 26356 06:03:54.320814 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:03:54.331903 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:03:54.342823 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:03:54.354618 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:03:54.365637 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:03:54.376570 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 06:03:54.490931 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 06:03:54.610073 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:03:55.106553 run create_hlr_db(pid=1867): Launched 06:03:55.237280 bus /sierra_2: Setting Powered False 06:03:56.301070 run create_hlr_db(pid=1867): Terminated: ok {rc=0} 06:03:56.731574 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1869): Launched 06:03:57.034700 run osmo-hlr_10.42.42.2(pid=1870): Launched 06:03:57.150220 run osmo-stp_10.42.42.5: Starting osmo-stp 06:03:57.686445 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1872): Launched 06:03:57.988750 run osmo-stp_10.42.42.5(pid=1873): Launched 06:03:58.103383 run osmo-msc_10.42.42.6: Starting osmo-msc 06:03:58.647554 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1875): Launched 06:03:58.950597 run osmo-msc_10.42.42.6(pid=1876): Launched 06:03:59.118843 run osmo-stp_10.42.42.5(pid=1873): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1873)] 06:03:59.247134 run osmo-stp_10.42.42.5(pid=1873): stdout: | (launched: 2022-12-10_06:03:57.933847) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:03:59.375241 run osmo-stp_10.42.42.5(pid=1873): stderr: | 20221210060358103 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060358103 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060358103 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060358104 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060358106 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060358106 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060358106 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:03:59.501187 run osmo-stp_10.42.42.5(pid=1873): stdout: | (launched: 2022-12-10_06:03:57.933847) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:03:59.620288 run osmo-stp_10.42.42.5(pid=1873): stderr: | 20221210060358103 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060358103 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060358103 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060358104 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060358106 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060358106 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060358106 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:03:59.763483 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1873): Process ended prematurely: osmo-stp_10.42.42.5(pid=1873) [trial-2370↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1873)] [trial-2370↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 06:03:59.772450 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 06:03:59.799585 run osmo-hlr_10.42.42.2(pid=1870): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1870)] 06:03:59.847338 run osmo-hlr_10.42.42.2(pid=1870): stdout: | (launched: 2022-12-10_06:03:56.978974) 06:03:59.896685 run osmo-hlr_10.42.42.2(pid=1870): stderr: | 20221210060357154 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210060357154 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210060357154 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210060357155 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210060357155 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210060357155 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210060357166 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210060357174 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210060357174 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210060357174 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:03:59.965220 run osmo-msc_10.42.42.6(pid=1876): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1876)] 06:04:00.012751 run osmo-msc_10.42.42.6(pid=1876): stdout: | (launched: 2022-12-10_06:03:58.894298) 06:04:00.062038 run osmo-msc_10.42.42.6(pid=1876): stderr: | 20221210060359166 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210060359166 DLGLOBAL DEBUG validating counter group 0x7fb981837c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210060359166 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210060359166 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210060359166 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210060359167 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210060359168 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210060359169 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210060359169 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210060359169 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:04:00.111854 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1869): Terminating (SIGTERM) 06:04:00.151597 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1872): Terminating (SIGTERM) 06:04:00.191227 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1875): Terminating (SIGTERM) 06:04:00.231066 --- ParallelTerminationStrategy: PID 1869 died... 06:04:00.250294 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1869): Terminated: ok {rc=0} 06:04:00.294395 --- ParallelTerminationStrategy: PID 1872 died... 06:04:00.312697 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1872): Terminated: ok {rc=0} 06:04:00.357391 --- ParallelTerminationStrategy: PID 1875 died... 06:04:00.376167 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1875): Terminated: ok {rc=0} 06:04:00.463332 bus /sierra_3: Setting Powered False 06:04:01.565763 bus /sierra_3: Setting Powered False 06:04:02.686257 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2370 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 06:04:03.832531 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:04:03.844430 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 06:04:03.913741 tst mo_mt_call_osmux.py: using LAC 26356 06:04:04.033709 tst mo_mt_call_osmux.py: using RAC 91 06:04:04.152092 tst mo_mt_call_osmux.py: using CellId 26356 06:04:04.278873 tst mo_mt_call_osmux.py: using BVCI 26357 06:04:04.396451 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:04:04.408319 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:04:04.419864 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:04:04.431562 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:04:04.443238 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:04:04.454823 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 06:04:04.568540 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 06:04:04.688856 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:04:05.184396 run create_hlr_db(pid=1878): Launched 06:04:05.315796 bus /sierra_2: Setting Powered False 06:04:06.379123 run create_hlr_db(pid=1878): Terminated: ok {rc=0} 06:04:06.823628 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1880): Launched 06:04:07.144603 run osmo-hlr_10.42.42.2(pid=1881): Launched 06:04:07.266545 run osmo-stp_10.42.42.5: Starting osmo-stp 06:04:07.822083 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1883): Launched 06:04:08.144480 run osmo-stp_10.42.42.5(pid=1884): Launched 06:04:08.268405 run osmo-msc_10.42.42.6: Starting osmo-msc 06:04:08.849867 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1886): Launched 06:04:09.172871 run osmo-msc_10.42.42.6(pid=1887): Launched 06:04:09.354099 run osmo-stp_10.42.42.5(pid=1884): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1884)] 06:04:09.489665 run osmo-stp_10.42.42.5(pid=1884): stdout: | (launched: 2022-12-10_06:04:08.086337) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:04:09.625956 run osmo-stp_10.42.42.5(pid=1884): stderr: | 20221210060408281 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060408281 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060408281 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060408282 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060408282 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060408282 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060408282 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:04:09.761212 run osmo-stp_10.42.42.5(pid=1884): stdout: | (launched: 2022-12-10_06:04:08.086337) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:04:09.888829 run osmo-stp_10.42.42.5(pid=1884): stderr: | 20221210060408281 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060408281 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060408281 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060408282 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060408282 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060408282 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060408282 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:04:10.041569 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1884): Process ended prematurely: osmo-stp_10.42.42.5(pid=1884) [trial-2370↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1884)] [trial-2370↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 06:04:10.051442 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 06:04:10.079455 run osmo-hlr_10.42.42.2(pid=1881): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1881)] 06:04:10.129304 run osmo-hlr_10.42.42.2(pid=1881): stdout: | (launched: 2022-12-10_06:04:07.085989) 06:04:10.180858 run osmo-hlr_10.42.42.2(pid=1881): stderr: | 20221210060407285 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210060407285 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210060407285 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210060407285 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210060407285 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210060407285 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210060407297 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210060407305 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210060407305 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210060407305 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:04:10.253288 run osmo-msc_10.42.42.6(pid=1887): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1887)] 06:04:10.302933 run osmo-msc_10.42.42.6(pid=1887): stdout: | (launched: 2022-12-10_06:04:09.114212) 06:04:10.354191 run osmo-msc_10.42.42.6(pid=1887): stderr: | 20221210060409435 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210060409436 DLGLOBAL DEBUG validating counter group 0x7fa6f75d1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210060409436 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210060409436 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210060409436 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210060409436 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210060409438 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210060409438 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210060409438 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210060409438 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:04:10.406121 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1880): Terminating (SIGTERM) 06:04:10.447545 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1883): Terminating (SIGTERM) 06:04:10.488849 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1886): Terminating (SIGTERM) 06:04:10.530448 --- ParallelTerminationStrategy: PID 1880 died... 06:04:10.550430 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1880): Terminated: ok {rc=0} 06:04:10.596614 --- ParallelTerminationStrategy: PID 1883 died... 06:04:10.616084 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1883): Terminated: ok {rc=0} 06:04:10.661785 --- ParallelTerminationStrategy: PID 1886 died... 06:04:10.681196 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1886): Terminated: ok {rc=0} 06:04:10.770704 bus /sierra_3: Setting Powered False 06:04:11.868914 bus /sierra_3: Setting Powered False 06:04:13.009244 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 06:04:14.259386 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:04:14.266568 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 06:04:14.300123 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 06:04:14.327704 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 06:04:14.381205 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 06:04:14.414420 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 06:04:14.441638 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 06:04:14.993667 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 06:04:15.044740 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:04:15.056550 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 06:04:15.126903 tst mo_mt_call.py: using LAC 26357 06:04:15.252264 tst mo_mt_call.py: using RAC 92 06:04:15.378206 tst mo_mt_call.py: using CellId 26357 06:04:15.508087 tst mo_mt_call.py: using BVCI 26358 06:04:15.625971 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:04:15.637637 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:04:15.649012 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:04:15.660362 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:04:15.671830 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:04:15.683213 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 06:04:15.800415 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 06:04:15.935080 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:04:16.443838 run create_hlr_db(pid=1892): Launched 06:04:16.607354 bus /sierra_2: Setting Powered False 06:04:17.670946 run create_hlr_db(pid=1892): Terminated: ok {rc=0} 06:04:18.120496 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1894): Launched 06:04:18.422484 run osmo-hlr_10.42.42.2(pid=1895): Launched 06:04:18.537865 run osmo-stp_10.42.42.5: Starting osmo-stp 06:04:19.053611 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1897): Launched 06:04:19.352841 run osmo-stp_10.42.42.5(pid=1898): Launched 06:04:19.466773 run osmo-msc_10.42.42.6: Starting osmo-msc 06:04:20.008886 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1900): Launched 06:04:20.309111 run osmo-msc_10.42.42.6(pid=1901): Launched 06:04:20.477462 run osmo-stp_10.42.42.5(pid=1898): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1898)] 06:04:20.605190 run osmo-stp_10.42.42.5(pid=1898): stdout: | (launched: 2022-12-10_06:04:19.297701) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:04:20.732746 run osmo-stp_10.42.42.5(pid=1898): stderr: | 20221210060419468 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060419468 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060419468 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060419469 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060419469 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060419469 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060419469 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:04:20.857967 run osmo-stp_10.42.42.5(pid=1898): stdout: | (launched: 2022-12-10_06:04:19.297701) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:04:20.976901 run osmo-stp_10.42.42.5(pid=1898): stderr: | 20221210060419468 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060419468 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060419468 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060419469 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060419469 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060419469 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060419469 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:04:21.119838 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1898): Process ended prematurely: osmo-stp_10.42.42.5(pid=1898) [trial-2370↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1898)] [trial-2370↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 06:04:21.128867 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 06:04:21.155655 run osmo-hlr_10.42.42.2(pid=1895): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1895)] 06:04:21.203322 run osmo-hlr_10.42.42.2(pid=1895): stdout: | (launched: 2022-12-10_06:04:18.367528) 06:04:21.252879 run osmo-hlr_10.42.42.2(pid=1895): stderr: | 20221210060418542 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210060418542 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210060418542 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210060418542 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210060418542 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210060418542 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210060418561 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210060418570 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210060418570 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210060418570 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:04:21.321566 run osmo-msc_10.42.42.6(pid=1901): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1901)] 06:04:21.369290 run osmo-msc_10.42.42.6(pid=1901): stdout: | (launched: 2022-12-10_06:04:20.253810) 06:04:21.418622 run osmo-msc_10.42.42.6(pid=1901): stderr: | 20221210060420525 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210060420525 DLGLOBAL DEBUG validating counter group 0x7f82a8f76c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210060420525 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210060420525 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210060420525 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210060420526 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210060420528 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210060420528 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210060420529 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210060420529 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:04:21.468334 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1894): Terminating (SIGTERM) 06:04:21.507598 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1897): Terminating (SIGTERM) 06:04:21.547063 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1900): Terminating (SIGTERM) 06:04:21.586513 --- ParallelTerminationStrategy: PID 1894 died... 06:04:21.605324 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1894): Terminated: ok {rc=0} 06:04:21.650109 --- ParallelTerminationStrategy: PID 1897 died... 06:04:21.668393 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1897): Terminated: ok {rc=0} 06:04:21.712077 --- ParallelTerminationStrategy: PID 1900 died... 06:04:21.730599 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1900): Terminated: ok {rc=0} 06:04:21.814916 bus /sierra_3: Setting Powered False 06:04:22.913870 bus /sierra_3: Setting Powered False 06:04:24.031652 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2370 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 06:04:25.180550 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:04:25.193356 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 06:04:25.264105 tst mo_mt_call_osmux.py: using LAC 26358 06:04:25.389832 tst mo_mt_call_osmux.py: using RAC 93 06:04:25.518018 tst mo_mt_call_osmux.py: using CellId 26358 06:04:25.645974 tst mo_mt_call_osmux.py: using BVCI 26359 06:04:25.762826 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:04:25.774444 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:04:25.785901 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:04:25.797454 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:04:25.809049 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:04:25.820443 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 06:04:25.940108 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 06:04:26.063376 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:04:26.561763 run create_hlr_db(pid=1903): Launched 06:04:26.692292 bus /sierra_2: Setting Powered False 06:04:27.756080 run create_hlr_db(pid=1903): Terminated: ok {rc=0} 06:04:28.202903 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1905): Launched 06:04:28.525712 run osmo-hlr_10.42.42.2(pid=1906): Launched 06:04:28.647816 run osmo-stp_10.42.42.5: Starting osmo-stp 06:04:29.199546 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1908): Launched 06:04:29.521958 run osmo-stp_10.42.42.5(pid=1909): Launched 06:04:29.644295 run osmo-msc_10.42.42.6: Starting osmo-msc 06:04:30.224514 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1911): Launched 06:04:30.546965 run osmo-msc_10.42.42.6(pid=1912): Launched 06:04:30.727373 run osmo-stp_10.42.42.5(pid=1909): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1909)] 06:04:30.887679 run osmo-stp_10.42.42.5(pid=1909): stdout: | (launched: 2022-12-10_06:04:29.462850) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:04:31.134957 run osmo-stp_10.42.42.5(pid=1909): stderr: | 20221210060429658 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060429658 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060429658 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060429659 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060429659 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060429659 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060429659 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:04:31.275400 run osmo-stp_10.42.42.5(pid=1909): stdout: | (launched: 2022-12-10_06:04:29.462850) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:04:31.408558 run osmo-stp_10.42.42.5(pid=1909): stderr: | 20221210060429658 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060429658 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060429658 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060429659 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060429659 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060429659 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060429659 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:04:31.567680 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1909): Process ended prematurely: osmo-stp_10.42.42.5(pid=1909) [trial-2370↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1909)] [trial-2370↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 06:04:31.578064 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 06:04:31.607042 run osmo-hlr_10.42.42.2(pid=1906): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1906)] 06:04:31.657982 run osmo-hlr_10.42.42.2(pid=1906): stdout: | (launched: 2022-12-10_06:04:28.467252) 06:04:31.710246 run osmo-hlr_10.42.42.2(pid=1906): stderr: | 20221210060428668 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210060428668 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210060428668 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210060428668 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210060428669 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210060428669 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210060428685 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210060428694 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210060428695 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210060428695 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:04:31.783545 run osmo-msc_10.42.42.6(pid=1912): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1912)] 06:04:31.833765 run osmo-msc_10.42.42.6(pid=1912): stdout: | (launched: 2022-12-10_06:04:30.487469) 06:04:31.885950 run osmo-msc_10.42.42.6(pid=1912): stderr: | 20221210060430809 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210060430809 DLGLOBAL DEBUG validating counter group 0x7f8b58405c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210060430809 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210060430809 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210060430809 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210060430810 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210060430811 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210060430812 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210060430812 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210060430812 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:04:31.938625 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1905): Terminating (SIGTERM) 06:04:31.982312 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1908): Terminating (SIGTERM) 06:04:32.026454 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1911): Terminating (SIGTERM) 06:04:32.070095 --- ParallelTerminationStrategy: PID 1905 died... 06:04:32.090287 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1905): Terminated: ok {rc=0} 06:04:32.136840 --- ParallelTerminationStrategy: PID 1908 died... 06:04:32.157667 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1908): Terminated: ok {rc=0} 06:04:32.203932 --- ParallelTerminationStrategy: PID 1911 died... 06:04:32.223740 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1911): Terminated: ok {rc=0} 06:04:32.311218 bus /sierra_3: Setting Powered False 06:04:33.408871 bus /sierra_3: Setting Powered False 06:04:34.521360 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 06:04:35.771787 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:04:35.779923 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 06:04:35.812768 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 06:04:35.840252 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 06:04:35.891117 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 06:04:35.924325 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 06:04:35.951631 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 06:04:36.501947 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 06:04:36.550963 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:04:36.562230 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 06:04:36.631511 tst mo_mt_call.py: using LAC 26359 06:04:36.751414 tst mo_mt_call.py: using RAC 94 06:04:36.876815 tst mo_mt_call.py: using CellId 26359 06:04:37.001833 tst mo_mt_call.py: using BVCI 26360 06:04:37.119338 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:04:37.130998 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:04:37.142360 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:04:37.153889 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:04:37.165376 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:04:37.176642 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 06:04:37.291342 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 06:04:37.407144 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:04:37.872278 run create_hlr_db(pid=1918): Launched 06:04:37.988599 bus /sierra_2: Setting Powered False 06:04:39.047613 run create_hlr_db(pid=1918): Terminated: ok {rc=0} 06:04:39.488498 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1920): Launched 06:04:39.810352 run osmo-hlr_10.42.42.2(pid=1921): Launched 06:04:39.933037 run osmo-stp_10.42.42.5: Starting osmo-stp 06:04:40.490803 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1923): Launched 06:04:40.813526 run osmo-stp_10.42.42.5(pid=1924): Launched 06:04:40.935624 run osmo-msc_10.42.42.6: Starting osmo-msc 06:04:41.517931 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1926): Launched 06:04:41.839748 run osmo-msc_10.42.42.6(pid=1927): Launched 06:04:42.018764 run osmo-stp_10.42.42.5(pid=1924): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1924)] 06:04:42.154529 run osmo-stp_10.42.42.5(pid=1924): stdout: | (launched: 2022-12-10_06:04:40.754941) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:04:42.290351 run osmo-stp_10.42.42.5(pid=1924): stderr: | 20221210060440949 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060440950 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060440950 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060440950 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060440951 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060440951 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060440951 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:04:42.426477 run osmo-stp_10.42.42.5(pid=1924): stdout: | (launched: 2022-12-10_06:04:40.754941) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:04:42.554798 run osmo-stp_10.42.42.5(pid=1924): stderr: | 20221210060440949 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060440950 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060440950 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060440950 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060440951 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060440951 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060440951 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:04:42.707722 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1924): Process ended prematurely: osmo-stp_10.42.42.5(pid=1924) [trial-2370↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1924)] [trial-2370↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 06:04:42.717474 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 06:04:42.745534 run osmo-hlr_10.42.42.2(pid=1921): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1921)] 06:04:42.795306 run osmo-hlr_10.42.42.2(pid=1921): stdout: | (launched: 2022-12-10_06:04:39.751529) 06:04:42.846819 run osmo-hlr_10.42.42.2(pid=1921): stderr: | 20221210060439951 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210060439951 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210060439951 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210060439951 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210060439951 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210060439951 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210060439964 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210060439972 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210060439972 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210060439972 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:04:42.918544 run osmo-msc_10.42.42.6(pid=1927): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1927)] 06:04:42.968260 run osmo-msc_10.42.42.6(pid=1927): stdout: | (launched: 2022-12-10_06:04:41.781243) 06:04:43.019743 run osmo-msc_10.42.42.6(pid=1927): stderr: | 20221210060442104 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210060442104 DLGLOBAL DEBUG validating counter group 0x7f6b9913ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210060442104 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210060442104 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210060442105 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210060442105 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210060442106 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210060442107 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210060442107 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210060442107 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:04:43.071515 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1920): Terminating (SIGTERM) 06:04:43.113396 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1923): Terminating (SIGTERM) 06:04:43.154833 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1926): Terminating (SIGTERM) 06:04:43.196424 --- ParallelTerminationStrategy: PID 1920 died... 06:04:43.216028 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1920): Terminated: ok {rc=0} 06:04:43.262087 --- ParallelTerminationStrategy: PID 1923 died... 06:04:43.281675 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1923): Terminated: ok {rc=0} 06:04:43.327361 --- ParallelTerminationStrategy: PID 1926 died... 06:04:43.346876 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1926): Terminated: ok {rc=0} 06:04:43.434494 bus /sierra_3: Setting Powered False 06:04:44.534896 bus /sierra_3: Setting Powered False 06:04:45.650176 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2370 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 06:04:46.827358 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:04:46.844444 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 06:04:46.933826 tst mo_mt_call_osmux.py: using LAC 26360 06:04:47.059462 tst mo_mt_call_osmux.py: using RAC 95 06:04:47.205486 tst mo_mt_call_osmux.py: using CellId 26360 06:04:47.326183 tst mo_mt_call_osmux.py: using BVCI 26361 06:04:47.437369 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:04:47.448327 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:04:47.459206 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:04:47.470696 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:04:47.482450 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:04:47.494037 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 06:04:47.609067 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 06:04:47.729471 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:04:48.228397 run create_hlr_db(pid=1931): Launched 06:04:48.359810 bus /sierra_2: Setting Powered False 06:04:49.423370 run create_hlr_db(pid=1931): Terminated: ok {rc=0} 06:04:49.853606 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1933): Launched 06:04:50.154569 run osmo-hlr_10.42.42.2(pid=1934): Launched 06:04:50.269710 run osmo-stp_10.42.42.5: Starting osmo-stp 06:04:50.826383 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1936): Launched 06:04:51.148600 run osmo-stp_10.42.42.5(pid=1937): Launched 06:04:51.270792 run osmo-msc_10.42.42.6: Starting osmo-msc 06:04:51.854498 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1939): Launched 06:04:52.175548 run osmo-msc_10.42.42.6(pid=1940): Launched 06:04:52.353930 run osmo-stp_10.42.42.5(pid=1937): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1937)] 06:04:52.489425 run osmo-stp_10.42.42.5(pid=1937): stdout: | (launched: 2022-12-10_06:04:51.089883) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:04:52.625461 run osmo-stp_10.42.42.5(pid=1937): stderr: | 20221210060451283 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060451283 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060451283 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060451283 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060451284 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060451284 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060451284 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:04:52.760306 run osmo-stp_10.42.42.5(pid=1937): stdout: | (launched: 2022-12-10_06:04:51.089883) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:04:52.887757 run osmo-stp_10.42.42.5(pid=1937): stderr: | 20221210060451283 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060451283 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060451283 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060451283 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060451284 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060451284 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060451284 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:04:53.040596 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1937): Process ended prematurely: osmo-stp_10.42.42.5(pid=1937) [trial-2370↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1937)] [trial-2370↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 06:04:53.050527 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 06:04:53.078843 run osmo-hlr_10.42.42.2(pid=1934): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1934)] 06:04:53.128842 run osmo-hlr_10.42.42.2(pid=1934): stdout: | (launched: 2022-12-10_06:04:50.099467) 06:04:53.180733 run osmo-hlr_10.42.42.2(pid=1934): stderr: | 20221210060450275 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210060450275 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210060450275 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210060450275 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210060450276 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210060450276 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210060450288 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210060450297 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210060450297 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210060450297 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:04:53.253089 run osmo-msc_10.42.42.6(pid=1940): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1940)] 06:04:53.303160 run osmo-msc_10.42.42.6(pid=1940): stdout: | (launched: 2022-12-10_06:04:52.116887) 06:04:53.354612 run osmo-msc_10.42.42.6(pid=1940): stderr: | 20221210060452441 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210060452441 DLGLOBAL DEBUG validating counter group 0x7f0c6a1a9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210060452441 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210060452441 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210060452441 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210060452442 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210060452443 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210060452444 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210060452444 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210060452444 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:04:53.406603 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1933): Terminating (SIGTERM) 06:04:53.447978 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1936): Terminating (SIGTERM) 06:04:53.489493 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1939): Terminating (SIGTERM) 06:04:53.531482 --- ParallelTerminationStrategy: PID 1933 died... 06:04:53.551418 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1933): Terminated: ok {rc=0} 06:04:53.597797 --- ParallelTerminationStrategy: PID 1936 died... 06:04:53.617367 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1936): Terminated: ok {rc=0} 06:04:53.663359 --- ParallelTerminationStrategy: PID 1939 died... 06:04:53.683012 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1939): Terminated: ok {rc=0} 06:04:53.771146 bus /sierra_3: Setting Powered False 06:04:54.870535 bus /sierra_3: Setting Powered False 06:04:55.985181 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 06:04:57.234915 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:04:57.241435 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 06:04:57.274016 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 06:04:57.300458 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 06:04:57.352160 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 06:04:57.384622 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 06:04:57.411320 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 06:04:57.960739 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 06:04:58.009250 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:04:58.020236 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 06:04:58.088331 tst mo_mt_call.py: using LAC 26361 06:04:58.206348 tst mo_mt_call.py: using RAC 96 06:04:58.326194 tst mo_mt_call.py: using CellId 26361 06:04:58.444222 tst mo_mt_call.py: using BVCI 26362 06:04:58.554681 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:04:58.565761 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:04:58.576815 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:04:58.587905 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:04:58.598991 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:04:58.610180 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 06:04:58.727123 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 06:04:58.850570 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:04:59.347277 run create_hlr_db(pid=1947): Launched 06:04:59.478877 bus /sierra_2: Setting Powered False 06:05:00.541954 run create_hlr_db(pid=1947): Terminated: ok {rc=0} 06:05:00.990572 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1949): Launched 06:05:01.311803 run osmo-hlr_10.42.42.2(pid=1950): Launched 06:05:01.579125 run osmo-stp_10.42.42.5: Starting osmo-stp 06:05:02.319801 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1955): Launched 06:05:02.635736 run osmo-stp_10.42.42.5(pid=1956): Launched 06:05:02.752504 run osmo-msc_10.42.42.6: Starting osmo-msc 06:05:03.298549 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1958): Launched 06:05:03.601154 run osmo-msc_10.42.42.6(pid=1959): Launched 06:05:03.771040 run osmo-stp_10.42.42.5(pid=1956): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1956)] 06:05:03.898740 run osmo-stp_10.42.42.5(pid=1956): stdout: | (launched: 2022-12-10_06:05:02.580112) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:05:04.026353 run osmo-stp_10.42.42.5(pid=1956): stderr: | 20221210060502750 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060502750 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060502751 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060502751 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060502751 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060502752 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060502752 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:05:04.151667 run osmo-stp_10.42.42.5(pid=1956): stdout: | (launched: 2022-12-10_06:05:02.580112) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:05:04.270704 run osmo-stp_10.42.42.5(pid=1956): stderr: | 20221210060502750 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060502750 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060502751 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060502751 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060502751 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060502752 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060502752 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:05:04.413741 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1956): Process ended prematurely: osmo-stp_10.42.42.5(pid=1956) [trial-2370↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1956)] [trial-2370↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 06:05:04.422694 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 06:05:04.449516 run osmo-hlr_10.42.42.2(pid=1950): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1950)] 06:05:04.496806 run osmo-hlr_10.42.42.2(pid=1950): stdout: | (launched: 2022-12-10_06:05:01.254337) 06:05:04.545854 run osmo-hlr_10.42.42.2(pid=1950): stderr: | 20221210060501544 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210060501544 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210060501544 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210060501544 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210060501544 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210060501544 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210060501567 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210060501588 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210060501588 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210060501588 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:05:04.614088 run osmo-msc_10.42.42.6(pid=1959): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1959)] 06:05:04.661736 run osmo-msc_10.42.42.6(pid=1959): stdout: | (launched: 2022-12-10_06:05:03.544372) 06:05:04.710800 run osmo-msc_10.42.42.6(pid=1959): stderr: | 20221210060503819 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210060503819 DLGLOBAL DEBUG validating counter group 0x7f02626bec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210060503819 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210060503819 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210060503819 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210060503820 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210060503822 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210060503822 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210060503823 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210060503823 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:05:04.760077 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1949): Terminating (SIGTERM) 06:05:04.799357 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1955): Terminating (SIGTERM) 06:05:04.838642 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1958): Terminating (SIGTERM) 06:05:04.878041 --- ParallelTerminationStrategy: PID 1949 died... 06:05:04.896763 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1949): Terminated: ok {rc=0} 06:05:04.940465 --- ParallelTerminationStrategy: PID 1955 died... 06:05:04.958890 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1955): Terminated: ok {rc=0} 06:05:05.002412 --- ParallelTerminationStrategy: PID 1958 died... 06:05:05.020850 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1958): Terminated: ok {rc=0} 06:05:05.104915 bus /sierra_3: Setting Powered False 06:05:06.200253 bus /sierra_3: Setting Powered False 06:05:07.311828 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2370 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 06:05:08.460881 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:05:08.473092 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 06:05:08.544401 tst mo_mt_call_osmux.py: using LAC 26362 06:05:08.672336 tst mo_mt_call_osmux.py: using RAC 97 06:05:08.798696 tst mo_mt_call_osmux.py: using CellId 26362 06:05:08.926762 tst mo_mt_call_osmux.py: using BVCI 26363 06:05:09.044903 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:05:09.056686 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:05:09.068140 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:05:09.079557 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:05:09.091069 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:05:09.102486 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 06:05:09.217735 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 06:05:09.333456 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:05:09.799449 run create_hlr_db(pid=1961): Launched 06:05:09.915527 bus /sierra_2: Setting Powered False 06:05:10.975025 run create_hlr_db(pid=1961): Terminated: ok {rc=0} 06:05:11.414693 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1963): Launched 06:05:11.737650 run osmo-hlr_10.42.42.2(pid=1965): Launched 06:05:11.860806 run osmo-stp_10.42.42.5: Starting osmo-stp 06:05:12.413040 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1967): Launched 06:05:12.734125 run osmo-stp_10.42.42.5(pid=1968): Launched 06:05:12.856515 run osmo-msc_10.42.42.6: Starting osmo-msc 06:05:13.437272 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1970): Launched 06:05:13.757714 run osmo-msc_10.42.42.6(pid=1971): Launched 06:05:13.937453 run osmo-stp_10.42.42.5(pid=1968): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1968)] 06:05:14.071987 run osmo-stp_10.42.42.5(pid=1968): stdout: | (launched: 2022-12-10_06:05:12.675190) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:05:14.207648 run osmo-stp_10.42.42.5(pid=1968): stderr: | 20221210060512867 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060512868 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060512868 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060512868 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060512869 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060512869 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060512869 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:05:14.342746 run osmo-stp_10.42.42.5(pid=1968): stdout: | (launched: 2022-12-10_06:05:12.675190) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:05:14.470678 run osmo-stp_10.42.42.5(pid=1968): stderr: | 20221210060512867 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060512868 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060512868 DLSS7[0;m INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060512868 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060512869 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060512869 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060512869 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:05:14.623375 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1968): Process ended prematurely: osmo-stp_10.42.42.5(pid=1968) [trial-2370↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1968)] [trial-2370↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 06:05:14.633380 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 06:05:14.661413 run osmo-hlr_10.42.42.2(pid=1965): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1965)] 06:05:14.711761 run osmo-hlr_10.42.42.2(pid=1965): stdout: | (launched: 2022-12-10_06:05:11.679226) 06:05:14.763519 run osmo-hlr_10.42.42.2(pid=1965): stderr: | 20221210060511878 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210060511878 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210060511878 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210060511878 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210060511878 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210060511878 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210060511890 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210060511898 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210060511898 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210060511898 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:05:14.835536 run osmo-msc_10.42.42.6(pid=1971): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1971)] 06:05:14.885471 run osmo-msc_10.42.42.6(pid=1971): stdout: | (launched: 2022-12-10_06:05:13.699381) 06:05:14.936910 run osmo-msc_10.42.42.6(pid=1971): stderr: | 20221210060514023 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210060514023 DLGLOBAL DEBUG validating counter group 0x7f5c804a6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210060514023 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210060514023 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210060514023 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210060514024 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210060514025 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210060514026 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210060514026 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210060514026 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:05:14.988582 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1963): Terminating (SIGTERM) 06:05:15.030054 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1967): Terminating (SIGTERM) 06:05:15.071486 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1970): Terminating (SIGTERM) 06:05:15.113301 --- ParallelTerminationStrategy: PID 1963 died... 06:05:15.132893 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1963): Terminated: ok {rc=0} 06:05:15.178940 --- ParallelTerminationStrategy: PID 1967 died... 06:05:15.198688 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1967): Terminated: ok {rc=0} 06:05:15.244300 --- ParallelTerminationStrategy: PID 1970 died... 06:05:15.263756 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1970): Terminated: ok {rc=0} 06:05:15.351213 bus /sierra_3: Setting Powered False 06:05:16.455828 bus /sierra_3: Setting Powered False 06:05:17.588556 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 06:05:18.843560 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:05:18.850689 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 06:05:18.884177 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 06:05:18.911682 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 06:05:18.968770 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 06:05:19.001913 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 06:05:19.029074 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 06:05:19.577574 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 06:05:19.628845 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:05:19.640439 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 06:05:19.709208 tst mo_mt_call.py: using LAC 26363 06:05:19.833220 tst mo_mt_call.py: using RAC 98 06:05:19.958026 tst mo_mt_call.py: using CellId 26363 06:05:20.082368 tst mo_mt_call.py: using BVCI 26364 06:05:20.199117 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:05:20.210668 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:05:20.222001 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:05:20.233308 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:05:20.244698 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:05:20.256111 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 06:05:20.372143 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 06:05:20.487096 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:05:20.951805 run create_hlr_db(pid=1976): Launched 06:05:21.085414 bus /sierra_2: Setting Powered False 06:05:22.149193 run create_hlr_db(pid=1976): Terminated: ok {rc=0} 06:05:22.596128 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1978): Launched 06:05:22.917621 run osmo-hlr_10.42.42.2(pid=1979): Launched 06:05:23.040863 run osmo-stp_10.42.42.5: Starting osmo-stp 06:05:23.592633 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1981): Launched 06:05:23.913446 run osmo-stp_10.42.42.5(pid=1982): Launched 06:05:24.035740 run osmo-msc_10.42.42.6: Starting osmo-msc 06:05:24.616445 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1984): Launched 06:05:24.938190 run osmo-msc_10.42.42.6(pid=1985): Launched 06:05:25.118008 run osmo-stp_10.42.42.5(pid=1982): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1982)] 06:05:25.252869 run osmo-stp_10.42.42.5(pid=1982): stdout: | (launched: 2022-12-10_06:05:23.854780) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:05:25.388578 run osmo-stp_10.42.42.5(pid=1982): stderr: | 20221210060524047 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060524048 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060524048 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060524048 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060524049 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060524049 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060524049 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:05:25.526263 run osmo-stp_10.42.42.5(pid=1982): stdout: | (launched: 2022-12-10_06:05:23.854780) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:05:25.653640 run osmo-stp_10.42.42.5(pid=1982): stderr: | 20221210060524047 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060524048 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060524048 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060524048 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060524049 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060524049 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060524049 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:05:25.805943 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1982): Process ended prematurely: osmo-stp_10.42.42.5(pid=1982) [trial-2370↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1982)] [trial-2370↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 06:05:25.815526 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 06:05:25.843334 run osmo-hlr_10.42.42.2(pid=1979): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1979)] 06:05:25.892808 run osmo-hlr_10.42.42.2(pid=1979): stdout: | (launched: 2022-12-10_06:05:22.859200) 06:05:25.944148 run osmo-hlr_10.42.42.2(pid=1979): stderr: | 20221210060523057 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210060523057 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210060523057 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210060523057 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210060523057 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210060523057 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210060523103 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210060523113 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210060523113 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210060523113 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:05:26.015597 run osmo-msc_10.42.42.6(pid=1985): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1985)] 06:05:26.065333 run osmo-msc_10.42.42.6(pid=1985): stdout: | (launched: 2022-12-10_06:05:24.879551) 06:05:26.116799 run osmo-msc_10.42.42.6(pid=1985): stderr: | 20221210060525203 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210060525203 DLGLOBAL DEBUG validating counter group 0x7f0148a24c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210060525203 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210060525203 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210060525203 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210060525204 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210060525206 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210060525206 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210060525206 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210060525206 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:05:26.168456 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1978): Terminating (SIGTERM) 06:05:26.209480 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1981): Terminating (SIGTERM) 06:05:26.250734 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1984): Terminating (SIGTERM) 06:05:26.292216 --- ParallelTerminationStrategy: PID 1978 died... 06:05:26.312103 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1978): Terminated: ok {rc=0} 06:05:26.357837 --- ParallelTerminationStrategy: PID 1981 died... 06:05:26.377326 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1981): Terminated: ok {rc=0} 06:05:26.423075 --- ParallelTerminationStrategy: PID 1984 died... 06:05:26.442369 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1984): Terminated: ok {rc=0} 06:05:26.529281 bus /sierra_3: Setting Powered False 06:05:27.628191 bus /sierra_3: Setting Powered False 06:05:28.743284 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2370 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 06:05:29.891660 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:05:29.903944 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 06:05:29.975510 tst mo_mt_call_osmux.py: using LAC 26364 06:05:30.102587 tst mo_mt_call_osmux.py: using RAC 99 06:05:30.225392 tst mo_mt_call_osmux.py: using CellId 26364 06:05:30.344610 tst mo_mt_call_osmux.py: using BVCI 26365 06:05:30.454278 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:05:30.465636 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:05:30.476651 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:05:30.488000 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:05:30.499168 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:05:30.510437 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 06:05:30.626336 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 06:05:30.740376 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:05:31.231836 run create_hlr_db(pid=1987): Launched 06:05:31.383626 bus /sierra_2: Setting Powered False 06:05:32.443287 run create_hlr_db(pid=1987): Terminated: ok {rc=0} 06:05:32.883670 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1989): Launched 06:05:33.207861 run osmo-hlr_10.42.42.2(pid=1990): Launched 06:05:33.331181 run osmo-stp_10.42.42.5: Starting osmo-stp 06:05:33.884794 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1992): Launched 06:05:34.206747 run osmo-stp_10.42.42.5(pid=1993): Launched 06:05:34.329665 run osmo-msc_10.42.42.6: Starting osmo-msc 06:05:34.913520 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1995): Launched 06:05:35.237027 run osmo-msc_10.42.42.6(pid=1996): Launched 06:05:35.417279 run osmo-stp_10.42.42.5(pid=1993): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1993)] 06:05:35.553607 run osmo-stp_10.42.42.5(pid=1993): stdout: | (launched: 2022-12-10_06:05:34.147766) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:05:35.691191 run osmo-stp_10.42.42.5(pid=1993): stderr: | 20221210060534338 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060534339 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060534339 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060534339 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060534340 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060534340 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060534340 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:05:35.826723 run osmo-stp_10.42.42.5(pid=1993): stdout: | (launched: 2022-12-10_06:05:34.147766) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:05:35.954924 run osmo-stp_10.42.42.5(pid=1993): stderr: | 20221210060534338 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060534339 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060534339 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060534339 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060534340 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060534340 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060534340 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:05:36.108257 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1993): Process ended prematurely: osmo-stp_10.42.42.5(pid=1993) [trial-2370↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1993)] [trial-2370↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 06:05:36.117811 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 06:05:36.145628 run osmo-hlr_10.42.42.2(pid=1990): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1990)] 06:05:36.195372 run osmo-hlr_10.42.42.2(pid=1990): stdout: | (launched: 2022-12-10_06:05:33.149317) 06:05:36.246980 run osmo-hlr_10.42.42.2(pid=1990): stderr: | 20221210060533347 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210060533347 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210060533347 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210060533347 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210060533347 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210060533347 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210060533361 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210060533369 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210060533370 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210060533370 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:05:36.319078 run osmo-msc_10.42.42.6(pid=1996): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1996)] 06:05:36.369095 run osmo-msc_10.42.42.6(pid=1996): stdout: | (launched: 2022-12-10_06:05:35.177738) 06:05:36.421103 run osmo-msc_10.42.42.6(pid=1996): stderr: | 20221210060535500 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210060535500 DLGLOBAL DEBUG validating counter group 0x7fb4c789bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210060535500 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210060535500 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210060535500 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210060535501 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210060535504 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210060535505 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210060535505 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210060535505 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:05:36.472886 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1989): Terminating (SIGTERM) 06:05:36.514487 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1992): Terminating (SIGTERM) 06:05:36.556149 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1995): Terminating (SIGTERM) 06:05:36.598099 --- ParallelTerminationStrategy: PID 1989 died... 06:05:36.618140 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1989): Terminated: ok {rc=0} 06:05:36.664273 --- ParallelTerminationStrategy: PID 1992 died... 06:05:36.683872 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1992): Terminated: ok {rc=0} 06:05:36.729807 --- ParallelTerminationStrategy: PID 1995 died... 06:05:36.749340 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1995): Terminated: ok {rc=0} 06:05:36.837903 bus /sierra_3: Setting Powered False 06:05:37.936217 bus /sierra_3: Setting Powered False 06:05:39.051529 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 06:05:40.306557 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:05:40.313661 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 06:05:40.346910 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 06:05:40.374201 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 06:05:40.427616 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 06:05:40.460593 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 06:05:40.487561 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 06:05:41.039954 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 06:05:41.091307 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:05:41.102961 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 06:05:41.173404 tst mo_mt_call.py: using LAC 26365 06:05:41.299695 tst mo_mt_call.py: using RAC 100 06:05:41.425881 tst mo_mt_call.py: using CellId 26365 06:05:41.554386 tst mo_mt_call.py: using BVCI 26366 06:05:41.671354 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:05:41.682980 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:05:41.694529 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:05:41.705998 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:05:41.717561 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:05:41.729009 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:05:41.843523 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:05:41.958248 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:05:42.424719 run create_hlr_db(pid=2002): Launched 06:05:42.541230 bus /sierra_2: Setting Powered False 06:05:43.601376 run create_hlr_db(pid=2002): Terminated: ok {rc=0} 06:05:44.020534 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2004): Launched 06:05:44.321587 run osmo-hlr_10.42.42.2(pid=2005): Launched 06:05:44.436516 run osmo-stp_10.42.42.5: Starting osmo-stp 06:05:44.954955 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2007): Launched 06:05:45.256034 run osmo-stp_10.42.42.5(pid=2008): Launched 06:05:45.371593 run osmo-msc_10.42.42.6: Starting osmo-msc 06:05:45.937959 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2010): Launched 06:05:46.308909 run osmo-msc_10.42.42.6(pid=2011): Launched 06:05:46.607381 run osmo-stp_10.42.42.5(pid=2008): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2008)] 06:05:46.999182 run osmo-stp_10.42.42.5(pid=2008): stdout: | (launched: 2022-12-10_06:05:45.200812) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:05:47.274916 run osmo-stp_10.42.42.5(pid=2008): stderr: | 20221210060545372 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060545372 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060545372 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060545372 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060545375 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060545375 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060545375 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:05:47.422149 run osmo-stp_10.42.42.5(pid=2008): stdout: | (launched: 2022-12-10_06:05:45.200812) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:05:47.551692 run osmo-stp_10.42.42.5(pid=2008): stderr: | 20221210060545372 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060545372 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060545372 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060545372 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060545375 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060545375 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060545375 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:05:47.695488 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2008): Process ended prematurely: osmo-stp_10.42.42.5(pid=2008) [trial-2370↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2008)] [trial-2370↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 06:05:47.704610 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 06:05:47.731834 run osmo-hlr_10.42.42.2(pid=2005): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2005)] 06:05:47.779497 run osmo-hlr_10.42.42.2(pid=2005): stdout: | (launched: 2022-12-10_06:05:44.266575) 06:05:47.828928 run osmo-hlr_10.42.42.2(pid=2005): stderr: | 20221210060544444 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210060544444 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210060544444 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210060544444 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210060544445 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210060544445 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210060544457 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210060544465 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210060544465 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210060544465 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:05:47.897726 run osmo-msc_10.42.42.6(pid=2011): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2011)] 06:05:47.945151 run osmo-msc_10.42.42.6(pid=2011): stdout: | (launched: 2022-12-10_06:05:46.252411) 06:05:47.994058 run osmo-msc_10.42.42.6(pid=2011): stderr: | 20221210060546853 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210060546853 DLGLOBAL DEBUG validating counter group 0x7f3e6bdd2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210060546853 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210060546853 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210060546854 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210060546854 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210060546856 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210060546856 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210060546856 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210060546856 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:05:48.043686 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2004): Terminating (SIGTERM) 06:05:48.083074 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2007): Terminating (SIGTERM) 06:05:48.122690 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2010): Terminating (SIGTERM) 06:05:48.162588 --- ParallelTerminationStrategy: PID 2004 died... 06:05:48.181747 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2004): Terminated: ok {rc=0} 06:05:48.226297 --- ParallelTerminationStrategy: PID 2007 died... 06:05:48.245094 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2007): Terminated: ok {rc=0} 06:05:48.289340 --- ParallelTerminationStrategy: PID 2010 died... 06:05:48.308003 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2010): Terminated: ok {rc=0} 06:05:48.393402 bus /sierra_3: Setting Powered False 06:05:49.492664 bus /sierra_3: Setting Powered False 06:05:50.607420 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2370 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 06:05:51.754278 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:05:51.766367 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 06:05:51.836839 tst mo_mt_call_osmux.py: using LAC 26366 06:05:51.957312 tst mo_mt_call_osmux.py: using RAC 101 06:05:52.084883 tst mo_mt_call_osmux.py: using CellId 26366 06:05:52.212099 tst mo_mt_call_osmux.py: using BVCI 26367 06:05:52.330236 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:05:52.341976 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:05:52.353783 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:05:52.365336 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:05:52.376804 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:05:52.388348 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:05:52.504580 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:05:52.625648 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:05:53.096285 run create_hlr_db(pid=2013): Launched 06:05:53.212475 bus /sierra_2: Setting Powered False 06:05:54.272763 run create_hlr_db(pid=2013): Terminated: ok {rc=0} 06:05:54.712830 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2015): Launched 06:05:55.034574 run osmo-hlr_10.42.42.2(pid=2016): Launched 06:05:55.159618 run osmo-stp_10.42.42.5: Starting osmo-stp 06:05:55.719555 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2018): Launched 06:05:56.042029 run osmo-stp_10.42.42.5(pid=2019): Launched 06:05:56.165934 run osmo-msc_10.42.42.6: Starting osmo-msc 06:05:56.749732 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2021): Launched 06:05:57.074330 run osmo-msc_10.42.42.6(pid=2022): Launched 06:05:57.256597 run osmo-stp_10.42.42.5(pid=2019): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2019)] 06:05:57.392657 run osmo-stp_10.42.42.5(pid=2019): stdout: | (launched: 2022-12-10_06:05:55.983181) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:05:57.531098 run osmo-stp_10.42.42.5(pid=2019): stderr: | 20221210060556177 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060556177 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060556177 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060556178 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060556178 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060556178 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060556178 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:05:57.666457 run osmo-stp_10.42.42.5(pid=2019): stdout: | (launched: 2022-12-10_06:05:55.983181) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:05:57.794709 run osmo-stp_10.42.42.5(pid=2019): stderr: | 20221210060556177 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060556177 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060556177 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060556178 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060556178 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060556178 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060556178 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:05:57.947963 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2019): Process ended prematurely: osmo-stp_10.42.42.5(pid=2019) [trial-2370↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2019)] [trial-2370↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 06:05:57.957755 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 06:05:57.985565 run osmo-hlr_10.42.42.2(pid=2016): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2016)] 06:05:58.035159 run osmo-hlr_10.42.42.2(pid=2016): stdout: | (launched: 2022-12-10_06:05:54.975975) 06:05:58.086442 run osmo-hlr_10.42.42.2(pid=2016): stderr: | 20221210060555173 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210060555173 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210060555173 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210060555173 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210060555173 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210060555173 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210060555185 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210060555194 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210060555194 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210060555194 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:05:58.157992 run osmo-msc_10.42.42.6(pid=2022): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2022)] 06:05:58.207523 run osmo-msc_10.42.42.6(pid=2022): stdout: | (launched: 2022-12-10_06:05:57.014921) 06:05:58.258593 run osmo-msc_10.42.42.6(pid=2022): stderr: | 20221210060557336 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210060557337 DLGLOBAL DEBUG validating counter group 0x7fec7396cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210060557337 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210060557337 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210060557337 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210060557337 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210060557339 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210060557339 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210060557339 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210060557339 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:05:58.310056 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2015): Terminating (SIGTERM) 06:05:58.351561 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2018): Terminating (SIGTERM) 06:05:58.393125 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2021): Terminating (SIGTERM) 06:05:58.435229 --- ParallelTerminationStrategy: PID 2015 died... 06:05:58.455078 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2015): Terminated: ok {rc=0} 06:05:58.501112 --- ParallelTerminationStrategy: PID 2018 died... 06:05:58.520572 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2018): Terminated: ok {rc=0} 06:05:58.566236 --- ParallelTerminationStrategy: PID 2021 died... 06:05:58.585649 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2021): Terminated: ok {rc=0} 06:05:58.672747 bus /sierra_3: Setting Powered False 06:05:59.771359 bus /sierra_3: Setting Powered False 06:06:00.909779 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 voice:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 06:06:02.169954 tst voice:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:06:02.176080 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 06:06:02.210412 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 06:06:02.238343 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 06:06:02.290542 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 06:06:02.345790 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 06:06:02.374398 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 06:06:02.898529 tst voice:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 06:06:02.947871 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:06:02.958991 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 06:06:03.026211 tst mo_mt_call.py: using LAC 26367 06:06:03.143750 tst mo_mt_call.py: using RAC 102 06:06:03.261962 tst mo_mt_call.py: using CellId 26367 06:06:03.380861 tst mo_mt_call.py: using BVCI 26368 06:06:03.490194 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:06:03.501316 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:06:03.512139 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:06:03.523514 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:06:03.534921 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:06:03.546303 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 06:06:03.661475 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 06:06:03.776179 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:06:04.240078 run create_hlr_db(pid=2027): Launched 06:06:04.355136 bus /sierra_2: Setting Powered False 06:06:05.413944 run create_hlr_db(pid=2027): Terminated: ok {rc=0} 06:06:05.853610 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2029): Launched 06:06:06.176425 run osmo-hlr_10.42.42.2(pid=2030): Launched 06:06:06.300712 run osmo-stp_10.42.42.5: Starting osmo-stp 06:06:06.858788 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2032): Launched 06:06:07.181999 run osmo-stp_10.42.42.5(pid=2033): Launched 06:06:07.304140 run osmo-msc_10.42.42.6: Starting osmo-msc 06:06:07.886294 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2035): Launched 06:06:08.209498 run osmo-msc_10.42.42.6(pid=2036): Launched 06:06:08.388929 run osmo-stp_10.42.42.5(pid=2033): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2033)] 06:06:08.524861 run osmo-stp_10.42.42.5(pid=2033): stdout: | (launched: 2022-12-10_06:06:07.123231) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:06:08.660319 run osmo-stp_10.42.42.5(pid=2033): stderr: | 20221210060607315 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060607315 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060607315 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060607315 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060607316 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060607316 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060607316 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:06:08.795372 run osmo-stp_10.42.42.5(pid=2033): stdout: | (launched: 2022-12-10_06:06:07.123231) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:06:08.922962 run osmo-stp_10.42.42.5(pid=2033): stderr: | 20221210060607315 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060607315 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060607315 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060607315 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060607316 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060607316 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060607316 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:06:09.076261 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2033): Process ended prematurely: osmo-stp_10.42.42.5(pid=2033) [trial-2370↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2033)] [trial-2370↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 06:06:09.085717 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 06:06:09.113735 run osmo-hlr_10.42.42.2(pid=2030): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2030)] 06:06:09.163956 run osmo-hlr_10.42.42.2(pid=2030): stdout: | (launched: 2022-12-10_06:06:06.117944) 06:06:09.215195 run osmo-hlr_10.42.42.2(pid=2030): stderr: | 20221210060606316 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210060606316 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210060606316 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210060606316 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210060606316 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210060606316 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210060606328 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210060606336 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210060606337 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210060606337 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:06:09.286579 run osmo-msc_10.42.42.6(pid=2036): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2036)] 06:06:09.336163 run osmo-msc_10.42.42.6(pid=2036): stdout: | (launched: 2022-12-10_06:06:08.150695) 06:06:09.387401 run osmo-msc_10.42.42.6(pid=2036): stderr: | 20221210060608473 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210060608473 DLGLOBAL DEBUG validating counter group 0x7f7ec168cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210060608473 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210060608473 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210060608473 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210060608473 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210060608475 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210060608475 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210060608476 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210060608476 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:06:09.439273 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2029): Terminating (SIGTERM) 06:06:09.480369 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2032): Terminating (SIGTERM) 06:06:09.521530 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2035): Terminating (SIGTERM) 06:06:09.562820 --- ParallelTerminationStrategy: PID 2029 died... 06:06:09.582337 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2029): Terminated: ok {rc=0} 06:06:09.627973 --- ParallelTerminationStrategy: PID 2032 died... 06:06:09.647247 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2032): Terminated: ok {rc=0} 06:06:09.692580 --- ParallelTerminationStrategy: PID 2035 died... 06:06:09.711895 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2035): Terminated: ok {rc=0} 06:06:09.799183 bus /sierra_3: Setting Powered False 06:06:10.897957 bus /sierra_3: Setting Powered False 06:06:12.015321 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2370 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 06:06:13.161942 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:06:13.173696 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 06:06:13.244052 tst mo_mt_call_osmux.py: using LAC 26368 06:06:13.362491 tst mo_mt_call_osmux.py: using RAC 103 06:06:13.485654 tst mo_mt_call_osmux.py: using CellId 26368 06:06:13.604756 tst mo_mt_call_osmux.py: using BVCI 26369 06:06:13.714255 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:06:13.725247 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:06:13.736015 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:06:13.746954 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:06:13.758080 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:06:13.769101 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 06:06:13.883631 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 06:06:14.003792 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:06:14.503759 run create_hlr_db(pid=2038): Launched 06:06:14.635786 bus /sierra_2: Setting Powered False 06:06:15.698836 run create_hlr_db(pid=2038): Terminated: ok {rc=0} 06:06:16.162565 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2040): Launched 06:06:16.496151 run osmo-hlr_10.42.42.2(pid=2041): Launched 06:06:16.743872 run osmo-stp_10.42.42.5: Starting osmo-stp 06:06:17.405665 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2043): Launched 06:06:17.730091 run osmo-stp_10.42.42.5(pid=2044): Launched 06:06:17.853609 run osmo-msc_10.42.42.6: Starting osmo-msc 06:06:18.443509 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2046): Launched 06:06:18.766226 run osmo-msc_10.42.42.6(pid=2047): Launched 06:06:18.947702 run osmo-stp_10.42.42.5(pid=2044): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2044)] 06:06:19.083756 run osmo-stp_10.42.42.5(pid=2044): stdout: | (launched: 2022-12-10_06:06:17.671393) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:06:19.220155 run osmo-stp_10.42.42.5(pid=2044): stderr: | 20221210060617862 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060617862 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060617863 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060617863 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060617863 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060617863 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060617863 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:06:19.355631 run osmo-stp_10.42.42.5(pid=2044): stdout: | (launched: 2022-12-10_06:06:17.671393) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:06:19.483847 run osmo-stp_10.42.42.5(pid=2044): stderr: | 20221210060617862 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060617862 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060617863 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060617863 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060617863 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060617863 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060617863 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:06:19.637290 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2044): Process ended prematurely: osmo-stp_10.42.42.5(pid=2044) [trial-2370↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2044)] [trial-2370↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 06:06:19.646915 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 06:06:19.674837 run osmo-hlr_10.42.42.2(pid=2041): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2041)] 06:06:19.724549 run osmo-hlr_10.42.42.2(pid=2041): stdout: | (launched: 2022-12-10_06:06:16.437454) 06:06:19.776015 run osmo-hlr_10.42.42.2(pid=2041): stderr: | 20221210060616749 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210060616749 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210060616749 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210060616749 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210060616749 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210060616749 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210060616769 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210060616777 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210060616777 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210060616777 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:06:19.847933 run osmo-msc_10.42.42.6(pid=2047): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2047)] 06:06:19.897432 run osmo-msc_10.42.42.6(pid=2047): stdout: | (launched: 2022-12-10_06:06:18.707605) 06:06:19.948623 run osmo-msc_10.42.42.6(pid=2047): stderr: | 20221210060619028 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210060619028 DLGLOBAL DEBUG validating counter group 0x7f87e6d35c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210060619028 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210060619028 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210060619029 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210060619029 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210060619031 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210060619031 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210060619031 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210060619031 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:06:20.000084 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2040): Terminating (SIGTERM) 06:06:20.041386 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2043): Terminating (SIGTERM) 06:06:20.082826 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2046): Terminating (SIGTERM) 06:06:20.124376 --- ParallelTerminationStrategy: PID 2040 died... 06:06:20.144334 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2040): Terminated: ok {rc=0} 06:06:20.190322 --- ParallelTerminationStrategy: PID 2043 died... 06:06:20.210066 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2043): Terminated: ok {rc=0} 06:06:20.255959 --- ParallelTerminationStrategy: PID 2046 died... 06:06:20.275609 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2046): Terminated: ok {rc=0} 06:06:20.364359 bus /sierra_3: Setting Powered False 06:06:21.463803 bus /sierra_3: Setting Powered False 06:06:22.580825 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 voice:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 06:06:23.825996 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:06:23.832189 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 06:06:23.865949 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 06:06:23.892139 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 06:06:23.945562 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 06:06:23.978959 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 06:06:24.005681 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 06:06:24.553023 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 06:06:24.607698 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 06:06:24.619860 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 06:06:24.673420 tst mo_mt_call.py: using LAC 26369 06:06:24.806162 tst mo_mt_call.py: using RAC 104 06:06:24.948586 tst mo_mt_call.py: using CellId 26369 06:06:25.076316 tst mo_mt_call.py: using BVCI 26370 06:06:25.193172 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 06:06:25.204881 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 06:06:25.216609 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 06:06:25.228273 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 06:06:25.239940 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 06:06:25.252097 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 06:06:25.368671 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 06:06:25.488869 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:06:25.986629 run create_hlr_db(pid=2052): Launched 06:06:26.119057 bus /sierra_2: Setting Powered False 06:06:27.182913 run create_hlr_db(pid=2052): Terminated: ok {rc=0} 06:06:27.629910 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2054): Launched 06:06:27.953512 run osmo-hlr_10.42.42.2(pid=2055): Launched 06:06:28.075610 run osmo-stp_10.42.42.5: Starting osmo-stp 06:06:28.629660 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2057): Launched 06:06:28.953895 run osmo-stp_10.42.42.5(pid=2058): Launched 06:06:29.077006 run osmo-msc_10.42.42.6: Starting osmo-msc 06:06:29.662333 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2060): Launched 06:06:29.986464 run osmo-msc_10.42.42.6(pid=2061): Launched 06:06:30.167977 run osmo-stp_10.42.42.5(pid=2058): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2058)] 06:06:30.303892 run osmo-stp_10.42.42.5(pid=2058): stdout: | (launched: 2022-12-10_06:06:28.895127) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:06:30.441532 run osmo-stp_10.42.42.5(pid=2058): stderr: | 20221210060629088 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060629088 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060629088 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060629089 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060629089 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060629089 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060629089 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:06:30.577022 run osmo-stp_10.42.42.5(pid=2058): stdout: | (launched: 2022-12-10_06:06:28.895127) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:06:30.704795 run osmo-stp_10.42.42.5(pid=2058): stderr: | 20221210060629088 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060629088 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060629088 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060629089 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060629089 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060629089 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060629089 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:06:30.869818 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2058): Process ended prematurely: osmo-stp_10.42.42.5(pid=2058) [trial-2370↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2058)] [trial-2370↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 06:06:30.880033 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 06:06:30.920919 run osmo-hlr_10.42.42.2(pid=2055): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2055)] 06:06:30.971442 run osmo-hlr_10.42.42.2(pid=2055): stdout: | (launched: 2022-12-10_06:06:27.894518) 06:06:31.033185 run osmo-hlr_10.42.42.2(pid=2055): stderr: | 20221210060628095 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210060628095 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210060628095 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210060628095 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210060628095 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210060628095 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210060628108 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210060628118 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210060628118 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210060628118 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:06:31.107912 run osmo-msc_10.42.42.6(pid=2061): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2061)] 06:06:31.159234 run osmo-msc_10.42.42.6(pid=2061): stdout: | (launched: 2022-12-10_06:06:29.927600) 06:06:31.212019 run osmo-msc_10.42.42.6(pid=2061): stderr: | 20221210060630250 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210060630251 DLGLOBAL DEBUG validating counter group 0x7f1806780c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210060630251 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210060630251 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210060630251 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210060630251 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210060630253 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210060630253 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210060630253 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210060630253 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:06:31.265965 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2054): Terminating (SIGTERM) 06:06:31.309795 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2057): Terminating (SIGTERM) 06:06:31.354994 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2060): Terminating (SIGTERM) 06:06:31.399076 --- ParallelTerminationStrategy: PID 2054 died... 06:06:31.420226 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2054): Terminated: ok {rc=0} 06:06:31.469933 --- ParallelTerminationStrategy: PID 2057 died... 06:06:31.490649 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2057): Terminated: ok {rc=0} 06:06:31.538607 --- ParallelTerminationStrategy: PID 2060 died... 06:06:31.559333 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2060): Terminated: ok {rc=0} 06:06:31.660777 bus /sierra_3: Setting Powered False 06:06:32.759962 bus /sierra_3: Setting Powered False 06:06:33.873435 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2370 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 06:06:35.022766 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 06:06:35.035339 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 06:06:35.089658 tst mo_mt_call_osmux.py: using LAC 26370 06:06:35.216815 tst mo_mt_call_osmux.py: using RAC 105 06:06:35.341974 tst mo_mt_call_osmux.py: using CellId 26370 06:06:35.468636 tst mo_mt_call_osmux.py: using BVCI 26371 06:06:35.585444 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 06:06:35.597385 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 06:06:35.608855 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 06:06:35.620516 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 06:06:35.632231 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 06:06:35.643921 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 06:06:35.758962 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 06:06:35.874855 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:06:36.340424 run create_hlr_db(pid=2063): Launched 06:06:36.459117 bus /sierra_2: Setting Powered False 06:06:37.519934 run create_hlr_db(pid=2063): Terminated: ok {rc=0} 06:06:37.961741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2065): Launched 06:06:38.285694 run osmo-hlr_10.42.42.2(pid=2066): Launched 06:06:38.410765 run osmo-stp_10.42.42.5: Starting osmo-stp 06:06:38.966257 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2068): Launched 06:06:39.290284 run osmo-stp_10.42.42.5(pid=2069): Launched 06:06:39.415968 run osmo-msc_10.42.42.6: Starting osmo-msc 06:06:40.001375 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2071): Launched 06:06:40.324740 run osmo-msc_10.42.42.6(pid=2072): Launched 06:06:40.506063 run osmo-stp_10.42.42.5(pid=2069): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2069)] 06:06:40.642974 run osmo-stp_10.42.42.5(pid=2069): stdout: | (launched: 2022-12-10_06:06:39.231726) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:06:40.780227 run osmo-stp_10.42.42.5(pid=2069): stderr: | 20221210060639423 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060639424 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060639424 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060639424 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060639425 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060639425 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060639425 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:06:40.916154 run osmo-stp_10.42.42.5(pid=2069): stdout: | (launched: 2022-12-10_06:06:39.231726) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:06:41.044562 run osmo-stp_10.42.42.5(pid=2069): stderr: | 20221210060639423 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060639424 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060639424 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060639424 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060639425 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060639425 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060639425 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:06:41.198894 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2069): Process ended prematurely: osmo-stp_10.42.42.5(pid=2069) [trial-2370↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2069)] [trial-2370↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 06:06:41.208826 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 06:06:41.236680 run osmo-hlr_10.42.42.2(pid=2066): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2066)] 06:06:41.286224 run osmo-hlr_10.42.42.2(pid=2066): stdout: | (launched: 2022-12-10_06:06:38.227017) 06:06:41.337677 run osmo-hlr_10.42.42.2(pid=2066): stderr: | 20221210060638427 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210060638427 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210060638427 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210060638427 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210060638427 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210060638428 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210060638440 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210060638448 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210060638449 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210060638449 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:06:41.409933 run osmo-msc_10.42.42.6(pid=2072): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2072)] 06:06:41.459817 run osmo-msc_10.42.42.6(pid=2072): stdout: | (launched: 2022-12-10_06:06:40.265595) 06:06:41.511141 run osmo-msc_10.42.42.6(pid=2072): stderr: | 20221210060640591 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210060640591 DLGLOBAL DEBUG validating counter group 0x7f603418cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210060640591 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210060640591 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210060640591 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210060640592 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210060640593 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210060640594 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210060640594 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210060640594 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:06:41.562855 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2065): Terminating (SIGTERM) 06:06:41.604311 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2068): Terminating (SIGTERM) 06:06:41.645776 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2071): Terminating (SIGTERM) 06:06:41.687327 --- ParallelTerminationStrategy: PID 2065 died... 06:06:41.707056 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2065): Terminated: ok {rc=0} 06:06:41.752603 --- ParallelTerminationStrategy: PID 2068 died... 06:06:41.772000 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2068): Terminated: ok {rc=0} 06:06:41.817368 --- ParallelTerminationStrategy: PID 2071 died... 06:06:41.836612 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2071): Terminated: ok {rc=0} 06:06:41.923406 bus /sierra_3: Setting Powered False 06:06:43.024678 bus /sierra_3: Setting Powered False 06:06:44.140387 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 emergency:trx-umtrx --------------------------------------------------------------------- 06:06:45.390138 tst emergency:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:06:45.395385 tst emergency:trx-umtrx: Verifying 1 x bts (candidates: 11) 06:06:45.429134 tst emergency:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 06:06:45.457255 tst emergency:trx-umtrx: Verifying 4 x modem (candidates: 12) 06:06:45.550012 tst emergency:trx-umtrx: Reserving 1 x bts (candidates: 11) 06:06:45.583277 tst emergency:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 06:06:45.610427 tst emergency:trx-umtrx: Reserving 4 x modem (candidates: 12) 06:06:46.186506 tst emergency:trx-umtrx: RESERVED RESOURCES for emergency: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2370 emergency:trx-umtrx emergency_mo_mt_call.py ---------------------------------------------- 06:06:46.195483 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 06:06:46.210472 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 06:06:46.273387 tst emergency_mo_mt_call.py: using LAC 26371 06:06:46.419110 tst emergency_mo_mt_call.py: using RAC 106 06:06:46.546813 tst emergency_mo_mt_call.py: using CellId 26371 06:06:46.689038 tst emergency_mo_mt_call.py: using BVCI 26372 06:06:46.808777 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 06:06:46.820184 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 06:06:46.831682 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 06:06:46.843134 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 06:06:46.854691 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 06:06:46.866191 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 06:06:47.004043 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 06:06:47.143571 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:06:47.660054 run create_hlr_db(pid=2077): Launched 06:06:47.789367 bus /sierra_2: Setting Powered False 06:06:48.852631 run create_hlr_db(pid=2077): Terminated: ok {rc=0} 06:06:49.295012 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2079): Launched 06:06:49.614786 run osmo-hlr_10.42.42.2(pid=2080): Launched 06:06:49.734652 run osmo-stp_10.42.42.5: Starting osmo-stp 06:06:50.282385 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2082): Launched 06:06:50.600535 run osmo-stp_10.42.42.5(pid=2083): Launched 06:06:50.730494 tst emergency_mo_mt_call.py: using MSISDN 7580 06:06:50.892809 run osmo-msc_10.42.42.6: Starting osmo-msc 06:06:51.464068 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2085): Launched 06:06:51.782485 run osmo-msc_10.42.42.6(pid=2086): Launched 06:06:51.959470 run osmo-stp_10.42.42.5(pid=2083): ERR: Terminated: ERROR {rc=1} [trial-2370↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2083)] 06:06:52.092916 run osmo-stp_10.42.42.5(pid=2083): stdout: | (launched: 2022-12-10_06:06:50.542549) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:06:52.226971 run osmo-stp_10.42.42.5(pid=2083): stderr: | 20221210060650736 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060650736 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060650737 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060650737 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060650738 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060650738 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060650738 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:06:52.360359 run osmo-stp_10.42.42.5(pid=2083): stdout: | (launched: 2022-12-10_06:06:50.542549) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:06:52.486864 run osmo-stp_10.42.42.5(pid=2083): stderr: | 20221210060650736 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060650736 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060650737 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060650737 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060650738 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060650738 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060650738 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:06:52.637935 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=2083): Process ended prematurely: osmo-stp_10.42.42.5(pid=2083) [trial-2370↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2083)] [trial-2370↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19] 06:06:52.646834 tst emergency_mo_mt_call.py:19: Test FAILED (6.4 sec) 06:06:52.674111 run osmo-hlr_10.42.42.2(pid=2080): ERR: Terminated: ERROR {rc=237} [trial-2370↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2080)] 06:06:52.723791 run osmo-hlr_10.42.42.2(pid=2080): stdout: | (launched: 2022-12-10_06:06:49.556867) 06:06:52.775390 run osmo-hlr_10.42.42.2(pid=2080): stderr: | 20221210060649758 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210060649758 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210060649759 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210060649759 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210060649759 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210060649759 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210060649771 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/emergency:trx-umtrx/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210060649779 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210060649779 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210060649779 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:06:52.847617 run osmo-msc_10.42.42.6(pid=2086): ERR: Terminated: ERROR {rc=2} [trial-2370↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2086)] 06:06:52.897417 run osmo-msc_10.42.42.6(pid=2086): stdout: | (launched: 2022-12-10_06:06:51.724286) 06:06:52.949121 run osmo-msc_10.42.42.6(pid=2086): stderr: | 20221210060652044 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210060652044 DLGLOBAL DEBUG validating counter group 0x7fd61cfb7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210060652045 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210060652045 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210060652045 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210060652045 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210060652047 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210060652047 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210060652047 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210060652047 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:06:53.001174 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2079): Terminating (SIGTERM) 06:06:53.042687 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2082): Terminating (SIGTERM) 06:06:53.084237 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2085): Terminating (SIGTERM) 06:06:53.126158 --- ParallelTerminationStrategy: PID 2079 died... 06:06:53.146126 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2079): Terminated: ok {rc=0} 06:06:53.191946 --- ParallelTerminationStrategy: PID 2082 died... 06:06:53.211359 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2082): Terminated: ok {rc=0} 06:06:53.256931 --- ParallelTerminationStrategy: PID 2085 died... 06:06:53.276433 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2085): Terminated: ok {rc=0} 06:06:53.364666 bus /sierra_3: Setting Powered False 06:06:54.464868 bus /sierra_3: Setting Powered False 06:06:55.579779 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2370 emergency:trx-umtrx emergency_preemptive_call.py ---------------------------------------------- 06:06:56.663796 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 06:06:56.675297 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 06:06:56.725718 tst emergency_preemptive_call.py: using LAC 26372 06:06:56.846722 tst emergency_preemptive_call.py: using RAC 107 06:06:56.962328 tst emergency_preemptive_call.py: using CellId 26372 06:06:57.078491 tst emergency_preemptive_call.py: using BVCI 26373 06:06:57.187442 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 06:06:57.198271 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 06:06:57.208855 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 06:06:57.219718 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 06:06:57.230668 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 06:06:57.241428 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 06:06:57.359347 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 06:06:57.474671 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 06:06:57.592673 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 06:06:57.710532 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:06:58.170297 run create_hlr_db(pid=2088): Launched 06:06:58.285167 bus /sierra_2: Setting Powered False 06:06:59.344881 run create_hlr_db(pid=2088): Terminated: ok {rc=0} 06:06:59.781619 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2090): Launched 06:07:00.085450 run osmo-hlr_10.42.42.2(pid=2091): Launched 06:07:00.198705 run osmo-stp_10.42.42.5: Starting osmo-stp 06:07:00.718249 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2093): Launched 06:07:01.050836 run osmo-stp_10.42.42.5(pid=2094): Launched 06:07:01.302290 tst emergency_preemptive_call.py: using MSISDN 7581 06:07:01.521665 run osmo-msc_10.42.42.6: Starting osmo-msc 06:07:02.189666 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2096): Launched 06:07:02.523319 run osmo-msc_10.42.42.6(pid=2097): Launched 06:07:02.705865 run osmo-stp_10.42.42.5(pid=2094): ERR: Terminated: ERROR {rc=1} [trial-2370↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2094)] 06:07:02.841260 run osmo-stp_10.42.42.5(pid=2094): stdout: | (launched: 2022-12-10_06:07:00.989923) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:07:02.977749 run osmo-stp_10.42.42.5(pid=2094): stderr: | 20221210060701205 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060701205 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060701205 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060701206 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060701206 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060701206 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060701206 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:07:03.111861 run osmo-stp_10.42.42.5(pid=2094): stdout: | (launched: 2022-12-10_06:07:00.989923) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:07:03.238543 run osmo-stp_10.42.42.5(pid=2094): stderr: | 20221210060701205 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060701205 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060701205 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060701206 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060701206 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060701206 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060701206 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:07:03.389573 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=2094): Process ended prematurely: osmo-stp_10.42.42.5(pid=2094) [trial-2370↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2094)] [trial-2370↪emergency:trx-umtrx↪emergency_preemptive_call.py:32] 06:07:03.398739 tst emergency_preemptive_call.py:32: Test FAILED (6.7 sec) 06:07:03.427070 run osmo-hlr_10.42.42.2(pid=2091): ERR: Terminated: ERROR {rc=237} [trial-2370↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2091)] 06:07:03.477843 run osmo-hlr_10.42.42.2(pid=2091): stdout: | (launched: 2022-12-10_06:07:00.030688) 06:07:03.530201 run osmo-hlr_10.42.42.2(pid=2091): stderr: | 20221210060700208 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210060700208 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210060700208 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210060700208 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210060700208 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210060700208 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210060700221 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/emergency:trx-umtrx/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210060700230 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210060700230 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210060700230 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:07:03.603307 run osmo-msc_10.42.42.6(pid=2097): ERR: Terminated: ERROR {rc=2} [trial-2370↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2097)] 06:07:03.653660 run osmo-msc_10.42.42.6(pid=2097): stdout: | (launched: 2022-12-10_06:07:02.464806) 06:07:03.705614 run osmo-msc_10.42.42.6(pid=2097): stderr: | 20221210060702786 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210060702786 DLGLOBAL DEBUG validating counter group 0x7fb43976bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210060702786 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210060702786 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210060702786 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210060702787 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210060702788 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210060702789 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210060702789 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210060702789 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:07:03.757909 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2090): Terminating (SIGTERM) 06:07:03.800213 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2093): Terminating (SIGTERM) 06:07:03.842565 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2096): Terminating (SIGTERM) 06:07:03.885106 --- ParallelTerminationStrategy: PID 2090 died... 06:07:03.905087 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2090): Terminated: ok {rc=0} 06:07:03.952154 --- ParallelTerminationStrategy: PID 2093 died... 06:07:03.971766 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2093): Terminated: ok {rc=0} 06:07:04.018625 --- ParallelTerminationStrategy: PID 2096 died... 06:07:04.038165 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2096): Terminated: ok {rc=0} 06:07:04.126763 bus /sierra_9: Setting Powered False 06:07:05.224661 bus /sierra_9: Setting Powered False 06:07:06.340538 bus /sierra_8: Setting Powered False 06:07:07.439200 bus /sierra_8: Setting Powered False 06:07:08.556480 bus /sierra_3: Setting Powered False 06:07:09.654273 bus /sierra_3: Setting Powered False 06:07:10.766326 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 emergency:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 gprs:trx-umtrx --------------------------------------------------------------------- 06:07:12.033436 tst gprs:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:07:12.037677 tst gprs:trx-umtrx: Verifying 1 x bts (candidates: 11) 06:07:12.070400 tst gprs:trx-umtrx: Verifying 9 x ip_address (candidates: 9) 06:07:12.108274 tst gprs:trx-umtrx: Verifying 4 x modem (candidates: 12) 06:07:12.194111 tst gprs:trx-umtrx: Reserving 1 x bts (candidates: 11) 06:07:12.226087 tst gprs:trx-umtrx: Reserving 9 x ip_address (candidates: 9) 06:07:12.263833 tst gprs:trx-umtrx: Reserving 4 x modem (candidates: 12) 06:07:12.851086 tst gprs:trx-umtrx: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2370 gprs:trx-umtrx cs_paging_gprs_active.py ---------------------------------------------- 06:07:12.899790 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:07:12.910293 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 06:07:12.956126 tst cs_paging_gprs_active.py: using LAC 26373 06:07:13.074003 tst cs_paging_gprs_active.py: using RAC 108 06:07:13.193234 tst cs_paging_gprs_active.py: using CellId 26373 06:07:13.319690 tst cs_paging_gprs_active.py: using BVCI 26374 06:07:13.436893 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:07:13.448333 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:07:13.459694 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:07:13.470717 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:07:13.481660 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:07:13.492545 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:07:13.503635 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:07:13.514687 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:07:13.525775 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 06:07:13.638875 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 06:07:13.754272 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 06:07:13.953926 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:07:14.251765 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2102): Launched 06:07:14.511327 run iperf3-srv_10.42.42.10(pid=2103): Launched 06:07:14.623846 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 06:07:14.821972 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:07:15.119377 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2104): Launched 06:07:15.377884 run iperf3-srv_10.42.42.10(pid=2105): Launched 06:07:15.489071 tst cs_paging_gprs_active.py:38: start network... 06:07:15.687085 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:07:16.169829 run create_hlr_db(pid=2106): Launched 06:07:16.331163 bus /sierra_2: Setting Powered False 06:07:17.394520 run create_hlr_db(pid=2106): Terminated: ok {rc=0} 06:07:17.824118 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2108): Launched 06:07:18.121766 run osmo-hlr_10.42.42.2(pid=2109): Launched 06:07:18.235189 run osmo-stp_10.42.42.5: Starting osmo-stp 06:07:18.745118 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2111): Launched 06:07:19.042785 run osmo-stp_10.42.42.5(pid=2112): Launched 06:07:19.157447 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:07:19.671202 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2114): Launched 06:07:19.785555 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:07:20.037306 run patchelf(pid=2115): Launched 06:07:20.203660 run osmo-stp_10.42.42.5(pid=2112): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2112)] 06:07:20.329836 run osmo-stp_10.42.42.5(pid=2112): stdout: | (launched: 2022-12-10_06:07:18.987870) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:07:20.457636 run osmo-stp_10.42.42.5(pid=2112): stderr: | 20221210060719155 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060719155 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060719156 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060719156 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060719158 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060719159 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060719159 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:07:20.585444 run osmo-stp_10.42.42.5(pid=2112): stdout: | (launched: 2022-12-10_06:07:18.987870) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:07:20.707456 run osmo-stp_10.42.42.5(pid=2112): stderr: | 20221210060719155 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060719155 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060719156 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060719156 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060719158 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060719159 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060719159 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:07:20.851932 run patchelf(pid=2115): Terminating (SIGINT) 06:07:21.018607 run patchelf(pid=2115): Terminated: ok {rc=0} 06:07:21.139598 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=2112): Process ended prematurely: osmo-stp_10.42.42.5(pid=2112) [trial-2370↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2112)] [trial-2370↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38] 06:07:21.149197 tst cs_paging_gprs_active.py:38: Test FAILED (8.3 sec) 06:07:21.176346 run osmo-hlr_10.42.42.2(pid=2109): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-umtrx↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2109)] 06:07:21.223425 run osmo-hlr_10.42.42.2(pid=2109): stdout: | (launched: 2022-12-10_06:07:18.066883) 06:07:21.272440 run osmo-hlr_10.42.42.2(pid=2109): stderr: | 20221210060718240 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210060718240 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210060718241 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210060718241 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210060718241 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210060718241 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210060718258 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-umtrx/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210060718267 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210060718268 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210060718268 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:07:21.321609 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2102): Terminating (SIGTERM) 06:07:21.361167 run iperf3-srv_10.42.42.10(pid=2103): Terminating (SIGTERM) 06:07:21.400373 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2104): Terminating (SIGTERM) 06:07:21.439690 run iperf3-srv_10.42.42.10(pid=2105): Terminating (SIGTERM) 06:07:21.478718 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2108): Terminating (SIGTERM) 06:07:21.517877 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2111): Terminating (SIGTERM) 06:07:21.557037 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2114): Terminating (SIGTERM) 06:07:21.596379 --- ParallelTerminationStrategy: PID 2102 died... 06:07:21.615221 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2102): Terminated: ok {rc=0} 06:07:21.658777 --- ParallelTerminationStrategy: PID 2103 died... 06:07:21.677486 run iperf3-srv_10.42.42.10(pid=2103): Terminated {rc=256} 06:07:21.721254 --- ParallelTerminationStrategy: PID 2104 died... 06:07:21.739484 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2104): Terminated: ok {rc=0} 06:07:21.783312 --- ParallelTerminationStrategy: PID 2105 died... 06:07:21.801634 run iperf3-srv_10.42.42.10(pid=2105): Terminated {rc=256} 06:07:21.845016 --- ParallelTerminationStrategy: PID 2108 died... 06:07:21.863383 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2108): Terminated: ok {rc=0} 06:07:21.906848 --- ParallelTerminationStrategy: PID 2111 died... 06:07:21.925195 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2111): Terminated: ok {rc=0} 06:07:21.968621 --- ParallelTerminationStrategy: PID 2114 died... 06:07:21.986996 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2114): Terminated: ok {rc=0} 06:07:22.072317 bus /gobi_0: Setting Powered False 06:07:23.170894 bus /gobi_0: Setting Powered False 06:07:24.285381 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-umtrx iperf3.py ---------------------------------------------- 06:07:25.428816 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:07:25.439917 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 06:07:25.490312 tst iperf3.py: using LAC 26374 06:07:25.609149 tst iperf3.py: using RAC 109 06:07:25.726357 tst iperf3.py: using CellId 26374 06:07:25.852536 tst iperf3.py: using BVCI 26375 06:07:25.968019 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:07:25.979469 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:07:25.990517 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:07:26.001570 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:07:26.012353 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:07:26.023284 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:07:26.034267 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:07:26.045070 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:07:26.056057 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 06:07:26.169302 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 06:07:26.370064 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:07:26.668644 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2116): Launched 06:07:26.928888 run iperf3-srv_10.42.42.10(pid=2117): Launched 06:07:27.041362 tst iperf3.py:8: start network... 06:07:27.240340 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:07:27.700931 run create_hlr_db(pid=2118): Launched 06:07:27.816657 bus /gobi_6: Setting Powered False 06:07:28.876274 run create_hlr_db(pid=2118): Terminated: ok {rc=0} 06:07:29.289237 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2120): Launched 06:07:29.586191 run osmo-hlr_10.42.42.2(pid=2121): Launched 06:07:29.700107 run osmo-stp_10.42.42.5: Starting osmo-stp 06:07:30.226034 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2123): Launched 06:07:30.521882 run osmo-stp_10.42.42.5(pid=2124): Launched 06:07:30.635410 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:07:31.182939 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2126): Launched 06:07:31.312060 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:07:31.574611 run patchelf(pid=2127): Launched 06:07:31.768098 run osmo-stp_10.42.42.5(pid=2124): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2124)] 06:07:31.905789 run osmo-stp_10.42.42.5(pid=2124): stdout: | (launched: 2022-12-10_06:07:30.467286) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:07:32.045531 run osmo-stp_10.42.42.5(pid=2124): stderr: | 20221210060730638 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060730638 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060730638 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060730639 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060730639 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060730639 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060730639 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:07:32.189533 run osmo-stp_10.42.42.5(pid=2124): stdout: | (launched: 2022-12-10_06:07:30.467286) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:07:32.312128 run osmo-stp_10.42.42.5(pid=2124): stderr: | 20221210060730638 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060730638 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060730638 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060730639 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060730639 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060730639 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060730639 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:07:32.455546 run patchelf(pid=2127): Terminating (SIGINT) 06:07:32.620551 run patchelf(pid=2127): Terminated: ok {rc=0} 06:07:32.739376 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2124): Process ended prematurely: osmo-stp_10.42.42.5(pid=2124) [trial-2370↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2124)] [trial-2370↪gprs:trx-umtrx↪iperf3.py:8] 06:07:32.748794 tst iperf3.py:8: Test FAILED (7.4 sec) 06:07:32.775985 run osmo-hlr_10.42.42.2(pid=2121): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-umtrx↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2121)] 06:07:32.823314 run osmo-hlr_10.42.42.2(pid=2121): stdout: | (launched: 2022-12-10_06:07:29.531478) 06:07:32.872016 run osmo-hlr_10.42.42.2(pid=2121): stderr: | 20221210060729707 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210060729707 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210060729707 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210060729707 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210060729707 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210060729707 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210060729719 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-umtrx/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210060729728 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210060729729 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210060729729 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:07:32.921402 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2116): Terminating (SIGTERM) 06:07:32.960581 run iperf3-srv_10.42.42.10(pid=2117): Terminating (SIGTERM) 06:07:32.999628 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2120): Terminating (SIGTERM) 06:07:33.038759 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2123): Terminating (SIGTERM) 06:07:33.077815 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2126): Terminating (SIGTERM) 06:07:33.117321 --- ParallelTerminationStrategy: PID 2116 died... 06:07:33.136029 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2116): Terminated: ok {rc=0} 06:07:33.179902 --- ParallelTerminationStrategy: PID 2117 died... 06:07:33.198105 run iperf3-srv_10.42.42.10(pid=2117): Terminated {rc=256} 06:07:33.241452 --- ParallelTerminationStrategy: PID 2120 died... 06:07:33.259754 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2120): Terminated: ok {rc=0} 06:07:33.303181 --- ParallelTerminationStrategy: PID 2123 died... 06:07:33.321398 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2123): Terminated: ok {rc=0} 06:07:33.364609 --- ParallelTerminationStrategy: PID 2126 died... 06:07:33.382814 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2126): Terminated: ok {rc=0} 06:07:33.467413 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-umtrx iperf3m4.py ---------------------------------------------- 06:07:34.610762 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:07:34.621959 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 06:07:34.669654 tst iperf3m4.py: using LAC 26375 06:07:34.785978 tst iperf3m4.py: using RAC 110 06:07:34.901646 tst iperf3m4.py: using CellId 26375 06:07:35.026304 tst iperf3m4.py: using BVCI 26376 06:07:35.141464 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:07:35.152464 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:07:35.163346 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:07:35.174716 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:07:35.185944 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:07:35.197136 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:07:35.208578 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:07:35.219867 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:07:35.231320 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 06:07:35.347552 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 06:07:35.469415 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 06:07:35.584812 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 06:07:35.700300 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 06:07:35.897622 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:07:36.194695 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2130): Launched 06:07:36.450309 run iperf3-srv_10.42.42.10(pid=2131): Launched 06:07:36.560418 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 06:07:36.756033 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:07:37.049295 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2132): Launched 06:07:37.304214 run iperf3-srv_10.42.42.10(pid=2133): Launched 06:07:37.414427 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 06:07:37.609885 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:07:37.903475 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2134): Launched 06:07:38.158919 run iperf3-srv_10.42.42.10(pid=2135): Launched 06:07:38.268812 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 06:07:38.464815 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:07:38.759165 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2136): Launched 06:07:39.014572 run iperf3-srv_10.42.42.10(pid=2137): Launched 06:07:39.124428 tst iperf3m4.py:8: start network... 06:07:39.319549 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:07:39.771192 run create_hlr_db(pid=2138): Launched 06:07:39.883940 bus /gobi_6: Setting Powered False 06:07:40.943489 run create_hlr_db(pid=2138): Terminated: ok {rc=0} 06:07:41.351060 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2140): Launched 06:07:41.644187 run osmo-hlr_10.42.42.2(pid=2141): Launched 06:07:41.755260 run osmo-stp_10.42.42.5: Starting osmo-stp 06:07:42.276767 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2143): Launched 06:07:42.570247 run osmo-stp_10.42.42.5(pid=2144): Launched 06:07:42.682582 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:07:43.188150 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2146): Launched 06:07:43.301575 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:07:43.549485 run patchelf(pid=2147): Launched 06:07:43.712897 run osmo-stp_10.42.42.5(pid=2144): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2144)] 06:07:43.837426 run osmo-stp_10.42.42.5(pid=2144): stdout: | (launched: 2022-12-10_06:07:42.516332) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:07:43.963484 run osmo-stp_10.42.42.5(pid=2144): stderr: | 20221210060742685 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060742685 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060742685 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060742686 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060742686 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060742686 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060742686 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:07:44.089360 run osmo-stp_10.42.42.5(pid=2144): stdout: | (launched: 2022-12-10_06:07:42.516332) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:07:44.209363 run osmo-stp_10.42.42.5(pid=2144): stderr: | 20221210060742685 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060742685 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060742685 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060742686 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060742686 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060742686 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060742686 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:07:44.351490 run patchelf(pid=2147): Terminating (SIGINT) 06:07:44.516008 run patchelf(pid=2147): Terminated: ok {rc=0} 06:07:44.634276 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2144): Process ended prematurely: osmo-stp_10.42.42.5(pid=2144) [trial-2370↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2144)] [trial-2370↪gprs:trx-umtrx↪iperf3m4.py:8] 06:07:44.643480 tst iperf3m4.py:8: Test FAILED (10.1 sec) 06:07:44.670735 run osmo-hlr_10.42.42.2(pid=2141): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-umtrx↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2141)] 06:07:44.717519 run osmo-hlr_10.42.42.2(pid=2141): stdout: | (launched: 2022-12-10_06:07:41.590229) 06:07:44.765950 run osmo-hlr_10.42.42.2(pid=2141): stderr: | 20221210060741768 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210060741768 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210060741768 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210060741768 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210060741768 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210060741768 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210060741783 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-umtrx/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210060741793 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210060741794 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210060741794 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:07:44.814688 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2130): Terminating (SIGTERM) 06:07:44.853366 run iperf3-srv_10.42.42.10(pid=2131): Terminating (SIGTERM) 06:07:44.892223 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2132): Terminating (SIGTERM) 06:07:44.931080 run iperf3-srv_10.42.42.10(pid=2133): Terminating (SIGTERM) 06:07:44.969818 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2134): Terminating (SIGTERM) 06:07:45.008529 run iperf3-srv_10.42.42.10(pid=2135): Terminating (SIGTERM) 06:07:45.047164 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2136): Terminating (SIGTERM) 06:07:45.085805 run iperf3-srv_10.42.42.10(pid=2137): Terminating (SIGTERM) 06:07:45.124435 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2140): Terminating (SIGTERM) 06:07:45.163217 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2143): Terminating (SIGTERM) 06:07:45.202046 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2146): Terminating (SIGTERM) 06:07:45.240900 --- ParallelTerminationStrategy: PID 2130 died... 06:07:45.259552 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2130): Terminated: ok {rc=0} 06:07:45.302843 --- ParallelTerminationStrategy: PID 2131 died... 06:07:45.320826 run iperf3-srv_10.42.42.10(pid=2131): Terminated {rc=256} 06:07:45.363669 --- ParallelTerminationStrategy: PID 2132 died... 06:07:45.381723 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2132): Terminated: ok {rc=0} 06:07:45.424673 --- ParallelTerminationStrategy: PID 2133 died... 06:07:45.443108 run iperf3-srv_10.42.42.10(pid=2133): Terminated {rc=256} 06:07:45.485820 --- ParallelTerminationStrategy: PID 2134 died... 06:07:45.503850 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2134): Terminated: ok {rc=0} 06:07:45.547299 --- ParallelTerminationStrategy: PID 2135 died... 06:07:45.565578 run iperf3-srv_10.42.42.10(pid=2135): Terminated {rc=256} 06:07:45.608455 --- ParallelTerminationStrategy: PID 2136 died... 06:07:45.626622 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2136): Terminated: ok {rc=0} 06:07:45.669722 --- ParallelTerminationStrategy: PID 2137 died... 06:07:45.687886 run iperf3-srv_10.42.42.10(pid=2137): Terminated {rc=256} 06:07:45.730959 --- ParallelTerminationStrategy: PID 2140 died... 06:07:45.749270 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2140): Terminated: ok {rc=0} 06:07:45.792268 --- ParallelTerminationStrategy: PID 2143 died... 06:07:45.810792 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2143): Terminated: ok {rc=0} 06:07:45.854262 --- ParallelTerminationStrategy: PID 2146 died... 06:07:45.874626 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2146): Terminated: ok {rc=0} 06:07:45.978616 bus /gobi_4: Setting Powered False 06:07:47.077763 bus /gobi_4: Setting Powered False 06:07:48.192035 bus /gobi_1: Setting Powered False 06:07:49.288436 bus /gobi_1: Setting Powered False 06:07:50.400850 bus /gobi_0: Setting Powered False 06:07:51.497214 bus /gobi_0: Setting Powered False 06:07:52.609581 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-umtrx ping.py ---------------------------------------------- 06:07:53.710755 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:07:53.722283 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 06:07:53.771209 tst ping.py: using LAC 26376 06:07:53.894211 tst ping.py: using RAC 111 06:07:54.017693 tst ping.py: using CellId 26376 06:07:54.140353 tst ping.py: using BVCI 26377 06:07:54.252215 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:07:54.263067 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:07:54.273948 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:07:54.284593 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:07:54.295240 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:07:54.305871 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:07:54.316619 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:07:54.327420 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 06:07:54.442574 tst ping.py:19: start network... 06:07:54.650832 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:07:55.127517 run create_hlr_db(pid=2148): Launched 06:07:55.252933 bus /gobi_6: Setting Powered False 06:07:56.314906 run create_hlr_db(pid=2148): Terminated: ok {rc=0} 06:07:56.727422 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2150): Launched 06:07:57.015283 run osmo-hlr_10.42.42.2(pid=2151): Launched 06:07:57.124928 run osmo-stp_10.42.42.5: Starting osmo-stp 06:07:57.635726 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2153): Launched 06:07:57.923562 run osmo-stp_10.42.42.5(pid=2154): Launched 06:07:58.033944 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:07:58.529636 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2156): Launched 06:07:58.640651 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:07:58.884032 run patchelf(pid=2157): Launched 06:07:59.045335 run osmo-stp_10.42.42.5(pid=2154): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2154)] 06:07:59.168536 run osmo-stp_10.42.42.5(pid=2154): stdout: | (launched: 2022-12-10_06:07:57.870726) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:07:59.293713 run osmo-stp_10.42.42.5(pid=2154): stderr: | 20221210060758040 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060758041 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060758041 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060758041 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060758042 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060758042 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060758042 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:07:59.419298 run osmo-stp_10.42.42.5(pid=2154): stdout: | (launched: 2022-12-10_06:07:57.870726) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:07:59.538813 run osmo-stp_10.42.42.5(pid=2154): stderr: | 20221210060758040 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060758041 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060758041 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060758041 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060758042 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060758042 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060758042 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:07:59.679648 run patchelf(pid=2157): Terminating (SIGINT) 06:07:59.842856 run patchelf(pid=2157): Terminated: ok {rc=0} 06:07:59.960467 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=2154): Process ended prematurely: osmo-stp_10.42.42.5(pid=2154) [trial-2370↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2154)] [trial-2370↪gprs:trx-umtrx↪ping.py:22] 06:07:59.969410 tst ping.py:22: Test FAILED (6.3 sec) 06:07:59.995762 run osmo-hlr_10.42.42.2(pid=2151): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-umtrx↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2151)] 06:08:00.043231 run osmo-hlr_10.42.42.2(pid=2151): stdout: | (launched: 2022-12-10_06:07:56.962808) 06:08:00.091953 run osmo-hlr_10.42.42.2(pid=2151): stderr: | 20221210060757134 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210060757134 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210060757135 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210060757135 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210060757135 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210060757135 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210060757147 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-umtrx/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210060757156 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210060757157 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210060757157 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:08:00.141029 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2150): Terminating (SIGTERM) 06:08:00.180221 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2153): Terminating (SIGTERM) 06:08:00.220112 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2156): Terminating (SIGTERM) 06:08:00.259113 --- ParallelTerminationStrategy: PID 2150 died... 06:08:00.278162 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2150): Terminated: ok {rc=0} 06:08:00.321736 --- ParallelTerminationStrategy: PID 2153 died... 06:08:00.340090 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2153): Terminated: ok {rc=0} 06:08:00.383579 --- ParallelTerminationStrategy: PID 2156 died... 06:08:00.401833 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2156): Terminated: ok {rc=0} 06:08:00.484226 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-umtrx ping_idle_ping.py ---------------------------------------------- 06:08:01.580224 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:08:01.591974 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 06:08:01.643137 tst ping_idle_ping.py: using LAC 26377 06:08:01.765531 tst ping_idle_ping.py: using RAC 112 06:08:01.914138 tst ping_idle_ping.py: using CellId 26377 06:08:02.032031 tst ping_idle_ping.py: using BVCI 26378 06:08:02.148037 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:08:02.159797 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:08:02.171174 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:08:02.183033 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:08:02.194808 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:08:02.206595 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:08:02.218755 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:08:02.230969 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 06:08:02.348294 tst ping_idle_ping.py:24: start network... 06:08:02.557866 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:08:03.039675 run create_hlr_db(pid=2158): Launched 06:08:03.165979 bus /gobi_6: Setting Powered False 06:08:04.227745 run create_hlr_db(pid=2158): Terminated: ok {rc=0} 06:08:04.645126 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2160): Launched 06:08:04.935183 run osmo-hlr_10.42.42.2(pid=2161): Launched 06:08:05.045836 run osmo-stp_10.42.42.5: Starting osmo-stp 06:08:05.545700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2163): Launched 06:08:05.833319 run osmo-stp_10.42.42.5(pid=2164): Launched 06:08:05.943186 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:08:06.440009 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2166): Launched 06:08:06.550257 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:08:06.793071 run patchelf(pid=2167): Launched 06:08:06.954233 run osmo-stp_10.42.42.5(pid=2164): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2164)] 06:08:07.077167 run osmo-stp_10.42.42.5(pid=2164): stdout: | (launched: 2022-12-10_06:08:05.780587) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:08:07.201324 run osmo-stp_10.42.42.5(pid=2164): stderr: | 20221210060805946 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060805946 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060805946 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060805947 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060805949 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060805949 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060805949 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:08:07.325770 run osmo-stp_10.42.42.5(pid=2164): stdout: | (launched: 2022-12-10_06:08:05.780587) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:08:07.443948 run osmo-stp_10.42.42.5(pid=2164): stderr: | 20221210060805946 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060805946 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060805946 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060805947 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060805949 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060805949 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060805949 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:08:07.584300 run patchelf(pid=2167): Terminating (SIGINT) 06:08:07.746371 run patchelf(pid=2167): Terminated: ok {rc=0} 06:08:07.863239 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=2164): Process ended prematurely: osmo-stp_10.42.42.5(pid=2164) [trial-2370↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2164)] [trial-2370↪gprs:trx-umtrx↪ping_idle_ping.py:27] 06:08:07.872061 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 06:08:07.898562 run osmo-hlr_10.42.42.2(pid=2161): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-umtrx↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2161)] 06:08:07.945476 run osmo-hlr_10.42.42.2(pid=2161): stdout: | (launched: 2022-12-10_06:08:04.882082) 06:08:07.993797 run osmo-hlr_10.42.42.2(pid=2161): stderr: | 20221210060805058 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210060805059 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210060805059 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210060805059 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210060805059 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210060805059 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210060805073 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-umtrx/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210060805082 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210060805083 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210060805083 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:08:08.042494 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2160): Terminating (SIGTERM) 06:08:08.081485 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2163): Terminating (SIGTERM) 06:08:08.120312 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2166): Terminating (SIGTERM) 06:08:08.159204 --- ParallelTerminationStrategy: PID 2160 died... 06:08:08.177619 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2160): Terminated: ok {rc=0} 06:08:08.220863 --- ParallelTerminationStrategy: PID 2163 died... 06:08:08.239073 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2163): Terminated: ok {rc=0} 06:08:08.282423 --- ParallelTerminationStrategy: PID 2166 died... 06:08:08.300383 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2166): Terminated: ok {rc=0} 06:08:08.385206 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2370 gprs:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 gprs:trx-umtrx+mod-bts0-egprs --------------------------------------------------------------------- 06:08:09.687483 tst gprs:trx-umtrx+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:08:09.693438 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 06:08:09.726669 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 06:08:09.765903 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 06:08:09.853554 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 06:08:09.886708 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 06:08:09.925796 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 06:08:10.519959 tst gprs:trx-umtrx+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2370 gprs:trx-umtrx+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 06:08:10.571532 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:08:10.582961 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:08:10.633614 tst cs_paging_gprs_active.py: using LAC 26378 06:08:10.752043 tst cs_paging_gprs_active.py: using RAC 113 06:08:10.877611 tst cs_paging_gprs_active.py: using CellId 26378 06:08:11.001621 tst cs_paging_gprs_active.py: using BVCI 26379 06:08:11.117106 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:08:11.128449 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:08:11.139614 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:08:11.150915 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:08:11.162138 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:08:11.173450 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:08:11.184617 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:08:11.195618 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:08:11.206834 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:08:11.322171 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:08:11.440787 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 06:08:11.655967 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:08:11.976373 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2171): Launched 06:08:12.252929 run iperf3-srv_10.42.42.10(pid=2172): Launched 06:08:12.372447 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 06:08:12.586363 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:08:12.904641 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2173): Launched 06:08:13.180254 run iperf3-srv_10.42.42.10(pid=2174): Launched 06:08:13.299253 tst cs_paging_gprs_active.py:38: start network... 06:08:13.512377 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:08:14.001684 run create_hlr_db(pid=2175): Launched 06:08:14.130893 bus /gobi_6: Setting Powered False 06:08:15.193619 run create_hlr_db(pid=2175): Terminated: ok {rc=0} 06:08:15.634472 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2177): Launched 06:08:15.961714 run osmo-hlr_10.42.42.2(pid=2178): Launched 06:08:16.243147 run osmo-stp_10.42.42.5: Starting osmo-stp 06:08:16.969732 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2216): Launched 06:08:17.349722 run osmo-stp_10.42.42.5(pid=2230): Launched 06:08:17.644342 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:08:18.389274 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2288): Launched 06:08:18.559568 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:08:18.902646 run patchelf(pid=2325): Launched 06:08:19.123258 run osmo-stp_10.42.42.5(pid=2230): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2230)] 06:08:19.280296 run osmo-stp_10.42.42.5(pid=2230): stdout: | (launched: 2022-12-10_06:08:17.263926) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:08:19.443396 run osmo-stp_10.42.42.5(pid=2230): stderr: | 20221210060817542 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060817542 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060817543 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060817543 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060817543 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060817544 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060817544 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:08:19.606398 run osmo-stp_10.42.42.5(pid=2230): stdout: | (launched: 2022-12-10_06:08:17.263926) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:08:19.761056 run osmo-stp_10.42.42.5(pid=2230): stderr: | 20221210060817542 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060817542 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060817543 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060817543 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060817543 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060817544 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060817544 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:08:19.929294 run patchelf(pid=2325): Terminating (SIGINT) 06:08:20.112220 run patchelf(pid=2325): Terminated: ok {rc=0} 06:08:20.253152 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=2230): Process ended prematurely: osmo-stp_10.42.42.5(pid=2230) [trial-2370↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2230)] [trial-2370↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 06:08:20.263710 tst cs_paging_gprs_active.py:38: Test FAILED (9.7 sec) 06:08:20.293360 run osmo-hlr_10.42.42.2(pid=2178): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2178)] 06:08:20.344570 run osmo-hlr_10.42.42.2(pid=2178): stdout: | (launched: 2022-12-10_06:08:15.897097) 06:08:20.397278 run osmo-hlr_10.42.42.2(pid=2178): stderr: | 20221210060816140 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210060816140 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210060816140 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210060816140 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210060816140 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210060816140 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210060816155 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-umtrx+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210060816184 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210060816184 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210060816184 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:08:20.450182 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2171): Terminating (SIGTERM) 06:08:20.493923 run iperf3-srv_10.42.42.10(pid=2172): Terminating (SIGTERM) 06:08:20.540183 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2173): Terminating (SIGTERM) 06:08:20.583619 run iperf3-srv_10.42.42.10(pid=2174): Terminating (SIGTERM) 06:08:20.626323 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2177): Terminating (SIGTERM) 06:08:20.669183 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2216): Terminating (SIGTERM) 06:08:20.712450 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2288): Terminating (SIGTERM) 06:08:20.757480 --- ParallelTerminationStrategy: PID 2171 died... 06:08:20.778058 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2171): Terminated: ok {rc=0} 06:08:20.825491 --- ParallelTerminationStrategy: PID 2172 died... 06:08:20.845709 run iperf3-srv_10.42.42.10(pid=2172): Terminated {rc=256} 06:08:20.892773 --- ParallelTerminationStrategy: PID 2173 died... 06:08:20.913058 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2173): Terminated: ok {rc=0} 06:08:20.960332 --- ParallelTerminationStrategy: PID 2174 died... 06:08:20.980436 run iperf3-srv_10.42.42.10(pid=2174): Terminated {rc=256} 06:08:21.027734 --- ParallelTerminationStrategy: PID 2177 died... 06:08:21.047869 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2177): Terminated: ok {rc=0} 06:08:21.094597 --- ParallelTerminationStrategy: PID 2216 died... 06:08:21.114576 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2216): Terminated: ok {rc=0} 06:08:21.161562 --- ParallelTerminationStrategy: PID 2288 died... 06:08:21.181440 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2288): Terminated: ok {rc=0} 06:08:21.269638 bus /gobi_0: Setting Powered False 06:08:22.368172 bus /gobi_0: Setting Powered False 06:08:23.482769 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-umtrx+mod-bts0-egprs iperf3.py ---------------------------------------------- 06:08:24.630059 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:08:24.642486 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:08:24.697894 tst iperf3.py: using LAC 26379 06:08:24.818071 tst iperf3.py: using RAC 114 06:08:24.938782 tst iperf3.py: using CellId 26379 06:08:25.059354 tst iperf3.py: using BVCI 26380 06:08:25.171924 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:08:25.183762 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:08:25.195782 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:08:25.209260 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:08:25.222663 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:08:25.234228 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:08:25.246621 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:08:25.260212 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:08:25.271877 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:08:25.392904 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 06:08:25.598575 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:08:25.924341 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2457): Launched 06:08:26.217851 run iperf3-srv_10.42.42.10(pid=2458): Launched 06:08:26.351132 tst iperf3.py:8: start network... 06:08:26.567990 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:08:27.073674 run create_hlr_db(pid=2459): Launched 06:08:27.231854 bus /gobi_6: Setting Powered False 06:08:28.296035 run create_hlr_db(pid=2459): Terminated: ok {rc=0} 06:08:28.755454 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2461): Launched 06:08:29.095361 run osmo-hlr_10.42.42.2(pid=2462): Launched 06:08:29.335894 run osmo-stp_10.42.42.5: Starting osmo-stp 06:08:30.010359 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2464): Launched 06:08:30.348609 run osmo-stp_10.42.42.5(pid=2465): Launched 06:08:30.587663 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:08:31.275647 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2467): Launched 06:08:31.466044 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:08:31.805965 run patchelf(pid=2468): Launched 06:08:32.063845 run osmo-stp_10.42.42.5(pid=2465): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2465)] 06:08:32.227237 run osmo-stp_10.42.42.5(pid=2465): stdout: | (launched: 2022-12-10_06:08:30.285791) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:08:32.390210 run osmo-stp_10.42.42.5(pid=2465): stderr: | 20221210060830593 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060830593 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060830593 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060830593 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060830594 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060830594 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060830594 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:08:32.556152 run osmo-stp_10.42.42.5(pid=2465): stdout: | (launched: 2022-12-10_06:08:30.285791) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:08:32.715004 run osmo-stp_10.42.42.5(pid=2465): stderr: | 20221210060830593 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060830593 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060830593 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060830593 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060830594 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060830594 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060830594 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:08:32.904451 run patchelf(pid=2468): Terminating (SIGINT) 06:08:33.120715 run patchelf(pid=2468): Terminated: ok {rc=0} 06:08:33.280734 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2465): Process ended prematurely: osmo-stp_10.42.42.5(pid=2465) [trial-2370↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2465)] [trial-2370↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8] 06:08:33.293674 tst iperf3.py:8: Test FAILED (8.7 sec) 06:08:33.328939 run osmo-hlr_10.42.42.2(pid=2462): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2462)] 06:08:33.386650 run osmo-hlr_10.42.42.2(pid=2462): stdout: | (launched: 2022-12-10_06:08:29.032502) 06:08:33.440457 run osmo-hlr_10.42.42.2(pid=2462): stderr: | 20221210060829351 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210060829351 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210060829351 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210060829351 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210060829351 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210060829351 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210060829373 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-umtrx+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210060829381 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210060829381 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210060829381 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:08:33.494315 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2457): Terminating (SIGTERM) 06:08:33.537201 run iperf3-srv_10.42.42.10(pid=2458): Terminating (SIGTERM) 06:08:33.583869 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2461): Terminating (SIGTERM) 06:08:33.626968 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2464): Terminating (SIGTERM) 06:08:33.671241 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2467): Terminating (SIGTERM) 06:08:33.715938 --- ParallelTerminationStrategy: PID 2457 died... 06:08:33.736656 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2457): Terminated: ok {rc=0} 06:08:33.786862 --- ParallelTerminationStrategy: PID 2458 died... 06:08:33.807122 run iperf3-srv_10.42.42.10(pid=2458): Terminated {rc=256} 06:08:33.853999 --- ParallelTerminationStrategy: PID 2461 died... 06:08:33.874349 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2461): Terminated: ok {rc=0} 06:08:33.921505 --- ParallelTerminationStrategy: PID 2464 died... 06:08:33.941844 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2464): Terminated: ok {rc=0} 06:08:33.990999 --- ParallelTerminationStrategy: PID 2467 died... 06:08:34.011186 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2467): Terminated: ok {rc=0} 06:08:34.100643 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-umtrx+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 06:08:35.254130 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:08:35.267188 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:08:35.318350 tst iperf3m4.py: using LAC 26380 06:08:35.448714 tst iperf3m4.py: using RAC 115 06:08:35.578025 tst iperf3m4.py: using CellId 26380 06:08:35.710772 tst iperf3m4.py: using BVCI 26381 06:08:35.832599 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:08:35.844899 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:08:35.857234 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:08:35.869434 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:08:35.881775 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:08:35.893275 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:08:35.905705 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:08:35.918112 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:08:35.930262 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:08:36.054511 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:08:36.180561 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:08:36.302742 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:08:36.426946 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 06:08:36.648414 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:08:36.980126 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2469): Launched 06:08:37.278680 run iperf3-srv_10.42.42.10(pid=2470): Launched 06:08:37.414365 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 06:08:37.637720 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:08:37.971881 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2471): Launched 06:08:38.270374 run iperf3-srv_10.42.42.10(pid=2472): Launched 06:08:38.407469 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 06:08:38.627812 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:08:38.959877 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2473): Launched 06:08:39.258431 run iperf3-srv_10.42.42.10(pid=2474): Launched 06:08:39.395278 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 06:08:39.616477 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:08:39.949354 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2475): Launched 06:08:40.250623 run iperf3-srv_10.42.42.10(pid=2476): Launched 06:08:40.387058 tst iperf3m4.py:8: start network... 06:08:40.608789 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:08:41.121252 run create_hlr_db(pid=2477): Launched 06:08:41.291954 bus /gobi_6: Setting Powered False 06:08:42.351676 run create_hlr_db(pid=2477): Terminated: ok {rc=0} 06:08:42.760836 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2480): Launched 06:08:43.055300 run osmo-hlr_10.42.42.2(pid=2481): Launched 06:08:43.166959 run osmo-stp_10.42.42.5: Starting osmo-stp 06:08:43.686019 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2483): Launched 06:08:43.980646 run osmo-stp_10.42.42.5(pid=2484): Launched 06:08:44.093304 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:08:44.601837 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2486): Launched 06:08:44.714841 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:08:44.962968 run patchelf(pid=2487): Launched 06:08:45.127307 run osmo-stp_10.42.42.5(pid=2484): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2484)] 06:08:45.252455 run osmo-stp_10.42.42.5(pid=2484): stdout: | (launched: 2022-12-10_06:08:43.926602) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:08:45.378741 run osmo-stp_10.42.42.5(pid=2484): stderr: | 20221210060844096 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060844097 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060844097 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060844097 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060844098 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060844098 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060844098 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:08:45.505476 run osmo-stp_10.42.42.5(pid=2484): stdout: | (launched: 2022-12-10_06:08:43.926602) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:08:45.626434 run osmo-stp_10.42.42.5(pid=2484): stderr: | 20221210060844096 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060844097 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060844097 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060844097 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060844098 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060844098 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060844098 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:08:45.769993 run patchelf(pid=2487): Terminating (SIGINT) 06:08:45.977378 run patchelf(pid=2487): Terminated: ok {rc=0} 06:08:46.108228 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2484): Process ended prematurely: osmo-stp_10.42.42.5(pid=2484) [trial-2370↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2484)] [trial-2370↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8] 06:08:46.118940 tst iperf3m4.py:8: Test FAILED (10.9 sec) 06:08:46.149555 run osmo-hlr_10.42.42.2(pid=2481): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2481)] 06:08:46.201144 run osmo-hlr_10.42.42.2(pid=2481): stdout: | (launched: 2022-12-10_06:08:43.001673) 06:08:46.254044 run osmo-hlr_10.42.42.2(pid=2481): stderr: | 20221210060843178 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210060843178 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210060843178 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210060843178 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210060843178 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210060843178 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210060843190 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-umtrx+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210060843198 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210060843198 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210060843199 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:08:46.306501 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2469): Terminating (SIGTERM) 06:08:46.350262 run iperf3-srv_10.42.42.10(pid=2470): Terminating (SIGTERM) 06:08:46.397795 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2471): Terminating (SIGTERM) 06:08:46.442436 run iperf3-srv_10.42.42.10(pid=2472): Terminating (SIGTERM) 06:08:46.488685 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2473): Terminating (SIGTERM) 06:08:46.533819 run iperf3-srv_10.42.42.10(pid=2474): Terminating (SIGTERM) 06:08:46.581663 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2475): Terminating (SIGTERM) 06:08:46.625717 run iperf3-srv_10.42.42.10(pid=2476): Terminating (SIGTERM) 06:08:46.672306 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2480): Terminating (SIGTERM) 06:08:46.716223 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2483): Terminating (SIGTERM) 06:08:46.761577 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2486): Terminating (SIGTERM) 06:08:46.808842 --- ParallelTerminationStrategy: PID 2469 died... 06:08:46.831022 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2469): Terminated: ok {rc=0} 06:08:46.878761 --- ParallelTerminationStrategy: PID 2470 died... 06:08:46.899052 run iperf3-srv_10.42.42.10(pid=2470): Terminated {rc=256} 06:08:46.945815 --- ParallelTerminationStrategy: PID 2471 died... 06:08:46.966057 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2471): Terminated: ok {rc=0} 06:08:47.013858 --- ParallelTerminationStrategy: PID 2472 died... 06:08:47.033729 run iperf3-srv_10.42.42.10(pid=2472): Terminated {rc=256} 06:08:47.080505 --- ParallelTerminationStrategy: PID 2473 died... 06:08:47.100274 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2473): Terminated: ok {rc=0} 06:08:47.146962 --- ParallelTerminationStrategy: PID 2474 died... 06:08:47.167036 run iperf3-srv_10.42.42.10(pid=2474): Terminated {rc=256} 06:08:47.213480 --- ParallelTerminationStrategy: PID 2475 died... 06:08:47.231713 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2475): Terminated: ok {rc=0} 06:08:47.276541 --- ParallelTerminationStrategy: PID 2476 died... 06:08:47.295159 run iperf3-srv_10.42.42.10(pid=2476): Terminated {rc=256} 06:08:47.339820 --- ParallelTerminationStrategy: PID 2480 died... 06:08:47.358318 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2480): Terminated: ok {rc=0} 06:08:47.403268 --- ParallelTerminationStrategy: PID 2483 died... 06:08:47.421925 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2483): Terminated: ok {rc=0} 06:08:47.466489 --- ParallelTerminationStrategy: PID 2486 died... 06:08:47.484897 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2486): Terminated: ok {rc=0} 06:08:47.570945 bus /gobi_4: Setting Powered False 06:08:48.669020 bus /gobi_4: Setting Powered False 06:08:49.783878 bus /gobi_1: Setting Powered False 06:08:50.881984 bus /gobi_1: Setting Powered False 06:08:51.994649 bus /gobi_0: Setting Powered False 06:08:53.091289 bus /gobi_0: Setting Powered False 06:08:54.204630 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-umtrx+mod-bts0-egprs ping.py ---------------------------------------------- 06:08:55.305692 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:08:55.317588 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:08:55.368864 tst ping.py: using LAC 26381 06:08:55.489726 tst ping.py: using RAC 116 06:08:55.611889 tst ping.py: using CellId 26381 06:08:55.733806 tst ping.py: using BVCI 26382 06:08:55.846025 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:08:55.857245 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:08:55.868212 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:08:55.879252 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:08:55.890257 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:08:55.901195 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:08:55.912279 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:08:55.923298 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:08:56.041570 tst ping.py:19: start network... 06:08:56.249513 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:08:56.729076 run create_hlr_db(pid=2488): Launched 06:08:56.854670 bus /gobi_6: Setting Powered False 06:08:57.916510 run create_hlr_db(pid=2488): Terminated: ok {rc=0} 06:08:58.331149 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2490): Launched 06:08:58.620367 run osmo-hlr_10.42.42.2(pid=2491): Launched 06:08:58.731310 run osmo-stp_10.42.42.5: Starting osmo-stp 06:08:59.244683 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2493): Launched 06:08:59.530580 run osmo-stp_10.42.42.5(pid=2494): Launched 06:08:59.639350 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:09:00.132826 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2496): Launched 06:09:00.243110 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:09:00.485492 run patchelf(pid=2497): Launched 06:09:00.646411 run osmo-stp_10.42.42.5(pid=2494): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2494)] 06:09:00.768417 run osmo-stp_10.42.42.5(pid=2494): stdout: | (launched: 2022-12-10_06:08:59.478122) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:09:00.908899 run osmo-stp_10.42.42.5(pid=2494): stderr: | 20221210060859645 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060859645 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060859645 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060859646 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060859648 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060859648 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060859648 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:09:01.055252 run osmo-stp_10.42.42.5(pid=2494): stdout: | (launched: 2022-12-10_06:08:59.478122) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:09:01.185652 run osmo-stp_10.42.42.5(pid=2494): stderr: | 20221210060859645 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060859645 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060859645 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060859646 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060859648 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060859648 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060859648 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:09:01.338690 run patchelf(pid=2497): Terminating (SIGINT) 06:09:01.516641 run patchelf(pid=2497): Terminated: ok {rc=0} 06:09:01.647075 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=2494): Process ended prematurely: osmo-stp_10.42.42.5(pid=2494) [trial-2370↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2494)] [trial-2370↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22] 06:09:01.657170 tst ping.py:22: Test FAILED (6.3 sec) 06:09:01.686560 run osmo-hlr_10.42.42.2(pid=2491): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2491)] 06:09:01.736876 run osmo-hlr_10.42.42.2(pid=2491): stdout: | (launched: 2022-12-10_06:08:58.567099) 06:09:01.790806 run osmo-hlr_10.42.42.2(pid=2491): stderr: | 20221210060858742 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210060858742 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210060858742 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210060858742 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210060858742 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210060858742 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210060858758 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-umtrx+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210060858767 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210060858767 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210060858767 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:09:01.843606 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2490): Terminating (SIGTERM) 06:09:01.887128 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2493): Terminating (SIGTERM) 06:09:01.931218 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2496): Terminating (SIGTERM) 06:09:01.976460 --- ParallelTerminationStrategy: PID 2490 died... 06:09:01.997305 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2490): Terminated: ok {rc=0} 06:09:02.045311 --- ParallelTerminationStrategy: PID 2493 died... 06:09:02.065184 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2493): Terminated: ok {rc=0} 06:09:02.111552 --- ParallelTerminationStrategy: PID 2496 died... 06:09:02.131879 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2496): Terminated: ok {rc=0} 06:09:02.221304 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-umtrx+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 06:09:03.308164 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:09:03.320123 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:09:03.371148 tst ping_idle_ping.py: using LAC 26382 06:09:03.495612 tst ping_idle_ping.py: using RAC 117 06:09:03.618573 tst ping_idle_ping.py: using CellId 26382 06:09:03.740022 tst ping_idle_ping.py: using BVCI 26383 06:09:03.853852 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:09:03.865218 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:09:03.876249 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:09:03.887668 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:09:03.898688 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:09:03.909831 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:09:03.921063 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:09:03.932102 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:09:04.047018 tst ping_idle_ping.py:24: start network... 06:09:04.240667 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:09:04.689903 run create_hlr_db(pid=2498): Launched 06:09:04.800616 bus /gobi_6: Setting Powered False 06:09:05.858994 run create_hlr_db(pid=2498): Terminated: ok {rc=0} 06:09:06.285142 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2500): Launched 06:09:06.597109 run osmo-hlr_10.42.42.2(pid=2501): Launched 06:09:06.716393 run osmo-stp_10.42.42.5: Starting osmo-stp 06:09:07.252714 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2503): Launched 06:09:07.563568 run osmo-stp_10.42.42.5(pid=2504): Launched 06:09:07.682296 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:09:08.219857 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2506): Launched 06:09:08.339335 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:09:08.602409 run patchelf(pid=2507): Launched 06:09:08.776065 run osmo-stp_10.42.42.5(pid=2504): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2504)] 06:09:08.907982 run osmo-stp_10.42.42.5(pid=2504): stdout: | (launched: 2022-12-10_06:09:07.506392) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:09:09.041759 run osmo-stp_10.42.42.5(pid=2504): stderr: | 20221210060907696 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060907696 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060907696 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060907696 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060907699 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060907699 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060907699 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:09:09.175512 run osmo-stp_10.42.42.5(pid=2504): stdout: | (launched: 2022-12-10_06:09:07.506392) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:09:09.303080 run osmo-stp_10.42.42.5(pid=2504): stderr: | 20221210060907696 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060907696 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060907696 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060907696 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060907699 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060907699 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060907699 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:09:09.454392 run patchelf(pid=2507): Terminating (SIGINT) 06:09:09.629267 run patchelf(pid=2507): Terminated: ok {rc=0} 06:09:09.754630 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=2504): Process ended prematurely: osmo-stp_10.42.42.5(pid=2504) [trial-2370↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2504)] [trial-2370↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27] 06:09:09.763988 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 06:09:09.791967 run osmo-hlr_10.42.42.2(pid=2501): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2501)] 06:09:09.841232 run osmo-hlr_10.42.42.2(pid=2501): stdout: | (launched: 2022-12-10_06:09:06.539919) 06:09:09.892214 run osmo-hlr_10.42.42.2(pid=2501): stderr: | 20221210060906738 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210060906738 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210060906738 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210060906738 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210060906738 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210060906738 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210060906751 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-umtrx+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210060906761 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210060906761 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210060906762 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:09:09.943471 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2500): Terminating (SIGTERM) 06:09:09.984448 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2503): Terminating (SIGTERM) 06:09:10.025796 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2506): Terminating (SIGTERM) 06:09:10.067431 --- ParallelTerminationStrategy: PID 2500 died... 06:09:10.087318 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2500): Terminated: ok {rc=0} 06:09:10.132796 --- ParallelTerminationStrategy: PID 2503 died... 06:09:10.152136 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2503): Terminated: ok {rc=0} 06:09:10.197520 --- ParallelTerminationStrategy: PID 2506 died... 06:09:10.217169 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2506): Terminated: ok {rc=0} 06:09:10.303467 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2370 gprs:trx-umtrx+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 gprs:trx-umtrx+mod-bts0-dynts-ipa --------------------------------------------------------------------- 06:09:11.607443 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:09:11.614003 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 06:09:11.646467 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 06:09:11.685080 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 06:09:11.772575 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 06:09:11.805217 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 06:09:11.843809 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 06:09:12.439048 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2370 gprs:trx-umtrx+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 06:09:12.489871 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:09:12.500887 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:09:12.570698 tst cs_paging_gprs_active.py: using LAC 26383 06:09:12.694908 tst cs_paging_gprs_active.py: using RAC 118 06:09:12.820915 tst cs_paging_gprs_active.py: using CellId 26383 06:09:12.946161 tst cs_paging_gprs_active.py: using BVCI 26384 06:09:13.062335 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:09:13.073646 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:09:13.084664 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:09:13.095801 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:09:13.106839 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:09:13.118104 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:09:13.129318 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:09:13.140304 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:09:13.151525 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:09:13.265481 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:09:13.383596 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 06:09:13.597612 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:09:13.914540 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2513): Launched 06:09:14.189330 run iperf3-srv_10.42.42.10(pid=2514): Launched 06:09:14.307726 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 06:09:14.519846 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:09:14.836938 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2515): Launched 06:09:15.111526 run iperf3-srv_10.42.42.10(pid=2516): Launched 06:09:15.230010 tst cs_paging_gprs_active.py:38: start network... 06:09:15.442205 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:09:15.961243 run create_hlr_db(pid=2517): Launched 06:09:16.121825 bus /gobi_6: Setting Powered False 06:09:17.183288 run create_hlr_db(pid=2517): Terminated: ok {rc=0} 06:09:17.606784 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2519): Launched 06:09:17.902350 run osmo-hlr_10.42.42.2(pid=2520): Launched 06:09:18.015014 run osmo-stp_10.42.42.5: Starting osmo-stp 06:09:18.536596 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2522): Launched 06:09:18.831303 run osmo-stp_10.42.42.5(pid=2523): Launched 06:09:18.943392 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:09:19.451016 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2525): Launched 06:09:19.564899 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:09:19.820400 run patchelf(pid=2526): Launched 06:09:19.985669 run osmo-stp_10.42.42.5(pid=2523): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2523)] 06:09:20.110768 run osmo-stp_10.42.42.5(pid=2523): stdout: | (launched: 2022-12-10_06:09:18.777315) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:09:20.237566 run osmo-stp_10.42.42.5(pid=2523): stderr: | 20221210060918944 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060918944 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060918944 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060918945 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060918947 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060918947 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060918947 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:09:20.364486 run osmo-stp_10.42.42.5(pid=2523): stdout: | (launched: 2022-12-10_06:09:18.777315) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:09:20.485994 run osmo-stp_10.42.42.5(pid=2523): stderr: | 20221210060918944 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060918944 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060918944 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060918945 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060918947 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060918947 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060918947 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:09:20.630326 run patchelf(pid=2526): Terminating (SIGINT) 06:09:20.796455 run patchelf(pid=2526): Terminated: ok {rc=0} 06:09:20.916203 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=2523): Process ended prematurely: osmo-stp_10.42.42.5(pid=2523) [trial-2370↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2523)] [trial-2370↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 06:09:20.925820 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 06:09:20.953309 run osmo-hlr_10.42.42.2(pid=2520): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2520)] 06:09:21.000089 run osmo-hlr_10.42.42.2(pid=2520): stdout: | (launched: 2022-12-10_06:09:17.848484) 06:09:21.048495 run osmo-hlr_10.42.42.2(pid=2520): stderr: | 20221210060918022 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210060918022 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210060918022 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210060918022 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210060918022 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210060918023 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210060918035 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-umtrx+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210060918044 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210060918044 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210060918044 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:09:21.097541 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2513): Terminating (SIGTERM) 06:09:21.136832 run iperf3-srv_10.42.42.10(pid=2514): Terminating (SIGTERM) 06:09:21.176207 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2515): Terminating (SIGTERM) 06:09:21.215372 run iperf3-srv_10.42.42.10(pid=2516): Terminating (SIGTERM) 06:09:21.254315 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2519): Terminating (SIGTERM) 06:09:21.293273 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2522): Terminating (SIGTERM) 06:09:21.332286 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2525): Terminating (SIGTERM) 06:09:21.371503 --- ParallelTerminationStrategy: PID 2513 died... 06:09:21.390245 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2513): Terminated: ok {rc=0} 06:09:21.434099 --- ParallelTerminationStrategy: PID 2514 died... 06:09:21.452221 run iperf3-srv_10.42.42.10(pid=2514): Terminated {rc=256} 06:09:21.495579 --- ParallelTerminationStrategy: PID 2515 died... 06:09:21.513963 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2515): Terminated: ok {rc=0} 06:09:21.557414 --- ParallelTerminationStrategy: PID 2516 died... 06:09:21.575657 run iperf3-srv_10.42.42.10(pid=2516): Terminated {rc=256} 06:09:21.618951 --- ParallelTerminationStrategy: PID 2519 died... 06:09:21.637339 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2519): Terminated: ok {rc=0} 06:09:21.680687 --- ParallelTerminationStrategy: PID 2522 died... 06:09:21.699070 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2522): Terminated: ok {rc=0} 06:09:21.742538 --- ParallelTerminationStrategy: PID 2525 died... 06:09:21.760799 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2525): Terminated: ok {rc=0} 06:09:21.842685 bus /gobi_0: Setting Powered False 06:09:22.940812 bus /gobi_0: Setting Powered False 06:09:24.055364 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 06:09:25.201347 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:09:25.213382 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:09:25.284034 tst iperf3.py: using LAC 26384 06:09:25.410004 tst iperf3.py: using RAC 119 06:09:25.533472 tst iperf3.py: using CellId 26384 06:09:25.657411 tst iperf3.py: using BVCI 26385 06:09:25.772388 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:09:25.783636 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:09:25.794781 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:09:25.805842 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:09:25.816732 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:09:25.827771 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:09:25.838869 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:09:25.849874 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:09:25.861012 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:09:25.977863 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 06:09:26.191853 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:09:26.508093 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2527): Launched 06:09:26.784088 run iperf3-srv_10.42.42.10(pid=2528): Launched 06:09:26.902573 tst iperf3.py:8: start network... 06:09:27.115260 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:09:27.604445 run create_hlr_db(pid=2529): Launched 06:09:27.731598 bus /gobi_6: Setting Powered False 06:09:28.794016 run create_hlr_db(pid=2529): Terminated: ok {rc=0} 06:09:29.213154 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2531): Launched 06:09:29.507934 run osmo-hlr_10.42.42.2(pid=2532): Launched 06:09:29.621905 run osmo-stp_10.42.42.5: Starting osmo-stp 06:09:30.229831 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2534): Launched 06:09:30.518969 run osmo-stp_10.42.42.5(pid=2535): Launched 06:09:30.630755 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:09:31.157126 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2537): Launched 06:09:31.280212 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:09:31.535573 run patchelf(pid=2538): Launched 06:09:31.717499 run osmo-stp_10.42.42.5(pid=2535): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2535)] 06:09:31.845086 run osmo-stp_10.42.42.5(pid=2535): stdout: | (launched: 2022-12-10_06:09:30.466253) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:09:31.973734 run osmo-stp_10.42.42.5(pid=2535): stderr: | 20221210060930635 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060930636 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060930636 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060930636 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060930637 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060930637 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060930637 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:09:32.102754 run osmo-stp_10.42.42.5(pid=2535): stdout: | (launched: 2022-12-10_06:09:30.466253) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:09:32.225935 run osmo-stp_10.42.42.5(pid=2535): stderr: | 20221210060930635 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060930636 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060930636 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060930636 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060930637 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060930637 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060930637 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:09:32.367489 run patchelf(pid=2538): Terminating (SIGINT) 06:09:32.531159 run patchelf(pid=2538): Terminated: ok {rc=0} 06:09:32.649928 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2535): Process ended prematurely: osmo-stp_10.42.42.5(pid=2535) [trial-2370↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2535)] [trial-2370↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8] 06:09:32.659239 tst iperf3.py:8: Test FAILED (7.5 sec) 06:09:32.686700 run osmo-hlr_10.42.42.2(pid=2532): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2532)] 06:09:32.734269 run osmo-hlr_10.42.42.2(pid=2532): stdout: | (launched: 2022-12-10_06:09:29.453609) 06:09:32.783417 run osmo-hlr_10.42.42.2(pid=2532): stderr: | 20221210060929628 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210060929628 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210060929628 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210060929628 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210060929628 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210060929628 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210060929640 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210060929651 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210060929651 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210060929651 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:09:32.832798 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2527): Terminating (SIGTERM) 06:09:32.871939 run iperf3-srv_10.42.42.10(pid=2528): Terminating (SIGTERM) 06:09:32.910987 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2531): Terminating (SIGTERM) 06:09:32.950023 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2534): Terminating (SIGTERM) 06:09:32.988663 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2537): Terminating (SIGTERM) 06:09:33.027931 --- ParallelTerminationStrategy: PID 2527 died... 06:09:33.046496 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2527): Terminated: ok {rc=0} 06:09:33.090185 --- ParallelTerminationStrategy: PID 2528 died... 06:09:33.108264 run iperf3-srv_10.42.42.10(pid=2528): Terminated {rc=256} 06:09:33.151636 --- ParallelTerminationStrategy: PID 2531 died... 06:09:33.170031 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2531): Terminated: ok {rc=0} 06:09:33.213155 --- ParallelTerminationStrategy: PID 2534 died... 06:09:33.231292 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2534): Terminated: ok {rc=0} 06:09:33.274568 --- ParallelTerminationStrategy: PID 2537 died... 06:09:33.292609 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2537): Terminated: ok {rc=0} 06:09:33.376379 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 06:09:34.520150 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:09:34.531637 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:09:34.600671 tst iperf3m4.py: using LAC 26385 06:09:34.714879 tst iperf3m4.py: using RAC 120 06:09:34.830615 tst iperf3m4.py: using CellId 26385 06:09:34.945440 tst iperf3m4.py: using BVCI 26386 06:09:35.059168 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:09:35.070471 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:09:35.081526 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:09:35.092537 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:09:35.103633 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:09:35.114684 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:09:35.125925 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:09:35.136752 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:09:35.147930 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:09:35.261368 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:09:35.377724 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:09:35.494526 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:09:35.611833 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 06:09:35.820451 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:09:36.131871 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2539): Launched 06:09:36.402845 run iperf3-srv_10.42.42.10(pid=2540): Launched 06:09:36.519639 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 06:09:36.728464 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:09:37.039984 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2541): Launched 06:09:37.309387 run iperf3-srv_10.42.42.10(pid=2542): Launched 06:09:37.425514 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 06:09:37.633998 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:09:37.943850 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2543): Launched 06:09:38.213581 run iperf3-srv_10.42.42.10(pid=2544): Launched 06:09:38.329445 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 06:09:38.537007 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:09:38.847252 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2545): Launched 06:09:39.116831 run iperf3-srv_10.42.42.10(pid=2546): Launched 06:09:39.232691 tst iperf3m4.py:8: start network... 06:09:39.439838 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:09:39.920610 run create_hlr_db(pid=2547): Launched 06:09:40.048084 bus /gobi_6: Setting Powered False 06:09:41.109419 run create_hlr_db(pid=2547): Terminated: ok {rc=0} 06:09:41.524543 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2549): Launched 06:09:41.817963 run osmo-hlr_10.42.42.2(pid=2550): Launched 06:09:41.929085 run osmo-stp_10.42.42.5: Starting osmo-stp 06:09:42.430946 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2552): Launched 06:09:42.720396 run osmo-stp_10.42.42.5(pid=2553): Launched 06:09:42.830976 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:09:43.332359 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2555): Launched 06:09:43.444034 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:09:43.689081 run patchelf(pid=2556): Launched 06:09:43.850917 run osmo-stp_10.42.42.5(pid=2553): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2553)] 06:09:43.974651 run osmo-stp_10.42.42.5(pid=2553): stdout: | (launched: 2022-12-10_06:09:42.667479) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:09:44.099447 run osmo-stp_10.42.42.5(pid=2553): stderr: | 20221210060942836 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060942837 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060942837 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060942837 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060942838 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060942838 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060942838 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:09:44.224560 run osmo-stp_10.42.42.5(pid=2553): stdout: | (launched: 2022-12-10_06:09:42.667479) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:09:44.344118 run osmo-stp_10.42.42.5(pid=2553): stderr: | 20221210060942836 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060942837 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060942837 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060942837 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060942838 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060942838 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060942838 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:09:44.485828 run patchelf(pid=2556): Terminating (SIGINT) 06:09:44.648325 run patchelf(pid=2556): Terminated: ok {rc=0} 06:09:44.765694 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2553): Process ended prematurely: osmo-stp_10.42.42.5(pid=2553) [trial-2370↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2553)] [trial-2370↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8] 06:09:44.775177 tst iperf3m4.py:8: Test FAILED (10.3 sec) 06:09:44.802945 run osmo-hlr_10.42.42.2(pid=2550): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2550)] 06:09:44.850763 run osmo-hlr_10.42.42.2(pid=2550): stdout: | (launched: 2022-12-10_06:09:41.763601) 06:09:44.899945 run osmo-hlr_10.42.42.2(pid=2550): stderr: | 20221210060941939 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210060941939 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210060941940 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210060941940 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210060941940 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210060941940 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210060941954 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210060941962 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210060941962 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210060941962 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:09:44.949427 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2539): Terminating (SIGTERM) 06:09:44.988711 run iperf3-srv_10.42.42.10(pid=2540): Terminating (SIGTERM) 06:09:45.027917 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2541): Terminating (SIGTERM) 06:09:45.067231 run iperf3-srv_10.42.42.10(pid=2542): Terminating (SIGTERM) 06:09:45.106442 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2543): Terminating (SIGTERM) 06:09:45.145568 run iperf3-srv_10.42.42.10(pid=2544): Terminating (SIGTERM) 06:09:45.184450 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2545): Terminating (SIGTERM) 06:09:45.223761 run iperf3-srv_10.42.42.10(pid=2546): Terminating (SIGTERM) 06:09:45.263192 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2549): Terminating (SIGTERM) 06:09:45.302586 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2552): Terminating (SIGTERM) 06:09:45.341734 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2555): Terminating (SIGTERM) 06:09:45.381314 --- ParallelTerminationStrategy: PID 2539 died... 06:09:45.399983 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2539): Terminated: ok {rc=0} 06:09:45.443587 --- ParallelTerminationStrategy: PID 2540 died... 06:09:45.461685 run iperf3-srv_10.42.42.10(pid=2540): Terminated {rc=256} 06:09:45.504829 --- ParallelTerminationStrategy: PID 2541 died... 06:09:45.523466 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2541): Terminated: ok {rc=0} 06:09:45.566939 --- ParallelTerminationStrategy: PID 2542 died... 06:09:45.585133 run iperf3-srv_10.42.42.10(pid=2542): Terminated {rc=256} 06:09:45.628123 --- ParallelTerminationStrategy: PID 2543 died... 06:09:45.646553 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2543): Terminated: ok {rc=0} 06:09:45.690031 --- ParallelTerminationStrategy: PID 2544 died... 06:09:45.708065 run iperf3-srv_10.42.42.10(pid=2544): Terminated {rc=256} 06:09:45.751901 --- ParallelTerminationStrategy: PID 2545 died... 06:09:45.770160 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2545): Terminated: ok {rc=0} 06:09:45.813524 --- ParallelTerminationStrategy: PID 2546 died... 06:09:45.832040 run iperf3-srv_10.42.42.10(pid=2546): Terminated {rc=256} 06:09:45.882531 --- ParallelTerminationStrategy: PID 2549 died... 06:09:45.915507 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2549): Terminated: ok {rc=0} 06:09:45.959662 --- ParallelTerminationStrategy: PID 2552 died... 06:09:45.978535 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2552): Terminated: ok {rc=0} 06:09:46.024643 --- ParallelTerminationStrategy: PID 2555 died... 06:09:46.045957 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2555): Terminated: ok {rc=0} 06:09:46.132065 bus /gobi_4: Setting Powered False 06:09:47.236870 bus /gobi_4: Setting Powered False 06:09:48.352234 bus /gobi_1: Setting Powered False 06:09:49.450349 bus /gobi_1: Setting Powered False 06:09:50.564143 bus /gobi_0: Setting Powered False 06:09:51.661895 bus /gobi_0: Setting Powered False 06:09:52.775194 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-umtrx+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 06:09:53.876068 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:09:53.887587 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:09:53.957590 tst ping.py: using LAC 26386 06:09:54.078732 tst ping.py: using RAC 121 06:09:54.198778 tst ping.py: using CellId 26386 06:09:54.319524 tst ping.py: using BVCI 26387 06:09:54.431023 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:09:54.442421 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:09:54.453733 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:09:54.465207 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:09:54.476609 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:09:54.488198 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:09:54.499750 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:09:54.511301 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:09:54.625231 tst ping.py:19: start network... 06:09:54.814599 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:09:55.256504 run create_hlr_db(pid=2557): Launched 06:09:55.365912 bus /gobi_6: Setting Powered False 06:09:56.423254 run create_hlr_db(pid=2557): Terminated: ok {rc=0} 06:09:56.840644 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2559): Launched 06:09:57.145614 run osmo-hlr_10.42.42.2(pid=2560): Launched 06:09:57.262035 run osmo-stp_10.42.42.5: Starting osmo-stp 06:09:57.786627 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2562): Launched 06:09:58.091298 run osmo-stp_10.42.42.5(pid=2563): Launched 06:09:58.207746 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:09:58.733429 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2565): Launched 06:09:58.850130 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:09:59.107224 run patchelf(pid=2566): Launched 06:09:59.276836 run osmo-stp_10.42.42.5(pid=2563): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2563)] 06:09:59.406952 run osmo-stp_10.42.42.5(pid=2563): stdout: | (launched: 2022-12-10_06:09:58.035902) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:09:59.538355 run osmo-stp_10.42.42.5(pid=2563): stderr: | 20221210060958223 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060958223 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060958224 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060958224 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060958224 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060958225 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060958225 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:09:59.670006 run osmo-stp_10.42.42.5(pid=2563): stdout: | (launched: 2022-12-10_06:09:58.035902) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:09:59.795143 run osmo-stp_10.42.42.5(pid=2563): stderr: | 20221210060958223 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210060958223 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210060958224 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210060958224 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210060958224 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210060958225 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210060958225 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:09:59.943686 run patchelf(pid=2566): Terminating (SIGINT) 06:10:00.114849 run patchelf(pid=2566): Terminated: ok {rc=0} 06:10:00.237838 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=2563): Process ended prematurely: osmo-stp_10.42.42.5(pid=2563) [trial-2370↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2563)] [trial-2370↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22] 06:10:00.247271 tst ping.py:22: Test FAILED (6.4 sec) 06:10:00.275073 run osmo-hlr_10.42.42.2(pid=2560): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2560)] 06:10:00.324526 run osmo-hlr_10.42.42.2(pid=2560): stdout: | (launched: 2022-12-10_06:09:57.090016) 06:10:00.375518 run osmo-hlr_10.42.42.2(pid=2560): stderr: | 20221210060957286 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210060957286 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210060957286 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210060957286 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210060957286 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210060957286 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210060957298 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210060957306 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210060957306 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210060957306 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:10:00.426951 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2559): Terminating (SIGTERM) 06:10:00.468231 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2562): Terminating (SIGTERM) 06:10:00.509665 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2565): Terminating (SIGTERM) 06:10:00.551536 --- ParallelTerminationStrategy: PID 2559 died... 06:10:00.571276 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2559): Terminated: ok {rc=0} 06:10:00.616691 --- ParallelTerminationStrategy: PID 2562 died... 06:10:00.635944 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2562): Terminated: ok {rc=0} 06:10:00.680923 --- ParallelTerminationStrategy: PID 2565 died... 06:10:00.700199 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2565): Terminated: ok {rc=0} 06:10:00.785862 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-umtrx+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 06:10:01.873699 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:10:01.888738 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:10:01.981602 tst ping_idle_ping.py: using LAC 26387 06:10:02.130482 tst ping_idle_ping.py: using RAC 122 06:10:02.294785 tst ping_idle_ping.py: using CellId 26387 06:10:02.411490 tst ping_idle_ping.py: using BVCI 26388 06:10:02.523394 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:10:02.535304 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:10:02.547315 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:10:02.558654 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:10:02.569971 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:10:02.581252 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:10:02.592652 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:10:02.603770 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:10:02.717517 tst ping_idle_ping.py:24: start network... 06:10:02.907748 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:10:03.349275 run create_hlr_db(pid=2577): Launched 06:10:03.459143 bus /gobi_6: Setting Powered False 06:10:04.516438 run create_hlr_db(pid=2577): Terminated: ok {rc=0} 06:10:04.935982 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2579): Launched 06:10:05.242250 run osmo-hlr_10.42.42.2(pid=2580): Launched 06:10:05.358502 run osmo-stp_10.42.42.5: Starting osmo-stp 06:10:05.884476 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2582): Launched 06:10:06.190473 run osmo-stp_10.42.42.5(pid=2583): Launched 06:10:06.307142 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:10:06.835280 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2585): Launched 06:10:06.952311 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:10:07.211586 run patchelf(pid=2586): Launched 06:10:07.382909 run osmo-stp_10.42.42.5(pid=2583): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2583)] 06:10:07.513344 run osmo-stp_10.42.42.5(pid=2583): stdout: | (launched: 2022-12-10_06:10:06.134905) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:10:07.646103 run osmo-stp_10.42.42.5(pid=2583): stderr: | 20221210061006322 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061006322 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061006322 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061006323 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061006323 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061006323 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061006323 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:10:07.778185 run osmo-stp_10.42.42.5(pid=2583): stdout: | (launched: 2022-12-10_06:10:06.134905) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:10:07.903975 run osmo-stp_10.42.42.5(pid=2583): stderr: | 20221210061006322 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061006322 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061006322 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061006323 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061006323 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061006323 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061006323 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:10:08.053506 run patchelf(pid=2586): Terminating (SIGINT) 06:10:08.226039 run patchelf(pid=2586): Terminated: ok {rc=0} 06:10:08.350311 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=2583): Process ended prematurely: osmo-stp_10.42.42.5(pid=2583) [trial-2370↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2583)] [trial-2370↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 06:10:08.359849 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 06:10:08.387684 run osmo-hlr_10.42.42.2(pid=2580): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2580)] 06:10:08.437298 run osmo-hlr_10.42.42.2(pid=2580): stdout: | (launched: 2022-12-10_06:10:05.186614) 06:10:08.488697 run osmo-hlr_10.42.42.2(pid=2580): stderr: | 20221210061005382 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210061005382 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210061005382 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210061005382 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210061005382 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210061005382 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210061005394 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210061005404 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210061005404 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210061005404 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:10:08.540829 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2579): Terminating (SIGTERM) 06:10:08.582446 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2582): Terminating (SIGTERM) 06:10:08.624089 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2585): Terminating (SIGTERM) 06:10:08.665892 --- ParallelTerminationStrategy: PID 2579 died... 06:10:08.685775 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2579): Terminated: ok {rc=0} 06:10:08.731524 --- ParallelTerminationStrategy: PID 2582 died... 06:10:08.750943 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2582): Terminated: ok {rc=0} 06:10:08.796594 --- ParallelTerminationStrategy: PID 2585 died... 06:10:08.816004 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2585): Terminated: ok {rc=0} 06:10:08.903016 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2370 gprs:trx-umtrx+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 gprs:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 06:10:10.201202 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:10:10.207166 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 06:10:10.240001 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 06:10:10.277732 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 06:10:10.362739 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 06:10:10.394650 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 06:10:10.432424 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 06:10:11.025479 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2370 gprs:trx-umtrx+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 06:10:11.072781 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:10:11.083854 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 06:10:11.152406 tst cs_paging_gprs_active.py: using LAC 26388 06:10:11.268347 tst cs_paging_gprs_active.py: using RAC 123 06:10:11.382368 tst cs_paging_gprs_active.py: using CellId 26388 06:10:11.501413 tst cs_paging_gprs_active.py: using BVCI 26389 06:10:11.608485 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:10:11.619430 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:10:11.630120 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:10:11.641212 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:10:11.652117 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:10:11.663092 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:10:11.674092 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:10:11.684928 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:10:11.695962 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:10:11.813482 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:10:11.932314 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 06:10:12.128639 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:10:12.441809 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2594): Launched 06:10:12.722997 run iperf3-srv_10.42.42.10(pid=2613): Launched 06:10:12.859124 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 06:10:13.075169 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:10:13.408186 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2756): Launched 06:10:13.697868 run iperf3-srv_10.42.42.10(pid=2786): Launched 06:10:13.823488 tst cs_paging_gprs_active.py:38: start network... 06:10:14.029027 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:10:14.523837 run create_hlr_db(pid=2946): Launched 06:10:14.654393 bus /gobi_6: Setting Powered False 06:10:15.716477 run create_hlr_db(pid=2946): Terminated: ok {rc=0} 06:10:16.194244 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2948): Launched 06:10:16.514816 run osmo-hlr_10.42.42.2(pid=2949): Launched 06:10:16.674687 run osmo-stp_10.42.42.5: Starting osmo-stp 06:10:17.556460 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2951): Launched 06:10:17.868708 run osmo-stp_10.42.42.5(pid=2952): Launched 06:10:17.987430 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:10:18.525085 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2954): Launched 06:10:18.645225 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:10:18.910164 run patchelf(pid=2955): Launched 06:10:19.084586 run osmo-stp_10.42.42.5(pid=2952): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2952)] 06:10:19.217700 run osmo-stp_10.42.42.5(pid=2952): stdout: | (launched: 2022-12-10_06:10:17.812029) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:10:19.351791 run osmo-stp_10.42.42.5(pid=2952): stderr: | 20221210061018004 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061018004 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061018004 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061018005 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061018005 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061018005 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061018005 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:10:19.486101 run osmo-stp_10.42.42.5(pid=2952): stdout: | (launched: 2022-12-10_06:10:17.812029) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:10:19.614942 run osmo-stp_10.42.42.5(pid=2952): stderr: | 20221210061018004 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061018004 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061018004 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061018005 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061018005 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061018005 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061018005 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:10:19.767399 run patchelf(pid=2955): Terminating (SIGINT) 06:10:19.942126 run patchelf(pid=2955): Terminated: ok {rc=0} 06:10:20.068526 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=2952): Process ended prematurely: osmo-stp_10.42.42.5(pid=2952) [trial-2370↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2952)] [trial-2370↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 06:10:20.078753 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 06:10:20.106903 run osmo-hlr_10.42.42.2(pid=2949): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2949)] 06:10:20.156233 run osmo-hlr_10.42.42.2(pid=2949): stdout: | (launched: 2022-12-10_06:10:16.454357) 06:10:20.207367 run osmo-hlr_10.42.42.2(pid=2949): stderr: | 20221210061016917 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210061016917 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210061016917 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210061016917 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210061016917 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210061016918 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210061016944 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-umtrx+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210061016963 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210061016964 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210061016964 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:10:20.259027 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2594): Terminating (SIGTERM) 06:10:20.300309 run iperf3-srv_10.42.42.10(pid=2613): Terminating (SIGTERM) 06:10:20.341783 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2756): Terminating (SIGTERM) 06:10:20.383160 run iperf3-srv_10.42.42.10(pid=2786): Terminating (SIGTERM) 06:10:20.424390 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2948): Terminating (SIGTERM) 06:10:20.465819 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2951): Terminating (SIGTERM) 06:10:20.507139 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2954): Terminating (SIGTERM) 06:10:20.548895 --- ParallelTerminationStrategy: PID 2594 died... 06:10:20.568667 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2594): Terminated: ok {rc=0} 06:10:20.614624 --- ParallelTerminationStrategy: PID 2613 died... 06:10:20.633900 run iperf3-srv_10.42.42.10(pid=2613): Terminated {rc=256} 06:10:20.679423 --- ParallelTerminationStrategy: PID 2756 died... 06:10:20.698724 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2756): Terminated: ok {rc=0} 06:10:20.744526 --- ParallelTerminationStrategy: PID 2786 died... 06:10:20.763778 run iperf3-srv_10.42.42.10(pid=2786): Terminated {rc=256} 06:10:20.809253 --- ParallelTerminationStrategy: PID 2948 died... 06:10:20.828411 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2948): Terminated: ok {rc=0} 06:10:20.873953 --- ParallelTerminationStrategy: PID 2951 died... 06:10:20.893183 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2951): Terminated: ok {rc=0} 06:10:20.938471 --- ParallelTerminationStrategy: PID 2954 died... 06:10:20.957702 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2954): Terminated: ok {rc=0} 06:10:21.043446 bus /gobi_0: Setting Powered False 06:10:22.142566 bus /gobi_0: Setting Powered False 06:10:23.255792 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 06:10:24.408453 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:10:24.421323 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 06:10:24.496340 tst iperf3.py: using LAC 26389 06:10:24.621295 tst iperf3.py: using RAC 124 06:10:24.742533 tst iperf3.py: using CellId 26389 06:10:24.866066 tst iperf3.py: using BVCI 26390 06:10:24.981457 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:10:24.994898 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:10:25.006961 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:10:25.019469 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:10:25.032481 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:10:25.045450 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:10:25.057532 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:10:25.071014 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:10:25.083784 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:10:25.207055 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 06:10:25.419543 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:10:25.743464 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3131): Launched 06:10:26.038344 run iperf3-srv_10.42.42.10(pid=3132): Launched 06:10:26.170567 tst iperf3.py:8: start network... 06:10:26.382948 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:10:26.879970 run create_hlr_db(pid=3133): Launched 06:10:27.042830 bus /gobi_6: Setting Powered False 06:10:28.107370 run create_hlr_db(pid=3133): Terminated: ok {rc=0} 06:10:28.557469 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3136): Launched 06:10:28.886271 run osmo-hlr_10.42.42.2(pid=3137): Launched 06:10:29.005105 run osmo-stp_10.42.42.5: Starting osmo-stp 06:10:29.544131 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3139): Launched 06:10:29.859296 run osmo-stp_10.42.42.5(pid=3140): Launched 06:10:29.978802 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:10:30.517632 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3142): Launched 06:10:30.637718 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:10:30.905757 run patchelf(pid=3143): Launched 06:10:31.097676 run osmo-stp_10.42.42.5(pid=3140): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3140)] 06:10:31.232939 run osmo-stp_10.42.42.5(pid=3140): stdout: | (launched: 2022-12-10_06:10:29.800435) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:10:31.369086 run osmo-stp_10.42.42.5(pid=3140): stderr: | 20221210061029991 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061029991 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061029992 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061029992 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061029993 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061029993 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061029993 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:10:31.505262 run osmo-stp_10.42.42.5(pid=3140): stdout: | (launched: 2022-12-10_06:10:29.800435) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:10:31.635500 run osmo-stp_10.42.42.5(pid=3140): stderr: | 20221210061029991 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061029991 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061029992 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061029992 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061029993 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061029993 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061029993 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:10:31.790517 run patchelf(pid=3143): Terminating (SIGINT) 06:10:31.968715 run patchelf(pid=3143): Terminated: ok {rc=0} 06:10:32.097493 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3140): Process ended prematurely: osmo-stp_10.42.42.5(pid=3140) [trial-2370↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3140)] [trial-2370↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8] 06:10:32.108681 tst iperf3.py:8: Test FAILED (7.7 sec) 06:10:32.139356 run osmo-hlr_10.42.42.2(pid=3137): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3137)] 06:10:32.190008 run osmo-hlr_10.42.42.2(pid=3137): stdout: | (launched: 2022-12-10_06:10:28.828760) 06:10:32.246363 run osmo-hlr_10.42.42.2(pid=3137): stderr: | 20221210061029025 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210061029025 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210061029025 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210061029025 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210061029025 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210061029025 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210061029038 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210061029046 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210061029047 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210061029047 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:10:32.299657 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3131): Terminating (SIGTERM) 06:10:32.341733 run iperf3-srv_10.42.42.10(pid=3132): Terminating (SIGTERM) 06:10:32.383170 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3136): Terminating (SIGTERM) 06:10:32.424757 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3139): Terminating (SIGTERM) 06:10:32.466382 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3142): Terminating (SIGTERM) 06:10:32.508195 --- ParallelTerminationStrategy: PID 3131 died... 06:10:32.528098 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3131): Terminated: ok {rc=0} 06:10:32.574910 --- ParallelTerminationStrategy: PID 3132 died... 06:10:32.594493 run iperf3-srv_10.42.42.10(pid=3132): Terminated {rc=256} 06:10:32.643038 --- ParallelTerminationStrategy: PID 3136 died... 06:10:32.662596 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3136): Terminated: ok {rc=0} 06:10:32.708661 --- ParallelTerminationStrategy: PID 3139 died... 06:10:32.728166 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3139): Terminated: ok {rc=0} 06:10:32.773967 --- ParallelTerminationStrategy: PID 3142 died... 06:10:32.793450 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3142): Terminated: ok {rc=0} 06:10:32.880564 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 06:10:34.022602 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:10:34.037402 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 06:10:34.104058 tst iperf3m4.py: using LAC 26390 06:10:34.217388 tst iperf3m4.py: using RAC 125 06:10:34.330108 tst iperf3m4.py: using CellId 26390 06:10:34.442952 tst iperf3m4.py: using BVCI 26391 06:10:34.548693 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:10:34.559566 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:10:34.570482 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:10:34.581550 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:10:34.592396 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:10:34.603325 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:10:34.614462 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:10:34.625393 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:10:34.636323 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:10:34.748260 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:10:34.868396 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:10:34.984202 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:10:35.102555 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 06:10:35.313306 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:10:35.626381 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3144): Launched 06:10:35.897638 run iperf3-srv_10.42.42.10(pid=3145): Launched 06:10:36.014357 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 06:10:36.223208 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:10:36.534796 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3146): Launched 06:10:36.807137 run iperf3-srv_10.42.42.10(pid=3147): Launched 06:10:36.923778 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 06:10:37.132903 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:10:37.446594 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3148): Launched 06:10:37.717608 run iperf3-srv_10.42.42.10(pid=3149): Launched 06:10:37.834054 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 06:10:38.042995 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:10:38.354520 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3150): Launched 06:10:38.626237 run iperf3-srv_10.42.42.10(pid=3151): Launched 06:10:38.742494 tst iperf3m4.py:8: start network... 06:10:38.951077 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:10:39.433299 run create_hlr_db(pid=3152): Launched 06:10:39.561879 bus /gobi_6: Setting Powered False 06:10:40.620824 run create_hlr_db(pid=3152): Terminated: ok {rc=0} 06:10:41.056142 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3154): Launched 06:10:41.369082 run osmo-hlr_10.42.42.2(pid=3155): Launched 06:10:41.488289 run osmo-stp_10.42.42.5: Starting osmo-stp 06:10:42.026705 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3157): Launched 06:10:42.339078 run osmo-stp_10.42.42.5(pid=3158): Launched 06:10:42.457466 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:10:42.995990 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3160): Launched 06:10:43.115671 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:10:43.378902 run patchelf(pid=3161): Launched 06:10:43.552562 run osmo-stp_10.42.42.5(pid=3158): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3158)] 06:10:43.685799 run osmo-stp_10.42.42.5(pid=3158): stdout: | (launched: 2022-12-10_06:10:42.281856) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:10:43.819570 run osmo-stp_10.42.42.5(pid=3158): stderr: | 20221210061042472 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061042472 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061042472 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061042473 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061042473 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061042473 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061042473 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:10:43.953537 run osmo-stp_10.42.42.5(pid=3158): stdout: | (launched: 2022-12-10_06:10:42.281856) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:10:44.081776 run osmo-stp_10.42.42.5(pid=3158): stderr: | 20221210061042472 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061042472 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061042472 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061042473 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061042473 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061042473 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061042473 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:10:44.233832 run patchelf(pid=3161): Terminating (SIGINT) 06:10:44.408678 run patchelf(pid=3161): Terminated: ok {rc=0} 06:10:44.534950 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3158): Process ended prematurely: osmo-stp_10.42.42.5(pid=3158) [trial-2370↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3158)] [trial-2370↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8] 06:10:44.545086 tst iperf3m4.py:8: Test FAILED (10.6 sec) 06:10:44.573991 run osmo-hlr_10.42.42.2(pid=3155): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3155)] 06:10:44.623535 run osmo-hlr_10.42.42.2(pid=3155): stdout: | (launched: 2022-12-10_06:10:41.311907) 06:10:44.674720 run osmo-hlr_10.42.42.2(pid=3155): stderr: | 20221210061041510 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210061041510 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210061041510 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210061041510 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210061041511 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210061041511 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210061041523 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210061041534 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210061041534 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210061041534 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:10:44.726285 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3144): Terminating (SIGTERM) 06:10:44.767387 run iperf3-srv_10.42.42.10(pid=3145): Terminating (SIGTERM) 06:10:44.808804 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3146): Terminating (SIGTERM) 06:10:44.850640 run iperf3-srv_10.42.42.10(pid=3147): Terminating (SIGTERM) 06:10:44.891934 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3148): Terminating (SIGTERM) 06:10:44.933354 run iperf3-srv_10.42.42.10(pid=3149): Terminating (SIGTERM) 06:10:44.974524 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3150): Terminating (SIGTERM) 06:10:45.015750 run iperf3-srv_10.42.42.10(pid=3151): Terminating (SIGTERM) 06:10:45.057034 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3154): Terminating (SIGTERM) 06:10:45.098295 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3157): Terminating (SIGTERM) 06:10:45.139397 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3160): Terminating (SIGTERM) 06:10:45.180915 --- ParallelTerminationStrategy: PID 3144 died... 06:10:45.200590 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3144): Terminated: ok {rc=0} 06:10:45.246480 --- ParallelTerminationStrategy: PID 3145 died... 06:10:45.265726 run iperf3-srv_10.42.42.10(pid=3145): Terminated {rc=256} 06:10:45.311367 --- ParallelTerminationStrategy: PID 3146 died... 06:10:45.330994 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3146): Terminated: ok {rc=0} 06:10:45.377101 --- ParallelTerminationStrategy: PID 3147 died... 06:10:45.396404 run iperf3-srv_10.42.42.10(pid=3147): Terminated {rc=256} 06:10:45.441939 --- ParallelTerminationStrategy: PID 3148 died... 06:10:45.461313 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3148): Terminated: ok {rc=0} 06:10:45.506988 --- ParallelTerminationStrategy: PID 3149 died... 06:10:45.526306 run iperf3-srv_10.42.42.10(pid=3149): Terminated {rc=256} 06:10:45.572317 --- ParallelTerminationStrategy: PID 3150 died... 06:10:45.591724 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3150): Terminated: ok {rc=0} 06:10:45.637333 --- ParallelTerminationStrategy: PID 3151 died... 06:10:45.656622 run iperf3-srv_10.42.42.10(pid=3151): Terminated {rc=256} 06:10:45.702281 --- ParallelTerminationStrategy: PID 3154 died... 06:10:45.721584 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3154): Terminated: ok {rc=0} 06:10:45.767046 --- ParallelTerminationStrategy: PID 3157 died... 06:10:45.786458 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3157): Terminated: ok {rc=0} 06:10:45.832031 --- ParallelTerminationStrategy: PID 3160 died... 06:10:45.851278 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3160): Terminated: ok {rc=0} 06:10:45.965315 bus /gobi_4: Setting Powered False 06:10:47.064616 bus /gobi_4: Setting Powered False 06:10:48.181145 bus /gobi_1: Setting Powered False 06:10:49.278934 bus /gobi_1: Setting Powered False 06:10:50.394595 bus /gobi_0: Setting Powered False 06:10:51.491927 bus /gobi_0: Setting Powered False 06:10:52.604689 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-umtrx+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 06:10:53.706588 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:10:53.718742 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 06:10:53.789978 tst ping.py: using LAC 26391 06:10:53.911890 tst ping.py: using RAC 126 06:10:54.032308 tst ping.py: using CellId 26391 06:10:54.157156 tst ping.py: using BVCI 26392 06:10:54.269181 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:10:54.280396 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:10:54.291521 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:10:54.302660 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:10:54.313665 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:10:54.324606 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:10:54.335756 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:10:54.346859 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:10:54.463187 tst ping.py:19: start network... 06:10:54.668665 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:10:55.144081 run create_hlr_db(pid=3162): Launched 06:10:55.268885 bus /gobi_6: Setting Powered False 06:10:56.330548 run create_hlr_db(pid=3162): Terminated: ok {rc=0} 06:10:56.759617 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3164): Launched 06:10:57.065890 run osmo-hlr_10.42.42.2(pid=3165): Launched 06:10:57.182911 run osmo-stp_10.42.42.5: Starting osmo-stp 06:10:57.712266 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3167): Launched 06:10:58.017095 run osmo-stp_10.42.42.5(pid=3168): Launched 06:10:58.134212 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:10:58.692630 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3170): Launched 06:10:58.810199 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:10:59.068927 run patchelf(pid=3171): Launched 06:10:59.239502 run osmo-stp_10.42.42.5(pid=3168): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3168)] 06:10:59.370127 run osmo-stp_10.42.42.5(pid=3168): stdout: | (launched: 2022-12-10_06:10:57.960854) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:10:59.502867 run osmo-stp_10.42.42.5(pid=3168): stderr: | 20221210061058150 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061058150 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061058151 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061058151 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061058151 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061058151 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061058151 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:10:59.635668 run osmo-stp_10.42.42.5(pid=3168): stdout: | (launched: 2022-12-10_06:10:57.960854) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:10:59.761715 run osmo-stp_10.42.42.5(pid=3168): stderr: | 20221210061058150 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061058150 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061058151 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061058151 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061058151 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061058151 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061058151 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:10:59.910769 run patchelf(pid=3171): Terminating (SIGINT) 06:11:00.082254 run patchelf(pid=3171): Terminated: ok {rc=0} 06:11:00.205685 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=3168): Process ended prematurely: osmo-stp_10.42.42.5(pid=3168) [trial-2370↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3168)] [trial-2370↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22] 06:11:00.215258 tst ping.py:22: Test FAILED (6.5 sec) 06:11:00.243022 run osmo-hlr_10.42.42.2(pid=3165): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3165)] 06:11:00.292274 run osmo-hlr_10.42.42.2(pid=3165): stdout: | (launched: 2022-12-10_06:10:57.009975) 06:11:00.343129 run osmo-hlr_10.42.42.2(pid=3165): stderr: | 20221210061057205 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210061057205 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210061057205 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210061057205 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210061057206 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210061057206 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210061057218 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210061057229 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210061057229 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210061057229 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:11:00.394422 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3164): Terminating (SIGTERM) 06:11:00.435893 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3167): Terminating (SIGTERM) 06:11:00.477233 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3170): Terminating (SIGTERM) 06:11:00.518973 --- ParallelTerminationStrategy: PID 3164 died... 06:11:00.538863 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3164): Terminated: ok {rc=0} 06:11:00.585095 --- ParallelTerminationStrategy: PID 3167 died... 06:11:00.604461 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3167): Terminated: ok {rc=0} 06:11:00.649863 --- ParallelTerminationStrategy: PID 3170 died... 06:11:00.669153 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3170): Terminated: ok {rc=0} 06:11:00.756711 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-umtrx+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 06:11:01.847014 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:11:01.862109 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 06:11:01.958561 tst ping_idle_ping.py: using LAC 26392 06:11:02.120478 tst ping_idle_ping.py: using RAC 127 06:11:02.242290 tst ping_idle_ping.py: using CellId 26392 06:11:02.372770 tst ping_idle_ping.py: using BVCI 26393 06:11:02.478454 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:11:02.489355 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:11:02.500014 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:11:02.511379 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:11:02.522770 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:11:02.534286 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:11:02.545691 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:11:02.557389 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:11:02.676276 tst ping_idle_ping.py:24: start network... 06:11:02.867403 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:11:03.310655 run create_hlr_db(pid=3172): Launched 06:11:03.419690 bus /gobi_6: Setting Powered False 06:11:04.477103 run create_hlr_db(pid=3172): Terminated: ok {rc=0} 06:11:04.898879 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3174): Launched 06:11:05.206212 run osmo-hlr_10.42.42.2(pid=3175): Launched 06:11:05.323312 run osmo-stp_10.42.42.5: Starting osmo-stp 06:11:05.857268 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3177): Launched 06:11:06.165078 run osmo-stp_10.42.42.5(pid=3178): Launched 06:11:06.282384 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:11:06.812855 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3180): Launched 06:11:06.930447 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:11:07.190158 run patchelf(pid=3181): Launched 06:11:07.361993 run osmo-stp_10.42.42.5(pid=3178): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3178)] 06:11:07.493086 run osmo-stp_10.42.42.5(pid=3178): stdout: | (launched: 2022-12-10_06:11:06.108855) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:11:07.626839 run osmo-stp_10.42.42.5(pid=3178): stderr: | 20221210061106300 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061106300 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061106300 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061106301 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061106301 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061106301 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061106301 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:11:07.759239 run osmo-stp_10.42.42.5(pid=3178): stdout: | (launched: 2022-12-10_06:11:06.108855) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:11:07.885415 run osmo-stp_10.42.42.5(pid=3178): stderr: | 20221210061106300 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061106300 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061106300 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061106301 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061106301 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061106301 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061106301 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:11:08.034848 run patchelf(pid=3181): Terminating (SIGINT) 06:11:08.207145 run patchelf(pid=3181): Terminated: ok {rc=0} 06:11:08.331353 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=3178): Process ended prematurely: osmo-stp_10.42.42.5(pid=3178) [trial-2370↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3178)] [trial-2370↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 06:11:08.340816 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 06:11:08.368703 run osmo-hlr_10.42.42.2(pid=3175): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3175)] 06:11:08.418431 run osmo-hlr_10.42.42.2(pid=3175): stdout: | (launched: 2022-12-10_06:11:05.150144) 06:11:08.469905 run osmo-hlr_10.42.42.2(pid=3175): stderr: | 20221210061105347 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210061105347 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210061105347 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210061105347 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210061105347 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210061105347 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210061105360 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210061105372 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210061105372 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210061105372 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:11:08.521780 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3174): Terminating (SIGTERM) 06:11:08.563090 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3177): Terminating (SIGTERM) 06:11:08.604749 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3180): Terminating (SIGTERM) 06:11:08.646763 --- ParallelTerminationStrategy: PID 3174 died... 06:11:08.666440 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3174): Terminated: ok {rc=0} 06:11:08.712244 --- ParallelTerminationStrategy: PID 3177 died... 06:11:08.733897 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3177): Terminated: ok {rc=0} 06:11:08.779401 --- ParallelTerminationStrategy: PID 3180 died... 06:11:08.798810 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3180): Terminated: ok {rc=0} 06:11:08.886049 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2370 gprs:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 06:11:10.192862 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:11:10.200316 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 06:11:10.233563 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 06:11:10.272279 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 06:11:10.358485 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 06:11:10.390908 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 06:11:10.429595 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 06:11:11.037785 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2370 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 06:11:11.087653 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:11:11.099207 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 06:11:11.155342 tst cs_paging_gprs_active.py: using LAC 26393 06:11:11.275759 tst cs_paging_gprs_active.py: using RAC 128 06:11:11.390858 tst cs_paging_gprs_active.py: using CellId 26393 06:11:11.506121 tst cs_paging_gprs_active.py: using BVCI 26394 06:11:11.612430 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:11:11.623690 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:11:11.634784 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:11:11.646126 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:11:11.660228 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:11:11.671842 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:11:11.683413 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:11:11.695058 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:11:11.706797 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 06:11:11.821790 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 06:11:11.935510 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 06:11:12.130612 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:11:12.423204 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3185): Launched 06:11:12.677747 run iperf3-srv_10.42.42.10(pid=3186): Launched 06:11:12.787433 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 06:11:12.981994 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:11:13.274838 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3187): Launched 06:11:13.530598 run iperf3-srv_10.42.42.10(pid=3188): Launched 06:11:13.640750 tst cs_paging_gprs_active.py:38: start network... 06:11:13.835797 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:11:14.287947 run create_hlr_db(pid=3189): Launched 06:11:14.399702 bus /gobi_6: Setting Powered False 06:11:15.458702 run create_hlr_db(pid=3189): Terminated: ok {rc=0} 06:11:15.890508 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3191): Launched 06:11:16.208620 run osmo-hlr_10.42.42.2(pid=3192): Launched 06:11:16.498239 run osmo-stp_10.42.42.5: Starting osmo-stp 06:11:17.087507 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3194): Launched 06:11:17.435572 run osmo-stp_10.42.42.5(pid=3195): Launched 06:11:17.556314 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:11:18.097410 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3197): Launched 06:11:18.217029 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:11:18.479990 run patchelf(pid=3198): Launched 06:11:18.654231 run osmo-stp_10.42.42.5(pid=3195): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3195)] 06:11:18.786109 run osmo-stp_10.42.42.5(pid=3195): stdout: | (launched: 2022-12-10_06:11:17.378487) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:11:18.919903 run osmo-stp_10.42.42.5(pid=3195): stderr: | 20221210061117570 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061117570 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061117570 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061117572 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061117572 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061117572 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061117572 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:11:19.054027 run osmo-stp_10.42.42.5(pid=3195): stdout: | (launched: 2022-12-10_06:11:17.378487) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:11:19.182014 run osmo-stp_10.42.42.5(pid=3195): stderr: | 20221210061117570 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061117570 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061117570 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061117572 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061117572 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061117572 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061117572 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:11:19.333541 run patchelf(pid=3198): Terminating (SIGINT) 06:11:19.507370 run patchelf(pid=3198): Terminated: ok {rc=0} 06:11:19.634762 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=3195): Process ended prematurely: osmo-stp_10.42.42.5(pid=3195) [trial-2370↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3195)] [trial-2370↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 06:11:19.644842 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 06:11:19.673024 run osmo-hlr_10.42.42.2(pid=3192): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3192)] 06:11:19.721937 run osmo-hlr_10.42.42.2(pid=3192): stdout: | (launched: 2022-12-10_06:11:16.148375) 06:11:19.772699 run osmo-hlr_10.42.42.2(pid=3192): stderr: | 20221210061116362 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210061116362 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210061116362 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210061116362 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210061116362 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210061116362 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210061116378 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210061116391 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210061116391 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210061116391 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:11:19.823783 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3185): Terminating (SIGTERM) 06:11:19.864619 run iperf3-srv_10.42.42.10(pid=3186): Terminating (SIGTERM) 06:11:19.905574 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3187): Terminating (SIGTERM) 06:11:19.946323 run iperf3-srv_10.42.42.10(pid=3188): Terminating (SIGTERM) 06:11:19.987160 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3191): Terminating (SIGTERM) 06:11:20.028073 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3194): Terminating (SIGTERM) 06:11:20.068929 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3197): Terminating (SIGTERM) 06:11:20.110347 --- ParallelTerminationStrategy: PID 3185 died... 06:11:20.129753 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3185): Terminated: ok {rc=0} 06:11:20.175402 --- ParallelTerminationStrategy: PID 3186 died... 06:11:20.194560 run iperf3-srv_10.42.42.10(pid=3186): Terminated {rc=256} 06:11:20.239478 --- ParallelTerminationStrategy: PID 3187 died... 06:11:20.258661 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3187): Terminated: ok {rc=0} 06:11:20.303725 --- ParallelTerminationStrategy: PID 3188 died... 06:11:20.322993 run iperf3-srv_10.42.42.10(pid=3188): Terminated {rc=256} 06:11:20.367758 --- ParallelTerminationStrategy: PID 3191 died... 06:11:20.387057 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3191): Terminated: ok {rc=0} 06:11:20.432014 --- ParallelTerminationStrategy: PID 3194 died... 06:11:20.451249 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3194): Terminated: ok {rc=0} 06:11:20.496252 --- ParallelTerminationStrategy: PID 3197 died... 06:11:20.515528 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3197): Terminated: ok {rc=0} 06:11:20.602069 bus /gobi_0: Setting Powered False 06:11:21.698356 bus /gobi_0: Setting Powered False 06:11:22.809794 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 06:11:23.956252 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:11:23.968689 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 06:11:24.024049 tst iperf3.py: using LAC 26394 06:11:24.148794 tst iperf3.py: using RAC 129 06:11:24.274899 tst iperf3.py: using CellId 26394 06:11:24.397300 tst iperf3.py: using BVCI 26395 06:11:24.509892 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:11:24.521521 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:11:24.532940 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:11:24.544528 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:11:24.555996 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:11:24.567592 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:11:24.579456 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:11:24.591011 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:11:24.602647 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 06:11:24.715230 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 06:11:24.910728 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:11:25.202518 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3199): Launched 06:11:25.457166 run iperf3-srv_10.42.42.10(pid=3200): Launched 06:11:25.566942 tst iperf3.py:8: start network... 06:11:25.762369 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:11:26.215134 run create_hlr_db(pid=3201): Launched 06:11:26.326461 bus /gobi_6: Setting Powered False 06:11:27.384889 run create_hlr_db(pid=3201): Terminated: ok {rc=0} 06:11:27.791178 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3203): Launched 06:11:28.082584 run osmo-hlr_10.42.42.2(pid=3204): Launched 06:11:28.194190 run osmo-stp_10.42.42.5: Starting osmo-stp 06:11:28.709674 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3206): Launched 06:11:29.001716 run osmo-stp_10.42.42.5(pid=3207): Launched 06:11:29.112808 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:11:29.614992 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3209): Launched 06:11:29.727450 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:11:29.973347 run patchelf(pid=3210): Launched 06:11:30.135608 run osmo-stp_10.42.42.5(pid=3207): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3207)] 06:11:30.259240 run osmo-stp_10.42.42.5(pid=3207): stdout: | (launched: 2022-12-10_06:11:28.947446) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:11:30.384125 run osmo-stp_10.42.42.5(pid=3207): stderr: | 20221210061129117 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061129117 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061129117 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061129118 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061129118 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061129118 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061129118 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:11:30.508936 run osmo-stp_10.42.42.5(pid=3207): stdout: | (launched: 2022-12-10_06:11:28.947446) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:11:30.628093 run osmo-stp_10.42.42.5(pid=3207): stderr: | 20221210061129117 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061129117 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061129117 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061129118 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061129118 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061129118 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061129118 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:11:30.769725 run patchelf(pid=3210): Terminating (SIGINT) 06:11:30.942991 run patchelf(pid=3210): Terminated: ok {rc=0} 06:11:31.063391 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3207): Process ended prematurely: osmo-stp_10.42.42.5(pid=3207) [trial-2370↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3207)] [trial-2370↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 06:11:31.073623 tst iperf3.py:8: Test FAILED (7.2 sec) 06:11:31.101748 run osmo-hlr_10.42.42.2(pid=3204): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3204)] 06:11:31.149771 run osmo-hlr_10.42.42.2(pid=3204): stdout: | (launched: 2022-12-10_06:11:28.028912) 06:11:31.199264 run osmo-hlr_10.42.42.2(pid=3204): stderr: | 20221210061128203 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210061128203 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210061128203 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210061128203 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210061128203 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210061128204 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210061128216 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210061128224 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210061128225 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210061128225 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:11:31.249036 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3199): Terminating (SIGTERM) 06:11:31.288840 run iperf3-srv_10.42.42.10(pid=3200): Terminating (SIGTERM) 06:11:31.328775 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3203): Terminating (SIGTERM) 06:11:31.368653 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3206): Terminating (SIGTERM) 06:11:31.408569 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3209): Terminating (SIGTERM) 06:11:31.448711 --- ParallelTerminationStrategy: PID 3199 died... 06:11:31.467560 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3199): Terminated: ok {rc=0} 06:11:31.512059 --- ParallelTerminationStrategy: PID 3200 died... 06:11:31.530920 run iperf3-srv_10.42.42.10(pid=3200): Terminated {rc=256} 06:11:31.575291 --- ParallelTerminationStrategy: PID 3203 died... 06:11:31.594122 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3203): Terminated: ok {rc=0} 06:11:31.638588 --- ParallelTerminationStrategy: PID 3206 died... 06:11:31.657445 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3206): Terminated: ok {rc=0} 06:11:31.701985 --- ParallelTerminationStrategy: PID 3209 died... 06:11:31.720856 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3209): Terminated: ok {rc=0} 06:11:31.805073 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 06:11:32.946509 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:11:32.958494 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 06:11:33.010502 tst iperf3m4.py: using LAC 26395 06:11:33.126065 tst iperf3m4.py: using RAC 130 06:11:33.243053 tst iperf3m4.py: using CellId 26395 06:11:33.367868 tst iperf3m4.py: using BVCI 26396 06:11:33.483045 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:11:33.495253 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:11:33.506893 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:11:33.519069 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:11:33.531044 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:11:33.542974 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:11:33.555030 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:11:33.566855 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:11:33.579214 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 06:11:33.697541 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 06:11:33.816086 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 06:11:33.931581 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 06:11:34.049173 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 06:11:34.258452 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:11:34.570889 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3211): Launched 06:11:34.843213 run iperf3-srv_10.42.42.10(pid=3212): Launched 06:11:34.960049 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 06:11:35.169665 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:11:35.482486 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3213): Launched 06:11:35.755291 run iperf3-srv_10.42.42.10(pid=3214): Launched 06:11:35.872647 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 06:11:36.082236 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:11:36.395526 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3215): Launched 06:11:36.668907 run iperf3-srv_10.42.42.10(pid=3216): Launched 06:11:36.786062 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 06:11:36.995674 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:11:37.308788 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3217): Launched 06:11:37.581141 run iperf3-srv_10.42.42.10(pid=3218): Launched 06:11:37.690947 tst iperf3m4.py:8: start network... 06:11:37.885785 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:11:38.337096 run create_hlr_db(pid=3219): Launched 06:11:38.450471 bus /gobi_6: Setting Powered False 06:11:39.509208 run create_hlr_db(pid=3219): Terminated: ok {rc=0} 06:11:39.917192 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3221): Launched 06:11:40.209683 run osmo-hlr_10.42.42.2(pid=3222): Launched 06:11:40.321726 run osmo-stp_10.42.42.5: Starting osmo-stp 06:11:40.822899 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3224): Launched 06:11:41.114339 run osmo-stp_10.42.42.5(pid=3225): Launched 06:11:41.225421 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:11:41.727791 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3227): Launched 06:11:41.840119 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:11:42.086715 run patchelf(pid=3228): Launched 06:11:42.249314 run osmo-stp_10.42.42.5(pid=3225): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3225)] 06:11:42.373542 run osmo-stp_10.42.42.5(pid=3225): stdout: | (launched: 2022-12-10_06:11:41.060602) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:11:42.498986 run osmo-stp_10.42.42.5(pid=3225): stderr: | 20221210061141231 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061141231 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061141231 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061141231 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061141232 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061141232 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061141232 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:11:42.624904 run osmo-stp_10.42.42.5(pid=3225): stdout: | (launched: 2022-12-10_06:11:41.060602) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:11:42.744881 run osmo-stp_10.42.42.5(pid=3225): stderr: | 20221210061141231 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061141231 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061141231 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061141231 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061141232 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061141232 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061141232 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:11:42.887181 run patchelf(pid=3228): Terminating (SIGINT) 06:11:43.051541 run patchelf(pid=3228): Terminated: ok {rc=0} 06:11:43.170233 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3225): Process ended prematurely: osmo-stp_10.42.42.5(pid=3225) [trial-2370↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3225)] [trial-2370↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 06:11:43.179721 tst iperf3m4.py:8: Test FAILED (10.3 sec) 06:11:43.207264 run osmo-hlr_10.42.42.2(pid=3222): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3222)] 06:11:43.254276 run osmo-hlr_10.42.42.2(pid=3222): stdout: | (launched: 2022-12-10_06:11:40.155656) 06:11:43.303032 run osmo-hlr_10.42.42.2(pid=3222): stderr: | 20221210061140330 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210061140330 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210061140330 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210061140330 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210061140330 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210061140330 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210061140343 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210061140351 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210061140351 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210061140351 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:11:43.352336 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3211): Terminating (SIGTERM) 06:11:43.391364 run iperf3-srv_10.42.42.10(pid=3212): Terminating (SIGTERM) 06:11:43.430216 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3213): Terminating (SIGTERM) 06:11:43.469102 run iperf3-srv_10.42.42.10(pid=3214): Terminating (SIGTERM) 06:11:43.507688 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3215): Terminating (SIGTERM) 06:11:43.546530 run iperf3-srv_10.42.42.10(pid=3216): Terminating (SIGTERM) 06:11:43.585119 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3217): Terminating (SIGTERM) 06:11:43.623694 run iperf3-srv_10.42.42.10(pid=3218): Terminating (SIGTERM) 06:11:43.662248 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3221): Terminating (SIGTERM) 06:11:43.700930 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3224): Terminating (SIGTERM) 06:11:43.739918 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3227): Terminating (SIGTERM) 06:11:43.778774 --- ParallelTerminationStrategy: PID 3211 died... 06:11:43.797514 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3211): Terminated: ok {rc=0} 06:11:43.840869 --- ParallelTerminationStrategy: PID 3212 died... 06:11:43.858998 run iperf3-srv_10.42.42.10(pid=3212): Terminated {rc=256} 06:11:43.902065 --- ParallelTerminationStrategy: PID 3213 died... 06:11:43.920118 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3213): Terminated: ok {rc=0} 06:11:43.963267 --- ParallelTerminationStrategy: PID 3214 died... 06:11:43.981316 run iperf3-srv_10.42.42.10(pid=3214): Terminated {rc=256} 06:11:44.024123 --- ParallelTerminationStrategy: PID 3215 died... 06:11:44.042296 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3215): Terminated: ok {rc=0} 06:11:44.085413 --- ParallelTerminationStrategy: PID 3216 died... 06:11:44.103325 run iperf3-srv_10.42.42.10(pid=3216): Terminated {rc=256} 06:11:44.146928 --- ParallelTerminationStrategy: PID 3217 died... 06:11:44.165023 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3217): Terminated: ok {rc=0} 06:11:44.208045 --- ParallelTerminationStrategy: PID 3218 died... 06:11:44.226133 run iperf3-srv_10.42.42.10(pid=3218): Terminated {rc=256} 06:11:44.269237 --- ParallelTerminationStrategy: PID 3221 died... 06:11:44.287399 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3221): Terminated: ok {rc=0} 06:11:44.330840 --- ParallelTerminationStrategy: PID 3224 died... 06:11:44.349174 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3224): Terminated: ok {rc=0} 06:11:44.392801 --- ParallelTerminationStrategy: PID 3227 died... 06:11:44.411500 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3227): Terminated: ok {rc=0} 06:11:44.493790 bus /gobi_4: Setting Powered False 06:11:45.588406 bus /gobi_4: Setting Powered False 06:11:46.700095 bus /gobi_1: Setting Powered False 06:11:47.793844 bus /gobi_1: Setting Powered False 06:11:48.907601 bus /gobi_0: Setting Powered False 06:11:50.007673 bus /gobi_0: Setting Powered False 06:11:51.123592 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 06:11:52.225664 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:11:52.237509 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 06:11:52.288436 tst ping.py: using LAC 26396 06:11:52.402337 tst ping.py: using RAC 131 06:11:52.514238 tst ping.py: using CellId 26396 06:11:52.636152 tst ping.py: using BVCI 26397 06:11:52.747310 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:11:52.759035 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:11:52.770696 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:11:52.782273 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:11:52.793715 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:11:52.805181 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:11:52.816710 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:11:52.828264 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 06:11:52.940473 tst ping.py:19: start network... 06:11:53.130595 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:11:53.571090 run create_hlr_db(pid=3229): Launched 06:11:53.681165 bus /gobi_6: Setting Powered False 06:11:54.738789 run create_hlr_db(pid=3229): Terminated: ok {rc=0} 06:11:55.157028 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3231): Launched 06:11:55.461719 run osmo-hlr_10.42.42.2(pid=3232): Launched 06:11:55.579235 run osmo-stp_10.42.42.5: Starting osmo-stp 06:11:56.110125 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3234): Launched 06:11:56.415590 run osmo-stp_10.42.42.5(pid=3235): Launched 06:11:56.532505 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:11:57.062746 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3237): Launched 06:11:57.179785 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:11:57.438344 run patchelf(pid=3238): Launched 06:11:57.609610 run osmo-stp_10.42.42.5(pid=3235): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3235)] 06:11:57.739825 run osmo-stp_10.42.42.5(pid=3235): stdout: | (launched: 2022-12-10_06:11:56.359529) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:11:57.872035 run osmo-stp_10.42.42.5(pid=3235): stderr: | 20221210061156547 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061156547 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061156547 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061156548 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061156550 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061156550 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061156550 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:11:58.004837 run osmo-stp_10.42.42.5(pid=3235): stdout: | (launched: 2022-12-10_06:11:56.359529) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:11:58.130487 run osmo-stp_10.42.42.5(pid=3235): stderr: | 20221210061156547 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061156547 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061156547 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061156548 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061156550 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061156550 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061156550 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:11:58.279215 run patchelf(pid=3238): Terminating (SIGINT) 06:11:58.451177 run patchelf(pid=3238): Terminated: ok {rc=0} 06:11:58.574580 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=3235): Process ended prematurely: osmo-stp_10.42.42.5(pid=3235) [trial-2370↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3235)] [trial-2370↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 06:11:58.584080 tst ping.py:22: Test FAILED (6.4 sec) 06:11:58.612004 run osmo-hlr_10.42.42.2(pid=3232): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3232)] 06:11:58.661165 run osmo-hlr_10.42.42.2(pid=3232): stdout: | (launched: 2022-12-10_06:11:55.405939) 06:11:58.712001 run osmo-hlr_10.42.42.2(pid=3232): stderr: | 20221210061155603 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210061155603 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210061155603 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210061155603 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210061155603 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210061155603 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210061155615 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210061155625 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210061155625 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210061155625 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:11:58.763504 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3231): Terminating (SIGTERM) 06:11:58.804394 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3234): Terminating (SIGTERM) 06:11:58.845414 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3237): Terminating (SIGTERM) 06:11:58.886552 --- ParallelTerminationStrategy: PID 3231 died... 06:11:58.906216 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3231): Terminated: ok {rc=0} 06:11:58.951485 --- ParallelTerminationStrategy: PID 3234 died... 06:11:58.970782 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3234): Terminated: ok {rc=0} 06:11:59.016373 --- ParallelTerminationStrategy: PID 3237 died... 06:11:59.035699 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3237): Terminated: ok {rc=0} 06:11:59.121993 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 06:12:00.208348 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:12:00.220737 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 06:12:00.274595 tst ping_idle_ping.py: using LAC 26397 06:12:00.395858 tst ping_idle_ping.py: using RAC 132 06:12:00.515641 tst ping_idle_ping.py: using CellId 26397 06:12:00.636761 tst ping_idle_ping.py: using BVCI 26398 06:12:00.749266 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:12:00.760892 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:12:00.772427 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:12:00.783984 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:12:00.795352 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:12:00.806799 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:12:00.818452 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:12:00.829967 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 06:12:00.965970 tst ping_idle_ping.py:24: start network... 06:12:01.170012 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:12:01.633466 run create_hlr_db(pid=3239): Launched 06:12:01.759657 bus /gobi_6: Setting Powered False 06:12:02.817459 run create_hlr_db(pid=3239): Terminated: ok {rc=0} 06:12:03.220264 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3241): Launched 06:12:03.507229 run osmo-hlr_10.42.42.2(pid=3242): Launched 06:12:03.617413 run osmo-stp_10.42.42.5: Starting osmo-stp 06:12:04.110411 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3244): Launched 06:12:04.397373 run osmo-stp_10.42.42.5(pid=3245): Launched 06:12:04.506961 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:12:05.002327 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3247): Launched 06:12:05.112201 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:12:05.354636 run patchelf(pid=3248): Launched 06:12:05.515144 run osmo-stp_10.42.42.5(pid=3245): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3245)] 06:12:05.637527 run osmo-stp_10.42.42.5(pid=3245): stdout: | (launched: 2022-12-10_06:12:04.344487) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:12:05.761459 run osmo-stp_10.42.42.5(pid=3245): stderr: | 20221210061204512 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061204512 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061204513 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061204513 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061204514 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061204514 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061204514 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:12:05.885852 run osmo-stp_10.42.42.5(pid=3245): stdout: | (launched: 2022-12-10_06:12:04.344487) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:12:06.004071 run osmo-stp_10.42.42.5(pid=3245): stderr: | 20221210061204512 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061204512 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061204513 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061204513 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061204514 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061204514 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061204514 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:12:06.143780 run patchelf(pid=3248): Terminating (SIGINT) 06:12:06.305373 run patchelf(pid=3248): Terminated: ok {rc=0} 06:12:06.421416 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=3245): Process ended prematurely: osmo-stp_10.42.42.5(pid=3245) [trial-2370↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3245)] [trial-2370↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 06:12:06.430349 tst ping_idle_ping.py:27: Test FAILED (6.2 sec) 06:12:06.456888 run osmo-hlr_10.42.42.2(pid=3242): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3242)] 06:12:06.504148 run osmo-hlr_10.42.42.2(pid=3242): stdout: | (launched: 2022-12-10_06:12:03.454178) 06:12:06.552306 run osmo-hlr_10.42.42.2(pid=3242): stderr: | 20221210061203629 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210061203629 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210061203629 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210061203629 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210061203629 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210061203629 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210061203640 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210061203649 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210061203649 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210061203649 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:12:06.601611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3241): Terminating (SIGTERM) 06:12:06.640421 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3244): Terminating (SIGTERM) 06:12:06.679633 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3247): Terminating (SIGTERM) 06:12:06.719002 --- ParallelTerminationStrategy: PID 3241 died... 06:12:06.737683 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3241): Terminated: ok {rc=0} 06:12:06.781527 --- ParallelTerminationStrategy: PID 3244 died... 06:12:06.799542 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3244): Terminated: ok {rc=0} 06:12:06.843016 --- ParallelTerminationStrategy: PID 3247 died... 06:12:06.861248 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3247): Terminated: ok {rc=0} 06:12:06.943199 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2370 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 06:12:08.255371 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:12:08.263205 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 06:12:08.296137 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 06:12:08.330979 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 06:12:08.382558 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 06:12:08.415254 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 06:12:08.450036 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 06:12:09.013303 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2370 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 06:12:09.018452 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:12:09.029676 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 06:12:09.100280 tst switch_tch_pdch.py: using LAC 26398 06:12:09.211725 tst switch_tch_pdch.py: using RAC 133 06:12:09.322059 tst switch_tch_pdch.py: using CellId 26398 06:12:09.434560 tst switch_tch_pdch.py: using BVCI 26399 06:12:09.537971 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:12:09.548927 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:12:09.559832 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:12:09.570932 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:12:09.582075 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:12:09.593157 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:12:09.604359 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:12:09.615395 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:12:09.728840 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:12:09.843949 tst switch_tch_pdch.py:51: start network... 06:12:10.050734 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:12:10.525407 run create_hlr_db(pid=3252): Launched 06:12:10.651130 bus /gobi_6: Setting Powered False 06:12:11.711827 run create_hlr_db(pid=3252): Terminated: ok {rc=0} 06:12:12.123780 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3254): Launched 06:12:12.409687 run osmo-hlr_10.42.42.2(pid=3255): Launched 06:12:12.518459 run osmo-stp_10.42.42.5: Starting osmo-stp 06:12:13.020459 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3257): Launched 06:12:13.305628 run osmo-stp_10.42.42.5(pid=3258): Launched 06:12:13.414998 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:12:13.907976 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3260): Launched 06:12:14.017228 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:12:14.258337 run patchelf(pid=3261): Launched 06:12:14.417720 run osmo-stp_10.42.42.5(pid=3258): ERR: Terminated: ERROR {rc=1} [trial-2370↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3258)] 06:12:14.538782 run osmo-stp_10.42.42.5(pid=3258): stdout: | (launched: 2022-12-10_06:12:13.253287) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:12:14.661998 run osmo-stp_10.42.42.5(pid=3258): stderr: | 20221210061213421 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061213421 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061213422 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061213422 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061213422 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061213422 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061213422 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:12:14.785163 run osmo-stp_10.42.42.5(pid=3258): stdout: | (launched: 2022-12-10_06:12:13.253287) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:12:14.901920 run osmo-stp_10.42.42.5(pid=3258): stderr: | 20221210061213421 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061213421 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061213422 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061213422 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061213422 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061213422 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061213422 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:12:15.040575 run patchelf(pid=3261): Terminating (SIGINT) 06:12:15.200310 run patchelf(pid=3261): Terminated: ok {rc=0} 06:12:15.315833 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=3258): Process ended prematurely: osmo-stp_10.42.42.5(pid=3258) [trial-2370↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3258)] [trial-2370↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 06:12:15.324874 tst switch_tch_pdch.py:54: Test FAILED (6.3 sec) 06:12:15.351376 run osmo-hlr_10.42.42.2(pid=3255): ERR: Terminated: ERROR {rc=237} [trial-2370↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3255)] 06:12:15.398519 run osmo-hlr_10.42.42.2(pid=3255): stdout: | (launched: 2022-12-10_06:12:12.357479) 06:12:15.446796 run osmo-hlr_10.42.42.2(pid=3255): stderr: | 20221210061212529 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210061212529 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210061212529 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210061212529 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210061212529 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210061212529 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210061212541 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210061212550 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210061212550 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210061212550 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:12:15.495481 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3254): Terminating (SIGTERM) 06:12:15.534376 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3257): Terminating (SIGTERM) 06:12:15.573323 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3260): Terminating (SIGTERM) 06:12:15.612419 --- ParallelTerminationStrategy: PID 3254 died... 06:12:15.631085 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3254): Terminated: ok {rc=0} 06:12:15.674355 --- ParallelTerminationStrategy: PID 3257 died... 06:12:15.692614 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3257): Terminated: ok {rc=0} 06:12:15.735701 --- ParallelTerminationStrategy: PID 3260 died... 06:12:15.753948 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3260): Terminated: ok {rc=0} 06:12:15.838114 bus /gobi_0: Setting Powered False 06:12:16.933599 bus /gobi_0: Setting Powered False 06:12:18.045555 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2370 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 dynts:trx-umtrx+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 06:12:19.299262 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:12:19.305880 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 06:12:19.338836 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 06:12:19.373618 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 06:12:19.426008 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 06:12:19.458400 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 06:12:19.492737 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 06:12:20.050665 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2370 dynts:trx-umtrx+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 06:12:20.055968 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:12:20.067235 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 06:12:20.135730 tst switch_tch_pdch.py: using LAC 26399 06:12:20.266372 tst switch_tch_pdch.py: using RAC 134 06:12:20.388916 tst switch_tch_pdch.py: using CellId 26399 06:12:20.509110 tst switch_tch_pdch.py: using BVCI 26400 06:12:20.619660 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:12:20.630897 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:12:20.641981 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:12:20.653064 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:12:20.664200 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:12:20.675224 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:12:20.686359 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:12:20.697440 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 06:12:20.815089 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 06:12:20.932675 tst switch_tch_pdch.py:51: start network... 06:12:21.128551 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:12:21.544672 run create_hlr_db(pid=3266): Launched 06:12:21.654462 bus /gobi_6: Setting Powered False 06:12:22.712132 run create_hlr_db(pid=3266): Terminated: ok {rc=0} 06:12:23.086636 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3268): Launched 06:12:23.370469 run osmo-hlr_10.42.42.2(pid=3269): Launched 06:12:23.478682 run osmo-stp_10.42.42.5: Starting osmo-stp 06:12:23.941125 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3271): Launched 06:12:24.226352 run osmo-stp_10.42.42.5(pid=3272): Launched 06:12:24.334868 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:12:24.802793 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3274): Launched 06:12:24.912337 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:12:25.153290 run patchelf(pid=3275): Launched 06:12:25.312719 run osmo-stp_10.42.42.5(pid=3272): ERR: Terminated: ERROR {rc=1} [trial-2370↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3272)] 06:12:25.434638 run osmo-stp_10.42.42.5(pid=3272): stdout: | (launched: 2022-12-10_06:12:24.173906) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:12:25.558143 run osmo-stp_10.42.42.5(pid=3272): stderr: | 20221210061224341 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061224341 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061224341 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061224341 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061224342 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061224342 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061224342 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:12:25.681946 run osmo-stp_10.42.42.5(pid=3272): stdout: | (launched: 2022-12-10_06:12:24.173906) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:12:25.799391 run osmo-stp_10.42.42.5(pid=3272): stderr: | 20221210061224341 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061224341 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061224341 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061224341 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061224342 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061224342 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061224342 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:12:25.938725 run patchelf(pid=3275): Terminating (SIGINT) 06:12:26.099513 run patchelf(pid=3275): Terminated: ok {rc=0} 06:12:26.215660 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=3272): Process ended prematurely: osmo-stp_10.42.42.5(pid=3272) [trial-2370↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3272)] [trial-2370↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 06:12:26.224580 tst switch_tch_pdch.py:54: Test FAILED (6.2 sec) 06:12:26.251069 run osmo-hlr_10.42.42.2(pid=3269): ERR: Terminated: ERROR {rc=237} [trial-2370↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3269)] 06:12:26.297559 run osmo-hlr_10.42.42.2(pid=3269): stdout: | (launched: 2022-12-10_06:12:23.318184) 06:12:26.346003 run osmo-hlr_10.42.42.2(pid=3269): stderr: | 20221210061223492 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210061223492 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210061223492 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210061223492 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210061223492 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210061223492 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210061223504 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/dynts:trx-umtrx+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210061223512 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210061223513 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210061223513 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:12:26.394979 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3268): Terminating (SIGTERM) 06:12:26.433738 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3271): Terminating (SIGTERM) 06:12:26.472366 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3274): Terminating (SIGTERM) 06:12:26.511273 --- ParallelTerminationStrategy: PID 3268 died... 06:12:26.529814 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3268): Terminated: ok {rc=0} 06:12:26.573272 --- ParallelTerminationStrategy: PID 3271 died... 06:12:26.591487 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3271): Terminated: ok {rc=0} 06:12:26.635144 --- ParallelTerminationStrategy: PID 3274 died... 06:12:26.653505 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3274): Terminated: ok {rc=0} 06:12:26.736110 bus /gobi_0: Setting Powered False 06:12:27.833262 bus /gobi_0: Setting Powered False 06:12:28.947659 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2370 dynts:trx-umtrx+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 nitb_sms:trx-lms --------------------------------------------------------------------- 06:12:30.188220 tst nitb_sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:12:30.192044 tst nitb_sms:trx-lms: Verifying 1 x bts (candidates: 11) 06:12:30.225123 tst nitb_sms:trx-lms: Verifying 1 x ip_address (candidates: 9) 06:12:30.231727 tst nitb_sms:trx-lms: Verifying 2 x modem (candidates: 12) 06:12:30.282610 tst nitb_sms:trx-lms: Reserving 1 x bts (candidates: 11) 06:12:30.314635 tst nitb_sms:trx-lms: Reserving 1 x ip_address (candidates: 9) 06:12:30.321161 tst nitb_sms:trx-lms: Reserving 2 x modem (candidates: 12) 06:12:30.871563 tst nitb_sms:trx-lms: RESERVED RESOURCES for nitb_sms: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 nitb_sms:trx-lms mo_mt_sms.py ---------------------------------------------- 06:12:30.878006 tst nitb_sms:trx-lms: Using 1 x ip_address (candidates: 1) 06:12:30.890645 tst nitb_sms:trx-lms: Using 1 x bts (candidates: 1) 06:12:30.960355 tst mo_mt_sms.py: using LAC 26400 06:12:31.101501 tst mo_mt_sms.py: using RAC 135 06:12:31.247131 tst mo_mt_sms.py: using CellId 26400 06:12:31.370869 tst mo_mt_sms.py: using BVCI 26401 06:12:31.486946 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 06:12:31.611474 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 06:12:31.761887 tst mo_mt_sms.py:9: start nitb and bts... 06:12:31.986318 run osmo-nitb_10.42.42.2: Starting osmo-nitb 06:12:32.620506 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3280): Launched 06:12:32.926526 run osmo-nitb_10.42.42.2(pid=3281): Launched 06:12:33.095361 run osmo-nitb_10.42.42.2(pid=3281): ERR: Terminated: ERROR {rc=2} [trial-2370↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3281)] 06:12:33.233497 run osmo-nitb_10.42.42.2(pid=3281): stdout: | (launched: 2022-12-10_06:12:32.870750) 06:12:33.373190 run osmo-nitb_10.42.42.2(pid=3281): stderr: | (launched: 2022-12-10_06:12:32.916040) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:12:33.512559 run osmo-nitb_10.42.42.2(pid=3281): stdout: | (launched: 2022-12-10_06:12:32.870750) 06:12:33.646052 run osmo-nitb_10.42.42.2(pid=3281): stderr: | (launched: 2022-12-10_06:12:32.916040) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=3281): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3281) [trial-2370↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3281)] 06:12:34.041751 tst osmo-nitb_10.42.42.2(pid=3281): stdout: | (launched: 2022-12-10_06:12:32.870750) 06:12:34.165663 tst osmo-nitb_10.42.42.2(pid=3281): stderr: | (launched: 2022-12-10_06:12:32.916040) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:12:34.311726 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=3281): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3281) [trial-2370↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3281)] [trial-2370↪nitb_sms:trx-lms↪mo_mt_sms.py:11] 06:12:34.320705 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 06:12:34.327800 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3280): Terminating (SIGTERM) 06:12:34.537447 --- ParallelTerminationStrategy: PID 3280 died... 06:12:34.558195 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3280): Terminated: ok {rc=0} 06:12:34.644186 bus /sierra_3: Setting Powered False 06:12:35.743450 bus /sierra_3: Setting Powered False 06:12:36.859933 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 nitb_sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 sms:trx-lms --------------------------------------------------------------------- 06:12:38.057430 tst sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:12:38.061728 tst sms:trx-lms: Verifying 1 x bts (candidates: 11) 06:12:38.094693 tst sms:trx-lms: Verifying 6 x ip_address (candidates: 9) 06:12:38.121590 tst sms:trx-lms: Verifying 2 x modem (candidates: 12) 06:12:38.175246 tst sms:trx-lms: Reserving 1 x bts (candidates: 11) 06:12:38.208574 tst sms:trx-lms: Reserving 6 x ip_address (candidates: 9) 06:12:38.235541 tst sms:trx-lms: Reserving 2 x modem (candidates: 12) 06:12:38.779433 tst sms:trx-lms: RESERVED RESOURCES for sms: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 sms:trx-lms mo_mt_sms.py ---------------------------------------------- 06:12:38.784562 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 06:12:38.795425 tst sms:trx-lms: Using 1 x bts (candidates: 1) 06:12:38.843782 tst mo_mt_sms.py: using LAC 26401 06:12:38.965904 tst mo_mt_sms.py: using RAC 136 06:12:39.086960 tst mo_mt_sms.py: using CellId 26401 06:12:39.206182 tst mo_mt_sms.py: using BVCI 26402 06:12:39.316644 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 06:12:39.327415 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 06:12:39.338127 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 06:12:39.348702 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 06:12:39.359365 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 06:12:39.369964 tst sms:trx-lms: Using 1 x modem (candidates: 2) 06:12:39.485430 tst sms:trx-lms: Using 1 x modem (candidates: 2) 06:12:39.599959 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:12:40.040024 run create_hlr_db(pid=3286): Launched 06:12:40.149244 bus /sierra_2: Setting Powered False 06:12:41.206302 run create_hlr_db(pid=3286): Terminated: ok {rc=0} 06:12:41.605059 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3288): Launched 06:12:41.889643 run osmo-hlr_10.42.42.2(pid=3289): Launched 06:12:41.998137 run osmo-stp_10.42.42.5: Starting osmo-stp 06:12:42.500333 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3291): Launched 06:12:42.784429 run osmo-stp_10.42.42.5(pid=3292): Launched 06:12:42.892887 run osmo-msc_10.42.42.6: Starting osmo-msc 06:12:43.408829 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3294): Launched 06:12:43.693619 run osmo-msc_10.42.42.6(pid=3295): Launched 06:12:43.853947 run osmo-stp_10.42.42.5(pid=3292): ERR: Terminated: ERROR {rc=1} [trial-2370↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3292)] 06:12:43.975885 run osmo-stp_10.42.42.5(pid=3292): stdout: | (launched: 2022-12-10_06:12:42.731745) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:12:44.098594 run osmo-stp_10.42.42.5(pid=3292): stderr: | 20221210061242900 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061242900 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061242900 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061242901 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061242901 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061242901 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061242901 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:12:44.217503 run osmo-stp_10.42.42.5(pid=3292): stdout: | (launched: 2022-12-10_06:12:42.731745) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:12:44.330928 run osmo-stp_10.42.42.5(pid=3292): stderr: | 20221210061242900 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061242900 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061242900 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061242901 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061242901 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061242901 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061242901 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:12:44.466559 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=3292): Process ended prematurely: osmo-stp_10.42.42.5(pid=3292) [trial-2370↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3292)] [trial-2370↪sms:trx-lms↪mo_mt_sms.py:16] 06:12:44.474785 tst mo_mt_sms.py:16: Test FAILED (5.7 sec) 06:12:44.500408 run osmo-hlr_10.42.42.2(pid=3289): ERR: Terminated: ERROR {rc=237} [trial-2370↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3289)] 06:12:44.547400 run osmo-hlr_10.42.42.2(pid=3289): stdout: | (launched: 2022-12-10_06:12:41.837351) 06:12:44.595725 run osmo-hlr_10.42.42.2(pid=3289): stderr: | 20221210061242012 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210061242012 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210061242012 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210061242012 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210061242012 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210061242012 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210061242027 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/sms:trx-lms/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210061242035 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210061242036 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210061242036 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:12:44.663194 run osmo-msc_10.42.42.6(pid=3295): ERR: Terminated: ERROR {rc=2} [trial-2370↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3295)] 06:12:44.709815 run osmo-msc_10.42.42.6(pid=3295): stdout: | (launched: 2022-12-10_06:12:43.641284) 06:12:44.758094 run osmo-msc_10.42.42.6(pid=3295): stderr: | 20221210061243911 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210061243911 DLGLOBAL DEBUG validating counter group 0x7fcad7dacc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210061243911 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210061243911 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210061243911 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210061243911 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210061243913 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210061243913 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210061243914 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210061243914 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:12:44.806928 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3288): Terminating (SIGTERM) 06:12:44.845885 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3291): Terminating (SIGTERM) 06:12:44.884873 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3294): Terminating (SIGTERM) 06:12:44.923719 --- ParallelTerminationStrategy: PID 3288 died... 06:12:44.942345 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3288): Terminated: ok {rc=0} 06:12:44.985515 --- ParallelTerminationStrategy: PID 3291 died... 06:12:45.003483 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3291): Terminated: ok {rc=0} 06:12:45.046466 --- ParallelTerminationStrategy: PID 3294 died... 06:12:45.064607 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3294): Terminated: ok {rc=0} 06:12:45.148326 bus /sierra_3: Setting Powered False 06:12:46.245196 bus /sierra_3: Setting Powered False 06:12:47.361841 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 nitb_ussd:trx-lms --------------------------------------------------------------------- 06:12:48.590574 tst nitb_ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:12:48.594641 tst nitb_ussd:trx-lms: Verifying 1 x bts (candidates: 11) 06:12:48.628003 tst nitb_ussd:trx-lms: Verifying 1 x ip_address (candidates: 9) 06:12:48.634894 tst nitb_ussd:trx-lms: Verifying 1 x modem (candidates: 12) 06:12:48.670113 tst nitb_ussd:trx-lms: Reserving 1 x bts (candidates: 11) 06:12:48.703505 tst nitb_ussd:trx-lms: Reserving 1 x ip_address (candidates: 9) 06:12:48.710424 tst nitb_ussd:trx-lms: Reserving 1 x modem (candidates: 12) 06:12:49.230057 tst nitb_ussd:trx-lms: RESERVED RESOURCES for nitb_ussd: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2370 nitb_ussd:trx-lms assert_extension.py ---------------------------------------------- 06:12:49.235154 tst nitb_ussd:trx-lms: Using 1 x ip_address (candidates: 1) 06:12:49.246270 tst nitb_ussd:trx-lms: Using 1 x bts (candidates: 1) 06:12:49.294313 tst assert_extension.py: using LAC 26402 06:12:49.416278 tst assert_extension.py: using RAC 137 06:12:49.536530 tst assert_extension.py: using CellId 26402 06:12:49.655650 tst assert_extension.py: using BVCI 26403 06:12:49.760455 tst nitb_ussd:trx-lms: Using 1 x modem (candidates: 1) 06:12:49.873848 tst assert_extension.py:10: start nitb and bts... 06:12:50.078349 run osmo-nitb_10.42.42.2: Starting osmo-nitb 06:12:50.704332 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3300): Launched 06:12:51.010973 run osmo-nitb_10.42.42.2(pid=3301): Launched 06:12:51.181886 run osmo-nitb_10.42.42.2(pid=3301): ERR: Terminated: ERROR {rc=2} [trial-2370↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3301)] 06:12:51.320241 run osmo-nitb_10.42.42.2(pid=3301): stdout: | (launched: 2022-12-10_06:12:50.954442) 06:12:51.460025 run osmo-nitb_10.42.42.2(pid=3301): stderr: | (launched: 2022-12-10_06:12:50.999933) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:12:51.599726 run osmo-nitb_10.42.42.2(pid=3301): stdout: | (launched: 2022-12-10_06:12:50.954442) 06:12:51.733996 run osmo-nitb_10.42.42.2(pid=3301): stderr: | (launched: 2022-12-10_06:12:50.999933) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=3301): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3301) [trial-2370↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3301)] 06:12:52.127867 tst osmo-nitb_10.42.42.2(pid=3301): stdout: | (launched: 2022-12-10_06:12:50.954442) 06:12:52.251533 tst osmo-nitb_10.42.42.2(pid=3301): stderr: | (launched: 2022-12-10_06:12:50.999933) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:12:52.398282 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=3301): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3301) [trial-2370↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3301)] [trial-2370↪nitb_ussd:trx-lms↪assert_extension.py:12] 06:12:52.407342 tst assert_extension.py:12: Test FAILED (3.2 sec) 06:12:52.414326 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3300): Terminating (SIGTERM) 06:12:52.623975 --- ParallelTerminationStrategy: PID 3300 died... 06:12:52.644325 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3300): Terminated: ok {rc=0} 06:12:52.730804 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 nitb_ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 ussd:trx-lms --------------------------------------------------------------------- 06:12:53.906330 tst ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:12:53.910413 tst ussd:trx-lms: Verifying 1 x bts (candidates: 11) 06:12:53.943408 tst ussd:trx-lms: Verifying 6 x ip_address (candidates: 9) 06:12:53.970136 tst ussd:trx-lms: Verifying 1 x modem (candidates: 12) 06:12:54.005944 tst ussd:trx-lms: Reserving 1 x bts (candidates: 11) 06:12:54.039043 tst ussd:trx-lms: Reserving 6 x ip_address (candidates: 9) 06:12:54.065582 tst ussd:trx-lms: Reserving 1 x modem (candidates: 12) 06:12:54.594696 tst ussd:trx-lms: RESERVED RESOURCES for ussd: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2370 ussd:trx-lms assert_extension.py ---------------------------------------------- 06:12:54.599804 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 06:12:54.610699 tst ussd:trx-lms: Using 1 x bts (candidates: 1) 06:12:54.658942 tst assert_extension.py: using LAC 26403 06:12:54.780458 tst assert_extension.py: using RAC 138 06:12:54.899714 tst assert_extension.py: using CellId 26403 06:12:55.019509 tst assert_extension.py: using BVCI 26404 06:12:55.129143 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 06:12:55.139976 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 06:12:55.150791 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 06:12:55.161590 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 06:12:55.172254 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 06:12:55.182959 tst ussd:trx-lms: Using 1 x modem (candidates: 1) 06:12:55.292627 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:12:55.731866 run create_hlr_db(pid=3305): Launched 06:12:55.841525 bus /sierra_2: Setting Powered False 06:12:56.898725 run create_hlr_db(pid=3305): Terminated: ok {rc=0} 06:12:57.298415 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3307): Launched 06:12:57.584365 run osmo-hlr_10.42.42.2(pid=3308): Launched 06:12:57.694308 run osmo-stp_10.42.42.5: Starting osmo-stp 06:12:58.187720 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3310): Launched 06:12:58.473731 run osmo-stp_10.42.42.5(pid=3311): Launched 06:12:58.582172 run osmo-msc_10.42.42.6: Starting osmo-msc 06:12:59.094340 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3313): Launched 06:12:59.379760 run osmo-msc_10.42.42.6(pid=3314): Launched 06:12:59.538730 run osmo-stp_10.42.42.5(pid=3311): ERR: Terminated: ERROR {rc=1} [trial-2370↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3311)] 06:12:59.660052 run osmo-stp_10.42.42.5(pid=3311): stdout: | (launched: 2022-12-10_06:12:58.421212) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:12:59.782747 run osmo-stp_10.42.42.5(pid=3311): stderr: | 20221210061258588 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061258588 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061258588 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061258588 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061258591 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061258591 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061258591 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:12:59.902447 run osmo-stp_10.42.42.5(pid=3311): stdout: | (launched: 2022-12-10_06:12:58.421212) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:13:00.016135 run osmo-stp_10.42.42.5(pid=3311): stderr: | 20221210061258588 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061258588 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061258588 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061258588 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061258591 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061258591 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061258591 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:13:00.152360 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=3311): Process ended prematurely: osmo-stp_10.42.42.5(pid=3311) [trial-2370↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3311)] [trial-2370↪ussd:trx-lms↪assert_extension.py:17] 06:13:00.160604 tst assert_extension.py:17: Test FAILED (5.6 sec) 06:13:00.186150 run osmo-hlr_10.42.42.2(pid=3308): ERR: Terminated: ERROR {rc=237} [trial-2370↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3308)] 06:13:00.233543 run osmo-hlr_10.42.42.2(pid=3308): stdout: | (launched: 2022-12-10_06:12:57.531754) 06:13:00.282377 run osmo-hlr_10.42.42.2(pid=3308): stderr: | 20221210061257702 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210061257702 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210061257702 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210061257702 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210061257702 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210061257702 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210061257715 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/ussd:trx-lms/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210061257723 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210061257724 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210061257724 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:13:00.350270 run osmo-msc_10.42.42.6(pid=3314): ERR: Terminated: ERROR {rc=2} [trial-2370↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3314)] 06:13:00.397369 run osmo-msc_10.42.42.6(pid=3314): stdout: | (launched: 2022-12-10_06:12:59.326646) 06:13:00.446080 run osmo-msc_10.42.42.6(pid=3314): stderr: | 20221210061259596 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210061259596 DLGLOBAL DEBUG validating counter group 0x7f2aeb946c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210061259596 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210061259596 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210061259597 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210061259597 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210061259598 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210061259599 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210061259599 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210061259599 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:13:00.495189 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3307): Terminating (SIGTERM) 06:13:00.534333 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3310): Terminating (SIGTERM) 06:13:00.573367 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3313): Terminating (SIGTERM) 06:13:00.612482 --- ParallelTerminationStrategy: PID 3307 died... 06:13:00.631260 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3307): Terminated: ok {rc=0} 06:13:00.674876 --- ParallelTerminationStrategy: PID 3310 died... 06:13:00.693121 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3310): Terminated: ok {rc=0} 06:13:00.736364 --- ParallelTerminationStrategy: PID 3313 died... 06:13:00.754586 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3313): Terminated: ok {rc=0} 06:13:00.847656 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 06:13:02.105974 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:13:02.113240 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 06:13:02.151824 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 06:13:02.180347 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 06:13:02.231601 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 06:13:02.266174 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 06:13:02.293561 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 06:13:02.843992 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 06:13:02.894516 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:13:02.905963 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 06:13:02.976082 tst mo_mt_call.py: using LAC 26404 06:13:03.092509 tst mo_mt_call.py: using RAC 139 06:13:03.208680 tst mo_mt_call.py: using CellId 26404 06:13:03.323705 tst mo_mt_call.py: using BVCI 26405 06:13:03.429719 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:13:03.440817 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:13:03.451885 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:13:03.463224 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:13:03.474608 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:13:03.485786 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 06:13:03.602567 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 06:13:03.720837 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:13:04.204674 run create_hlr_db(pid=3319): Launched 06:13:04.332304 bus /sierra_2: Setting Powered False 06:13:05.394695 run create_hlr_db(pid=3319): Terminated: ok {rc=0} 06:13:05.813055 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3321): Launched 06:13:06.105052 run osmo-hlr_10.42.42.2(pid=3322): Launched 06:13:06.216701 run osmo-stp_10.42.42.5: Starting osmo-stp 06:13:06.719704 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3324): Launched 06:13:07.010461 run osmo-stp_10.42.42.5(pid=3325): Launched 06:13:07.121070 run osmo-msc_10.42.42.6: Starting osmo-msc 06:13:07.646656 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3327): Launched 06:13:07.938072 run osmo-msc_10.42.42.6(pid=3328): Launched 06:13:08.100937 run osmo-stp_10.42.42.5(pid=3325): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3325)] 06:13:08.224552 run osmo-stp_10.42.42.5(pid=3325): stdout: | (launched: 2022-12-10_06:13:06.957241) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:13:08.349175 run osmo-stp_10.42.42.5(pid=3325): stderr: | 20221210061307126 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061307126 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061307126 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061307127 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061307127 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061307127 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061307127 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:13:08.471496 run osmo-stp_10.42.42.5(pid=3325): stdout: | (launched: 2022-12-10_06:13:06.957241) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:13:08.587241 run osmo-stp_10.42.42.5(pid=3325): stderr: | 20221210061307126 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061307126 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061307126 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061307127 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061307127 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061307127 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061307127 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:13:08.725937 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3325): Process ended prematurely: osmo-stp_10.42.42.5(pid=3325) [trial-2370↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3325)] [trial-2370↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 06:13:08.734954 tst mo_mt_call.py:8: Test FAILED (5.9 sec) 06:13:08.761697 run osmo-hlr_10.42.42.2(pid=3322): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3322)] 06:13:08.809243 run osmo-hlr_10.42.42.2(pid=3322): stdout: | (launched: 2022-12-10_06:13:06.051483) 06:13:08.858201 run osmo-hlr_10.42.42.2(pid=3322): stderr: | 20221210061306227 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210061306227 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210061306228 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210061306228 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210061306228 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210061306228 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210061306240 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210061306248 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210061306248 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210061306248 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:13:08.926318 run osmo-msc_10.42.42.6(pid=3328): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3328)] 06:13:08.973762 run osmo-msc_10.42.42.6(pid=3328): stdout: | (launched: 2022-12-10_06:13:07.884106) 06:13:09.022868 run osmo-msc_10.42.42.6(pid=3328): stderr: | 20221210061308154 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210061308155 DLGLOBAL DEBUG validating counter group 0x7fef03311c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210061308155 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210061308155 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210061308155 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210061308155 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210061308157 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210061308157 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210061308157 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210061308157 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:13:09.072271 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3321): Terminating (SIGTERM) 06:13:09.111834 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3324): Terminating (SIGTERM) 06:13:09.151185 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3327): Terminating (SIGTERM) 06:13:09.190714 --- ParallelTerminationStrategy: PID 3321 died... 06:13:09.209618 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3321): Terminated: ok {rc=0} 06:13:09.253900 --- ParallelTerminationStrategy: PID 3324 died... 06:13:09.272348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3324): Terminated: ok {rc=0} 06:13:09.316412 --- ParallelTerminationStrategy: PID 3327 died... 06:13:09.335033 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3327): Terminated: ok {rc=0} 06:13:09.422005 bus /sierra_3: Setting Powered False 06:13:10.520688 bus /sierra_3: Setting Powered False 06:13:11.631855 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2370 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 06:13:12.778146 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:13:12.790174 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 06:13:12.861621 tst mo_mt_call_osmux.py: using LAC 26405 06:13:12.979167 tst mo_mt_call_osmux.py: using RAC 140 06:13:13.102771 tst mo_mt_call_osmux.py: using CellId 26405 06:13:13.227468 tst mo_mt_call_osmux.py: using BVCI 26406 06:13:13.341909 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:13:13.353466 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:13:13.364723 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:13:13.376109 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:13:13.387504 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:13:13.398868 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 06:13:13.515015 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 06:13:13.634856 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:13:14.116460 run create_hlr_db(pid=3330): Launched 06:13:14.243401 bus /sierra_2: Setting Powered False 06:13:15.305459 run create_hlr_db(pid=3330): Terminated: ok {rc=0} 06:13:15.721639 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3332): Launched 06:13:16.050732 run osmo-hlr_10.42.42.2(pid=3333): Launched 06:13:16.351770 run osmo-stp_10.42.42.5: Starting osmo-stp 06:13:16.961792 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3335): Launched 06:13:17.276354 run osmo-stp_10.42.42.5(pid=3336): Launched 06:13:17.402848 run osmo-msc_10.42.42.6: Starting osmo-msc 06:13:17.971686 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3338): Launched 06:13:18.284299 run osmo-msc_10.42.42.6(pid=3339): Launched 06:13:18.458064 run osmo-stp_10.42.42.5(pid=3336): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3336)] 06:13:18.590853 run osmo-stp_10.42.42.5(pid=3336): stdout: | (launched: 2022-12-10_06:13:17.207567) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:13:18.723997 run osmo-stp_10.42.42.5(pid=3336): stderr: | 20221210061317416 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061317416 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061317417 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061317417 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061317418 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061317418 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061317418 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:13:18.855694 run osmo-stp_10.42.42.5(pid=3336): stdout: | (launched: 2022-12-10_06:13:17.207567) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:13:18.979482 run osmo-stp_10.42.42.5(pid=3336): stderr: | 20221210061317416 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061317416 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061317417 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061317417 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061317418 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061317418 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061317418 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:13:19.127932 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3336): Process ended prematurely: osmo-stp_10.42.42.5(pid=3336) [trial-2370↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3336)] [trial-2370↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 06:13:19.137685 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 06:13:19.165155 run osmo-hlr_10.42.42.2(pid=3333): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3333)] 06:13:19.214625 run osmo-hlr_10.42.42.2(pid=3333): stdout: | (launched: 2022-12-10_06:13:15.990895) 06:13:19.265533 run osmo-hlr_10.42.42.2(pid=3333): stderr: | 20221210061316246 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210061316246 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210061316246 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210061316247 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210061316247 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210061316247 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210061316267 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210061316287 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210061316287 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210061316287 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:13:19.336429 run osmo-msc_10.42.42.6(pid=3339): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3339)] 06:13:19.385839 run osmo-msc_10.42.42.6(pid=3339): stdout: | (launched: 2022-12-10_06:13:18.227335) 06:13:19.436629 run osmo-msc_10.42.42.6(pid=3339): stderr: | 20221210061318547 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210061318548 DLGLOBAL DEBUG validating counter group 0x7fec9e637c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210061318548 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210061318548 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210061318548 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210061318548 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210061318550 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210061318550 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210061318550 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210061318550 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:13:19.487873 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3332): Terminating (SIGTERM) 06:13:19.528686 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3335): Terminating (SIGTERM) 06:13:19.569898 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3338): Terminating (SIGTERM) 06:13:19.611118 --- ParallelTerminationStrategy: PID 3332 died... 06:13:19.630816 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3332): Terminated: ok {rc=0} 06:13:19.676603 --- ParallelTerminationStrategy: PID 3335 died... 06:13:19.695903 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3335): Terminated: ok {rc=0} 06:13:19.741232 --- ParallelTerminationStrategy: PID 3338 died... 06:13:19.760286 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3338): Terminated: ok {rc=0} 06:13:19.846688 bus /sierra_3: Setting Powered False 06:13:20.944838 bus /sierra_3: Setting Powered False 06:13:22.059151 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 06:13:23.299821 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:13:23.306388 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 06:13:23.339519 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 06:13:23.365671 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 06:13:23.416670 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 06:13:23.449236 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 06:13:23.475386 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 06:13:24.024526 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 06:13:24.071502 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:13:24.082504 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 06:13:24.151172 tst mo_mt_call.py: using LAC 26406 06:13:24.274730 tst mo_mt_call.py: using RAC 141 06:13:24.397738 tst mo_mt_call.py: using CellId 26406 06:13:24.522426 tst mo_mt_call.py: using BVCI 26407 06:13:24.637985 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:13:24.649816 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:13:24.661237 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:13:24.672738 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:13:24.684371 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:13:24.696012 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 06:13:24.810150 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 06:13:24.925489 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:13:25.410654 run create_hlr_db(pid=3344): Launched 06:13:25.537650 bus /sierra_2: Setting Powered False 06:13:26.599623 run create_hlr_db(pid=3344): Terminated: ok {rc=0} 06:13:27.036464 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3346): Launched 06:13:27.350027 run osmo-hlr_10.42.42.2(pid=3347): Launched 06:13:27.469465 run osmo-stp_10.42.42.5: Starting osmo-stp 06:13:28.014903 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3349): Launched 06:13:28.327400 run osmo-stp_10.42.42.5(pid=3350): Launched 06:13:28.446750 run osmo-msc_10.42.42.6: Starting osmo-msc 06:13:29.012882 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3352): Launched 06:13:29.325758 run osmo-msc_10.42.42.6(pid=3353): Launched 06:13:29.500097 run osmo-stp_10.42.42.5(pid=3350): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3350)] 06:13:29.631909 run osmo-stp_10.42.42.5(pid=3350): stdout: | (launched: 2022-12-10_06:13:28.270028) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:13:29.765278 run osmo-stp_10.42.42.5(pid=3350): stderr: | 20221210061328460 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061328460 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061328461 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061328461 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061328462 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061328462 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061328462 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:13:29.897209 run osmo-stp_10.42.42.5(pid=3350): stdout: | (launched: 2022-12-10_06:13:28.270028) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:13:30.021593 run osmo-stp_10.42.42.5(pid=3350): stderr: | 20221210061328460 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061328460 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061328461 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061328461 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061328462 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061328462 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061328462 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:13:30.170503 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3350): Process ended prematurely: osmo-stp_10.42.42.5(pid=3350) [trial-2370↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3350)] [trial-2370↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 06:13:30.180036 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 06:13:30.207549 run osmo-hlr_10.42.42.2(pid=3347): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3347)] 06:13:30.257181 run osmo-hlr_10.42.42.2(pid=3347): stdout: | (launched: 2022-12-10_06:13:27.292678) 06:13:30.308428 run osmo-hlr_10.42.42.2(pid=3347): stderr: | 20221210061327491 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210061327491 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210061327491 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210061327491 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210061327491 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210061327491 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210061327505 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210061327515 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210061327515 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210061327515 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:13:30.379705 run osmo-msc_10.42.42.6(pid=3353): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3353)] 06:13:30.429184 run osmo-msc_10.42.42.6(pid=3353): stdout: | (launched: 2022-12-10_06:13:29.268696) 06:13:30.480114 run osmo-msc_10.42.42.6(pid=3353): stderr: | 20221210061329590 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210061329590 DLGLOBAL DEBUG validating counter group 0x7fa5cf447c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210061329590 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210061329590 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210061329590 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210061329590 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210061329592 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210061329592 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210061329593 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210061329593 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:13:30.531478 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3346): Terminating (SIGTERM) 06:13:30.572371 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3349): Terminating (SIGTERM) 06:13:30.613446 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3352): Terminating (SIGTERM) 06:13:30.655250 --- ParallelTerminationStrategy: PID 3346 died... 06:13:30.675064 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3346): Terminated: ok {rc=0} 06:13:30.720880 --- ParallelTerminationStrategy: PID 3349 died... 06:13:30.740246 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3349): Terminated: ok {rc=0} 06:13:30.786337 --- ParallelTerminationStrategy: PID 3352 died... 06:13:30.805893 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3352): Terminated: ok {rc=0} 06:13:30.903545 bus /sierra_3: Setting Powered False 06:13:32.012800 bus /sierra_3: Setting Powered False 06:13:33.129548 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2370 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 06:13:34.272823 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:13:34.284392 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 06:13:34.353360 tst mo_mt_call_osmux.py: using LAC 26407 06:13:34.469731 tst mo_mt_call_osmux.py: using RAC 142 06:13:34.585371 tst mo_mt_call_osmux.py: using CellId 26407 06:13:34.710379 tst mo_mt_call_osmux.py: using BVCI 26408 06:13:34.823185 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:13:34.834818 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:13:34.846295 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:13:34.857799 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:13:34.869367 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:13:34.880839 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 06:13:34.997172 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 06:13:35.116535 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:13:35.600176 run create_hlr_db(pid=3355): Launched 06:13:35.727821 bus /sierra_2: Setting Powered False 06:13:36.788296 run create_hlr_db(pid=3355): Terminated: ok {rc=0} 06:13:37.205567 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3357): Launched 06:13:37.518974 run osmo-hlr_10.42.42.2(pid=3358): Launched 06:13:37.637817 run osmo-stp_10.42.42.5: Starting osmo-stp 06:13:38.176453 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3360): Launched 06:13:38.488719 run osmo-stp_10.42.42.5(pid=3361): Launched 06:13:38.608016 run osmo-msc_10.42.42.6: Starting osmo-msc 06:13:39.174570 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3363): Launched 06:13:39.486799 run osmo-msc_10.42.42.6(pid=3364): Launched 06:13:39.662881 run osmo-stp_10.42.42.5(pid=3361): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3361)] 06:13:39.795482 run osmo-stp_10.42.42.5(pid=3361): stdout: | (launched: 2022-12-10_06:13:38.431702) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:13:39.927963 run osmo-stp_10.42.42.5(pid=3361): stderr: | 20221210061338622 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061338622 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061338622 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061338623 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061338623 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061338623 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061338623 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:13:40.061711 run osmo-stp_10.42.42.5(pid=3361): stdout: | (launched: 2022-12-10_06:13:38.431702) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:13:40.186197 run osmo-stp_10.42.42.5(pid=3361): stderr: | 20221210061338622 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061338622 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061338622 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061338623 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061338623 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061338623 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061338623 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:13:40.335424 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3361): Process ended prematurely: osmo-stp_10.42.42.5(pid=3361) [trial-2370↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3361)] [trial-2370↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 06:13:40.345113 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 06:13:40.373038 run osmo-hlr_10.42.42.2(pid=3358): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3358)] 06:13:40.422762 run osmo-hlr_10.42.42.2(pid=3358): stdout: | (launched: 2022-12-10_06:13:37.461926) 06:13:40.474166 run osmo-hlr_10.42.42.2(pid=3358): stderr: | 20221210061337658 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210061337658 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210061337658 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210061337658 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210061337659 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210061337659 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210061337671 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210061337681 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210061337682 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210061337682 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:13:40.545650 run osmo-msc_10.42.42.6(pid=3364): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3364)] 06:13:40.595103 run osmo-msc_10.42.42.6(pid=3364): stdout: | (launched: 2022-12-10_06:13:39.429838) 06:13:40.646283 run osmo-msc_10.42.42.6(pid=3364): stderr: | 20221210061339750 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210061339750 DLGLOBAL DEBUG validating counter group 0x7fa4889a9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210061339750 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210061339750 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210061339751 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210061339751 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210061339752 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210061339753 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210061339753 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210061339753 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:13:40.697803 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3357): Terminating (SIGTERM) 06:13:40.739149 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3360): Terminating (SIGTERM) 06:13:40.780247 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3363): Terminating (SIGTERM) 06:13:40.821546 --- ParallelTerminationStrategy: PID 3357 died... 06:13:40.841300 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3357): Terminated: ok {rc=0} 06:13:40.887067 --- ParallelTerminationStrategy: PID 3360 died... 06:13:40.906449 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3360): Terminated: ok {rc=0} 06:13:40.952146 --- ParallelTerminationStrategy: PID 3363 died... 06:13:40.971512 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3363): Terminated: ok {rc=0} 06:13:41.058418 bus /sierra_3: Setting Powered False 06:13:42.153143 bus /sierra_3: Setting Powered False 06:13:43.266772 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 06:13:44.515258 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:13:44.522469 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 06:13:44.556346 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 06:13:44.583593 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 06:13:44.639510 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 06:13:44.674243 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 06:13:44.701458 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 06:13:45.248925 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 06:13:45.299268 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:13:45.310813 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 06:13:45.384313 tst mo_mt_call.py: using LAC 26408 06:13:45.509899 tst mo_mt_call.py: using RAC 143 06:13:45.631134 tst mo_mt_call.py: using CellId 26408 06:13:45.745714 tst mo_mt_call.py: using BVCI 26409 06:13:45.880569 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:13:45.893545 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:13:45.905618 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:13:45.917504 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:13:45.930429 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:13:45.944427 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 06:13:46.064206 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 06:13:46.183996 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:13:46.665685 run create_hlr_db(pid=3369): Launched 06:13:46.829302 bus /sierra_2: Setting Powered False 06:13:47.891908 run create_hlr_db(pid=3369): Terminated: ok {rc=0} 06:13:48.328314 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3371): Launched 06:13:48.642318 run osmo-hlr_10.42.42.2(pid=3372): Launched 06:13:48.761928 run osmo-stp_10.42.42.5: Starting osmo-stp 06:13:49.301226 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3374): Launched 06:13:49.613661 run osmo-stp_10.42.42.5(pid=3375): Launched 06:13:49.733712 run osmo-msc_10.42.42.6: Starting osmo-msc 06:13:50.299723 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3377): Launched 06:13:50.612263 run osmo-msc_10.42.42.6(pid=3378): Launched 06:13:50.787513 run osmo-stp_10.42.42.5(pid=3375): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3375)] 06:13:50.920299 run osmo-stp_10.42.42.5(pid=3375): stdout: | (launched: 2022-12-10_06:13:49.556564) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:13:51.054848 run osmo-stp_10.42.42.5(pid=3375): stderr: | 20221210061349746 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061349747 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061349747 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061349747 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061349748 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061349748 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061349748 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:13:51.186743 run osmo-stp_10.42.42.5(pid=3375): stdout: | (launched: 2022-12-10_06:13:49.556564) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:13:51.310980 run osmo-stp_10.42.42.5(pid=3375): stderr: | 20221210061349746 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061349747 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061349747 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061349747 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061349748 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061349748 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061349748 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:13:51.459937 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3375): Process ended prematurely: osmo-stp_10.42.42.5(pid=3375) [trial-2370↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3375)] [trial-2370↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 06:13:51.469496 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 06:13:51.496887 run osmo-hlr_10.42.42.2(pid=3372): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3372)] 06:13:51.545927 run osmo-hlr_10.42.42.2(pid=3372): stdout: | (launched: 2022-12-10_06:13:48.584904) 06:13:51.596924 run osmo-hlr_10.42.42.2(pid=3372): stderr: | 20221210061348782 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210061348782 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210061348782 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210061348782 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210061348782 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210061348782 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210061348795 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210061348803 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210061348803 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210061348804 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:13:51.668214 run osmo-msc_10.42.42.6(pid=3378): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3378)] 06:13:51.717709 run osmo-msc_10.42.42.6(pid=3378): stdout: | (launched: 2022-12-10_06:13:50.554562) 06:13:51.768311 run osmo-msc_10.42.42.6(pid=3378): stderr: | 20221210061350876 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210061350876 DLGLOBAL DEBUG validating counter group 0x7f1285cd4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210061350876 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210061350876 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210061350876 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210061350877 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210061350878 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210061350879 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210061350879 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210061350879 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:13:51.819540 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3371): Terminating (SIGTERM) 06:13:51.860369 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3374): Terminating (SIGTERM) 06:13:51.901267 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3377): Terminating (SIGTERM) 06:13:51.942657 --- ParallelTerminationStrategy: PID 3371 died... 06:13:51.962296 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3371): Terminated: ok {rc=0} 06:13:52.007564 --- ParallelTerminationStrategy: PID 3374 died... 06:13:52.026877 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3374): Terminated: ok {rc=0} 06:13:52.071945 --- ParallelTerminationStrategy: PID 3377 died... 06:13:52.091250 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3377): Terminated: ok {rc=0} 06:13:52.176746 bus /sierra_3: Setting Powered False 06:13:53.274147 bus /sierra_3: Setting Powered False 06:13:54.388808 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2370 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 06:13:55.531473 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:13:55.543229 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 06:13:55.615372 tst mo_mt_call_osmux.py: using LAC 26409 06:13:55.729203 tst mo_mt_call_osmux.py: using RAC 144 06:13:55.842099 tst mo_mt_call_osmux.py: using CellId 26409 06:13:55.957564 tst mo_mt_call_osmux.py: using BVCI 26410 06:13:56.071162 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:13:56.082872 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:13:56.094292 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:13:56.105784 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:13:56.117292 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:13:56.128439 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 06:13:56.242384 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 06:13:56.360861 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:13:56.810937 run create_hlr_db(pid=3380): Launched 06:13:56.923692 bus /sierra_2: Setting Powered False 06:13:57.981169 run create_hlr_db(pid=3380): Terminated: ok {rc=0} 06:13:58.407348 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3382): Launched 06:13:58.720536 run osmo-hlr_10.42.42.2(pid=3383): Launched 06:13:58.839500 run osmo-stp_10.42.42.5: Starting osmo-stp 06:13:59.377342 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3385): Launched 06:13:59.687865 run osmo-stp_10.42.42.5(pid=3386): Launched 06:13:59.806838 run osmo-msc_10.42.42.6: Starting osmo-msc 06:14:00.369936 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3388): Launched 06:14:00.681257 run osmo-msc_10.42.42.6(pid=3389): Launched 06:14:00.900234 run osmo-stp_10.42.42.5(pid=3386): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3386)] 06:14:01.120480 run osmo-stp_10.42.42.5(pid=3386): stdout: | (launched: 2022-12-10_06:13:59.630912) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:14:01.425678 run osmo-stp_10.42.42.5(pid=3386): stderr: | 20221210061359822 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061359822 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061359822 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061359823 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061359825 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061359825 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061359825 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:14:01.554360 run osmo-stp_10.42.42.5(pid=3386): stdout: | (launched: 2022-12-10_06:13:59.630912) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:14:01.678151 run osmo-stp_10.42.42.5(pid=3386): stderr: | 20221210061359822 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061359822 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061359822 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061359823 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061359825 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061359825 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061359825 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:14:01.824109 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3386): Process ended prematurely: osmo-stp_10.42.42.5(pid=3386) [trial-2370↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3386)] [trial-2370↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 06:14:01.834451 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 06:14:01.864519 run osmo-hlr_10.42.42.2(pid=3383): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3383)] 06:14:01.914570 run osmo-hlr_10.42.42.2(pid=3383): stdout: | (launched: 2022-12-10_06:13:58.663375) 06:14:01.965779 run osmo-hlr_10.42.42.2(pid=3383): stderr: | 20221210061358861 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210061358861 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210061358861 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210061358861 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210061358861 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210061358861 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210061358876 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210061358884 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210061358884 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210061358884 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:14:02.039334 run osmo-msc_10.42.42.6(pid=3389): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3389)] 06:14:02.089352 run osmo-msc_10.42.42.6(pid=3389): stdout: | (launched: 2022-12-10_06:14:00.623966) 06:14:02.140631 run osmo-msc_10.42.42.6(pid=3389): stderr: | 20221210061401059 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210061401059 DLGLOBAL DEBUG validating counter group 0x7f03663acc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210061401059 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210061401059 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210061401059 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210061401059 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210061401061 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210061401062 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210061401062 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210061401062 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:14:02.193403 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3382): Terminating (SIGTERM) 06:14:02.235532 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3385): Terminating (SIGTERM) 06:14:02.278930 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3388): Terminating (SIGTERM) 06:14:02.319966 --- ParallelTerminationStrategy: PID 3382 died... 06:14:02.339419 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3382): Terminated: ok {rc=0} 06:14:02.383265 --- ParallelTerminationStrategy: PID 3385 died... 06:14:02.401381 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3385): Terminated: ok {rc=0} 06:14:02.444839 --- ParallelTerminationStrategy: PID 3388 died... 06:14:02.463538 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3388): Terminated: ok {rc=0} 06:14:02.547804 bus /sierra_3: Setting Powered False 06:14:03.645200 bus /sierra_3: Setting Powered False 06:14:04.759087 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 06:14:06.008433 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:14:06.016313 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 06:14:06.049438 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 06:14:06.075815 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 06:14:06.126330 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 06:14:06.160656 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 06:14:06.187734 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 06:14:06.739048 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 06:14:06.789938 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:14:06.801553 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 06:14:06.871393 tst mo_mt_call.py: using LAC 26410 06:14:06.995580 tst mo_mt_call.py: using RAC 145 06:14:07.118314 tst mo_mt_call.py: using CellId 26410 06:14:07.239273 tst mo_mt_call.py: using BVCI 26411 06:14:07.352764 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:14:07.364380 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:14:07.375759 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:14:07.387382 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:14:07.399344 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:14:07.411685 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 06:14:07.526810 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 06:14:07.644844 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:14:08.128345 run create_hlr_db(pid=3396): Launched 06:14:08.255120 bus /sierra_2: Setting Powered False 06:14:09.317615 run create_hlr_db(pid=3396): Terminated: ok {rc=0} 06:14:09.734512 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3398): Launched 06:14:10.026521 run osmo-hlr_10.42.42.2(pid=3399): Launched 06:14:10.137217 run osmo-stp_10.42.42.5: Starting osmo-stp 06:14:10.639235 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3401): Launched 06:14:10.930005 run osmo-stp_10.42.42.5(pid=3402): Launched 06:14:11.041701 run osmo-msc_10.42.42.6: Starting osmo-msc 06:14:11.570993 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3404): Launched 06:14:11.862903 run osmo-msc_10.42.42.6(pid=3405): Launched 06:14:12.026748 run osmo-stp_10.42.42.5(pid=3402): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3402)] 06:14:12.150348 run osmo-stp_10.42.42.5(pid=3402): stdout: | (launched: 2022-12-10_06:14:10.876445) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:14:12.275512 run osmo-stp_10.42.42.5(pid=3402): stderr: | 20221210061411048 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061411048 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061411048 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061411048 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061411049 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061411049 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061411049 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:14:12.397272 run osmo-stp_10.42.42.5(pid=3402): stdout: | (launched: 2022-12-10_06:14:10.876445) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:14:12.513298 run osmo-stp_10.42.42.5(pid=3402): stderr: | 20221210061411048 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061411048 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061411048 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061411048 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061411049 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061411049 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061411049 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:14:12.652209 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3402): Process ended prematurely: osmo-stp_10.42.42.5(pid=3402) [trial-2370↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3402)] [trial-2370↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 06:14:12.661210 tst mo_mt_call.py:8: Test FAILED (5.9 sec) 06:14:12.687906 run osmo-hlr_10.42.42.2(pid=3399): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3399)] 06:14:12.735035 run osmo-hlr_10.42.42.2(pid=3399): stdout: | (launched: 2022-12-10_06:14:09.972853) 06:14:12.783767 run osmo-hlr_10.42.42.2(pid=3399): stderr: | 20221210061410148 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210061410148 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210061410148 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210061410148 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210061410148 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210061410148 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210061410160 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210061410168 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210061410169 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210061410169 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:14:12.851731 run osmo-msc_10.42.42.6(pid=3405): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3405)] 06:14:12.899269 run osmo-msc_10.42.42.6(pid=3405): stdout: | (launched: 2022-12-10_06:14:11.809344) 06:14:12.947747 run osmo-msc_10.42.42.6(pid=3405): stderr: | 20221210061412081 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210061412082 DLGLOBAL DEBUG validating counter group 0x7f8615fbdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210061412082 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210061412082 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210061412082 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210061412082 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210061412084 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210061412084 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210061412084 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210061412085 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:14:12.997225 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3398): Terminating (SIGTERM) 06:14:13.036236 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3401): Terminating (SIGTERM) 06:14:13.075060 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3404): Terminating (SIGTERM) 06:14:13.114753 --- ParallelTerminationStrategy: PID 3398 died... 06:14:13.133843 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3398): Terminated: ok {rc=0} 06:14:13.177160 --- ParallelTerminationStrategy: PID 3401 died... 06:14:13.195367 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3401): Terminated: ok {rc=0} 06:14:13.239576 --- ParallelTerminationStrategy: PID 3404 died... 06:14:13.257927 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3404): Terminated: ok {rc=0} 06:14:13.342380 bus /sierra_3: Setting Powered False 06:14:14.438625 bus /sierra_3: Setting Powered False 06:14:15.554222 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2370 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 06:14:16.718252 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:14:16.734242 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 06:14:16.821814 tst mo_mt_call_osmux.py: using LAC 26411 06:14:16.969316 tst mo_mt_call_osmux.py: using RAC 146 06:14:17.096237 tst mo_mt_call_osmux.py: using CellId 26411 06:14:17.237591 tst mo_mt_call_osmux.py: using BVCI 26412 06:14:17.348758 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:14:17.360023 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:14:17.370900 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:14:17.382510 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:14:17.393658 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:14:17.404745 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 06:14:17.523182 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 06:14:17.642687 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:14:18.093910 run create_hlr_db(pid=3407): Launched 06:14:18.205506 bus /sierra_2: Setting Powered False 06:14:19.263831 run create_hlr_db(pid=3407): Terminated: ok {rc=0} 06:14:19.692240 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3409): Launched 06:14:20.005321 run osmo-hlr_10.42.42.2(pid=3410): Launched 06:14:20.124555 run osmo-stp_10.42.42.5: Starting osmo-stp 06:14:20.668119 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3412): Launched 06:14:20.981786 run osmo-stp_10.42.42.5(pid=3413): Launched 06:14:21.102160 run osmo-msc_10.42.42.6: Starting osmo-msc 06:14:21.669676 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3415): Launched 06:14:21.982940 run osmo-msc_10.42.42.6(pid=3416): Launched 06:14:22.157548 run osmo-stp_10.42.42.5(pid=3413): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3413)] 06:14:22.293834 run osmo-stp_10.42.42.5(pid=3413): stdout: | (launched: 2022-12-10_06:14:20.923596) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:14:22.427480 run osmo-stp_10.42.42.5(pid=3413): stderr: | 20221210061421116 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061421116 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061421116 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061421117 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061421117 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061421117 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061421117 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:14:22.558693 run osmo-stp_10.42.42.5(pid=3413): stdout: | (launched: 2022-12-10_06:14:20.923596) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:14:22.683705 run osmo-stp_10.42.42.5(pid=3413): stderr: | 20221210061421116 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061421116 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061421116 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061421117 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061421117 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061421117 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061421117 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:14:22.832893 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3413): Process ended prematurely: osmo-stp_10.42.42.5(pid=3413) [trial-2370↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3413)] [trial-2370↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 06:14:22.842528 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 06:14:22.870280 run osmo-hlr_10.42.42.2(pid=3410): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3410)] 06:14:22.920042 run osmo-hlr_10.42.42.2(pid=3410): stdout: | (launched: 2022-12-10_06:14:19.948254) 06:14:22.971496 run osmo-hlr_10.42.42.2(pid=3410): stderr: | 20221210061420148 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210061420149 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210061420149 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210061420149 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210061420149 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210061420149 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210061420161 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210061420169 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210061420170 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210061420170 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:14:23.043230 run osmo-msc_10.42.42.6(pid=3416): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3416)] 06:14:23.093409 run osmo-msc_10.42.42.6(pid=3416): stdout: | (launched: 2022-12-10_06:14:21.925346) 06:14:23.144841 run osmo-msc_10.42.42.6(pid=3416): stderr: | 20221210061422246 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210061422246 DLGLOBAL DEBUG validating counter group 0x7fbe86e10c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210061422247 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210061422247 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210061422247 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210061422247 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210061422249 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210061422249 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210061422249 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210061422249 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:14:23.196445 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3409): Terminating (SIGTERM) 06:14:23.237605 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3412): Terminating (SIGTERM) 06:14:23.279126 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3415): Terminating (SIGTERM) 06:14:23.320737 --- ParallelTerminationStrategy: PID 3409 died... 06:14:23.340542 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3409): Terminated: ok {rc=0} 06:14:23.386351 --- ParallelTerminationStrategy: PID 3412 died... 06:14:23.405948 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3412): Terminated: ok {rc=0} 06:14:23.451522 --- ParallelTerminationStrategy: PID 3415 died... 06:14:23.470962 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3415): Terminated: ok {rc=0} 06:14:23.558173 bus /sierra_3: Setting Powered False 06:14:24.657040 bus /sierra_3: Setting Powered False 06:14:25.775454 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 06:14:27.024148 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:14:27.030500 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 06:14:27.063393 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 06:14:27.089664 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 06:14:27.140536 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 06:14:27.172680 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 06:14:27.198465 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 06:14:27.748263 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 06:14:27.794803 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:14:27.805674 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 06:14:27.873377 tst mo_mt_call.py: using LAC 26412 06:14:27.989219 tst mo_mt_call.py: using RAC 147 06:14:28.112901 tst mo_mt_call.py: using CellId 26412 06:14:28.235804 tst mo_mt_call.py: using BVCI 26413 06:14:28.350526 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:14:28.361991 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:14:28.373061 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:14:28.384326 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:14:28.395962 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:14:28.407127 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 06:14:28.520192 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 06:14:28.636360 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:14:29.119598 run create_hlr_db(pid=3422): Launched 06:14:29.247307 bus /sierra_2: Setting Powered False 06:14:30.308893 run create_hlr_db(pid=3422): Terminated: ok {rc=0} 06:14:30.726229 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3424): Launched 06:14:31.049842 run osmo-hlr_10.42.42.2(pid=3425): Launched 06:14:31.249886 run osmo-stp_10.42.42.5: Starting osmo-stp 06:14:31.981098 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3427): Launched 06:14:32.282881 run osmo-stp_10.42.42.5(pid=3428): Launched 06:14:32.435223 run osmo-msc_10.42.42.6: Starting osmo-msc 06:14:32.975464 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3430): Launched 06:14:33.268147 run osmo-msc_10.42.42.6(pid=3431): Launched 06:14:33.431621 run osmo-stp_10.42.42.5(pid=3428): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3428)] 06:14:33.560026 run osmo-stp_10.42.42.5(pid=3428): stdout: | (launched: 2022-12-10_06:14:32.227175) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:14:33.685173 run osmo-stp_10.42.42.5(pid=3428): stderr: | 20221210061432446 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061432446 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061432446 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061432447 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061432447 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061432447 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061432447 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:14:33.807422 run osmo-stp_10.42.42.5(pid=3428): stdout: | (launched: 2022-12-10_06:14:32.227175) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:14:33.923168 run osmo-stp_10.42.42.5(pid=3428): stderr: | 20221210061432446 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061432446 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061432446 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061432447 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061432447 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061432447 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061432447 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:14:34.062423 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3428): Process ended prematurely: osmo-stp_10.42.42.5(pid=3428) [trial-2370↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3428)] [trial-2370↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 06:14:34.071318 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 06:14:34.097785 run osmo-hlr_10.42.42.2(pid=3425): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3425)] 06:14:34.145226 run osmo-hlr_10.42.42.2(pid=3425): stdout: | (launched: 2022-12-10_06:14:30.991105) 06:14:34.194179 run osmo-hlr_10.42.42.2(pid=3425): stderr: | 20221210061431321 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210061431321 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210061431321 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210061431321 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210061431321 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210061431321 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210061431343 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210061431352 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210061431352 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210061431352 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:14:34.262277 run osmo-msc_10.42.42.6(pid=3431): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3431)] 06:14:34.309944 run osmo-msc_10.42.42.6(pid=3431): stdout: | (launched: 2022-12-10_06:14:33.214328) 06:14:34.358789 run osmo-msc_10.42.42.6(pid=3431): stderr: | 20221210061433484 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210061433484 DLGLOBAL DEBUG validating counter group 0x7ff59f1dfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210061433484 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210061433484 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210061433484 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210061433484 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210061433486 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210061433487 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210061433487 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210061433487 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:14:34.407932 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3424): Terminating (SIGTERM) 06:14:34.446913 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3427): Terminating (SIGTERM) 06:14:34.485887 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3430): Terminating (SIGTERM) 06:14:34.525114 --- ParallelTerminationStrategy: PID 3424 died... 06:14:34.543940 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3424): Terminated: ok {rc=0} 06:14:34.587275 --- ParallelTerminationStrategy: PID 3427 died... 06:14:34.605433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3427): Terminated: ok {rc=0} 06:14:34.648870 --- ParallelTerminationStrategy: PID 3430 died... 06:14:34.667699 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3430): Terminated: ok {rc=0} 06:14:34.754316 bus /sierra_3: Setting Powered False 06:14:35.851517 bus /sierra_3: Setting Powered False 06:14:36.965511 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2370 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 06:14:38.108925 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:14:38.120614 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 06:14:38.189486 tst mo_mt_call_osmux.py: using LAC 26413 06:14:38.306890 tst mo_mt_call_osmux.py: using RAC 148 06:14:38.421260 tst mo_mt_call_osmux.py: using CellId 26413 06:14:38.535117 tst mo_mt_call_osmux.py: using BVCI 26414 06:14:38.640661 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:14:38.651677 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:14:38.662503 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:14:38.673980 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:14:38.684888 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:14:38.696034 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 06:14:38.810381 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 06:14:38.924499 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:14:39.376770 run create_hlr_db(pid=3433): Launched 06:14:39.487900 bus /sierra_2: Setting Powered False 06:14:40.546647 run create_hlr_db(pid=3433): Terminated: ok {rc=0} 06:14:40.973722 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3435): Launched 06:14:41.285191 run osmo-hlr_10.42.42.2(pid=3436): Launched 06:14:41.404694 run osmo-stp_10.42.42.5: Starting osmo-stp 06:14:41.946047 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3438): Launched 06:14:42.257755 run osmo-stp_10.42.42.5(pid=3439): Launched 06:14:42.376794 run osmo-msc_10.42.42.6: Starting osmo-msc 06:14:42.941659 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3441): Launched 06:14:43.254129 run osmo-msc_10.42.42.6(pid=3442): Launched 06:14:43.427835 run osmo-stp_10.42.42.5(pid=3439): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3439)] 06:14:43.559669 run osmo-stp_10.42.42.5(pid=3439): stdout: | (launched: 2022-12-10_06:14:42.200866) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:14:43.692180 run osmo-stp_10.42.42.5(pid=3439): stderr: | 20221210061442390 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061442391 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061442391 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061442391 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061442392 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061442392 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061442392 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:14:43.824703 run osmo-stp_10.42.42.5(pid=3439): stdout: | (launched: 2022-12-10_06:14:42.200866) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:14:43.948378 run osmo-stp_10.42.42.5(pid=3439): stderr: | 20221210061442390 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061442391 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061442391 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061442391 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061442392 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061442392 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061442392 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:14:44.096735 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3439): Process ended prematurely: osmo-stp_10.42.42.5(pid=3439) [trial-2370↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3439)] [trial-2370↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 06:14:44.106330 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 06:14:44.133654 run osmo-hlr_10.42.42.2(pid=3436): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3436)] 06:14:44.182464 run osmo-hlr_10.42.42.2(pid=3436): stdout: | (launched: 2022-12-10_06:14:41.228388) 06:14:44.233214 run osmo-hlr_10.42.42.2(pid=3436): stderr: | 20221210061441427 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210061441427 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210061441427 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210061441427 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210061441428 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210061441428 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210061441440 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210061441448 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210061441448 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210061441448 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:14:44.303797 run osmo-msc_10.42.42.6(pid=3442): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3442)] 06:14:44.353111 run osmo-msc_10.42.42.6(pid=3442): stdout: | (launched: 2022-12-10_06:14:43.196548) 06:14:44.403699 run osmo-msc_10.42.42.6(pid=3442): stderr: | 20221210061443515 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210061443515 DLGLOBAL DEBUG validating counter group 0x7fce5d241c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210061443515 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210061443515 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210061443516 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210061443516 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210061443517 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210061443518 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210061443518 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210061443518 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:14:44.454802 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3435): Terminating (SIGTERM) 06:14:44.495510 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3438): Terminating (SIGTERM) 06:14:44.536312 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3441): Terminating (SIGTERM) 06:14:44.577341 --- ParallelTerminationStrategy: PID 3435 died... 06:14:44.596992 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3435): Terminated: ok {rc=0} 06:14:44.642360 --- ParallelTerminationStrategy: PID 3438 died... 06:14:44.661456 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3438): Terminated: ok {rc=0} 06:14:44.706698 --- ParallelTerminationStrategy: PID 3441 died... 06:14:44.725838 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3441): Terminated: ok {rc=0} 06:14:44.811246 bus /sierra_3: Setting Powered False 06:14:45.924803 bus /sierra_3: Setting Powered False 06:14:47.066116 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 06:14:48.332099 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:14:48.339894 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 06:14:48.374486 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 06:14:48.401066 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 06:14:48.454200 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 06:14:48.487024 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 06:14:48.513203 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 06:14:49.067527 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 06:14:49.117838 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:14:49.129433 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 06:14:49.200180 tst mo_mt_call.py: using LAC 26414 06:14:49.324927 tst mo_mt_call.py: using RAC 149 06:14:49.451625 tst mo_mt_call.py: using CellId 26414 06:14:49.573658 tst mo_mt_call.py: using BVCI 26415 06:14:49.686385 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:14:49.697957 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:14:49.709354 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:14:49.720710 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:14:49.732226 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:14:49.743574 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:14:49.856194 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:14:49.971380 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:14:50.423305 run create_hlr_db(pid=3447): Launched 06:14:50.535618 bus /sierra_2: Setting Powered False 06:14:51.593679 run create_hlr_db(pid=3447): Terminated: ok {rc=0} 06:14:52.021881 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3449): Launched 06:14:52.335214 run osmo-hlr_10.42.42.2(pid=3450): Launched 06:14:52.454990 run osmo-stp_10.42.42.5: Starting osmo-stp 06:14:52.996047 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3452): Launched 06:14:53.309755 run osmo-stp_10.42.42.5(pid=3453): Launched 06:14:53.429489 run osmo-msc_10.42.42.6: Starting osmo-msc 06:14:53.997152 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3455): Launched 06:14:54.309681 run osmo-msc_10.42.42.6(pid=3456): Launched 06:14:54.483595 run osmo-stp_10.42.42.5(pid=3453): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3453)] 06:14:54.616120 run osmo-stp_10.42.42.5(pid=3453): stdout: | (launched: 2022-12-10_06:14:53.252143) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:14:54.749726 run osmo-stp_10.42.42.5(pid=3453): stderr: | 20221210061453445 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061453446 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061453446 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061453446 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061453447 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061453447 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061453447 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:14:54.881419 run osmo-stp_10.42.42.5(pid=3453): stdout: | (launched: 2022-12-10_06:14:53.252143) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:14:55.005628 run osmo-stp_10.42.42.5(pid=3453): stderr: | 20221210061453445 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061453446 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061453446 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061453446 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061453447 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061453447 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061453447 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:14:55.154276 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3453): Process ended prematurely: osmo-stp_10.42.42.5(pid=3453) [trial-2370↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3453)] [trial-2370↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 06:14:55.163826 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 06:14:55.191186 run osmo-hlr_10.42.42.2(pid=3450): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3450)] 06:14:55.240193 run osmo-hlr_10.42.42.2(pid=3450): stdout: | (launched: 2022-12-10_06:14:52.278112) 06:14:55.291008 run osmo-hlr_10.42.42.2(pid=3450): stderr: | 20221210061452475 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210061452475 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210061452475 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210061452475 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210061452475 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210061452475 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210061452488 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210061452496 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210061452497 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210061452497 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:14:55.362764 run osmo-msc_10.42.42.6(pid=3456): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3456)] 06:14:55.411972 run osmo-msc_10.42.42.6(pid=3456): stdout: | (launched: 2022-12-10_06:14:54.252579) 06:14:55.462554 run osmo-msc_10.42.42.6(pid=3456): stderr: | 20221210061454573 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210061454573 DLGLOBAL DEBUG validating counter group 0x7f5a18e22c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210061454573 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210061454574 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210061454574 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210061454574 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210061454576 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210061454576 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210061454576 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210061454576 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:14:55.513529 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3449): Terminating (SIGTERM) 06:14:55.554606 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3452): Terminating (SIGTERM) 06:14:55.595447 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3455): Terminating (SIGTERM) 06:14:55.636495 --- ParallelTerminationStrategy: PID 3449 died... 06:14:55.656050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3449): Terminated: ok {rc=0} 06:14:55.701687 --- ParallelTerminationStrategy: PID 3452 died... 06:14:55.720484 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3452): Terminated: ok {rc=0} 06:14:55.765626 --- ParallelTerminationStrategy: PID 3455 died... 06:14:55.784936 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3455): Terminated: ok {rc=0} 06:14:55.870301 bus /sierra_3: Setting Powered False 06:14:56.967448 bus /sierra_3: Setting Powered False 06:14:58.081872 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2370 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 06:14:59.227460 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:14:59.239616 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 06:14:59.310562 tst mo_mt_call_osmux.py: using LAC 26415 06:14:59.435010 tst mo_mt_call_osmux.py: using RAC 150 06:14:59.559104 tst mo_mt_call_osmux.py: using CellId 26415 06:14:59.681295 tst mo_mt_call_osmux.py: using BVCI 26416 06:14:59.794159 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:14:59.805710 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:14:59.817109 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:14:59.828311 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:14:59.839662 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:14:59.851000 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:14:59.965610 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:15:00.079479 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:15:00.532151 run create_hlr_db(pid=3458): Launched 06:15:00.643777 bus /sierra_2: Setting Powered False 06:15:01.702340 run create_hlr_db(pid=3458): Terminated: ok {rc=0} 06:15:02.194367 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3463): Launched 06:15:02.500420 run osmo-hlr_10.42.42.2(pid=3464): Launched 06:15:02.613802 run osmo-stp_10.42.42.5: Starting osmo-stp 06:15:03.128040 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3466): Launched 06:15:03.419337 run osmo-stp_10.42.42.5(pid=3467): Launched 06:15:03.530183 run osmo-msc_10.42.42.6: Starting osmo-msc 06:15:04.063952 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3469): Launched 06:15:04.357162 run osmo-msc_10.42.42.6(pid=3470): Launched 06:15:04.522332 run osmo-stp_10.42.42.5(pid=3467): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3467)] 06:15:04.647552 run osmo-stp_10.42.42.5(pid=3467): stdout: | (launched: 2022-12-10_06:15:03.365557) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:15:04.773753 run osmo-stp_10.42.42.5(pid=3467): stderr: | 20221210061503535 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061503535 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061503536 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061503536 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061503537 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061503537 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061503537 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:15:04.896314 run osmo-stp_10.42.42.5(pid=3467): stdout: | (launched: 2022-12-10_06:15:03.365557) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:15:05.012849 run osmo-stp_10.42.42.5(pid=3467): stderr: | 20221210061503535 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061503535 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061503536 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061503536 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061503537 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061503537 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061503537 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:15:05.152616 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3467): Process ended prematurely: osmo-stp_10.42.42.5(pid=3467) [trial-2370↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3467)] [trial-2370↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 06:15:05.161776 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 06:15:05.188541 run osmo-hlr_10.42.42.2(pid=3464): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3464)] 06:15:05.235657 run osmo-hlr_10.42.42.2(pid=3464): stdout: | (launched: 2022-12-10_06:15:02.446849) 06:15:05.284250 run osmo-hlr_10.42.42.2(pid=3464): stderr: | 20221210061502621 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210061502621 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210061502621 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210061502621 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210061502621 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210061502621 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210061502637 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210061502645 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210061502646 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210061502646 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:15:05.352014 run osmo-msc_10.42.42.6(pid=3470): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3470)] 06:15:05.399422 run osmo-msc_10.42.42.6(pid=3470): stdout: | (launched: 2022-12-10_06:15:04.302984) 06:15:05.448544 run osmo-msc_10.42.42.6(pid=3470): stderr: | 20221210061504573 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210061504573 DLGLOBAL DEBUG validating counter group 0x7f535d243c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210061504573 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210061504574 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210061504574 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210061504574 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210061504576 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210061504577 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210061504578 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210061504578 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:15:05.497692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3463): Terminating (SIGTERM) 06:15:05.536849 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3466): Terminating (SIGTERM) 06:15:05.576234 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3469): Terminating (SIGTERM) 06:15:05.615866 --- ParallelTerminationStrategy: PID 3463 died... 06:15:05.634670 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3463): Terminated: ok {rc=0} 06:15:05.678565 --- ParallelTerminationStrategy: PID 3466 died... 06:15:05.696990 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3466): Terminated: ok {rc=0} 06:15:05.740551 --- ParallelTerminationStrategy: PID 3469 died... 06:15:05.759037 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3469): Terminated: ok {rc=0} 06:15:05.844101 bus /sierra_3: Setting Powered False 06:15:06.942187 bus /sierra_3: Setting Powered False 06:15:08.053376 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 voice:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 06:15:09.301896 tst voice:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:15:09.308052 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 06:15:09.341640 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 06:15:09.370149 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 06:15:09.422605 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 06:15:09.456894 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 06:15:09.483820 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 06:15:10.032004 tst voice:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 06:15:10.081944 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:15:10.093216 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 06:15:10.164411 tst mo_mt_call.py: using LAC 26416 06:15:10.289137 tst mo_mt_call.py: using RAC 151 06:15:10.412921 tst mo_mt_call.py: using CellId 26416 06:15:10.534602 tst mo_mt_call.py: using BVCI 26417 06:15:10.647791 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:15:10.659055 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:15:10.670147 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:15:10.681204 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:15:10.692569 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:15:10.703786 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 06:15:10.817404 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 06:15:10.933130 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:15:11.415787 run create_hlr_db(pid=3475): Launched 06:15:11.542912 bus /sierra_2: Setting Powered False 06:15:12.605184 run create_hlr_db(pid=3475): Terminated: ok {rc=0} 06:15:13.022755 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3477): Launched 06:15:13.313869 run osmo-hlr_10.42.42.2(pid=3478): Launched 06:15:13.424423 run osmo-stp_10.42.42.5: Starting osmo-stp 06:15:13.942905 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3480): Launched 06:15:14.234106 run osmo-stp_10.42.42.5(pid=3481): Launched 06:15:14.346260 run osmo-msc_10.42.42.6: Starting osmo-msc 06:15:14.876101 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3483): Launched 06:15:15.169834 run osmo-msc_10.42.42.6(pid=3484): Launched 06:15:15.334155 run osmo-stp_10.42.42.5(pid=3481): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3481)] 06:15:15.458312 run osmo-stp_10.42.42.5(pid=3481): stdout: | (launched: 2022-12-10_06:15:14.180580) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:15:15.584022 run osmo-stp_10.42.42.5(pid=3481): stderr: | 20221210061514348 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061514348 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061514348 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061514348 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061514351 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061514351 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061514351 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:15:15.705794 run osmo-stp_10.42.42.5(pid=3481): stdout: | (launched: 2022-12-10_06:15:14.180580) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:15:15.821786 run osmo-stp_10.42.42.5(pid=3481): stderr: | 20221210061514348 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061514348 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061514348 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061514348 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061514351 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061514351 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061514351 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:15:15.977396 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3481): Process ended prematurely: osmo-stp_10.42.42.5(pid=3481) [trial-2370↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3481)] [trial-2370↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 06:15:15.987472 tst mo_mt_call.py:8: Test FAILED (5.9 sec) 06:15:16.015386 run osmo-hlr_10.42.42.2(pid=3478): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3478)] 06:15:16.066341 run osmo-hlr_10.42.42.2(pid=3478): stdout: | (launched: 2022-12-10_06:15:13.260463) 06:15:16.117900 run osmo-hlr_10.42.42.2(pid=3478): stderr: | 20221210061513436 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210061513436 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210061513436 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210061513437 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210061513437 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210061513437 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210061513448 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210061513457 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210061513457 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210061513457 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:15:16.188932 run osmo-msc_10.42.42.6(pid=3484): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3484)] 06:15:16.238914 run osmo-msc_10.42.42.6(pid=3484): stdout: | (launched: 2022-12-10_06:15:15.116001) 06:15:16.290764 run osmo-msc_10.42.42.6(pid=3484): stderr: | 20221210061515389 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210061515389 DLGLOBAL DEBUG validating counter group 0x7fa8fa6bfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210061515389 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210061515389 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210061515389 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210061515390 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210061515391 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210061515392 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210061515392 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210061515392 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:15:16.342604 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3477): Terminating (SIGTERM) 06:15:16.384325 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3480): Terminating (SIGTERM) 06:15:16.426057 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3483): Terminating (SIGTERM) 06:15:16.467845 --- ParallelTerminationStrategy: PID 3477 died... 06:15:16.487417 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3477): Terminated: ok {rc=0} 06:15:16.534198 --- ParallelTerminationStrategy: PID 3480 died... 06:15:16.553686 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3480): Terminated: ok {rc=0} 06:15:16.600409 --- ParallelTerminationStrategy: PID 3483 died... 06:15:16.619838 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3483): Terminated: ok {rc=0} 06:15:16.709136 bus /sierra_3: Setting Powered False 06:15:17.805173 bus /sierra_3: Setting Powered False 06:15:18.919102 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2370 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 06:15:20.060911 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:15:20.072460 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 06:15:20.142121 tst mo_mt_call_osmux.py: using LAC 26417 06:15:20.259723 tst mo_mt_call_osmux.py: using RAC 152 06:15:20.375055 tst mo_mt_call_osmux.py: using CellId 26417 06:15:20.491171 tst mo_mt_call_osmux.py: using BVCI 26418 06:15:20.599187 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:15:20.609935 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:15:20.620496 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:15:20.631308 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:15:20.642180 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:15:20.653010 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 06:15:20.768469 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 06:15:20.883957 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:15:21.334693 run create_hlr_db(pid=3486): Launched 06:15:21.445483 bus /sierra_2: Setting Powered False 06:15:22.503263 run create_hlr_db(pid=3486): Terminated: ok {rc=0} 06:15:22.930617 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3488): Launched 06:15:23.244145 run osmo-hlr_10.42.42.2(pid=3489): Launched 06:15:23.364344 run osmo-stp_10.42.42.5: Starting osmo-stp 06:15:23.904516 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3491): Launched 06:15:24.217318 run osmo-stp_10.42.42.5(pid=3492): Launched 06:15:24.338017 run osmo-msc_10.42.42.6: Starting osmo-msc 06:15:24.906775 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3494): Launched 06:15:25.219613 run osmo-msc_10.42.42.6(pid=3495): Launched 06:15:25.395770 run osmo-stp_10.42.42.5(pid=3492): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3492)] 06:15:25.528688 run osmo-stp_10.42.42.5(pid=3492): stdout: | (launched: 2022-12-10_06:15:24.160128) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:15:25.662770 run osmo-stp_10.42.42.5(pid=3492): stderr: | 20221210061524352 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061524352 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061524352 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061524353 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061524353 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061524353 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061524353 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:15:25.795628 run osmo-stp_10.42.42.5(pid=3492): stdout: | (launched: 2022-12-10_06:15:24.160128) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:15:25.919908 run osmo-stp_10.42.42.5(pid=3492): stderr: | 20221210061524352 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061524352 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061524352 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061524353 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061524353 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061524353 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061524353 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:15:26.069201 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3492): Process ended prematurely: osmo-stp_10.42.42.5(pid=3492) [trial-2370↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3492)] [trial-2370↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 06:15:26.078681 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 06:15:26.106509 run osmo-hlr_10.42.42.2(pid=3489): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3489)] 06:15:26.156486 run osmo-hlr_10.42.42.2(pid=3489): stdout: | (launched: 2022-12-10_06:15:23.186741) 06:15:26.207965 run osmo-hlr_10.42.42.2(pid=3489): stderr: | 20221210061523385 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210061523385 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210061523385 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210061523385 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210061523385 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210061523385 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210061523397 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210061523406 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210061523406 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210061523406 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:15:26.279660 run osmo-msc_10.42.42.6(pid=3495): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3495)] 06:15:26.329538 run osmo-msc_10.42.42.6(pid=3495): stdout: | (launched: 2022-12-10_06:15:25.162335) 06:15:26.381180 run osmo-msc_10.42.42.6(pid=3495): stderr: | 20221210061525483 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210061525483 DLGLOBAL DEBUG validating counter group 0x7ff0fae91c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210061525484 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210061525484 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210061525484 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210061525484 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210061525486 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210061525486 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210061525486 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210061525486 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:15:26.433208 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3488): Terminating (SIGTERM) 06:15:26.474626 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3491): Terminating (SIGTERM) 06:15:26.515971 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3494): Terminating (SIGTERM) 06:15:26.557602 --- ParallelTerminationStrategy: PID 3488 died... 06:15:26.577444 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3488): Terminated: ok {rc=0} 06:15:26.623284 --- ParallelTerminationStrategy: PID 3491 died... 06:15:26.642638 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3491): Terminated: ok {rc=0} 06:15:26.688337 --- ParallelTerminationStrategy: PID 3494 died... 06:15:26.708159 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3494): Terminated: ok {rc=0} 06:15:26.795576 bus /sierra_3: Setting Powered False 06:15:27.893732 bus /sierra_3: Setting Powered False 06:15:29.008645 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 voice:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 emergency:trx-lms --------------------------------------------------------------------- 06:15:30.256184 tst emergency:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:15:30.260809 tst emergency:trx-lms: Verifying 1 x bts (candidates: 11) 06:15:30.294723 tst emergency:trx-lms: Verifying 6 x ip_address (candidates: 9) 06:15:30.322340 tst emergency:trx-lms: Verifying 4 x modem (candidates: 12) 06:15:30.413926 tst emergency:trx-lms: Reserving 1 x bts (candidates: 11) 06:15:30.447011 tst emergency:trx-lms: Reserving 6 x ip_address (candidates: 9) 06:15:30.474281 tst emergency:trx-lms: Reserving 4 x modem (candidates: 12) 06:15:31.066999 tst emergency:trx-lms: RESERVED RESOURCES for emergency: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2370 emergency:trx-lms emergency_mo_mt_call.py ---------------------------------------------- 06:15:31.072660 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 06:15:31.084733 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 06:15:31.135625 tst emergency_mo_mt_call.py: using LAC 26418 06:15:31.257574 tst emergency_mo_mt_call.py: using RAC 153 06:15:31.374136 tst emergency_mo_mt_call.py: using CellId 26418 06:15:31.490257 tst emergency_mo_mt_call.py: using BVCI 26419 06:15:31.599801 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 06:15:31.611484 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 06:15:31.622895 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 06:15:31.635437 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 06:15:31.649245 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 06:15:31.660528 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 06:15:31.777786 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 06:15:31.899369 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:15:32.377033 run create_hlr_db(pid=3500): Launched 06:15:32.501431 bus /sierra_2: Setting Powered False 06:15:33.562082 run create_hlr_db(pid=3500): Terminated: ok {rc=0} 06:15:33.971275 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3502): Launched 06:15:34.255849 run osmo-hlr_10.42.42.2(pid=3503): Launched 06:15:34.365125 run osmo-stp_10.42.42.5: Starting osmo-stp 06:15:34.867151 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3505): Launched 06:15:35.153032 run osmo-stp_10.42.42.5(pid=3506): Launched 06:15:35.271975 tst emergency_mo_mt_call.py: using MSISDN 7582 06:15:35.434964 run osmo-msc_10.42.42.6: Starting osmo-msc 06:15:35.950883 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3508): Launched 06:15:36.236774 run osmo-msc_10.42.42.6(pid=3509): Launched 06:15:36.398594 run osmo-stp_10.42.42.5(pid=3506): ERR: Terminated: ERROR {rc=1} [trial-2370↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3506)] 06:15:36.520219 run osmo-stp_10.42.42.5(pid=3506): stdout: | (launched: 2022-12-10_06:15:35.099863) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:15:36.643309 run osmo-stp_10.42.42.5(pid=3506): stderr: | 20221210061535270 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061535270 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061535271 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061535271 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061535272 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061535272 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061535272 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:15:36.763179 run osmo-stp_10.42.42.5(pid=3506): stdout: | (launched: 2022-12-10_06:15:35.099863) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:15:36.877290 run osmo-stp_10.42.42.5(pid=3506): stderr: | 20221210061535270 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061535270 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061535271 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061535271 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061535272 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061535272 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061535272 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:15:37.013779 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=3506): Process ended prematurely: osmo-stp_10.42.42.5(pid=3506) [trial-2370↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3506)] [trial-2370↪emergency:trx-lms↪emergency_mo_mt_call.py:19] 06:15:37.022273 tst emergency_mo_mt_call.py:19: Test FAILED (5.9 sec) 06:15:37.048673 run osmo-hlr_10.42.42.2(pid=3503): ERR: Terminated: ERROR {rc=237} [trial-2370↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3503)] 06:15:37.096266 run osmo-hlr_10.42.42.2(pid=3503): stdout: | (launched: 2022-12-10_06:15:34.203334) 06:15:37.145561 run osmo-hlr_10.42.42.2(pid=3503): stderr: | 20221210061534378 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210061534378 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210061534378 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210061534378 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210061534378 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210061534379 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210061534391 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/emergency:trx-lms/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210061534399 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210061534399 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210061534399 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:15:37.213939 run osmo-msc_10.42.42.6(pid=3509): ERR: Terminated: ERROR {rc=2} [trial-2370↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3509)] 06:15:37.261340 run osmo-msc_10.42.42.6(pid=3509): stdout: | (launched: 2022-12-10_06:15:36.183906) 06:15:37.310216 run osmo-msc_10.42.42.6(pid=3509): stderr: | 20221210061536453 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210061536453 DLGLOBAL DEBUG validating counter group 0x7fba41fdbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210061536453 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210061536453 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210061536453 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210061536454 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210061536455 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210061536456 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210061536456 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210061536456 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:15:37.359477 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3502): Terminating (SIGTERM) 06:15:37.398827 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3505): Terminating (SIGTERM) 06:15:37.438343 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3508): Terminating (SIGTERM) 06:15:37.478135 --- ParallelTerminationStrategy: PID 3502 died... 06:15:37.497203 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3502): Terminated: ok {rc=0} 06:15:37.541584 --- ParallelTerminationStrategy: PID 3505 died... 06:15:37.560176 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3505): Terminated: ok {rc=0} 06:15:37.604563 --- ParallelTerminationStrategy: PID 3508 died... 06:15:37.623321 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3508): Terminated: ok {rc=0} 06:15:37.707623 bus /sierra_3: Setting Powered False 06:15:38.805611 bus /sierra_3: Setting Powered False 06:15:39.920719 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2370 emergency:trx-lms emergency_preemptive_call.py ---------------------------------------------- 06:15:41.005091 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 06:15:41.016410 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 06:15:41.065671 tst emergency_preemptive_call.py: using LAC 26419 06:15:41.189716 tst emergency_preemptive_call.py: using RAC 154 06:15:41.303311 tst emergency_preemptive_call.py: using CellId 26419 06:15:41.426595 tst emergency_preemptive_call.py: using BVCI 26420 06:15:41.537615 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 06:15:41.548570 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 06:15:41.559494 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 06:15:41.570858 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 06:15:41.582315 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 06:15:41.593723 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 06:15:41.706347 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 06:15:41.822150 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 06:15:41.937456 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 06:15:42.052845 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:15:42.498877 run create_hlr_db(pid=3511): Launched 06:15:42.609735 bus /sierra_2: Setting Powered False 06:15:43.667548 run create_hlr_db(pid=3511): Terminated: ok {rc=0} 06:15:44.089917 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3513): Launched 06:15:44.397630 run osmo-hlr_10.42.42.2(pid=3514): Launched 06:15:44.515503 run osmo-stp_10.42.42.5: Starting osmo-stp 06:15:45.045585 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3516): Launched 06:15:45.352453 run osmo-stp_10.42.42.5(pid=3517): Launched 06:15:45.479787 tst emergency_preemptive_call.py: using MSISDN 7583 06:15:45.636929 run osmo-msc_10.42.42.6: Starting osmo-msc 06:15:46.193741 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3519): Launched 06:15:46.500517 run osmo-msc_10.42.42.6(pid=3520): Launched 06:15:46.771139 run osmo-stp_10.42.42.5(pid=3517): ERR: Terminated: ERROR {rc=1} [trial-2370↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3517)] 06:15:46.950119 run osmo-stp_10.42.42.5(pid=3517): stdout: | (launched: 2022-12-10_06:15:45.296301) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:15:47.250861 run osmo-stp_10.42.42.5(pid=3517): stderr: | 20221210061545488 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061545488 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061545488 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061545488 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061545489 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061545489 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061545489 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:15:47.393282 run osmo-stp_10.42.42.5(pid=3517): stdout: | (launched: 2022-12-10_06:15:45.296301) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:15:47.515468 run osmo-stp_10.42.42.5(pid=3517): stderr: | 20221210061545488 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061545488 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061545488 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061545488 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061545489 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061545489 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061545489 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:15:47.661806 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=3517): Process ended prematurely: osmo-stp_10.42.42.5(pid=3517) [trial-2370↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3517)] [trial-2370↪emergency:trx-lms↪emergency_preemptive_call.py:32] 06:15:47.670708 tst emergency_preemptive_call.py:32: Test FAILED (6.7 sec) 06:15:47.698000 run osmo-hlr_10.42.42.2(pid=3514): ERR: Terminated: ERROR {rc=237} [trial-2370↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3514)] 06:15:47.748902 run osmo-hlr_10.42.42.2(pid=3514): stdout: | (launched: 2022-12-10_06:15:44.341289) 06:15:47.800882 run osmo-hlr_10.42.42.2(pid=3514): stderr: | 20221210061544539 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210061544539 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210061544539 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210061544539 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210061544539 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210061544539 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210061544551 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/emergency:trx-lms/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210061544560 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210061544560 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210061544560 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:15:47.873113 run osmo-msc_10.42.42.6(pid=3520): ERR: Terminated: ERROR {rc=2} [trial-2370↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3520)] 06:15:47.923092 run osmo-msc_10.42.42.6(pid=3520): stdout: | (launched: 2022-12-10_06:15:46.444151) 06:15:47.974875 run osmo-msc_10.42.42.6(pid=3520): stderr: | 20221210061547055 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210061547055 DLGLOBAL DEBUG validating counter group 0x7f687d9eec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210061547056 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210061547056 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210061547056 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210061547056 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210061547062 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210061547063 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210061547063 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210061547063 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:15:48.027289 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3513): Terminating (SIGTERM) 06:15:48.069021 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3516): Terminating (SIGTERM) 06:15:48.110783 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3519): Terminating (SIGTERM) 06:15:48.152629 --- ParallelTerminationStrategy: PID 3513 died... 06:15:48.172534 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3513): Terminated: ok {rc=0} 06:15:48.218916 --- ParallelTerminationStrategy: PID 3516 died... 06:15:48.238464 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3516): Terminated: ok {rc=0} 06:15:48.284398 --- ParallelTerminationStrategy: PID 3519 died... 06:15:48.303929 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3519): Terminated: ok {rc=0} 06:15:48.391655 bus /sierra_9: Setting Powered False 06:15:49.490202 bus /sierra_9: Setting Powered False 06:15:50.608310 bus /sierra_8: Setting Powered False 06:15:51.706544 bus /sierra_8: Setting Powered False 06:15:52.821154 bus /sierra_3: Setting Powered False 06:15:53.918550 bus /sierra_3: Setting Powered False 06:15:55.033020 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 emergency:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 gprs:trx-lms --------------------------------------------------------------------- 06:15:56.300379 tst gprs:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:15:56.304591 tst gprs:trx-lms: Verifying 1 x bts (candidates: 11) 06:15:56.337295 tst gprs:trx-lms: Verifying 9 x ip_address (candidates: 9) 06:15:56.375033 tst gprs:trx-lms: Verifying 4 x modem (candidates: 12) 06:15:56.460097 tst gprs:trx-lms: Reserving 1 x bts (candidates: 11) 06:15:56.493975 tst gprs:trx-lms: Reserving 9 x ip_address (candidates: 9) 06:15:56.533399 tst gprs:trx-lms: Reserving 4 x modem (candidates: 12) 06:15:57.122773 tst gprs:trx-lms: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2370 gprs:trx-lms cs_paging_gprs_active.py ---------------------------------------------- 06:15:57.174013 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:15:57.185047 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 06:15:57.234755 tst cs_paging_gprs_active.py: using LAC 26420 06:15:57.359355 tst cs_paging_gprs_active.py: using RAC 155 06:15:57.481999 tst cs_paging_gprs_active.py: using CellId 26420 06:15:57.598601 tst cs_paging_gprs_active.py: using BVCI 26421 06:15:57.706385 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:15:57.716858 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:15:57.727225 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:15:57.737921 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:15:57.748331 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:15:57.758745 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:15:57.769424 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:15:57.779824 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:15:57.790487 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 06:15:57.906419 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 06:15:58.024625 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 06:15:58.236638 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:15:58.552120 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3525): Launched 06:15:58.827355 run iperf3-srv_10.42.42.10(pid=3526): Launched 06:15:58.945589 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 06:15:59.156304 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:15:59.471755 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3527): Launched 06:15:59.747091 run iperf3-srv_10.42.42.10(pid=3528): Launched 06:15:59.865459 tst cs_paging_gprs_active.py:38: start network... 06:16:00.076029 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:16:00.560909 run create_hlr_db(pid=3529): Launched 06:16:00.689953 bus /sierra_2: Setting Powered False 06:16:01.747620 run create_hlr_db(pid=3529): Terminated: ok {rc=0} 06:16:02.189974 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3531): Launched 06:16:02.497333 run osmo-hlr_10.42.42.2(pid=3532): Launched 06:16:02.610331 run osmo-stp_10.42.42.5: Starting osmo-stp 06:16:03.114970 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3534): Launched 06:16:03.407101 run osmo-stp_10.42.42.5(pid=3535): Launched 06:16:03.518449 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:16:04.022918 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3537): Launched 06:16:04.135863 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:16:04.384047 run patchelf(pid=3538): Launched 06:16:04.547813 run osmo-stp_10.42.42.5(pid=3535): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3535)] 06:16:04.671979 run osmo-stp_10.42.42.5(pid=3535): stdout: | (launched: 2022-12-10_06:16:03.353623) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:16:04.797931 run osmo-stp_10.42.42.5(pid=3535): stderr: | 20221210061603520 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061603520 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061603521 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061603521 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061603522 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061603522 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061603522 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:16:04.923694 run osmo-stp_10.42.42.5(pid=3535): stdout: | (launched: 2022-12-10_06:16:03.353623) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:16:05.043793 run osmo-stp_10.42.42.5(pid=3535): stderr: | 20221210061603520 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061603520 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061603521 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061603521 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061603522 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061603522 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061603522 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:16:05.186214 run patchelf(pid=3538): Terminating (SIGINT) 06:16:05.349913 run patchelf(pid=3538): Terminated: ok {rc=0} 06:16:05.468289 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=3535): Process ended prematurely: osmo-stp_10.42.42.5(pid=3535) [trial-2370↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3535)] [trial-2370↪gprs:trx-lms↪cs_paging_gprs_active.py:38] 06:16:05.477781 tst cs_paging_gprs_active.py:38: Test FAILED (8.3 sec) 06:16:05.504909 run osmo-hlr_10.42.42.2(pid=3532): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-lms↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3532)] 06:16:05.552916 run osmo-hlr_10.42.42.2(pid=3532): stdout: | (launched: 2022-12-10_06:16:02.443290) 06:16:05.602236 run osmo-hlr_10.42.42.2(pid=3532): stderr: | 20221210061602617 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210061602617 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210061602617 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210061602617 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210061602617 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210061602617 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210061602630 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-lms/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210061602638 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210061602638 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210061602638 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:16:05.651903 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3525): Terminating (SIGTERM) 06:16:05.691700 run iperf3-srv_10.42.42.10(pid=3526): Terminating (SIGTERM) 06:16:05.731082 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3527): Terminating (SIGTERM) 06:16:05.770868 run iperf3-srv_10.42.42.10(pid=3528): Terminating (SIGTERM) 06:16:05.810175 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3531): Terminating (SIGTERM) 06:16:05.849771 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3534): Terminating (SIGTERM) 06:16:05.889508 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3537): Terminating (SIGTERM) 06:16:05.929306 --- ParallelTerminationStrategy: PID 3525 died... 06:16:05.948213 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3525): Terminated: ok {rc=0} 06:16:05.991924 --- ParallelTerminationStrategy: PID 3526 died... 06:16:06.010453 run iperf3-srv_10.42.42.10(pid=3526): Terminated {rc=256} 06:16:06.053975 --- ParallelTerminationStrategy: PID 3527 died... 06:16:06.072453 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3527): Terminated: ok {rc=0} 06:16:06.116240 --- ParallelTerminationStrategy: PID 3528 died... 06:16:06.134587 run iperf3-srv_10.42.42.10(pid=3528): Terminated {rc=256} 06:16:06.178288 --- ParallelTerminationStrategy: PID 3531 died... 06:16:06.196835 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3531): Terminated: ok {rc=0} 06:16:06.240571 --- ParallelTerminationStrategy: PID 3534 died... 06:16:06.259082 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3534): Terminated: ok {rc=0} 06:16:06.303188 --- ParallelTerminationStrategy: PID 3537 died... 06:16:06.321634 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3537): Terminated: ok {rc=0} 06:16:06.404670 bus /gobi_0: Setting Powered False 06:16:07.498155 bus /gobi_0: Setting Powered False 06:16:08.612014 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-lms iperf3.py ---------------------------------------------- 06:16:09.755049 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:16:09.766227 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 06:16:09.817769 tst iperf3.py: using LAC 26421 06:16:09.954803 tst iperf3.py: using RAC 156 06:16:10.082238 tst iperf3.py: using CellId 26421 06:16:10.206100 tst iperf3.py: using BVCI 26422 06:16:10.312226 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:16:10.322903 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:16:10.333367 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:16:10.343661 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:16:10.354808 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:16:10.365385 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:16:10.375837 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:16:10.386676 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:16:10.397301 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 06:16:10.509401 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 06:16:10.704818 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:16:10.998019 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3539): Launched 06:16:11.253684 run iperf3-srv_10.42.42.10(pid=3540): Launched 06:16:11.363367 tst iperf3.py:8: start network... 06:16:11.557394 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:16:12.009459 run create_hlr_db(pid=3541): Launched 06:16:12.120823 bus /gobi_6: Setting Powered False 06:16:13.180197 run create_hlr_db(pid=3541): Terminated: ok {rc=0} 06:16:13.608571 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3543): Launched 06:16:13.924054 run osmo-hlr_10.42.42.2(pid=3544): Launched 06:16:14.045080 run osmo-stp_10.42.42.5: Starting osmo-stp 06:16:14.586480 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3546): Launched 06:16:14.901287 run osmo-stp_10.42.42.5(pid=3547): Launched 06:16:15.021166 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:16:15.561935 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3549): Launched 06:16:15.682377 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:16:15.969164 run patchelf(pid=3550): Launched 06:16:16.172726 run osmo-stp_10.42.42.5(pid=3547): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3547)] 06:16:16.302239 run osmo-stp_10.42.42.5(pid=3547): stdout: | (launched: 2022-12-10_06:16:14.843880) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:16:16.434171 run osmo-stp_10.42.42.5(pid=3547): stderr: | 20221210061615034 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061615034 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061615034 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061615034 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061615037 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061615037 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061615037 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:16:16.564410 run osmo-stp_10.42.42.5(pid=3547): stdout: | (launched: 2022-12-10_06:16:14.843880) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:16:16.690766 run osmo-stp_10.42.42.5(pid=3547): stderr: | 20221210061615034 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061615034 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061615034 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061615034 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061615037 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061615037 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061615037 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:16:16.839036 run patchelf(pid=3550): Terminating (SIGINT) 06:16:17.010683 run patchelf(pid=3550): Terminated: ok {rc=0} 06:16:17.134824 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3547): Process ended prematurely: osmo-stp_10.42.42.5(pid=3547) [trial-2370↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3547)] [trial-2370↪gprs:trx-lms↪iperf3.py:8] 06:16:17.145508 tst iperf3.py:8: Test FAILED (7.4 sec) 06:16:17.176388 run osmo-hlr_10.42.42.2(pid=3544): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-lms↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3544)] 06:16:17.227930 run osmo-hlr_10.42.42.2(pid=3544): stdout: | (launched: 2022-12-10_06:16:13.866678) 06:16:17.279993 run osmo-hlr_10.42.42.2(pid=3544): stderr: | 20221210061614067 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210061614067 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210061614067 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210061614067 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210061614067 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210061614067 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210061614080 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-lms/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210061614090 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210061614090 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210061614091 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:16:17.331055 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3539): Terminating (SIGTERM) 06:16:17.370219 run iperf3-srv_10.42.42.10(pid=3540): Terminating (SIGTERM) 06:16:17.409441 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3543): Terminating (SIGTERM) 06:16:17.448635 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3546): Terminating (SIGTERM) 06:16:17.487905 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3549): Terminating (SIGTERM) 06:16:17.527764 --- ParallelTerminationStrategy: PID 3539 died... 06:16:17.547119 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3539): Terminated: ok {rc=0} 06:16:17.590963 --- ParallelTerminationStrategy: PID 3540 died... 06:16:17.609257 run iperf3-srv_10.42.42.10(pid=3540): Terminated {rc=256} 06:16:17.652798 --- ParallelTerminationStrategy: PID 3543 died... 06:16:17.671117 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3543): Terminated: ok {rc=0} 06:16:17.714734 --- ParallelTerminationStrategy: PID 3546 died... 06:16:17.732937 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3546): Terminated: ok {rc=0} 06:16:17.776313 --- ParallelTerminationStrategy: PID 3549 died... 06:16:17.794886 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3549): Terminated: ok {rc=0} 06:16:17.879456 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-lms iperf3m4.py ---------------------------------------------- 06:16:19.022320 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:16:19.033503 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 06:16:19.082476 tst iperf3m4.py: using LAC 26422 06:16:19.198382 tst iperf3m4.py: using RAC 157 06:16:19.315626 tst iperf3m4.py: using CellId 26422 06:16:19.430504 tst iperf3m4.py: using BVCI 26423 06:16:19.536405 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:16:19.547016 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:16:19.557418 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:16:19.567900 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:16:19.578393 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:16:19.588842 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:16:19.599492 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:16:19.610043 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:16:19.620618 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 06:16:19.732770 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 06:16:19.851496 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 06:16:19.969140 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 06:16:20.082930 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 06:16:20.277767 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:16:20.570775 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3551): Launched 06:16:20.825432 run iperf3-srv_10.42.42.10(pid=3552): Launched 06:16:20.934789 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 06:16:21.128657 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:16:21.420887 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3553): Launched 06:16:21.676552 run iperf3-srv_10.42.42.10(pid=3554): Launched 06:16:21.786652 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 06:16:21.981639 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:16:22.275525 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3555): Launched 06:16:22.530755 run iperf3-srv_10.42.42.10(pid=3556): Launched 06:16:22.640200 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 06:16:22.835039 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:16:23.128222 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3557): Launched 06:16:23.383876 run iperf3-srv_10.42.42.10(pid=3558): Launched 06:16:23.503006 tst iperf3m4.py:8: start network... 06:16:23.715460 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:16:24.203145 run create_hlr_db(pid=3559): Launched 06:16:24.331831 bus /gobi_6: Setting Powered False 06:16:25.393741 run create_hlr_db(pid=3559): Terminated: ok {rc=0} 06:16:25.830593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3561): Launched 06:16:26.144651 run osmo-hlr_10.42.42.2(pid=3562): Launched 06:16:26.264671 run osmo-stp_10.42.42.5: Starting osmo-stp 06:16:26.807377 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3564): Launched 06:16:27.122073 run osmo-stp_10.42.42.5(pid=3565): Launched 06:16:27.238414 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:16:27.746017 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3567): Launched 06:16:27.858866 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:16:28.107047 run patchelf(pid=3568): Launched 06:16:28.270725 run osmo-stp_10.42.42.5(pid=3565): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3565)] 06:16:28.395518 run osmo-stp_10.42.42.5(pid=3565): stdout: | (launched: 2022-12-10_06:16:27.064668) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:16:28.521340 run osmo-stp_10.42.42.5(pid=3565): stderr: | 20221210061627235 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061627235 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061627235 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061627236 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061627236 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061627236 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061627236 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:16:28.647268 run osmo-stp_10.42.42.5(pid=3565): stdout: | (launched: 2022-12-10_06:16:27.064668) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:16:28.767590 run osmo-stp_10.42.42.5(pid=3565): stderr: | 20221210061627235 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061627235 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061627235 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061627236 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061627236 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061627236 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061627236 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:16:28.910193 run patchelf(pid=3568): Terminating (SIGINT) 06:16:29.074026 run patchelf(pid=3568): Terminated: ok {rc=0} 06:16:29.191997 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3565): Process ended prematurely: osmo-stp_10.42.42.5(pid=3565) [trial-2370↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3565)] [trial-2370↪gprs:trx-lms↪iperf3m4.py:8] 06:16:29.201615 tst iperf3m4.py:8: Test FAILED (10.2 sec) 06:16:29.228894 run osmo-hlr_10.42.42.2(pid=3562): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-lms↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3562)] 06:16:29.276151 run osmo-hlr_10.42.42.2(pid=3562): stdout: | (launched: 2022-12-10_06:16:26.087101) 06:16:29.325082 run osmo-hlr_10.42.42.2(pid=3562): stderr: | 20221210061626287 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210061626287 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210061626287 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210061626287 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210061626287 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210061626287 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210061626300 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-lms/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210061626310 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210061626311 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210061626311 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:16:29.373908 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3551): Terminating (SIGTERM) 06:16:29.412792 run iperf3-srv_10.42.42.10(pid=3552): Terminating (SIGTERM) 06:16:29.451679 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3553): Terminating (SIGTERM) 06:16:29.490367 run iperf3-srv_10.42.42.10(pid=3554): Terminating (SIGTERM) 06:16:29.529045 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3555): Terminating (SIGTERM) 06:16:29.567639 run iperf3-srv_10.42.42.10(pid=3556): Terminating (SIGTERM) 06:16:29.606479 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3557): Terminating (SIGTERM) 06:16:29.645278 run iperf3-srv_10.42.42.10(pid=3558): Terminating (SIGTERM) 06:16:29.683853 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3561): Terminating (SIGTERM) 06:16:29.722704 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3564): Terminating (SIGTERM) 06:16:29.761513 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3567): Terminating (SIGTERM) 06:16:29.800547 --- ParallelTerminationStrategy: PID 3551 died... 06:16:29.819236 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3551): Terminated: ok {rc=0} 06:16:29.863114 --- ParallelTerminationStrategy: PID 3552 died... 06:16:29.881228 run iperf3-srv_10.42.42.10(pid=3552): Terminated {rc=256} 06:16:29.924250 --- ParallelTerminationStrategy: PID 3553 died... 06:16:29.942479 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3553): Terminated: ok {rc=0} 06:16:29.985749 --- ParallelTerminationStrategy: PID 3554 died... 06:16:30.003650 run iperf3-srv_10.42.42.10(pid=3554): Terminated {rc=256} 06:16:30.047106 --- ParallelTerminationStrategy: PID 3555 died... 06:16:30.065388 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3555): Terminated: ok {rc=0} 06:16:30.108527 --- ParallelTerminationStrategy: PID 3556 died... 06:16:30.126593 run iperf3-srv_10.42.42.10(pid=3556): Terminated {rc=256} 06:16:30.169633 --- ParallelTerminationStrategy: PID 3557 died... 06:16:30.187702 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3557): Terminated: ok {rc=0} 06:16:30.231345 --- ParallelTerminationStrategy: PID 3558 died... 06:16:30.249399 run iperf3-srv_10.42.42.10(pid=3558): Terminated {rc=256} 06:16:30.292353 --- ParallelTerminationStrategy: PID 3561 died... 06:16:30.310614 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3561): Terminated: ok {rc=0} 06:16:30.354057 --- ParallelTerminationStrategy: PID 3564 died... 06:16:30.372179 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3564): Terminated: ok {rc=0} 06:16:30.415200 --- ParallelTerminationStrategy: PID 3567 died... 06:16:30.433376 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3567): Terminated: ok {rc=0} 06:16:30.517557 bus /gobi_4: Setting Powered False 06:16:31.624452 bus /gobi_4: Setting Powered False 06:16:32.752456 bus /gobi_1: Setting Powered False 06:16:33.848584 bus /gobi_1: Setting Powered False 06:16:34.961414 bus /gobi_0: Setting Powered False 06:16:36.057378 bus /gobi_0: Setting Powered False 06:16:37.171532 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-lms ping.py ---------------------------------------------- 06:16:38.274288 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:16:38.285918 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 06:16:38.335941 tst ping.py: using LAC 26423 06:16:38.457552 tst ping.py: using RAC 158 06:16:38.570847 tst ping.py: using CellId 26423 06:16:38.683551 tst ping.py: using BVCI 26424 06:16:38.787397 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:16:38.798008 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:16:38.808355 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:16:38.819017 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:16:38.829612 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:16:38.840018 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:16:38.850562 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:16:38.861076 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 06:16:38.974057 tst ping.py:19: start network... 06:16:39.180804 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:16:39.654505 run create_hlr_db(pid=3569): Launched 06:16:39.780755 bus /gobi_6: Setting Powered False 06:16:40.842433 run create_hlr_db(pid=3569): Terminated: ok {rc=0} 06:16:41.269493 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3571): Launched 06:16:41.575230 run osmo-hlr_10.42.42.2(pid=3572): Launched 06:16:41.691777 run osmo-stp_10.42.42.5: Starting osmo-stp 06:16:42.224233 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3574): Launched 06:16:42.531175 run osmo-stp_10.42.42.5(pid=3575): Launched 06:16:42.648442 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:16:43.177977 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3577): Launched 06:16:43.295051 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:16:43.554456 run patchelf(pid=3578): Launched 06:16:43.726605 run osmo-stp_10.42.42.5(pid=3575): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3575)] 06:16:43.857735 run osmo-stp_10.42.42.5(pid=3575): stdout: | (launched: 2022-12-10_06:16:42.475057) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:16:43.990185 run osmo-stp_10.42.42.5(pid=3575): stderr: | 20221210061642665 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061642665 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061642665 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061642666 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061642666 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061642666 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061642666 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:16:44.123020 run osmo-stp_10.42.42.5(pid=3575): stdout: | (launched: 2022-12-10_06:16:42.475057) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:16:44.249628 run osmo-stp_10.42.42.5(pid=3575): stderr: | 20221210061642665 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061642665 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061642665 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061642666 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061642666 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061642666 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061642666 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:16:44.399063 run patchelf(pid=3578): Terminating (SIGINT) 06:16:44.570628 run patchelf(pid=3578): Terminated: ok {rc=0} 06:16:44.694044 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=3575): Process ended prematurely: osmo-stp_10.42.42.5(pid=3575) [trial-2370↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3575)] [trial-2370↪gprs:trx-lms↪ping.py:22] 06:16:44.703614 tst ping.py:22: Test FAILED (6.4 sec) 06:16:44.731671 run osmo-hlr_10.42.42.2(pid=3572): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-lms↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3572)] 06:16:44.781471 run osmo-hlr_10.42.42.2(pid=3572): stdout: | (launched: 2022-12-10_06:16:41.519117) 06:16:44.832663 run osmo-hlr_10.42.42.2(pid=3572): stderr: | 20221210061641717 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210061641717 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210061641717 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210061641717 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210061641717 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210061641718 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210061641729 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-lms/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210061641737 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210061641737 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210061641737 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:16:44.884370 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3571): Terminating (SIGTERM) 06:16:44.925398 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3574): Terminating (SIGTERM) 06:16:44.966465 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3577): Terminating (SIGTERM) 06:16:45.007880 --- ParallelTerminationStrategy: PID 3571 died... 06:16:45.027578 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3571): Terminated: ok {rc=0} 06:16:45.073467 --- ParallelTerminationStrategy: PID 3574 died... 06:16:45.092617 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3574): Terminated: ok {rc=0} 06:16:45.138215 --- ParallelTerminationStrategy: PID 3577 died... 06:16:45.157522 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3577): Terminated: ok {rc=0} 06:16:45.243711 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-lms ping_idle_ping.py ---------------------------------------------- 06:16:46.326752 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:16:46.338982 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 06:16:46.392519 tst ping_idle_ping.py: using LAC 26424 06:16:46.526959 tst ping_idle_ping.py: using RAC 159 06:16:46.680011 tst ping_idle_ping.py: using CellId 26424 06:16:46.819255 tst ping_idle_ping.py: using BVCI 26425 06:16:46.963943 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:16:46.978729 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:16:46.993698 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:16:47.007823 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:16:47.023356 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:16:47.039514 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:16:47.055564 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:16:47.068904 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 06:16:47.203844 tst ping_idle_ping.py:24: start network... 06:16:47.413600 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:16:47.892433 run create_hlr_db(pid=3579): Launched 06:16:48.018944 bus /gobi_6: Setting Powered False 06:16:49.077244 run create_hlr_db(pid=3579): Terminated: ok {rc=0} 06:16:49.509629 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3581): Launched 06:16:49.818607 run osmo-hlr_10.42.42.2(pid=3582): Launched 06:16:49.935782 run osmo-stp_10.42.42.5: Starting osmo-stp 06:16:50.471213 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3584): Launched 06:16:50.781268 run osmo-stp_10.42.42.5(pid=3585): Launched 06:16:50.898797 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:16:51.431052 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3587): Launched 06:16:51.548932 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:16:51.810893 run patchelf(pid=3588): Launched 06:16:51.983041 run osmo-stp_10.42.42.5(pid=3585): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3585)] 06:16:52.113624 run osmo-stp_10.42.42.5(pid=3585): stdout: | (launched: 2022-12-10_06:16:50.723533) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:16:52.246500 run osmo-stp_10.42.42.5(pid=3585): stderr: | 20221210061650914 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061650914 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061650914 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061650915 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061650915 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061650915 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061650915 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:16:52.380136 run osmo-stp_10.42.42.5(pid=3585): stdout: | (launched: 2022-12-10_06:16:50.723533) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:16:52.506620 run osmo-stp_10.42.42.5(pid=3585): stderr: | 20221210061650914 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061650914 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061650914 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061650915 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061650915 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061650915 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061650915 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:16:52.656456 run patchelf(pid=3588): Terminating (SIGINT) 06:16:52.829749 run patchelf(pid=3588): Terminated: ok {rc=0} 06:16:52.953523 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=3585): Process ended prematurely: osmo-stp_10.42.42.5(pid=3585) [trial-2370↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3585)] [trial-2370↪gprs:trx-lms↪ping_idle_ping.py:27] 06:16:52.963021 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 06:16:52.990713 run osmo-hlr_10.42.42.2(pid=3582): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-lms↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3582)] 06:16:53.039383 run osmo-hlr_10.42.42.2(pid=3582): stdout: | (launched: 2022-12-10_06:16:49.761763) 06:16:53.089793 run osmo-hlr_10.42.42.2(pid=3582): stderr: | 20221210061649957 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210061649957 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210061649957 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210061649957 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210061649957 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210061649957 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210061649969 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-lms/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210061649978 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210061649978 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210061649978 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:16:53.140675 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3581): Terminating (SIGTERM) 06:16:53.181486 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3584): Terminating (SIGTERM) 06:16:53.222182 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3587): Terminating (SIGTERM) 06:16:53.263148 --- ParallelTerminationStrategy: PID 3581 died... 06:16:53.282361 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3581): Terminated: ok {rc=0} 06:16:53.327763 --- ParallelTerminationStrategy: PID 3584 died... 06:16:53.346997 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3584): Terminated: ok {rc=0} 06:16:53.392108 --- ParallelTerminationStrategy: PID 3587 died... 06:16:53.411343 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3587): Terminated: ok {rc=0} 06:16:53.497709 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2370 gprs:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 gprs:trx-lms+mod-bts0-egprs --------------------------------------------------------------------- 06:16:54.800645 tst gprs:trx-lms+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:16:54.806853 tst gprs:trx-lms+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 06:16:54.840397 tst gprs:trx-lms+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 06:16:54.879378 tst gprs:trx-lms+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 06:16:54.966225 tst gprs:trx-lms+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 06:16:54.999398 tst gprs:trx-lms+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 06:16:55.038149 tst gprs:trx-lms+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 06:16:55.632367 tst gprs:trx-lms+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2370 gprs:trx-lms+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 06:16:55.682924 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:16:55.694118 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:16:55.749494 tst cs_paging_gprs_active.py: using LAC 26425 06:16:55.874243 tst cs_paging_gprs_active.py: using RAC 160 06:16:55.995625 tst cs_paging_gprs_active.py: using CellId 26425 06:16:56.117576 tst cs_paging_gprs_active.py: using BVCI 26426 06:16:56.231419 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:16:56.242616 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:16:56.253668 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:16:56.264606 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:16:56.275808 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:16:56.286890 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:16:56.298177 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:16:56.309176 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:16:56.320164 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:16:56.434606 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:16:56.548448 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 06:16:56.745634 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:16:57.041605 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3592): Launched 06:16:57.298678 run iperf3-srv_10.42.42.10(pid=3593): Launched 06:16:57.409858 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 06:16:57.606343 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:16:57.902165 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3594): Launched 06:16:58.158980 run iperf3-srv_10.42.42.10(pid=3595): Launched 06:16:58.269742 tst cs_paging_gprs_active.py:38: start network... 06:16:58.466599 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:16:58.922006 run create_hlr_db(pid=3596): Launched 06:16:59.034899 bus /gobi_6: Setting Powered False 06:17:00.094083 run create_hlr_db(pid=3596): Terminated: ok {rc=0} 06:17:00.524122 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3598): Launched 06:17:00.849941 run osmo-hlr_10.42.42.2(pid=3599): Launched 06:17:01.083536 run osmo-stp_10.42.42.5: Starting osmo-stp 06:17:01.769112 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3601): Launched 06:17:02.113128 run osmo-stp_10.42.42.5(pid=3605): Launched 06:17:02.250633 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:17:02.810727 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3607): Launched 06:17:02.923602 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:17:03.172017 run patchelf(pid=3608): Launched 06:17:03.338143 run osmo-stp_10.42.42.5(pid=3605): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3605)] 06:17:03.463210 run osmo-stp_10.42.42.5(pid=3605): stdout: | (launched: 2022-12-10_06:17:02.053265) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:17:03.589726 run osmo-stp_10.42.42.5(pid=3605): stderr: | 20221210061702451 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061702452 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061702452 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061702452 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061702453 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061702453 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061702453 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:17:03.716416 run osmo-stp_10.42.42.5(pid=3605): stdout: | (launched: 2022-12-10_06:17:02.053265) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:17:03.837789 run osmo-stp_10.42.42.5(pid=3605): stderr: | 20221210061702451 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061702452 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061702452 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061702452 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061702453 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061702453 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061702453 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:17:03.981478 run patchelf(pid=3608): Terminating (SIGINT) 06:17:04.146949 run patchelf(pid=3608): Terminated: ok {rc=0} 06:17:04.266717 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=3605): Process ended prematurely: osmo-stp_10.42.42.5(pid=3605) [trial-2370↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3605)] [trial-2370↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 06:17:04.276368 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 06:17:04.303636 run osmo-hlr_10.42.42.2(pid=3599): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3599)] 06:17:04.351416 run osmo-hlr_10.42.42.2(pid=3599): stdout: | (launched: 2022-12-10_06:17:00.782044) 06:17:04.400667 run osmo-hlr_10.42.42.2(pid=3599): stderr: | 20221210061701094 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210061701094 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210061701094 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210061701094 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210061701094 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210061701094 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210061701114 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-lms+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210061701136 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210061701136 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210061701136 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:17:04.450236 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3592): Terminating (SIGTERM) 06:17:04.489630 run iperf3-srv_10.42.42.10(pid=3593): Terminating (SIGTERM) 06:17:04.529107 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3594): Terminating (SIGTERM) 06:17:04.568569 run iperf3-srv_10.42.42.10(pid=3595): Terminating (SIGTERM) 06:17:04.607807 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3598): Terminating (SIGTERM) 06:17:04.647152 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3601): Terminating (SIGTERM) 06:17:04.686574 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3607): Terminating (SIGTERM) 06:17:04.726243 --- ParallelTerminationStrategy: PID 3592 died... 06:17:04.745274 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3592): Terminated: ok {rc=0} 06:17:04.789237 --- ParallelTerminationStrategy: PID 3593 died... 06:17:04.807428 run iperf3-srv_10.42.42.10(pid=3593): Terminated {rc=256} 06:17:04.851117 --- ParallelTerminationStrategy: PID 3594 died... 06:17:04.869541 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3594): Terminated: ok {rc=0} 06:17:04.913261 --- ParallelTerminationStrategy: PID 3595 died... 06:17:04.931507 run iperf3-srv_10.42.42.10(pid=3595): Terminated {rc=256} 06:17:04.975360 --- ParallelTerminationStrategy: PID 3598 died... 06:17:04.993773 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3598): Terminated: ok {rc=0} 06:17:05.037187 --- ParallelTerminationStrategy: PID 3601 died... 06:17:05.055650 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3601): Terminated: ok {rc=0} 06:17:05.099435 --- ParallelTerminationStrategy: PID 3607 died... 06:17:05.117957 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3607): Terminated: ok {rc=0} 06:17:05.202959 bus /gobi_0: Setting Powered False 06:17:06.302467 bus /gobi_0: Setting Powered False 06:17:07.416611 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-lms+mod-bts0-egprs iperf3.py ---------------------------------------------- 06:17:08.558561 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:17:08.570055 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:17:08.619632 tst iperf3.py: using LAC 26426 06:17:08.737264 tst iperf3.py: using RAC 161 06:17:08.854581 tst iperf3.py: using CellId 26426 06:17:08.971484 tst iperf3.py: using BVCI 26427 06:17:09.078287 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:17:09.089043 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:17:09.099559 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:17:09.110303 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:17:09.120992 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:17:09.131668 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:17:09.142534 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:17:09.153148 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:17:09.164059 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:17:09.279315 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 06:17:09.475794 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:17:09.771162 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3609): Launched 06:17:10.028015 run iperf3-srv_10.42.42.10(pid=3610): Launched 06:17:10.138429 tst iperf3.py:8: start network... 06:17:10.334803 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:17:10.789674 run create_hlr_db(pid=3611): Launched 06:17:10.901109 bus /gobi_6: Setting Powered False 06:17:11.960009 run create_hlr_db(pid=3611): Terminated: ok {rc=0} 06:17:12.389727 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3613): Launched 06:17:12.704656 run osmo-hlr_10.42.42.2(pid=3614): Launched 06:17:12.825975 run osmo-stp_10.42.42.5: Starting osmo-stp 06:17:13.366475 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3616): Launched 06:17:13.680248 run osmo-stp_10.42.42.5(pid=3617): Launched 06:17:13.800936 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:17:14.342186 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3619): Launched 06:17:14.462577 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:17:14.725885 run patchelf(pid=3620): Launched 06:17:14.900751 run osmo-stp_10.42.42.5(pid=3617): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3617)] 06:17:15.033936 run osmo-stp_10.42.42.5(pid=3617): stdout: | (launched: 2022-12-10_06:17:13.622968) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:17:15.168284 run osmo-stp_10.42.42.5(pid=3617): stderr: | 20221210061713814 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061713814 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061713814 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061713815 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061713817 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061713817 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061713817 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:17:15.302789 run osmo-stp_10.42.42.5(pid=3617): stdout: | (launched: 2022-12-10_06:17:13.622968) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:17:15.431596 run osmo-stp_10.42.42.5(pid=3617): stderr: | 20221210061713814 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061713814 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061713814 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061713815 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061713817 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061713817 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061713817 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:17:15.584156 run patchelf(pid=3620): Terminating (SIGINT) 06:17:15.759772 run patchelf(pid=3620): Terminated: ok {rc=0} 06:17:15.908045 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3617): Process ended prematurely: osmo-stp_10.42.42.5(pid=3617) [trial-2370↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3617)] [trial-2370↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8] 06:17:15.919102 tst iperf3.py:8: Test FAILED (7.4 sec) 06:17:15.948138 run osmo-hlr_10.42.42.2(pid=3614): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3614)] 06:17:15.998241 run osmo-hlr_10.42.42.2(pid=3614): stdout: | (launched: 2022-12-10_06:17:12.647217) 06:17:16.050129 run osmo-hlr_10.42.42.2(pid=3614): stderr: | 20221210061712848 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210061712848 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210061712848 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210061712848 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210061712848 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210061712848 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210061712863 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-lms+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210061712872 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210061712872 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210061712872 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:17:16.102430 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3609): Terminating (SIGTERM) 06:17:16.144888 run iperf3-srv_10.42.42.10(pid=3610): Terminating (SIGTERM) 06:17:16.189615 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3613): Terminating (SIGTERM) 06:17:16.232246 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3616): Terminating (SIGTERM) 06:17:16.276113 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3619): Terminating (SIGTERM) 06:17:16.318462 --- ParallelTerminationStrategy: PID 3609 died... 06:17:16.338559 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3609): Terminated: ok {rc=0} 06:17:16.384843 --- ParallelTerminationStrategy: PID 3610 died... 06:17:16.404680 run iperf3-srv_10.42.42.10(pid=3610): Terminated {rc=256} 06:17:16.451276 --- ParallelTerminationStrategy: PID 3613 died... 06:17:16.471290 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3613): Terminated: ok {rc=0} 06:17:16.517289 --- ParallelTerminationStrategy: PID 3616 died... 06:17:16.537089 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3616): Terminated: ok {rc=0} 06:17:16.583406 --- ParallelTerminationStrategy: PID 3619 died... 06:17:16.603233 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3619): Terminated: ok {rc=0} 06:17:16.691411 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-lms+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 06:17:17.839096 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:17:17.850771 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:17:17.903770 tst iperf3m4.py: using LAC 26427 06:17:18.025977 tst iperf3m4.py: using RAC 162 06:17:18.146397 tst iperf3m4.py: using CellId 26427 06:17:18.267227 tst iperf3m4.py: using BVCI 26428 06:17:18.380714 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:17:18.392034 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:17:18.403038 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:17:18.414066 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:17:18.424908 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:17:18.435831 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:17:18.447237 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:17:18.458336 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:17:18.469635 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:17:18.589374 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:17:18.709415 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:17:18.824670 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:17:18.941591 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 06:17:19.153883 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:17:19.469657 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3621): Launched 06:17:19.743346 run iperf3-srv_10.42.42.10(pid=3622): Launched 06:17:19.862681 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 06:17:20.074561 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:17:20.390864 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3623): Launched 06:17:20.666627 run iperf3-srv_10.42.42.10(pid=3624): Launched 06:17:20.785046 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 06:17:20.995681 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:17:21.311210 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3625): Launched 06:17:21.585749 run iperf3-srv_10.42.42.10(pid=3626): Launched 06:17:21.703484 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 06:17:21.914970 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:17:22.230270 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3627): Launched 06:17:22.505824 run iperf3-srv_10.42.42.10(pid=3628): Launched 06:17:22.623823 tst iperf3m4.py:8: start network... 06:17:22.836190 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:17:23.323175 run create_hlr_db(pid=3629): Launched 06:17:23.450716 bus /gobi_6: Setting Powered False 06:17:24.513363 run create_hlr_db(pid=3629): Terminated: ok {rc=0} 06:17:24.934451 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3631): Launched 06:17:25.229391 run osmo-hlr_10.42.42.2(pid=3632): Launched 06:17:25.341437 run osmo-stp_10.42.42.5: Starting osmo-stp 06:17:25.861710 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3634): Launched 06:17:26.155265 run osmo-stp_10.42.42.5(pid=3635): Launched 06:17:26.267480 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:17:26.774209 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3637): Launched 06:17:26.887377 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:17:27.135391 run patchelf(pid=3638): Launched 06:17:27.299440 run osmo-stp_10.42.42.5(pid=3635): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3635)] 06:17:27.424161 run osmo-stp_10.42.42.5(pid=3635): stdout: | (launched: 2022-12-10_06:17:26.101217) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:17:27.550177 run osmo-stp_10.42.42.5(pid=3635): stderr: | 20221210061726273 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061726273 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061726274 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061726274 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061726274 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061726274 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061726274 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:17:27.675910 run osmo-stp_10.42.42.5(pid=3635): stdout: | (launched: 2022-12-10_06:17:26.101217) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:17:27.796332 run osmo-stp_10.42.42.5(pid=3635): stderr: | 20221210061726273 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061726273 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061726274 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061726274 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061726274 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061726274 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061726274 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:17:27.938753 run patchelf(pid=3638): Terminating (SIGINT) 06:17:28.103178 run patchelf(pid=3638): Terminated: ok {rc=0} 06:17:28.221827 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3635): Process ended prematurely: osmo-stp_10.42.42.5(pid=3635) [trial-2370↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3635)] [trial-2370↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8] 06:17:28.231097 tst iperf3m4.py:8: Test FAILED (10.4 sec) 06:17:28.258756 run osmo-hlr_10.42.42.2(pid=3632): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3632)] 06:17:28.306047 run osmo-hlr_10.42.42.2(pid=3632): stdout: | (launched: 2022-12-10_06:17:25.174723) 06:17:28.354786 run osmo-hlr_10.42.42.2(pid=3632): stderr: | 20221210061725349 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210061725349 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210061725349 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210061725349 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210061725349 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210061725349 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210061725360 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-lms+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210061725369 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210061725369 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210061725369 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:17:28.403915 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3621): Terminating (SIGTERM) 06:17:28.443805 run iperf3-srv_10.42.42.10(pid=3622): Terminating (SIGTERM) 06:17:28.483570 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3623): Terminating (SIGTERM) 06:17:28.523267 run iperf3-srv_10.42.42.10(pid=3624): Terminating (SIGTERM) 06:17:28.562711 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3625): Terminating (SIGTERM) 06:17:28.602024 run iperf3-srv_10.42.42.10(pid=3626): Terminating (SIGTERM) 06:17:28.641336 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3627): Terminating (SIGTERM) 06:17:28.681264 run iperf3-srv_10.42.42.10(pid=3628): Terminating (SIGTERM) 06:17:28.720462 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3631): Terminating (SIGTERM) 06:17:28.760021 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3634): Terminating (SIGTERM) 06:17:28.799263 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3637): Terminating (SIGTERM) 06:17:28.838784 --- ParallelTerminationStrategy: PID 3621 died... 06:17:28.857520 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3621): Terminated: ok {rc=0} 06:17:28.901359 --- ParallelTerminationStrategy: PID 3622 died... 06:17:28.919697 run iperf3-srv_10.42.42.10(pid=3622): Terminated {rc=256} 06:17:28.963625 --- ParallelTerminationStrategy: PID 3623 died... 06:17:28.982100 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3623): Terminated: ok {rc=0} 06:17:29.025561 --- ParallelTerminationStrategy: PID 3624 died... 06:17:29.043983 run iperf3-srv_10.42.42.10(pid=3624): Terminated {rc=256} 06:17:29.087518 --- ParallelTerminationStrategy: PID 3625 died... 06:17:29.105835 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3625): Terminated: ok {rc=0} 06:17:29.149382 --- ParallelTerminationStrategy: PID 3626 died... 06:17:29.167763 run iperf3-srv_10.42.42.10(pid=3626): Terminated {rc=256} 06:17:29.211653 --- ParallelTerminationStrategy: PID 3627 died... 06:17:29.229920 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3627): Terminated: ok {rc=0} 06:17:29.273514 --- ParallelTerminationStrategy: PID 3628 died... 06:17:29.291871 run iperf3-srv_10.42.42.10(pid=3628): Terminated {rc=256} 06:17:29.335198 --- ParallelTerminationStrategy: PID 3631 died... 06:17:29.353562 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3631): Terminated: ok {rc=0} 06:17:29.397530 --- ParallelTerminationStrategy: PID 3634 died... 06:17:29.415776 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3634): Terminated: ok {rc=0} 06:17:29.459525 --- ParallelTerminationStrategy: PID 3637 died... 06:17:29.477846 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3637): Terminated: ok {rc=0} 06:17:29.562951 bus /gobi_4: Setting Powered False 06:17:30.661713 bus /gobi_4: Setting Powered False 06:17:31.782630 bus /gobi_1: Setting Powered False 06:17:32.889210 bus /gobi_1: Setting Powered False 06:17:34.002647 bus /gobi_0: Setting Powered False 06:17:35.099365 bus /gobi_0: Setting Powered False 06:17:36.215037 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-lms+mod-bts0-egprs ping.py ---------------------------------------------- 06:17:37.316681 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:17:37.328282 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:17:37.378651 tst ping.py: using LAC 26428 06:17:37.493249 tst ping.py: using RAC 163 06:17:37.606696 tst ping.py: using CellId 26428 06:17:37.721435 tst ping.py: using BVCI 26429 06:17:37.826757 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:17:37.837574 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:17:37.847949 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:17:37.858995 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:17:37.869524 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:17:37.880054 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:17:37.890785 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:17:37.902288 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:17:38.015743 tst ping.py:19: start network... 06:17:38.207053 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:17:38.650970 run create_hlr_db(pid=3639): Launched 06:17:38.760088 bus /gobi_6: Setting Powered False 06:17:39.818878 run create_hlr_db(pid=3639): Terminated: ok {rc=0} 06:17:40.242599 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3641): Launched 06:17:40.551543 run osmo-hlr_10.42.42.2(pid=3642): Launched 06:17:40.671101 run osmo-stp_10.42.42.5: Starting osmo-stp 06:17:41.205731 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3644): Launched 06:17:41.514044 run osmo-stp_10.42.42.5(pid=3645): Launched 06:17:41.632511 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:17:42.166795 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3647): Launched 06:17:42.284669 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:17:42.545530 run patchelf(pid=3648): Launched 06:17:42.718417 run osmo-stp_10.42.42.5(pid=3645): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3645)] 06:17:42.849395 run osmo-stp_10.42.42.5(pid=3645): stdout: | (launched: 2022-12-10_06:17:41.457446) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:17:42.982679 run osmo-stp_10.42.42.5(pid=3645): stderr: | 20221210061741646 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061741647 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061741647 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061741647 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061741648 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061741648 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061741648 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:17:43.115053 run osmo-stp_10.42.42.5(pid=3645): stdout: | (launched: 2022-12-10_06:17:41.457446) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:17:43.241334 run osmo-stp_10.42.42.5(pid=3645): stderr: | 20221210061741646 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061741647 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061741647 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061741647 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061741648 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061741648 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061741648 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:17:43.390651 run patchelf(pid=3648): Terminating (SIGINT) 06:17:43.563006 run patchelf(pid=3648): Terminated: ok {rc=0} 06:17:43.687137 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=3645): Process ended prematurely: osmo-stp_10.42.42.5(pid=3645) [trial-2370↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3645)] [trial-2370↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22] 06:17:43.696641 tst ping.py:22: Test FAILED (6.4 sec) 06:17:43.724355 run osmo-hlr_10.42.42.2(pid=3642): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-lms+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3642)] 06:17:43.774037 run osmo-hlr_10.42.42.2(pid=3642): stdout: | (launched: 2022-12-10_06:17:40.494840) 06:17:43.825327 run osmo-hlr_10.42.42.2(pid=3642): stderr: | 20221210061740692 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210061740692 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210061740692 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210061740692 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210061740692 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210061740692 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210061740705 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-lms+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210061740713 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210061740713 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210061740713 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:17:43.876931 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3641): Terminating (SIGTERM) 06:17:43.918171 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3644): Terminating (SIGTERM) 06:17:43.959519 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3647): Terminating (SIGTERM) 06:17:44.001182 --- ParallelTerminationStrategy: PID 3641 died... 06:17:44.020707 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3641): Terminated: ok {rc=0} 06:17:44.066082 --- ParallelTerminationStrategy: PID 3644 died... 06:17:44.085314 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3644): Terminated: ok {rc=0} 06:17:44.130279 --- ParallelTerminationStrategy: PID 3647 died... 06:17:44.149485 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3647): Terminated: ok {rc=0} 06:17:44.234839 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-lms+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 06:17:45.320098 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:17:45.332062 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:17:45.385269 tst ping_idle_ping.py: using LAC 26429 06:17:45.507473 tst ping_idle_ping.py: using RAC 164 06:17:45.628235 tst ping_idle_ping.py: using CellId 26429 06:17:45.744560 tst ping_idle_ping.py: using BVCI 26430 06:17:45.864367 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:17:45.880821 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:17:45.894611 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:17:45.914329 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:17:45.929049 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:17:45.941763 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:17:45.954660 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:17:45.966975 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:17:46.090047 tst ping_idle_ping.py:24: start network... 06:17:46.303804 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:17:46.799721 run create_hlr_db(pid=3649): Launched 06:17:46.959384 bus /gobi_6: Setting Powered False 06:17:48.021453 run create_hlr_db(pid=3649): Terminated: ok {rc=0} 06:17:48.435830 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3651): Launched 06:17:48.725684 run osmo-hlr_10.42.42.2(pid=3652): Launched 06:17:48.835408 run osmo-stp_10.42.42.5: Starting osmo-stp 06:17:49.332499 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3654): Launched 06:17:49.621629 run osmo-stp_10.42.42.5(pid=3655): Launched 06:17:49.731798 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:17:50.229054 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3657): Launched 06:17:50.339949 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:17:50.584018 run patchelf(pid=3658): Launched 06:17:50.745563 run osmo-stp_10.42.42.5(pid=3655): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3655)] 06:17:50.868264 run osmo-stp_10.42.42.5(pid=3655): stdout: | (launched: 2022-12-10_06:17:49.567863) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:17:50.992430 run osmo-stp_10.42.42.5(pid=3655): stderr: | 20221210061749737 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061749737 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061749737 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061749738 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061749738 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061749738 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061749738 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:17:51.117272 run osmo-stp_10.42.42.5(pid=3655): stdout: | (launched: 2022-12-10_06:17:49.567863) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:17:51.235348 run osmo-stp_10.42.42.5(pid=3655): stderr: | 20221210061749737 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061749737 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061749737 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061749738 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061749738 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061749738 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061749738 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:17:51.375779 run patchelf(pid=3658): Terminating (SIGINT) 06:17:51.537739 run patchelf(pid=3658): Terminated: ok {rc=0} 06:17:51.654217 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=3655): Process ended prematurely: osmo-stp_10.42.42.5(pid=3655) [trial-2370↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3655)] [trial-2370↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27] 06:17:51.663064 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 06:17:51.689829 run osmo-hlr_10.42.42.2(pid=3652): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3652)] 06:17:51.737277 run osmo-hlr_10.42.42.2(pid=3652): stdout: | (launched: 2022-12-10_06:17:48.671484) 06:17:51.786286 run osmo-hlr_10.42.42.2(pid=3652): stderr: | 20221210061748847 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210061748847 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210061748847 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210061748847 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210061748848 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210061748848 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210061748859 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-lms+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210061748868 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210061748868 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210061748868 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:17:51.835863 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3651): Terminating (SIGTERM) 06:17:51.875224 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3654): Terminating (SIGTERM) 06:17:51.914943 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3657): Terminating (SIGTERM) 06:17:51.954920 --- ParallelTerminationStrategy: PID 3651 died... 06:17:51.973887 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3651): Terminated: ok {rc=0} 06:17:52.018130 --- ParallelTerminationStrategy: PID 3654 died... 06:17:52.036465 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3654): Terminated: ok {rc=0} 06:17:52.080335 --- ParallelTerminationStrategy: PID 3657 died... 06:17:52.099014 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3657): Terminated: ok {rc=0} 06:17:52.183992 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2370 gprs:trx-lms+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 gprs:trx-lms+mod-bts0-dynts-ipa --------------------------------------------------------------------- 06:17:53.480610 tst gprs:trx-lms+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:17:53.486678 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 06:17:53.519770 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 06:17:53.557797 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 06:17:53.644755 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 06:17:53.677571 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 06:17:53.715246 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 06:17:54.305280 tst gprs:trx-lms+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2370 gprs:trx-lms+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 06:17:54.353076 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:17:54.363983 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:17:54.432140 tst cs_paging_gprs_active.py: using LAC 26430 06:17:54.552645 tst cs_paging_gprs_active.py: using RAC 165 06:17:54.668361 tst cs_paging_gprs_active.py: using CellId 26430 06:17:54.783343 tst cs_paging_gprs_active.py: using BVCI 26431 06:17:54.890222 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:17:54.900800 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:17:54.911483 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:17:54.922298 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:17:54.933212 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:17:54.944038 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:17:54.955160 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:17:54.966023 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:17:54.977071 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:17:55.095554 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:17:55.210217 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 06:17:55.407087 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:17:55.702583 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3662): Launched 06:17:55.960027 run iperf3-srv_10.42.42.10(pid=3663): Launched 06:17:56.070645 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 06:17:56.266894 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:17:56.562585 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3664): Launched 06:17:56.819555 run iperf3-srv_10.42.42.10(pid=3665): Launched 06:17:56.930079 tst cs_paging_gprs_active.py:38: start network... 06:17:57.125905 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:17:57.579685 run create_hlr_db(pid=3666): Launched 06:17:57.692739 bus /gobi_6: Setting Powered False 06:17:58.752402 run create_hlr_db(pid=3666): Terminated: ok {rc=0} 06:17:59.184244 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3668): Launched 06:17:59.499712 run osmo-hlr_10.42.42.2(pid=3669): Launched 06:17:59.620461 run osmo-stp_10.42.42.5: Starting osmo-stp 06:18:00.164471 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3671): Launched 06:18:00.479212 run osmo-stp_10.42.42.5(pid=3672): Launched 06:18:00.600032 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:18:01.153399 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3674): Launched 06:18:01.285580 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:18:01.566751 run patchelf(pid=3675): Launched 06:18:01.756730 run osmo-stp_10.42.42.5(pid=3672): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3672)] 06:18:01.894232 run osmo-stp_10.42.42.5(pid=3672): stdout: | (launched: 2022-12-10_06:18:00.421552) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:18:02.031812 run osmo-stp_10.42.42.5(pid=3672): stderr: | 20221210061800612 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061800612 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061800612 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061800613 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061800613 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061800613 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061800613 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:18:02.169354 run osmo-stp_10.42.42.5(pid=3672): stdout: | (launched: 2022-12-10_06:18:00.421552) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:18:02.299424 run osmo-stp_10.42.42.5(pid=3672): stderr: | 20221210061800612 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061800612 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061800612 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061800613 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061800613 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061800613 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061800613 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:18:02.453102 run patchelf(pid=3675): Terminating (SIGINT) 06:18:02.629842 run patchelf(pid=3675): Terminated: ok {rc=0} 06:18:02.757937 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=3672): Process ended prematurely: osmo-stp_10.42.42.5(pid=3672) [trial-2370↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3672)] [trial-2370↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 06:18:02.768251 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 06:18:02.797085 run osmo-hlr_10.42.42.2(pid=3669): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3669)] 06:18:02.846858 run osmo-hlr_10.42.42.2(pid=3669): stdout: | (launched: 2022-12-10_06:17:59.442102) 06:18:02.897970 run osmo-hlr_10.42.42.2(pid=3669): stderr: | 20221210061759640 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210061759640 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210061759640 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210061759640 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210061759640 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210061759640 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210061759653 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-lms+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210061759662 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210061759662 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210061759662 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:18:02.949442 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3662): Terminating (SIGTERM) 06:18:02.990662 run iperf3-srv_10.42.42.10(pid=3663): Terminating (SIGTERM) 06:18:03.032022 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3664): Terminating (SIGTERM) 06:18:03.073503 run iperf3-srv_10.42.42.10(pid=3665): Terminating (SIGTERM) 06:18:03.114813 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3668): Terminating (SIGTERM) 06:18:03.156172 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3671): Terminating (SIGTERM) 06:18:03.197485 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3674): Terminating (SIGTERM) 06:18:03.239058 --- ParallelTerminationStrategy: PID 3662 died... 06:18:03.258940 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3662): Terminated: ok {rc=0} 06:18:03.305397 --- ParallelTerminationStrategy: PID 3663 died... 06:18:03.324774 run iperf3-srv_10.42.42.10(pid=3663): Terminated {rc=256} 06:18:03.370383 --- ParallelTerminationStrategy: PID 3664 died... 06:18:03.389902 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3664): Terminated: ok {rc=0} 06:18:03.435568 --- ParallelTerminationStrategy: PID 3665 died... 06:18:03.456643 run iperf3-srv_10.42.42.10(pid=3665): Terminated {rc=256} 06:18:03.502250 --- ParallelTerminationStrategy: PID 3668 died... 06:18:03.521708 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3668): Terminated: ok {rc=0} 06:18:03.567267 --- ParallelTerminationStrategy: PID 3671 died... 06:18:03.586697 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3671): Terminated: ok {rc=0} 06:18:03.632070 --- ParallelTerminationStrategy: PID 3674 died... 06:18:03.651507 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3674): Terminated: ok {rc=0} 06:18:03.738484 bus /gobi_0: Setting Powered False 06:18:04.837230 bus /gobi_0: Setting Powered False 06:18:05.951216 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-lms+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 06:18:07.099223 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:18:07.111176 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:18:07.182333 tst iperf3.py: using LAC 26431 06:18:07.306742 tst iperf3.py: using RAC 166 06:18:07.430001 tst iperf3.py: using CellId 26431 06:18:07.555736 tst iperf3.py: using BVCI 26432 06:18:07.670213 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:18:07.681470 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:18:07.692463 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:18:07.703491 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:18:07.714425 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:18:07.725472 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:18:07.736532 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:18:07.747409 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:18:07.758495 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:18:07.872650 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 06:18:08.071259 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:18:08.366820 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3676): Launched 06:18:08.623616 run iperf3-srv_10.42.42.10(pid=3677): Launched 06:18:08.734037 tst iperf3.py:8: start network... 06:18:08.930700 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:18:09.384143 run create_hlr_db(pid=3678): Launched 06:18:09.497582 bus /gobi_6: Setting Powered False 06:18:10.555737 run create_hlr_db(pid=3678): Terminated: ok {rc=0} 06:18:10.986653 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3680): Launched 06:18:11.301106 run osmo-hlr_10.42.42.2(pid=3681): Launched 06:18:11.422196 run osmo-stp_10.42.42.5: Starting osmo-stp 06:18:11.966085 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3683): Launched 06:18:12.280636 run osmo-stp_10.42.42.5(pid=3684): Launched 06:18:12.401555 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:18:12.945767 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3686): Launched 06:18:13.066687 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:18:13.332820 run patchelf(pid=3687): Launched 06:18:13.508896 run osmo-stp_10.42.42.5(pid=3684): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3684)] 06:18:13.642641 run osmo-stp_10.42.42.5(pid=3684): stdout: | (launched: 2022-12-10_06:18:12.223166) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:18:13.778346 run osmo-stp_10.42.42.5(pid=3684): stderr: | 20221210061812415 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061812415 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061812415 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061812416 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061812416 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061812416 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061812416 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:18:13.913641 run osmo-stp_10.42.42.5(pid=3684): stdout: | (launched: 2022-12-10_06:18:12.223166) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:18:14.043015 run osmo-stp_10.42.42.5(pid=3684): stderr: | 20221210061812415 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061812415 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061812415 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061812416 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061812416 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061812416 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061812416 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:18:14.196235 run patchelf(pid=3687): Terminating (SIGINT) 06:18:14.372652 run patchelf(pid=3687): Terminated: ok {rc=0} 06:18:14.499995 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3684): Process ended prematurely: osmo-stp_10.42.42.5(pid=3684) [trial-2370↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3684)] [trial-2370↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8] 06:18:14.510237 tst iperf3.py:8: Test FAILED (7.4 sec) 06:18:14.538776 run osmo-hlr_10.42.42.2(pid=3681): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3681)] 06:18:14.588416 run osmo-hlr_10.42.42.2(pid=3681): stdout: | (launched: 2022-12-10_06:18:11.244041) 06:18:14.639637 run osmo-hlr_10.42.42.2(pid=3681): stderr: | 20221210061811443 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210061811443 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210061811443 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210061811443 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210061811443 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210061811443 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210061811455 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210061811464 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210061811464 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210061811464 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:18:14.691042 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3676): Terminating (SIGTERM) 06:18:14.732720 run iperf3-srv_10.42.42.10(pid=3677): Terminating (SIGTERM) 06:18:14.774167 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3680): Terminating (SIGTERM) 06:18:14.815985 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3683): Terminating (SIGTERM) 06:18:14.857575 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3686): Terminating (SIGTERM) 06:18:14.899731 --- ParallelTerminationStrategy: PID 3676 died... 06:18:14.919972 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3676): Terminated: ok {rc=0} 06:18:14.966208 --- ParallelTerminationStrategy: PID 3677 died... 06:18:14.985571 run iperf3-srv_10.42.42.10(pid=3677): Terminated {rc=256} 06:18:15.031289 --- ParallelTerminationStrategy: PID 3680 died... 06:18:15.050732 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3680): Terminated: ok {rc=0} 06:18:15.096291 --- ParallelTerminationStrategy: PID 3683 died... 06:18:15.115738 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3683): Terminated: ok {rc=0} 06:18:15.161433 --- ParallelTerminationStrategy: PID 3686 died... 06:18:15.180724 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3686): Terminated: ok {rc=0} 06:18:15.267762 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-lms+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 06:18:16.415472 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:18:16.428384 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:18:16.511351 tst iperf3m4.py: using LAC 26432 06:18:16.638237 tst iperf3m4.py: using RAC 167 06:18:16.763293 tst iperf3m4.py: using CellId 26432 06:18:16.930144 tst iperf3m4.py: using BVCI 26433 06:18:17.043868 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:18:17.055858 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:18:17.067502 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:18:17.080887 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:18:17.093206 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:18:17.104743 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:18:17.117434 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:18:17.130634 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:18:17.142463 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:18:17.260047 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:18:17.380200 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:18:17.499609 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:18:17.618605 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 06:18:17.831046 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:18:18.147423 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3688): Launched 06:18:18.422149 run iperf3-srv_10.42.42.10(pid=3689): Launched 06:18:18.539935 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 06:18:18.751119 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:18:19.068147 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3690): Launched 06:18:19.342350 run iperf3-srv_10.42.42.10(pid=3691): Launched 06:18:19.460407 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 06:18:19.671721 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:18:19.988020 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3692): Launched 06:18:20.262630 run iperf3-srv_10.42.42.10(pid=3693): Launched 06:18:20.380771 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 06:18:20.592635 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:18:20.909395 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3694): Launched 06:18:21.183669 run iperf3-srv_10.42.42.10(pid=3695): Launched 06:18:21.301909 tst iperf3m4.py:8: start network... 06:18:21.513255 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:18:22.002081 run create_hlr_db(pid=3696): Launched 06:18:22.129955 bus /gobi_6: Setting Powered False 06:18:23.192649 run create_hlr_db(pid=3696): Terminated: ok {rc=0} 06:18:23.613919 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3698): Launched 06:18:23.906954 run osmo-hlr_10.42.42.2(pid=3699): Launched 06:18:24.020234 run osmo-stp_10.42.42.5: Starting osmo-stp 06:18:24.525448 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3701): Launched 06:18:24.818682 run osmo-stp_10.42.42.5(pid=3702): Launched 06:18:24.930401 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:18:25.434892 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3704): Launched 06:18:25.548511 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:18:25.795845 run patchelf(pid=3705): Launched 06:18:25.959570 run osmo-stp_10.42.42.5(pid=3702): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3702)] 06:18:26.084282 run osmo-stp_10.42.42.5(pid=3702): stdout: | (launched: 2022-12-10_06:18:24.764707) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:18:26.210078 run osmo-stp_10.42.42.5(pid=3702): stderr: | 20221210061824932 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061824932 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061824932 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061824933 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061824933 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061824933 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061824933 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:18:26.335645 run osmo-stp_10.42.42.5(pid=3702): stdout: | (launched: 2022-12-10_06:18:24.764707) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:18:26.455586 run osmo-stp_10.42.42.5(pid=3702): stderr: | 20221210061824932 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061824932 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061824932 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061824933 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061824933 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061824933 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061824933 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:18:26.598013 run patchelf(pid=3705): Terminating (SIGINT) 06:18:26.762050 run patchelf(pid=3705): Terminated: ok {rc=0} 06:18:26.880469 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3702): Process ended prematurely: osmo-stp_10.42.42.5(pid=3702) [trial-2370↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3702)] [trial-2370↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8] 06:18:26.889942 tst iperf3m4.py:8: Test FAILED (10.5 sec) 06:18:26.917638 run osmo-hlr_10.42.42.2(pid=3699): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3699)] 06:18:26.964843 run osmo-hlr_10.42.42.2(pid=3699): stdout: | (launched: 2022-12-10_06:18:23.852714) 06:18:27.013842 run osmo-hlr_10.42.42.2(pid=3699): stderr: | 20221210061824028 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210061824028 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210061824029 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210061824029 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210061824029 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210061824029 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210061824040 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210061824049 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210061824050 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210061824050 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:18:27.063091 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3688): Terminating (SIGTERM) 06:18:27.102307 run iperf3-srv_10.42.42.10(pid=3689): Terminating (SIGTERM) 06:18:27.141420 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3690): Terminating (SIGTERM) 06:18:27.180920 run iperf3-srv_10.42.42.10(pid=3691): Terminating (SIGTERM) 06:18:27.219941 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3692): Terminating (SIGTERM) 06:18:27.259101 run iperf3-srv_10.42.42.10(pid=3693): Terminating (SIGTERM) 06:18:27.298025 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3694): Terminating (SIGTERM) 06:18:27.336923 run iperf3-srv_10.42.42.10(pid=3695): Terminating (SIGTERM) 06:18:27.375850 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3698): Terminating (SIGTERM) 06:18:27.414958 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3701): Terminating (SIGTERM) 06:18:27.453951 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3704): Terminating (SIGTERM) 06:18:27.493430 --- ParallelTerminationStrategy: PID 3688 died... 06:18:27.512419 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3688): Terminated: ok {rc=0} 06:18:27.556295 --- ParallelTerminationStrategy: PID 3689 died... 06:18:27.574762 run iperf3-srv_10.42.42.10(pid=3689): Terminated {rc=256} 06:18:27.618382 --- ParallelTerminationStrategy: PID 3690 died... 06:18:27.636657 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3690): Terminated: ok {rc=0} 06:18:27.680579 --- ParallelTerminationStrategy: PID 3691 died... 06:18:27.698903 run iperf3-srv_10.42.42.10(pid=3691): Terminated {rc=256} 06:18:27.741969 --- ParallelTerminationStrategy: PID 3692 died... 06:18:27.760195 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3692): Terminated: ok {rc=0} 06:18:27.803407 --- ParallelTerminationStrategy: PID 3693 died... 06:18:27.821612 run iperf3-srv_10.42.42.10(pid=3693): Terminated {rc=256} 06:18:27.864766 --- ParallelTerminationStrategy: PID 3694 died... 06:18:27.883130 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3694): Terminated: ok {rc=0} 06:18:27.926342 --- ParallelTerminationStrategy: PID 3695 died... 06:18:27.944615 run iperf3-srv_10.42.42.10(pid=3695): Terminated {rc=256} 06:18:27.987745 --- ParallelTerminationStrategy: PID 3698 died... 06:18:28.006000 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3698): Terminated: ok {rc=0} 06:18:28.049288 --- ParallelTerminationStrategy: PID 3701 died... 06:18:28.067465 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3701): Terminated: ok {rc=0} 06:18:28.111064 --- ParallelTerminationStrategy: PID 3704 died... 06:18:28.129453 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3704): Terminated: ok {rc=0} 06:18:28.212925 bus /gobi_4: Setting Powered False 06:18:29.310060 bus /gobi_4: Setting Powered False 06:18:30.427387 bus /gobi_1: Setting Powered False 06:18:31.530148 bus /gobi_1: Setting Powered False 06:18:32.654788 bus /gobi_0: Setting Powered False 06:18:33.750848 bus /gobi_0: Setting Powered False 06:18:34.863685 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-lms+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 06:18:35.965564 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:18:35.977800 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:18:36.054136 tst ping.py: using LAC 26433 06:18:36.168539 tst ping.py: using RAC 168 06:18:36.289395 tst ping.py: using CellId 26433 06:18:36.409140 tst ping.py: using BVCI 26434 06:18:36.520784 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:18:36.532425 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:18:36.543610 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:18:36.554902 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:18:36.566538 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:18:36.577767 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:18:36.589403 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:18:36.600374 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:18:36.718022 tst ping.py:19: start network... 06:18:36.910561 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:18:37.357503 run create_hlr_db(pid=3706): Launched 06:18:37.467959 bus /gobi_6: Setting Powered False 06:18:38.525694 run create_hlr_db(pid=3706): Terminated: ok {rc=0} 06:18:38.929745 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3708): Launched 06:18:39.220622 run osmo-hlr_10.42.42.2(pid=3709): Launched 06:18:39.333924 run osmo-stp_10.42.42.5: Starting osmo-stp 06:18:39.832543 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3711): Launched 06:18:40.122390 run osmo-stp_10.42.42.5(pid=3712): Launched 06:18:40.232428 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:18:40.729099 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3714): Launched 06:18:40.840185 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:18:41.084316 run patchelf(pid=3715): Launched 06:18:41.246684 run osmo-stp_10.42.42.5(pid=3712): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3712)] 06:18:41.369328 run osmo-stp_10.42.42.5(pid=3712): stdout: | (launched: 2022-12-10_06:18:40.069164) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:18:41.493574 run osmo-stp_10.42.42.5(pid=3712): stderr: | 20221210061840239 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061840239 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061840239 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061840240 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061840240 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061840240 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061840241 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:18:41.617952 run osmo-stp_10.42.42.5(pid=3712): stdout: | (launched: 2022-12-10_06:18:40.069164) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:18:41.736247 run osmo-stp_10.42.42.5(pid=3712): stderr: | 20221210061840239 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061840239 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061840239 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061840240 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061840240 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061840240 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061840241 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:18:41.876564 run patchelf(pid=3715): Terminating (SIGINT) 06:18:42.038194 run patchelf(pid=3715): Terminated: ok {rc=0} 06:18:42.154719 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=3712): Process ended prematurely: osmo-stp_10.42.42.5(pid=3712) [trial-2370↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3712)] [trial-2370↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22] 06:18:42.163708 tst ping.py:22: Test FAILED (6.2 sec) 06:18:42.190982 run osmo-hlr_10.42.42.2(pid=3709): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3709)] 06:18:42.238190 run osmo-hlr_10.42.42.2(pid=3709): stdout: | (launched: 2022-12-10_06:18:39.166211) 06:18:42.287240 run osmo-hlr_10.42.42.2(pid=3709): stderr: | 20221210061839340 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210061839340 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210061839340 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210061839340 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210061839340 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210061839340 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210061839352 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-lms+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210061839361 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210061839361 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210061839361 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:18:42.336558 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3708): Terminating (SIGTERM) 06:18:42.376189 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3711): Terminating (SIGTERM) 06:18:42.415713 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3714): Terminating (SIGTERM) 06:18:42.455440 --- ParallelTerminationStrategy: PID 3708 died... 06:18:42.474454 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3708): Terminated: ok {rc=0} 06:18:42.518752 --- ParallelTerminationStrategy: PID 3711 died... 06:18:42.537395 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3711): Terminated: ok {rc=0} 06:18:42.581485 --- ParallelTerminationStrategy: PID 3714 died... 06:18:42.600151 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3714): Terminated: ok {rc=0} 06:18:42.685910 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-lms+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 06:18:43.773253 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:18:43.785426 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:18:43.855732 tst ping_idle_ping.py: using LAC 26434 06:18:43.969702 tst ping_idle_ping.py: using RAC 169 06:18:44.083837 tst ping_idle_ping.py: using CellId 26434 06:18:44.197478 tst ping_idle_ping.py: using BVCI 26435 06:18:44.304376 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:18:44.315409 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:18:44.326160 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:18:44.337229 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:18:44.348462 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:18:44.359565 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:18:44.370840 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:18:44.381715 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:18:44.496613 tst ping_idle_ping.py:24: start network... 06:18:44.705854 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:18:45.189147 run create_hlr_db(pid=3716): Launched 06:18:45.315456 bus /gobi_6: Setting Powered False 06:18:46.375407 run create_hlr_db(pid=3716): Terminated: ok {rc=0} 06:18:46.809487 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3718): Launched 06:18:47.133726 run osmo-hlr_10.42.42.2(pid=3719): Launched 06:18:47.270569 run osmo-stp_10.42.42.5: Starting osmo-stp 06:18:47.803250 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3721): Launched 06:18:48.112203 run osmo-stp_10.42.42.5(pid=3722): Launched 06:18:48.229760 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:18:48.763410 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3724): Launched 06:18:48.882694 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:18:49.144231 run patchelf(pid=3725): Launched 06:18:49.317832 run osmo-stp_10.42.42.5(pid=3722): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3722)] 06:18:49.450015 run osmo-stp_10.42.42.5(pid=3722): stdout: | (launched: 2022-12-10_06:18:48.055381) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:18:49.584094 run osmo-stp_10.42.42.5(pid=3722): stderr: | 20221210061848246 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061848246 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061848246 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061848247 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061848247 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061848247 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061848247 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:18:49.718374 run osmo-stp_10.42.42.5(pid=3722): stdout: | (launched: 2022-12-10_06:18:48.055381) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:18:49.846241 run osmo-stp_10.42.42.5(pid=3722): stderr: | 20221210061848246 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061848246 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061848246 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061848247 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061848247 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061848247 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061848247 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:18:49.997391 run patchelf(pid=3725): Terminating (SIGINT) 06:18:50.171251 run patchelf(pid=3725): Terminated: ok {rc=0} 06:18:50.296126 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=3722): Process ended prematurely: osmo-stp_10.42.42.5(pid=3722) [trial-2370↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3722)] [trial-2370↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 06:18:50.305744 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 06:18:50.333591 run osmo-hlr_10.42.42.2(pid=3719): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3719)] 06:18:50.382760 run osmo-hlr_10.42.42.2(pid=3719): stdout: | (launched: 2022-12-10_06:18:47.064566) 06:18:50.433610 run osmo-hlr_10.42.42.2(pid=3719): stderr: | 20221210061847292 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210061847292 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210061847292 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210061847292 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210061847292 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210061847292 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210061847305 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-lms+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210061847313 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210061847313 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210061847313 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:18:50.484770 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3718): Terminating (SIGTERM) 06:18:50.525896 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3721): Terminating (SIGTERM) 06:18:50.567178 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3724): Terminating (SIGTERM) 06:18:50.608681 --- ParallelTerminationStrategy: PID 3718 died... 06:18:50.628199 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3718): Terminated: ok {rc=0} 06:18:50.673873 --- ParallelTerminationStrategy: PID 3721 died... 06:18:50.693408 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3721): Terminated: ok {rc=0} 06:18:50.739012 --- ParallelTerminationStrategy: PID 3724 died... 06:18:50.758412 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3724): Terminated: ok {rc=0} 06:18:50.845400 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2370 gprs:trx-lms+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 gprs:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 06:18:52.146907 tst gprs:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:18:52.153803 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 06:18:52.187172 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 06:18:52.226405 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 06:18:52.314099 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 06:18:52.347875 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 06:18:52.387015 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 06:18:52.980756 tst gprs:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2370 gprs:trx-lms+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 06:18:53.031087 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:18:53.042415 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 06:18:53.113487 tst cs_paging_gprs_active.py: using LAC 26435 06:18:53.237596 tst cs_paging_gprs_active.py: using RAC 170 06:18:53.362395 tst cs_paging_gprs_active.py: using CellId 26435 06:18:53.487043 tst cs_paging_gprs_active.py: using BVCI 26436 06:18:53.601208 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:18:53.612516 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:18:53.623675 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:18:53.634812 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:18:53.645826 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:18:53.656809 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:18:53.668063 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:18:53.679136 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:18:53.690376 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:18:53.807446 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:18:53.927706 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 06:18:54.138889 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:18:54.454625 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3729): Launched 06:18:54.729561 run iperf3-srv_10.42.42.10(pid=3730): Launched 06:18:54.848108 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 06:18:55.059456 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:18:55.376055 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3731): Launched 06:18:55.651230 run iperf3-srv_10.42.42.10(pid=3732): Launched 06:18:55.769451 tst cs_paging_gprs_active.py:38: start network... 06:18:55.981564 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:18:56.471165 run create_hlr_db(pid=3733): Launched 06:18:56.599204 bus /gobi_6: Setting Powered False 06:18:57.661980 run create_hlr_db(pid=3733): Terminated: ok {rc=0} 06:18:58.102279 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3735): Launched 06:18:58.418743 run osmo-hlr_10.42.42.2(pid=3736): Launched 06:18:58.539045 run osmo-stp_10.42.42.5: Starting osmo-stp 06:18:59.080939 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3738): Launched 06:18:59.396797 run osmo-stp_10.42.42.5(pid=3739): Launched 06:18:59.517544 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:19:00.062632 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3741): Launched 06:19:00.183448 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:19:00.449133 run patchelf(pid=3742): Launched 06:19:00.626542 run osmo-stp_10.42.42.5(pid=3739): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3739)] 06:19:00.760084 run osmo-stp_10.42.42.5(pid=3739): stdout: | (launched: 2022-12-10_06:18:59.338927) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:19:00.907966 run osmo-stp_10.42.42.5(pid=3739): stderr: | 20221210061859533 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061859533 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061859534 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061859534 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061859534 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061859534 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061859534 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:19:01.041197 run osmo-stp_10.42.42.5(pid=3739): stdout: | (launched: 2022-12-10_06:18:59.338927) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:19:01.167605 run osmo-stp_10.42.42.5(pid=3739): stderr: | 20221210061859533 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061859533 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061859534 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061859534 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061859534 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061859534 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061859534 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:19:01.318596 run patchelf(pid=3742): Terminating (SIGINT) 06:19:01.490985 run patchelf(pid=3742): Terminated: ok {rc=0} 06:19:01.617212 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=3739): Process ended prematurely: osmo-stp_10.42.42.5(pid=3739) [trial-2370↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3739)] [trial-2370↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 06:19:01.627922 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 06:19:01.658633 run osmo-hlr_10.42.42.2(pid=3736): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3736)] 06:19:01.709891 run osmo-hlr_10.42.42.2(pid=3736): stdout: | (launched: 2022-12-10_06:18:58.359361) 06:19:01.761293 run osmo-hlr_10.42.42.2(pid=3736): stderr: | 20221210061858557 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210061858557 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210061858557 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210061858557 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210061858557 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210061858557 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210061858569 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-lms+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210061858577 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210061858577 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210061858578 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:19:01.814903 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3729): Terminating (SIGTERM) 06:19:01.857456 run iperf3-srv_10.42.42.10(pid=3730): Terminating (SIGTERM) 06:19:01.901953 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3731): Terminating (SIGTERM) 06:19:01.945113 run iperf3-srv_10.42.42.10(pid=3732): Terminating (SIGTERM) 06:19:01.990562 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3735): Terminating (SIGTERM) 06:19:02.034820 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3738): Terminating (SIGTERM) 06:19:02.079333 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3741): Terminating (SIGTERM) 06:19:02.123136 --- ParallelTerminationStrategy: PID 3729 died... 06:19:02.142888 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3729): Terminated: ok {rc=0} 06:19:02.190870 --- ParallelTerminationStrategy: PID 3730 died... 06:19:02.210642 run iperf3-srv_10.42.42.10(pid=3730): Terminated {rc=256} 06:19:02.254690 --- ParallelTerminationStrategy: PID 3731 died... 06:19:02.273372 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3731): Terminated: ok {rc=0} 06:19:02.317720 --- ParallelTerminationStrategy: PID 3732 died... 06:19:02.336151 run iperf3-srv_10.42.42.10(pid=3732): Terminated {rc=256} 06:19:02.380801 --- ParallelTerminationStrategy: PID 3735 died... 06:19:02.399725 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3735): Terminated: ok {rc=0} 06:19:02.443780 --- ParallelTerminationStrategy: PID 3738 died... 06:19:02.462313 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3738): Terminated: ok {rc=0} 06:19:02.506189 --- ParallelTerminationStrategy: PID 3741 died... 06:19:02.524786 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3741): Terminated: ok {rc=0} 06:19:02.610359 bus /gobi_0: Setting Powered False 06:19:03.707767 bus /gobi_0: Setting Powered False 06:19:04.822376 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-lms+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 06:19:05.965921 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:19:05.977525 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 06:19:06.047436 tst iperf3.py: using LAC 26436 06:19:06.164929 tst iperf3.py: using RAC 171 06:19:06.281106 tst iperf3.py: using CellId 26436 06:19:06.398102 tst iperf3.py: using BVCI 26437 06:19:06.505292 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:19:06.515926 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:19:06.526503 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:19:06.537282 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:19:06.547985 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:19:06.558863 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:19:06.569792 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:19:06.580376 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:19:06.591265 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:19:06.704645 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 06:19:06.900320 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:19:07.194296 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3743): Launched 06:19:07.451046 run iperf3-srv_10.42.42.10(pid=3744): Launched 06:19:07.561357 tst iperf3.py:8: start network... 06:19:07.756777 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:19:08.213096 run create_hlr_db(pid=3745): Launched 06:19:08.325942 bus /gobi_6: Setting Powered False 06:19:09.388112 run create_hlr_db(pid=3745): Terminated: ok {rc=0} 06:19:09.808404 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3748): Launched 06:19:10.127034 run osmo-hlr_10.42.42.2(pid=3749): Launched 06:19:10.246402 run osmo-stp_10.42.42.5: Starting osmo-stp 06:19:10.789947 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3751): Launched 06:19:11.105476 run osmo-stp_10.42.42.5(pid=3752): Launched 06:19:11.226314 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:19:11.770604 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3754): Launched 06:19:11.892224 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:19:12.158597 run patchelf(pid=3755): Launched 06:19:12.333274 run osmo-stp_10.42.42.5(pid=3752): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3752)] 06:19:12.466240 run osmo-stp_10.42.42.5(pid=3752): stdout: | (launched: 2022-12-10_06:19:11.047626) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:19:12.600602 run osmo-stp_10.42.42.5(pid=3752): stderr: | 20221210061911242 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061911242 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061911242 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061911242 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061911243 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061911243 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061911243 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:19:12.735337 run osmo-stp_10.42.42.5(pid=3752): stdout: | (launched: 2022-12-10_06:19:11.047626) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:19:12.864365 run osmo-stp_10.42.42.5(pid=3752): stderr: | 20221210061911242 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061911242 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061911242 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061911242 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061911243 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061911243 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061911243 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:19:13.017410 run patchelf(pid=3755): Terminating (SIGINT) 06:19:13.192917 run patchelf(pid=3755): Terminated: ok {rc=0} 06:19:13.319321 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3752): Process ended prematurely: osmo-stp_10.42.42.5(pid=3752) [trial-2370↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3752)] [trial-2370↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8] 06:19:13.329479 tst iperf3.py:8: Test FAILED (7.4 sec) 06:19:13.357738 run osmo-hlr_10.42.42.2(pid=3749): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3749)] 06:19:13.406763 run osmo-hlr_10.42.42.2(pid=3749): stdout: | (launched: 2022-12-10_06:19:10.069370) 06:19:13.457413 run osmo-hlr_10.42.42.2(pid=3749): stderr: | 20221210061910267 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210061910267 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210061910267 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210061910267 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210061910268 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210061910268 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210061910280 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210061910290 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210061910290 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210061910290 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:19:13.508198 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3743): Terminating (SIGTERM) 06:19:13.549184 run iperf3-srv_10.42.42.10(pid=3744): Terminating (SIGTERM) 06:19:13.589896 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3748): Terminating (SIGTERM) 06:19:13.630600 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3751): Terminating (SIGTERM) 06:19:13.671258 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3754): Terminating (SIGTERM) 06:19:13.712243 --- ParallelTerminationStrategy: PID 3743 died... 06:19:13.731919 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3743): Terminated: ok {rc=0} 06:19:13.777351 --- ParallelTerminationStrategy: PID 3744 died... 06:19:13.796321 run iperf3-srv_10.42.42.10(pid=3744): Terminated {rc=256} 06:19:13.841945 --- ParallelTerminationStrategy: PID 3748 died... 06:19:13.861272 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3748): Terminated: ok {rc=0} 06:19:13.906530 --- ParallelTerminationStrategy: PID 3751 died... 06:19:13.925678 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3751): Terminated: ok {rc=0} 06:19:13.970959 --- ParallelTerminationStrategy: PID 3754 died... 06:19:13.990372 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3754): Terminated: ok {rc=0} 06:19:14.075828 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-lms+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 06:19:15.223948 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:19:15.235838 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 06:19:15.308851 tst iperf3m4.py: using LAC 26437 06:19:15.433218 tst iperf3m4.py: using RAC 172 06:19:15.558142 tst iperf3m4.py: using CellId 26437 06:19:15.683763 tst iperf3m4.py: using BVCI 26438 06:19:15.791957 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:19:15.802764 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:19:15.813755 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:19:15.824803 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:19:15.835988 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:19:15.852287 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:19:15.867499 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:19:15.883746 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:19:15.897456 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:19:16.024227 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:19:16.151262 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:19:16.273870 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:19:16.396776 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 06:19:16.599253 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:19:16.914300 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3757): Launched 06:19:17.213777 run iperf3-srv_10.42.42.10(pid=3758): Launched 06:19:17.333104 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 06:19:17.529666 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:19:17.825499 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3759): Launched 06:19:18.081692 run iperf3-srv_10.42.42.10(pid=3760): Launched 06:19:18.191924 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 06:19:18.387254 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:19:18.682206 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3761): Launched 06:19:18.938764 run iperf3-srv_10.42.42.10(pid=3762): Launched 06:19:19.048753 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 06:19:19.244214 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:19:19.540145 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3763): Launched 06:19:19.797099 run iperf3-srv_10.42.42.10(pid=3764): Launched 06:19:19.907336 tst iperf3m4.py:8: start network... 06:19:20.102619 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:19:20.559172 run create_hlr_db(pid=3765): Launched 06:19:20.672846 bus /gobi_6: Setting Powered False 06:19:21.731276 run create_hlr_db(pid=3765): Terminated: ok {rc=0} 06:19:22.161915 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3767): Launched 06:19:22.477391 run osmo-hlr_10.42.42.2(pid=3768): Launched 06:19:22.598633 run osmo-stp_10.42.42.5: Starting osmo-stp 06:19:23.142457 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3770): Launched 06:19:23.456752 run osmo-stp_10.42.42.5(pid=3771): Launched 06:19:23.577325 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:19:24.121419 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3773): Launched 06:19:24.241561 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:19:24.507897 run patchelf(pid=3774): Launched 06:19:24.683349 run osmo-stp_10.42.42.5(pid=3771): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3771)] 06:19:24.816318 run osmo-stp_10.42.42.5(pid=3771): stdout: | (launched: 2022-12-10_06:19:23.398080) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:19:24.950968 run osmo-stp_10.42.42.5(pid=3771): stderr: | 20221210061923588 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061923588 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061923588 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061923589 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061923590 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061923590 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061923590 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:19:25.085386 run osmo-stp_10.42.42.5(pid=3771): stdout: | (launched: 2022-12-10_06:19:23.398080) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:19:25.214343 run osmo-stp_10.42.42.5(pid=3771): stderr: | 20221210061923588 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061923588 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061923588 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061923589 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061923590 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061923590 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061923590 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:19:25.367878 run patchelf(pid=3774): Terminating (SIGINT) 06:19:25.544172 run patchelf(pid=3774): Terminated: ok {rc=0} 06:19:25.671105 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3771): Process ended prematurely: osmo-stp_10.42.42.5(pid=3771) [trial-2370↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3771)] [trial-2370↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8] 06:19:25.681252 tst iperf3m4.py:8: Test FAILED (10.5 sec) 06:19:25.709730 run osmo-hlr_10.42.42.2(pid=3768): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3768)] 06:19:25.758737 run osmo-hlr_10.42.42.2(pid=3768): stdout: | (launched: 2022-12-10_06:19:22.419476) 06:19:25.809603 run osmo-hlr_10.42.42.2(pid=3768): stderr: | 20221210061922620 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210061922620 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210061922620 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210061922620 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210061922620 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210061922620 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210061922633 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210061922641 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210061922641 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210061922641 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:19:25.860921 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3757): Terminating (SIGTERM) 06:19:25.902090 run iperf3-srv_10.42.42.10(pid=3758): Terminating (SIGTERM) 06:19:25.943069 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3759): Terminating (SIGTERM) 06:19:25.984165 run iperf3-srv_10.42.42.10(pid=3760): Terminating (SIGTERM) 06:19:26.026539 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3761): Terminating (SIGTERM) 06:19:26.068028 run iperf3-srv_10.42.42.10(pid=3762): Terminating (SIGTERM) 06:19:26.108816 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3763): Terminating (SIGTERM) 06:19:26.150385 run iperf3-srv_10.42.42.10(pid=3764): Terminating (SIGTERM) 06:19:26.191367 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3767): Terminating (SIGTERM) 06:19:26.232275 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3770): Terminating (SIGTERM) 06:19:26.273181 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3773): Terminating (SIGTERM) 06:19:26.314500 --- ParallelTerminationStrategy: PID 3757 died... 06:19:26.334194 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3757): Terminated: ok {rc=0} 06:19:26.379789 --- ParallelTerminationStrategy: PID 3758 died... 06:19:26.399086 run iperf3-srv_10.42.42.10(pid=3758): Terminated {rc=256} 06:19:26.444326 --- ParallelTerminationStrategy: PID 3759 died... 06:19:26.463653 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3759): Terminated: ok {rc=0} 06:19:26.509266 --- ParallelTerminationStrategy: PID 3760 died... 06:19:26.528374 run iperf3-srv_10.42.42.10(pid=3760): Terminated {rc=256} 06:19:26.573728 --- ParallelTerminationStrategy: PID 3761 died... 06:19:26.593072 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3761): Terminated: ok {rc=0} 06:19:26.638291 --- ParallelTerminationStrategy: PID 3762 died... 06:19:26.657481 run iperf3-srv_10.42.42.10(pid=3762): Terminated {rc=256} 06:19:26.702495 --- ParallelTerminationStrategy: PID 3763 died... 06:19:26.721723 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3763): Terminated: ok {rc=0} 06:19:26.766937 --- ParallelTerminationStrategy: PID 3764 died... 06:19:26.786243 run iperf3-srv_10.42.42.10(pid=3764): Terminated {rc=256} 06:19:26.831707 --- ParallelTerminationStrategy: PID 3767 died... 06:19:26.850752 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3767): Terminated: ok {rc=0} 06:19:26.896091 --- ParallelTerminationStrategy: PID 3770 died... 06:19:26.915301 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3770): Terminated: ok {rc=0} 06:19:26.960414 --- ParallelTerminationStrategy: PID 3773 died... 06:19:26.979955 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3773): Terminated: ok {rc=0} 06:19:27.066238 bus /gobi_4: Setting Powered False 06:19:28.165512 bus /gobi_4: Setting Powered False 06:19:29.280093 bus /gobi_1: Setting Powered False 06:19:30.377849 bus /gobi_1: Setting Powered False 06:19:31.506089 bus /gobi_0: Setting Powered False 06:19:32.613561 bus /gobi_0: Setting Powered False 06:19:33.728177 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-lms+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 06:19:34.830522 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:19:34.842154 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 06:19:34.912221 tst ping.py: using LAC 26438 06:19:35.026738 tst ping.py: using RAC 173 06:19:35.139466 tst ping.py: using CellId 26438 06:19:35.256143 tst ping.py: using BVCI 26439 06:19:35.370548 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:19:35.381865 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:19:35.392766 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:19:35.404343 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:19:35.415978 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:19:35.427498 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:19:35.439069 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:19:35.450707 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:19:35.566623 tst ping.py:19: start network... 06:19:35.776202 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:19:36.228675 run create_hlr_db(pid=3775): Launched 06:19:36.340876 bus /gobi_6: Setting Powered False 06:19:37.401619 run create_hlr_db(pid=3775): Terminated: ok {rc=0} 06:19:37.835744 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3777): Launched 06:19:38.146831 run osmo-hlr_10.42.42.2(pid=3778): Launched 06:19:38.265124 run osmo-stp_10.42.42.5: Starting osmo-stp 06:19:38.801356 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3780): Launched 06:19:39.111164 run osmo-stp_10.42.42.5(pid=3781): Launched 06:19:39.228702 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:19:39.763035 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3783): Launched 06:19:39.882014 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:19:40.143704 run patchelf(pid=3784): Launched 06:19:40.316709 run osmo-stp_10.42.42.5(pid=3781): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3781)] 06:19:40.448380 run osmo-stp_10.42.42.5(pid=3781): stdout: | (launched: 2022-12-10_06:19:39.054106) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:19:40.581704 run osmo-stp_10.42.42.5(pid=3781): stderr: | 20221210061939243 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061939243 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061939244 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061939244 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061939245 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061939245 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061939245 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:19:40.715084 run osmo-stp_10.42.42.5(pid=3781): stdout: | (launched: 2022-12-10_06:19:39.054106) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:19:40.843673 run osmo-stp_10.42.42.5(pid=3781): stderr: | 20221210061939243 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061939243 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061939244 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061939244 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061939245 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061939245 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061939245 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:19:40.994132 run patchelf(pid=3784): Terminating (SIGINT) 06:19:41.167933 run patchelf(pid=3784): Terminated: ok {rc=0} 06:19:41.293020 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=3781): Process ended prematurely: osmo-stp_10.42.42.5(pid=3781) [trial-2370↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3781)] [trial-2370↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22] 06:19:41.302769 tst ping.py:22: Test FAILED (6.5 sec) 06:19:41.330910 run osmo-hlr_10.42.42.2(pid=3778): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3778)] 06:19:41.380283 run osmo-hlr_10.42.42.2(pid=3778): stdout: | (launched: 2022-12-10_06:19:38.089745) 06:19:41.431253 run osmo-hlr_10.42.42.2(pid=3778): stderr: | 20221210061938286 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210061938286 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210061938286 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210061938286 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210061938286 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210061938287 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210061938299 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-lms+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210061938307 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210061938307 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210061938307 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:19:41.482319 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3777): Terminating (SIGTERM) 06:19:41.523573 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3780): Terminating (SIGTERM) 06:19:41.564705 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3783): Terminating (SIGTERM) 06:19:41.606839 --- ParallelTerminationStrategy: PID 3777 died... 06:19:41.626487 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3777): Terminated: ok {rc=0} 06:19:41.672424 --- ParallelTerminationStrategy: PID 3780 died... 06:19:41.691966 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3780): Terminated: ok {rc=0} 06:19:41.737664 --- ParallelTerminationStrategy: PID 3783 died... 06:19:41.757133 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3783): Terminated: ok {rc=0} 06:19:41.843285 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-lms+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 06:19:42.931015 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:19:42.942919 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 06:19:43.016143 tst ping_idle_ping.py: using LAC 26439 06:19:43.137828 tst ping_idle_ping.py: using RAC 174 06:19:43.258335 tst ping_idle_ping.py: using CellId 26439 06:19:43.379650 tst ping_idle_ping.py: using BVCI 26440 06:19:43.491761 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:19:43.503066 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:19:43.514172 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:19:43.525357 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:19:43.536364 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:19:43.547517 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:19:43.558754 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:19:43.569848 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:19:43.683874 tst ping_idle_ping.py:24: start network... 06:19:43.876723 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:19:44.326599 run create_hlr_db(pid=3785): Launched 06:19:44.438426 bus /gobi_6: Setting Powered False 06:19:45.495963 run create_hlr_db(pid=3785): Terminated: ok {rc=0} 06:19:45.928733 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3787): Launched 06:19:46.249709 run osmo-hlr_10.42.42.2(pid=3788): Launched 06:19:46.494264 run osmo-stp_10.42.42.5: Starting osmo-stp 06:19:47.182895 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3790): Launched 06:19:47.505366 run osmo-stp_10.42.42.5(pid=3791): Launched 06:19:47.624701 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:19:48.161203 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3793): Launched 06:19:48.280035 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:19:48.542621 run patchelf(pid=3794): Launched 06:19:48.716574 run osmo-stp_10.42.42.5(pid=3791): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3791)] 06:19:48.848657 run osmo-stp_10.42.42.5(pid=3791): stdout: | (launched: 2022-12-10_06:19:47.448296) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:19:48.982485 run osmo-stp_10.42.42.5(pid=3791): stderr: | 20221210061947636 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061947637 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061947637 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061947637 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061947639 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061947640 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061947640 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:19:49.115818 run osmo-stp_10.42.42.5(pid=3791): stdout: | (launched: 2022-12-10_06:19:47.448296) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:19:49.243412 run osmo-stp_10.42.42.5(pid=3791): stderr: | 20221210061947636 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061947637 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061947637 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061947637 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061947639 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061947640 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061947640 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:19:49.394247 run patchelf(pid=3794): Terminating (SIGINT) 06:19:49.567788 run patchelf(pid=3794): Terminated: ok {rc=0} 06:19:49.693100 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=3791): Process ended prematurely: osmo-stp_10.42.42.5(pid=3791) [trial-2370↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3791)] [trial-2370↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 06:19:49.702711 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 06:19:49.730868 run osmo-hlr_10.42.42.2(pid=3788): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3788)] 06:19:49.780486 run osmo-hlr_10.42.42.2(pid=3788): stdout: | (launched: 2022-12-10_06:19:46.184781) 06:19:49.832231 run osmo-hlr_10.42.42.2(pid=3788): stderr: | 20221210061946488 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210061946488 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210061946488 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210061946488 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210061946488 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210061946488 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210061946507 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-lms+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210061946519 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210061946520 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210061946520 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:19:49.884098 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3787): Terminating (SIGTERM) 06:19:49.925648 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3790): Terminating (SIGTERM) 06:19:49.967146 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3793): Terminating (SIGTERM) 06:19:50.009122 --- ParallelTerminationStrategy: PID 3787 died... 06:19:50.030214 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3787): Terminated: ok {rc=0} 06:19:50.076086 --- ParallelTerminationStrategy: PID 3790 died... 06:19:50.095567 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3790): Terminated: ok {rc=0} 06:19:50.141333 --- ParallelTerminationStrategy: PID 3793 died... 06:19:50.160663 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3793): Terminated: ok {rc=0} 06:19:50.249110 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2370 gprs:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 06:19:51.557995 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:19:51.565613 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 06:19:51.599439 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 06:19:51.634413 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 06:19:51.686896 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 06:19:51.720578 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 06:19:51.755842 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 06:19:52.315143 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2370 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 06:19:52.320388 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:19:52.332020 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 06:19:52.401088 tst switch_tch_pdch.py: using LAC 26440 06:19:52.521132 tst switch_tch_pdch.py: using RAC 175 06:19:52.640629 tst switch_tch_pdch.py: using CellId 26440 06:19:52.760624 tst switch_tch_pdch.py: using BVCI 26441 06:19:52.873316 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:19:52.884834 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:19:52.896267 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:19:52.907647 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:19:52.918947 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:19:52.930226 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:19:52.941706 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:19:52.953073 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:19:53.067856 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:19:53.186186 tst switch_tch_pdch.py:51: start network... 06:19:53.379142 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:19:53.826116 run create_hlr_db(pid=3806): Launched 06:19:53.936425 bus /gobi_6: Setting Powered False 06:19:54.994796 run create_hlr_db(pid=3806): Terminated: ok {rc=0} 06:19:55.419378 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3808): Launched 06:19:55.729678 run osmo-hlr_10.42.42.2(pid=3809): Launched 06:19:55.847926 run osmo-stp_10.42.42.5: Starting osmo-stp 06:19:56.379146 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3811): Launched 06:19:56.688200 run osmo-stp_10.42.42.5(pid=3812): Launched 06:19:56.806046 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:19:57.339147 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3814): Launched 06:19:57.457911 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:19:57.718659 run patchelf(pid=3815): Launched 06:19:57.891702 run osmo-stp_10.42.42.5(pid=3812): ERR: Terminated: ERROR {rc=1} [trial-2370↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3812)] 06:19:58.023233 run osmo-stp_10.42.42.5(pid=3812): stdout: | (launched: 2022-12-10_06:19:56.631537) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:19:58.156232 run osmo-stp_10.42.42.5(pid=3812): stderr: | 20221210061956823 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061956823 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061956824 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061956824 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061956824 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061956824 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061956825 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:19:58.289145 run osmo-stp_10.42.42.5(pid=3812): stdout: | (launched: 2022-12-10_06:19:56.631537) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:19:58.415712 run osmo-stp_10.42.42.5(pid=3812): stderr: | 20221210061956823 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210061956823 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210061956824 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210061956824 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210061956824 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210061956824 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210061956825 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:19:58.565799 run patchelf(pid=3815): Terminating (SIGINT) 06:19:58.738755 run patchelf(pid=3815): Terminated: ok {rc=0} 06:19:58.863252 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=3812): Process ended prematurely: osmo-stp_10.42.42.5(pid=3812) [trial-2370↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3812)] [trial-2370↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 06:19:58.872785 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 06:19:58.900422 run osmo-hlr_10.42.42.2(pid=3809): ERR: Terminated: ERROR {rc=237} [trial-2370↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3809)] 06:19:58.949061 run osmo-hlr_10.42.42.2(pid=3809): stdout: | (launched: 2022-12-10_06:19:55.672643) 06:19:58.999948 run osmo-hlr_10.42.42.2(pid=3809): stderr: | 20221210061955872 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210061955872 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210061955872 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210061955872 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210061955872 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210061955873 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210061955884 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210061955892 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210061955893 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210061955893 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:19:59.050755 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3808): Terminating (SIGTERM) 06:19:59.091527 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3811): Terminating (SIGTERM) 06:19:59.132344 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3814): Terminating (SIGTERM) 06:19:59.173352 --- ParallelTerminationStrategy: PID 3808 died... 06:19:59.192425 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3808): Terminated: ok {rc=0} 06:19:59.237367 --- ParallelTerminationStrategy: PID 3811 died... 06:19:59.256410 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3811): Terminated: ok {rc=0} 06:19:59.301165 --- ParallelTerminationStrategy: PID 3814 died... 06:19:59.320266 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3814): Terminated: ok {rc=0} 06:19:59.404941 bus /gobi_0: Setting Powered False 06:20:00.502021 bus /gobi_0: Setting Powered False 06:20:01.625546 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2370 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 dynts:trx-lms+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 06:20:02.879828 tst dynts:trx-lms+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:20:02.885586 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 06:20:02.918864 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 06:20:02.952651 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 06:20:03.004575 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 06:20:03.036907 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 06:20:03.070709 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 06:20:03.625518 tst dynts:trx-lms+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2370 dynts:trx-lms+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 06:20:03.630549 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:20:03.641500 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 06:20:03.714751 tst switch_tch_pdch.py: using LAC 26441 06:20:03.827486 tst switch_tch_pdch.py: using RAC 176 06:20:03.950170 tst switch_tch_pdch.py: using CellId 26441 06:20:04.069109 tst switch_tch_pdch.py: using BVCI 26442 06:20:04.181492 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:20:04.192864 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:20:04.204120 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:20:04.215765 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:20:04.227217 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:20:04.239067 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:20:04.250835 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:20:04.262405 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 06:20:04.377814 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 06:20:04.494282 tst switch_tch_pdch.py:51: start network... 06:20:04.702640 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:20:05.154614 run create_hlr_db(pid=3822): Launched 06:20:05.280645 bus /gobi_6: Setting Powered False 06:20:06.342592 run create_hlr_db(pid=3822): Terminated: ok {rc=0} 06:20:06.731657 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3824): Launched 06:20:07.020695 run osmo-hlr_10.42.42.2(pid=3825): Launched 06:20:07.130171 run osmo-stp_10.42.42.5: Starting osmo-stp 06:20:07.616754 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3827): Launched 06:20:07.905174 run osmo-stp_10.42.42.5(pid=3828): Launched 06:20:08.015045 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:20:08.488528 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3830): Launched 06:20:08.599024 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:20:08.842237 run patchelf(pid=3831): Launched 06:20:09.002785 run osmo-stp_10.42.42.5(pid=3828): ERR: Terminated: ERROR {rc=1} [trial-2370↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3828)] 06:20:09.124798 run osmo-stp_10.42.42.5(pid=3828): stdout: | (launched: 2022-12-10_06:20:07.851849) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:20:09.248397 run osmo-stp_10.42.42.5(pid=3828): stderr: | 20221210062008019 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062008019 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062008019 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062008020 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062008020 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062008020 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062008021 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:20:09.372265 run osmo-stp_10.42.42.5(pid=3828): stdout: | (launched: 2022-12-10_06:20:07.851849) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:20:09.490063 run osmo-stp_10.42.42.5(pid=3828): stderr: | 20221210062008019 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062008019 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062008019 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062008020 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062008020 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062008020 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062008021 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:20:09.629427 run patchelf(pid=3831): Terminating (SIGINT) 06:20:09.790932 run patchelf(pid=3831): Terminated: ok {rc=0} 06:20:09.908635 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=3828): Process ended prematurely: osmo-stp_10.42.42.5(pid=3828) [trial-2370↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3828)] [trial-2370↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 06:20:09.917624 tst switch_tch_pdch.py:54: Test FAILED (6.3 sec) 06:20:09.944346 run osmo-hlr_10.42.42.2(pid=3825): ERR: Terminated: ERROR {rc=237} [trial-2370↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3825)] 06:20:09.991107 run osmo-hlr_10.42.42.2(pid=3825): stdout: | (launched: 2022-12-10_06:20:06.967200) 06:20:10.039385 run osmo-hlr_10.42.42.2(pid=3825): stderr: | 20221210062007144 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210062007144 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210062007144 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210062007144 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210062007144 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210062007145 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210062007155 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/dynts:trx-lms+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210062007164 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210062007164 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210062007164 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:20:10.088111 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3824): Terminating (SIGTERM) 06:20:10.127050 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3827): Terminating (SIGTERM) 06:20:10.166001 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3830): Terminating (SIGTERM) 06:20:10.205221 --- ParallelTerminationStrategy: PID 3824 died... 06:20:10.223811 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3824): Terminated: ok {rc=0} 06:20:10.267217 --- ParallelTerminationStrategy: PID 3827 died... 06:20:10.285316 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3827): Terminated: ok {rc=0} 06:20:10.328540 --- ParallelTerminationStrategy: PID 3830 died... 06:20:10.346728 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3830): Terminated: ok {rc=0} 06:20:10.429170 bus /gobi_0: Setting Powered False 06:20:11.525747 bus /gobi_0: Setting Powered False 06:20:12.641564 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2370 dynts:trx-lms+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 nitb_sms:trx-lms-limenet-micro --------------------------------------------------------------------- 06:20:13.890761 tst nitb_sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:20:13.895148 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 06:20:13.924514 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 06:20:13.931458 tst nitb_sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 06:20:13.986615 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 06:20:14.016371 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 06:20:14.023243 tst nitb_sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 06:20:14.559174 tst nitb_sms:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_sms: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 nitb_sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 06:20:14.564214 tst nitb_sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 06:20:14.575560 tst nitb_sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 06:20:14.619737 tst mo_mt_sms.py: using LAC 26442 06:20:14.742153 tst mo_mt_sms.py: using RAC 177 06:20:14.862928 tst mo_mt_sms.py: using CellId 26442 06:20:14.985460 tst mo_mt_sms.py: using BVCI 26443 06:20:15.097375 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 06:20:15.209217 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 06:20:15.319108 tst mo_mt_sms.py:9: start nitb and bts... 06:20:15.511708 run osmo-nitb_10.42.42.2: Starting osmo-nitb 06:20:16.171128 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3836): Launched 06:20:16.522358 run osmo-nitb_10.42.42.2(pid=3837): Launched 06:20:16.734518 run osmo-nitb_10.42.42.2(pid=3837): ERR: Terminated: ERROR {rc=2} [trial-2370↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3837)] 06:20:16.872559 run osmo-nitb_10.42.42.2(pid=3837): stdout: | (launched: 2022-12-10_06:20:16.459412) 06:20:17.008007 run osmo-nitb_10.42.42.2(pid=3837): stderr: | (launched: 2022-12-10_06:20:16.505844) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:20:17.144488 run osmo-nitb_10.42.42.2(pid=3837): stdout: | (launched: 2022-12-10_06:20:16.459412) 06:20:17.274379 run osmo-nitb_10.42.42.2(pid=3837): stderr: | (launched: 2022-12-10_06:20:16.505844) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=3837): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3837) [trial-2370↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3837)] 06:20:17.680794 tst osmo-nitb_10.42.42.2(pid=3837): stdout: | (launched: 2022-12-10_06:20:16.459412) 06:20:17.797345 tst osmo-nitb_10.42.42.2(pid=3837): stderr: | (launched: 2022-12-10_06:20:16.505844) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:20:17.936085 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=3837): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3837) [trial-2370↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3837)] [trial-2370↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11] 06:20:17.944463 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 06:20:17.951109 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3836): Terminating (SIGTERM) 06:20:18.159945 --- ParallelTerminationStrategy: PID 3836 died... 06:20:18.180127 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3836): Terminated: ok {rc=0} 06:20:18.265297 bus /sierra_3: Setting Powered False 06:20:19.363801 bus /sierra_3: Setting Powered False 06:20:20.479366 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 nitb_sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 sms:trx-lms-limenet-micro --------------------------------------------------------------------- 06:20:21.666378 tst sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:20:21.670805 tst sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 06:20:21.700262 tst sms:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 06:20:21.726514 tst sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 06:20:21.811374 tst sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 06:20:21.839621 tst sms:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 06:20:21.866186 tst sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 06:20:22.378963 tst sms:trx-lms-limenet-micro: RESERVED RESOURCES for sms: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 06:20:22.383828 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:20:22.394435 tst sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 06:20:22.437979 tst mo_mt_sms.py: using LAC 26443 06:20:22.552832 tst mo_mt_sms.py: using RAC 178 06:20:22.666709 tst mo_mt_sms.py: using CellId 26443 06:20:22.785405 tst mo_mt_sms.py: using BVCI 26444 06:20:22.890638 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:20:22.901327 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:20:22.911861 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:20:22.922637 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:20:22.933509 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:20:22.944125 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 06:20:23.059971 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 06:20:23.173246 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:20:23.618765 run create_hlr_db(pid=3841): Launched 06:20:23.728588 bus /sierra_2: Setting Powered False 06:20:24.786894 run create_hlr_db(pid=3841): Terminated: ok {rc=0} 06:20:25.212528 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3843): Launched 06:20:25.522107 run osmo-hlr_10.42.42.2(pid=3844): Launched 06:20:25.640575 run osmo-stp_10.42.42.5: Starting osmo-stp 06:20:26.174692 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3846): Launched 06:20:26.482788 run osmo-stp_10.42.42.5(pid=3847): Launched 06:20:26.602125 run osmo-msc_10.42.42.6: Starting osmo-msc 06:20:27.167402 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3849): Launched 06:20:27.477686 run osmo-msc_10.42.42.6(pid=3850): Launched 06:20:27.651328 run osmo-stp_10.42.42.5(pid=3847): ERR: Terminated: ERROR {rc=1} [trial-2370↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3847)] 06:20:27.782391 run osmo-stp_10.42.42.5(pid=3847): stdout: | (launched: 2022-12-10_06:20:26.426121) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:20:27.914031 run osmo-stp_10.42.42.5(pid=3847): stderr: | 20221210062026613 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062026614 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062026614 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062026614 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062026615 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062026615 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062026615 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:20:28.045249 run osmo-stp_10.42.42.5(pid=3847): stdout: | (launched: 2022-12-10_06:20:26.426121) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:20:28.168085 run osmo-stp_10.42.42.5(pid=3847): stderr: | 20221210062026613 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062026614 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062026614 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062026614 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062026615 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062026615 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062026615 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:20:28.315005 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=3847): Process ended prematurely: osmo-stp_10.42.42.5(pid=3847) [trial-2370↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3847)] [trial-2370↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16] 06:20:28.323829 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 06:20:28.351142 run osmo-hlr_10.42.42.2(pid=3844): ERR: Terminated: ERROR {rc=237} [trial-2370↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3844)] 06:20:28.400499 run osmo-hlr_10.42.42.2(pid=3844): stdout: | (launched: 2022-12-10_06:20:25.465259) 06:20:28.451764 run osmo-hlr_10.42.42.2(pid=3844): stderr: | 20221210062025663 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210062025663 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210062025663 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210062025663 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210062025663 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210062025663 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210062025675 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/sms:trx-lms-limenet-micro/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210062025684 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210062025684 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210062025684 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:20:28.523273 run osmo-msc_10.42.42.6(pid=3850): ERR: Terminated: ERROR {rc=2} [trial-2370↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3850)] 06:20:28.572596 run osmo-msc_10.42.42.6(pid=3850): stdout: | (launched: 2022-12-10_06:20:27.420214) 06:20:28.623737 run osmo-msc_10.42.42.6(pid=3850): stderr: | 20221210062027740 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210062027740 DLGLOBAL DEBUG validating counter group 0x7fc38fc3ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210062027741 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210062027741 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210062027741 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210062027741 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210062027743 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210062027743 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210062027743 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210062027743 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:20:28.675067 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3843): Terminating (SIGTERM) 06:20:28.716389 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3846): Terminating (SIGTERM) 06:20:28.757819 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3849): Terminating (SIGTERM) 06:20:28.799310 --- ParallelTerminationStrategy: PID 3843 died... 06:20:28.819203 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3843): Terminated: ok {rc=0} 06:20:28.865353 --- ParallelTerminationStrategy: PID 3846 died... 06:20:28.884743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3846): Terminated: ok {rc=0} 06:20:28.930159 --- ParallelTerminationStrategy: PID 3849 died... 06:20:28.949451 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3849): Terminated: ok {rc=0} 06:20:29.036209 bus /sierra_3: Setting Powered False 06:20:30.133527 bus /sierra_3: Setting Powered False 06:20:31.266698 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 nitb_ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 06:20:32.498863 tst nitb_ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:20:32.502646 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 06:20:32.531465 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 06:20:32.538053 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 06:20:32.573868 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 06:20:32.603674 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 06:20:32.610530 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 06:20:33.128419 tst nitb_ussd:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_ussd: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2370 nitb_ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 06:20:33.133681 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 06:20:33.144434 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 06:20:33.187065 tst assert_extension.py: using LAC 26444 06:20:33.302826 tst assert_extension.py: using RAC 179 06:20:33.418937 tst assert_extension.py: using CellId 26444 06:20:33.533118 tst assert_extension.py: using BVCI 26445 06:20:33.639201 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 06:20:33.750134 tst assert_extension.py:10: start nitb and bts... 06:20:33.942886 run osmo-nitb_10.42.42.2: Starting osmo-nitb 06:20:34.534557 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3855): Launched 06:20:34.824039 run osmo-nitb_10.42.42.2(pid=3856): Launched 06:20:34.984678 run osmo-nitb_10.42.42.2(pid=3856): ERR: Terminated: ERROR {rc=2} [trial-2370↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3856)] 06:20:35.114897 run osmo-nitb_10.42.42.2(pid=3856): stdout: | (launched: 2022-12-10_06:20:34.770689) 06:20:35.246588 run osmo-nitb_10.42.42.2(pid=3856): stderr: | (launched: 2022-12-10_06:20:34.813383) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:20:35.378392 run osmo-nitb_10.42.42.2(pid=3856): stdout: | (launched: 2022-12-10_06:20:34.770689) 06:20:35.503933 run osmo-nitb_10.42.42.2(pid=3856): stderr: | (launched: 2022-12-10_06:20:34.813383) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=3856): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3856) [trial-2370↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3856)] 06:20:35.933672 tst osmo-nitb_10.42.42.2(pid=3856): stdout: | (launched: 2022-12-10_06:20:34.770689) 06:20:36.050796 tst osmo-nitb_10.42.42.2(pid=3856): stderr: | (launched: 2022-12-10_06:20:34.813383) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:20:36.188762 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=3856): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3856) [trial-2370↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3856)] [trial-2370↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12] 06:20:36.197357 tst assert_extension.py:12: Test FAILED (3.1 sec) 06:20:36.204151 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3855): Terminating (SIGTERM) 06:20:36.412833 --- ParallelTerminationStrategy: PID 3855 died... 06:20:36.433501 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3855): Terminated: ok {rc=0} 06:20:36.519146 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 nitb_ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 06:20:37.692906 tst ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:20:37.697536 tst ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 06:20:37.726989 tst ussd:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 06:20:37.754161 tst ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 06:20:37.789921 tst ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 06:20:37.819554 tst ussd:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 06:20:37.846533 tst ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 06:20:38.376259 tst ussd:trx-lms-limenet-micro: RESERVED RESOURCES for ussd: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2370 ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 06:20:38.381706 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:20:38.392758 tst ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 06:20:38.437105 tst assert_extension.py: using LAC 26445 06:20:38.558115 tst assert_extension.py: using RAC 180 06:20:38.680187 tst assert_extension.py: using CellId 26445 06:20:38.802591 tst assert_extension.py: using BVCI 26446 06:20:38.916476 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:20:38.927694 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:20:38.938702 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:20:38.949688 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:20:38.960674 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:20:38.971657 tst ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 06:20:39.083811 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:20:39.531827 run create_hlr_db(pid=3860): Launched 06:20:39.643350 bus /sierra_2: Setting Powered False 06:20:40.701142 run create_hlr_db(pid=3860): Terminated: ok {rc=0} 06:20:41.106804 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3862): Launched 06:20:41.396114 run osmo-hlr_10.42.42.2(pid=3863): Launched 06:20:41.506720 run osmo-stp_10.42.42.5: Starting osmo-stp 06:20:42.019095 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3865): Launched 06:20:42.308769 run osmo-stp_10.42.42.5(pid=3866): Launched 06:20:42.419010 run osmo-msc_10.42.42.6: Starting osmo-msc 06:20:42.940113 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3868): Launched 06:20:43.229085 run osmo-msc_10.42.42.6(pid=3869): Launched 06:20:43.390579 run osmo-stp_10.42.42.5(pid=3866): ERR: Terminated: ERROR {rc=1} [trial-2370↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3866)] 06:20:43.514970 run osmo-stp_10.42.42.5(pid=3866): stdout: | (launched: 2022-12-10_06:20:42.255122) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:20:43.638918 run osmo-stp_10.42.42.5(pid=3866): stderr: | 20221210062042423 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062042424 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062042424 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062042424 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062042425 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062042425 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062042425 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:20:43.760109 run osmo-stp_10.42.42.5(pid=3866): stdout: | (launched: 2022-12-10_06:20:42.255122) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:20:43.874412 run osmo-stp_10.42.42.5(pid=3866): stderr: | 20221210062042423 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062042424 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062042424 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062042424 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062042425 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062042425 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062042425 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:20:44.011648 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=3866): Process ended prematurely: osmo-stp_10.42.42.5(pid=3866) [trial-2370↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3866)] [trial-2370↪ussd:trx-lms-limenet-micro↪assert_extension.py:17] 06:20:44.019953 tst assert_extension.py:17: Test FAILED (5.6 sec) 06:20:44.046103 run osmo-hlr_10.42.42.2(pid=3863): ERR: Terminated: ERROR {rc=237} [trial-2370↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3863)] 06:20:44.093555 run osmo-hlr_10.42.42.2(pid=3863): stdout: | (launched: 2022-12-10_06:20:41.342463) 06:20:44.142523 run osmo-hlr_10.42.42.2(pid=3863): stderr: | 20221210062041519 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210062041519 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210062041519 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210062041519 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210062041519 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210062041519 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210062041531 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/ussd:trx-lms-limenet-micro/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210062041539 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210062041540 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210062041540 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:20:44.210621 run osmo-msc_10.42.42.6(pid=3869): ERR: Terminated: ERROR {rc=2} [trial-2370↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3869)] 06:20:44.257854 run osmo-msc_10.42.42.6(pid=3869): stdout: | (launched: 2022-12-10_06:20:43.175677) 06:20:44.306626 run osmo-msc_10.42.42.6(pid=3869): stderr: | 20221210062043443 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210062043443 DLGLOBAL DEBUG validating counter group 0x7feb0d705c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210062043443 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210062043443 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210062043444 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210062043444 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210062043446 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210062043446 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210062043446 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210062043446 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:20:44.355772 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3862): Terminating (SIGTERM) 06:20:44.394788 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3865): Terminating (SIGTERM) 06:20:44.434001 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3868): Terminating (SIGTERM) 06:20:44.473495 --- ParallelTerminationStrategy: PID 3862 died... 06:20:44.492498 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3862): Terminated: ok {rc=0} 06:20:44.536550 --- ParallelTerminationStrategy: PID 3865 died... 06:20:44.554991 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3865): Terminated: ok {rc=0} 06:20:44.598544 --- ParallelTerminationStrategy: PID 3868 died... 06:20:44.616749 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3868): Terminated: ok {rc=0} 06:20:44.702280 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 06:20:45.941186 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:20:45.948740 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 06:20:45.980647 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 06:20:46.009367 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 06:20:46.062914 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 06:20:46.094539 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 06:20:46.124142 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 06:20:46.700370 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 06:20:46.750991 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:20:46.763186 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 06:20:46.830391 tst mo_mt_call.py: using LAC 26446 06:20:46.982227 tst mo_mt_call.py: using RAC 181 06:20:47.119690 tst mo_mt_call.py: using CellId 26446 06:20:47.238353 tst mo_mt_call.py: using BVCI 26447 06:20:47.352293 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:20:47.363510 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:20:47.374555 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:20:47.385844 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:20:47.397223 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:20:47.408417 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 06:20:47.525992 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 06:20:47.642153 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:20:48.098599 run create_hlr_db(pid=3874): Launched 06:20:48.213187 bus /sierra_2: Setting Powered False 06:20:49.272260 run create_hlr_db(pid=3874): Terminated: ok {rc=0} 06:20:49.705334 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3876): Launched 06:20:50.022239 run osmo-hlr_10.42.42.2(pid=3877): Launched 06:20:50.143441 run osmo-stp_10.42.42.5: Starting osmo-stp 06:20:50.687165 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3879): Launched 06:20:51.004307 run osmo-stp_10.42.42.5(pid=3880): Launched 06:20:51.125083 run osmo-msc_10.42.42.6: Starting osmo-msc 06:20:51.701648 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3882): Launched 06:20:52.017563 run osmo-msc_10.42.42.6(pid=3883): Launched 06:20:52.194261 run osmo-stp_10.42.42.5(pid=3880): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3880)] 06:20:52.327548 run osmo-stp_10.42.42.5(pid=3880): stdout: | (launched: 2022-12-10_06:20:50.946414) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:20:52.464326 run osmo-stp_10.42.42.5(pid=3880): stderr: | 20221210062051140 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062051140 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062051140 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062051140 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062051141 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062051141 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062051141 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:20:52.597947 run osmo-stp_10.42.42.5(pid=3880): stdout: | (launched: 2022-12-10_06:20:50.946414) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:20:52.723300 run osmo-stp_10.42.42.5(pid=3880): stderr: | 20221210062051140 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062051140 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062051140 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062051140 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062051141 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062051141 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062051141 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:20:52.873859 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3880): Process ended prematurely: osmo-stp_10.42.42.5(pid=3880) [trial-2370↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3880)] [trial-2370↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 06:20:52.883641 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 06:20:52.911327 run osmo-hlr_10.42.42.2(pid=3877): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3877)] 06:20:52.960474 run osmo-hlr_10.42.42.2(pid=3877): stdout: | (launched: 2022-12-10_06:20:49.964374) 06:20:53.011377 run osmo-hlr_10.42.42.2(pid=3877): stderr: | 20221210062050167 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210062050167 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210062050167 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210062050167 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210062050167 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210062050167 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210062050179 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210062050189 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210062050189 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210062050190 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:20:53.082415 run osmo-msc_10.42.42.6(pid=3883): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3883)] 06:20:53.131860 run osmo-msc_10.42.42.6(pid=3883): stdout: | (launched: 2022-12-10_06:20:51.959900) 06:20:53.182538 run osmo-msc_10.42.42.6(pid=3883): stderr: | 20221210062052282 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210062052282 DLGLOBAL DEBUG validating counter group 0x7f7b13a8dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210062052282 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210062052282 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210062052282 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210062052282 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210062052286 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210062052286 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210062052287 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210062052287 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:20:53.233517 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3876): Terminating (SIGTERM) 06:20:53.274270 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3879): Terminating (SIGTERM) 06:20:53.315422 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3882): Terminating (SIGTERM) 06:20:53.356844 --- ParallelTerminationStrategy: PID 3876 died... 06:20:53.376191 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3876): Terminated: ok {rc=0} 06:20:53.421775 --- ParallelTerminationStrategy: PID 3879 died... 06:20:53.441164 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3879): Terminated: ok {rc=0} 06:20:53.486488 --- ParallelTerminationStrategy: PID 3882 died... 06:20:53.505834 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3882): Terminated: ok {rc=0} 06:20:53.591947 bus /sierra_3: Setting Powered False 06:20:54.689579 bus /sierra_3: Setting Powered False 06:20:55.803143 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2370 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 06:20:56.950577 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:20:56.962995 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 06:20:57.030545 tst mo_mt_call_osmux.py: using LAC 26447 06:20:57.161794 tst mo_mt_call_osmux.py: using RAC 182 06:20:57.277706 tst mo_mt_call_osmux.py: using CellId 26447 06:20:57.397194 tst mo_mt_call_osmux.py: using BVCI 26448 06:20:57.505370 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:20:57.516663 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:20:57.528122 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:20:57.539714 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:20:57.551119 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:20:57.562526 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 06:20:57.676590 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 06:20:57.795401 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:20:58.286968 run create_hlr_db(pid=3885): Launched 06:20:58.415959 bus /sierra_2: Setting Powered False 06:20:59.479437 run create_hlr_db(pid=3885): Terminated: ok {rc=0} 06:20:59.919239 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3887): Launched 06:21:00.236008 run osmo-hlr_10.42.42.2(pid=3888): Launched 06:21:00.356720 run osmo-stp_10.42.42.5: Starting osmo-stp 06:21:00.909768 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3890): Launched 06:21:01.227005 run osmo-stp_10.42.42.5(pid=3891): Launched 06:21:01.468884 run osmo-msc_10.42.42.6: Starting osmo-msc 06:21:02.170338 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3893): Launched 06:21:02.477886 run osmo-msc_10.42.42.6(pid=3894): Launched 06:21:02.645496 run osmo-stp_10.42.42.5(pid=3891): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3891)] 06:21:02.772281 run osmo-stp_10.42.42.5(pid=3891): stdout: | (launched: 2022-12-10_06:21:01.163639) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:21:02.898689 run osmo-stp_10.42.42.5(pid=3891): stderr: | 20221210062101493 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062101493 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062101493 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062101494 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062101494 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062101494 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062101494 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:21:03.022559 run osmo-stp_10.42.42.5(pid=3891): stdout: | (launched: 2022-12-10_06:21:01.163639) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:21:03.140055 run osmo-stp_10.42.42.5(pid=3891): stderr: | 20221210062101493 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062101493 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062101493 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062101494 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062101494 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062101494 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062101494 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:21:03.281118 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3891): Process ended prematurely: osmo-stp_10.42.42.5(pid=3891) [trial-2370↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3891)] [trial-2370↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 06:21:03.290113 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 06:21:03.316764 run osmo-hlr_10.42.42.2(pid=3888): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3888)] 06:21:03.364512 run osmo-hlr_10.42.42.2(pid=3888): stdout: | (launched: 2022-12-10_06:21:00.177721) 06:21:03.413578 run osmo-hlr_10.42.42.2(pid=3888): stderr: | 20221210062100376 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210062100376 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210062100376 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210062100376 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210062100376 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210062100376 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210062100389 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210062100397 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210062100397 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210062100398 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:21:03.481815 run osmo-msc_10.42.42.6(pid=3894): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3894)] 06:21:03.528934 run osmo-msc_10.42.42.6(pid=3894): stdout: | (launched: 2022-12-10_06:21:02.423501) 06:21:03.577631 run osmo-msc_10.42.42.6(pid=3894): stderr: | 20221210062102691 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210062102691 DLGLOBAL DEBUG validating counter group 0x7fedace01c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210062102692 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210062102692 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210062102692 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210062102692 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210062102694 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210062102694 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210062102694 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210062102694 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:21:03.626831 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3887): Terminating (SIGTERM) 06:21:03.666286 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3890): Terminating (SIGTERM) 06:21:03.705869 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3893): Terminating (SIGTERM) 06:21:03.745872 --- ParallelTerminationStrategy: PID 3887 died... 06:21:03.764925 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3887): Terminated: ok {rc=0} 06:21:03.809217 --- ParallelTerminationStrategy: PID 3890 died... 06:21:03.827831 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3890): Terminated: ok {rc=0} 06:21:03.871641 --- ParallelTerminationStrategy: PID 3893 died... 06:21:03.890226 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3893): Terminated: ok {rc=0} 06:21:03.975492 bus /sierra_3: Setting Powered False 06:21:05.073571 bus /sierra_3: Setting Powered False 06:21:06.188270 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 06:21:07.437412 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:21:07.444295 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 06:21:07.473930 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 06:21:07.501209 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 06:21:07.553458 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 06:21:07.583598 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 06:21:07.611027 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 06:21:08.164158 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 06:21:08.214715 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:21:08.226679 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 06:21:08.293594 tst mo_mt_call.py: using LAC 26448 06:21:08.418521 tst mo_mt_call.py: using RAC 183 06:21:08.542343 tst mo_mt_call.py: using CellId 26448 06:21:08.667633 tst mo_mt_call.py: using BVCI 26449 06:21:08.783719 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:21:08.795389 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:21:08.806823 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:21:08.818266 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:21:08.829800 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:21:08.841278 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 06:21:08.955323 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 06:21:09.069553 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:21:09.524528 run create_hlr_db(pid=3899): Launched 06:21:09.638527 bus /sierra_2: Setting Powered False 06:21:10.697997 run create_hlr_db(pid=3899): Terminated: ok {rc=0} 06:21:11.108413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3901): Launched 06:21:11.403396 run osmo-hlr_10.42.42.2(pid=3902): Launched 06:21:11.516242 run osmo-stp_10.42.42.5: Starting osmo-stp 06:21:12.039633 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3904): Launched 06:21:12.336051 run osmo-stp_10.42.42.5(pid=3905): Launched 06:21:12.450254 run osmo-msc_10.42.42.6: Starting osmo-msc 06:21:12.983361 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3907): Launched 06:21:13.278199 run osmo-msc_10.42.42.6(pid=3908): Launched 06:21:13.443129 run osmo-stp_10.42.42.5(pid=3905): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3905)] 06:21:13.568440 run osmo-stp_10.42.42.5(pid=3905): stdout: | (launched: 2022-12-10_06:21:12.280328) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:21:13.694073 run osmo-stp_10.42.42.5(pid=3905): stderr: | 20221210062112450 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062112450 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062112451 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062112451 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062112452 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062112452 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062112452 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:21:13.817465 run osmo-stp_10.42.42.5(pid=3905): stdout: | (launched: 2022-12-10_06:21:12.280328) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:21:13.934431 run osmo-stp_10.42.42.5(pid=3905): stderr: | 20221210062112450 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062112450 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062112451 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062112451 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062112452 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062112452 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062112452 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:21:14.075091 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3905): Process ended prematurely: osmo-stp_10.42.42.5(pid=3905) [trial-2370↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3905)] [trial-2370↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 06:21:14.083893 tst mo_mt_call.py:8: Test FAILED (5.9 sec) 06:21:14.110266 run osmo-hlr_10.42.42.2(pid=3902): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3902)] 06:21:14.157364 run osmo-hlr_10.42.42.2(pid=3902): stdout: | (launched: 2022-12-10_06:21:11.349359) 06:21:14.205736 run osmo-hlr_10.42.42.2(pid=3902): stderr: | 20221210062111525 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210062111525 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210062111525 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210062111525 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210062111525 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210062111525 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210062111541 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210062111551 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210062111551 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210062111551 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:21:14.273255 run osmo-msc_10.42.42.6(pid=3908): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3908)] 06:21:14.320118 run osmo-msc_10.42.42.6(pid=3908): stdout: | (launched: 2022-12-10_06:21:13.223615) 06:21:14.368473 run osmo-msc_10.42.42.6(pid=3908): stderr: | 20221210062113495 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210062113495 DLGLOBAL DEBUG validating counter group 0x7f3eb8b6cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210062113495 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210062113496 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210062113496 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210062113496 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210062113498 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210062113498 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210062113498 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210062113498 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:21:14.417066 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3901): Terminating (SIGTERM) 06:21:14.455730 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3904): Terminating (SIGTERM) 06:21:14.494191 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3907): Terminating (SIGTERM) 06:21:14.533176 --- ParallelTerminationStrategy: PID 3901 died... 06:21:14.551802 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3901): Terminated: ok {rc=0} 06:21:14.595154 --- ParallelTerminationStrategy: PID 3904 died... 06:21:14.613281 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3904): Terminated: ok {rc=0} 06:21:14.656830 --- ParallelTerminationStrategy: PID 3907 died... 06:21:14.675434 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3907): Terminated: ok {rc=0} 06:21:14.759709 bus /sierra_3: Setting Powered False 06:21:15.879794 bus /sierra_3: Setting Powered False 06:21:17.019228 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2370 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 06:21:18.167982 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:21:18.179905 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 06:21:18.247617 tst mo_mt_call_osmux.py: using LAC 26449 06:21:18.362338 tst mo_mt_call_osmux.py: using RAC 184 06:21:18.478910 tst mo_mt_call_osmux.py: using CellId 26449 06:21:18.593650 tst mo_mt_call_osmux.py: using BVCI 26450 06:21:18.700625 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:21:18.711952 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:21:18.723048 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:21:18.734362 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:21:18.745709 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:21:18.756993 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 06:21:18.874709 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 06:21:18.990526 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:21:19.446849 run create_hlr_db(pid=3910): Launched 06:21:19.559386 bus /sierra_2: Setting Powered False 06:21:20.618853 run create_hlr_db(pid=3910): Terminated: ok {rc=0} 06:21:21.031770 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3912): Launched 06:21:21.327413 run osmo-hlr_10.42.42.2(pid=3913): Launched 06:21:21.440379 run osmo-stp_10.42.42.5: Starting osmo-stp 06:21:21.988871 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3915): Launched 06:21:22.284222 run osmo-stp_10.42.42.5(pid=3916): Launched 06:21:22.397558 run osmo-msc_10.42.42.6: Starting osmo-msc 06:21:22.933336 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3918): Launched 06:21:23.229742 run osmo-msc_10.42.42.6(pid=3919): Launched 06:21:23.395236 run osmo-stp_10.42.42.5(pid=3916): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3916)] 06:21:23.521920 run osmo-stp_10.42.42.5(pid=3916): stdout: | (launched: 2022-12-10_06:21:22.229649) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:21:23.648026 run osmo-stp_10.42.42.5(pid=3916): stderr: | 20221210062122400 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062122400 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062122400 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062122401 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062122401 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062122401 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062122401 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:21:23.771328 run osmo-stp_10.42.42.5(pid=3916): stdout: | (launched: 2022-12-10_06:21:22.229649) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:21:23.888706 run osmo-stp_10.42.42.5(pid=3916): stderr: | 20221210062122400 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062122400 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062122400 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062122401 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062122401 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062122401 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062122401 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:21:24.029426 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3916): Process ended prematurely: osmo-stp_10.42.42.5(pid=3916) [trial-2370↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3916)] [trial-2370↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 06:21:24.038155 tst mo_mt_call_osmux.py:8: Test FAILED (5.9 sec) 06:21:24.065643 run osmo-hlr_10.42.42.2(pid=3913): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3913)] 06:21:24.113188 run osmo-hlr_10.42.42.2(pid=3913): stdout: | (launched: 2022-12-10_06:21:21.273085) 06:21:24.162353 run osmo-hlr_10.42.42.2(pid=3913): stderr: | 20221210062121449 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210062121449 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210062121449 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210062121449 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210062121449 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210062121449 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210062121462 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210062121470 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210062121470 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210062121470 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:21:24.231123 run osmo-msc_10.42.42.6(pid=3919): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3919)] 06:21:24.278332 run osmo-msc_10.42.42.6(pid=3919): stdout: | (launched: 2022-12-10_06:21:23.174771) 06:21:24.327402 run osmo-msc_10.42.42.6(pid=3919): stderr: | 20221210062123444 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210062123444 DLGLOBAL DEBUG validating counter group 0x7fc8cb334c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210062123444 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210062123444 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210062123444 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210062123445 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210062123447 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210062123447 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210062123448 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210062123448 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:21:24.377285 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3912): Terminating (SIGTERM) 06:21:24.416933 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3915): Terminating (SIGTERM) 06:21:24.456480 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3918): Terminating (SIGTERM) 06:21:24.496178 --- ParallelTerminationStrategy: PID 3912 died... 06:21:24.514973 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3912): Terminated: ok {rc=0} 06:21:24.559265 --- ParallelTerminationStrategy: PID 3915 died... 06:21:24.577835 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3915): Terminated: ok {rc=0} 06:21:24.622471 --- ParallelTerminationStrategy: PID 3918 died... 06:21:24.641175 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3918): Terminated: ok {rc=0} 06:21:24.727309 bus /sierra_3: Setting Powered False 06:21:25.826493 bus /sierra_3: Setting Powered False 06:21:26.940111 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 06:21:28.183156 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:21:28.189534 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 06:21:28.218792 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 06:21:28.245496 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 06:21:28.295521 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 06:21:28.324123 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 06:21:28.350138 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 06:21:28.903702 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 06:21:28.951353 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:21:28.962522 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 06:21:29.026558 tst mo_mt_call.py: using LAC 26450 06:21:29.141368 tst mo_mt_call.py: using RAC 185 06:21:29.256534 tst mo_mt_call.py: using CellId 26450 06:21:29.371896 tst mo_mt_call.py: using BVCI 26451 06:21:29.478785 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:21:29.489971 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:21:29.500856 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:21:29.512126 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:21:29.523413 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:21:29.534555 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 06:21:29.652809 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 06:21:29.769836 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:21:30.227942 run create_hlr_db(pid=3924): Launched 06:21:30.341376 bus /sierra_2: Setting Powered False 06:21:31.428497 run create_hlr_db(pid=3924): Terminated: ok {rc=0} 06:21:31.944800 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3926): Launched 06:21:32.278707 run osmo-hlr_10.42.42.2(pid=3927): Launched 06:21:32.401547 run osmo-stp_10.42.42.5: Starting osmo-stp 06:21:32.949745 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3929): Launched 06:21:33.265698 run osmo-stp_10.42.42.5(pid=3930): Launched 06:21:33.386575 run osmo-msc_10.42.42.6: Starting osmo-msc 06:21:33.963347 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3932): Launched 06:21:34.281214 run osmo-msc_10.42.42.6(pid=3933): Launched 06:21:34.458946 run osmo-stp_10.42.42.5(pid=3930): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3930)] 06:21:34.593352 run osmo-stp_10.42.42.5(pid=3930): stdout: | (launched: 2022-12-10_06:21:33.207890) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:21:34.727693 run osmo-stp_10.42.42.5(pid=3930): stderr: | 20221210062133401 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062133401 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062133401 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062133402 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062133402 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062133402 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062133402 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:21:34.861487 run osmo-stp_10.42.42.5(pid=3930): stdout: | (launched: 2022-12-10_06:21:33.207890) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:21:34.987868 run osmo-stp_10.42.42.5(pid=3930): stderr: | 20221210062133401 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062133401 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062133401 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062133402 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062133402 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062133402 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062133402 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:21:35.138997 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3930): Process ended prematurely: osmo-stp_10.42.42.5(pid=3930) [trial-2370↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3930)] [trial-2370↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 06:21:35.148525 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 06:21:35.176699 run osmo-hlr_10.42.42.2(pid=3927): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3927)] 06:21:35.226780 run osmo-hlr_10.42.42.2(pid=3927): stdout: | (launched: 2022-12-10_06:21:32.220144) 06:21:35.278461 run osmo-hlr_10.42.42.2(pid=3927): stderr: | 20221210062132419 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210062132419 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210062132419 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210062132419 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210062132419 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210062132419 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210062132432 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210062132440 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210062132440 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210062132440 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:21:35.350767 run osmo-msc_10.42.42.6(pid=3933): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3933)] 06:21:35.400677 run osmo-msc_10.42.42.6(pid=3933): stdout: | (launched: 2022-12-10_06:21:34.223060) 06:21:35.451918 run osmo-msc_10.42.42.6(pid=3933): stderr: | 20221210062134546 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210062134546 DLGLOBAL DEBUG validating counter group 0x7f15573dec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210062134546 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210062134546 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210062134546 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210062134546 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210062134548 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210062134548 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210062134548 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210062134549 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:21:35.503576 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3926): Terminating (SIGTERM) 06:21:35.544801 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3929): Terminating (SIGTERM) 06:21:35.586240 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3932): Terminating (SIGTERM) 06:21:35.627909 --- ParallelTerminationStrategy: PID 3926 died... 06:21:35.647866 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3926): Terminated: ok {rc=0} 06:21:35.693811 --- ParallelTerminationStrategy: PID 3929 died... 06:21:35.713359 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3929): Terminated: ok {rc=0} 06:21:35.759074 --- ParallelTerminationStrategy: PID 3932 died... 06:21:35.778696 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3932): Terminated: ok {rc=0} 06:21:35.865689 bus /sierra_3: Setting Powered False 06:21:36.962849 bus /sierra_3: Setting Powered False 06:21:38.077208 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2370 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 06:21:39.223560 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:21:39.236262 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 06:21:39.304409 tst mo_mt_call_osmux.py: using LAC 26451 06:21:39.429177 tst mo_mt_call_osmux.py: using RAC 186 06:21:39.553650 tst mo_mt_call_osmux.py: using CellId 26451 06:21:39.677660 tst mo_mt_call_osmux.py: using BVCI 26452 06:21:39.792783 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:21:39.804768 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:21:39.816307 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:21:39.827978 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:21:39.840385 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:21:39.852108 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 06:21:39.972052 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 06:21:40.092687 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:21:40.584560 run create_hlr_db(pid=3935): Launched 06:21:40.713293 bus /sierra_2: Setting Powered False 06:21:41.776643 run create_hlr_db(pid=3935): Terminated: ok {rc=0} 06:21:42.199054 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3937): Launched 06:21:42.494828 run osmo-hlr_10.42.42.2(pid=3938): Launched 06:21:42.608224 run osmo-stp_10.42.42.5: Starting osmo-stp 06:21:43.132138 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3940): Launched 06:21:43.429138 run osmo-stp_10.42.42.5(pid=3941): Launched 06:21:43.542445 run osmo-msc_10.42.42.6: Starting osmo-msc 06:21:44.082433 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3943): Launched 06:21:44.377718 run osmo-msc_10.42.42.6(pid=3944): Launched 06:21:44.543832 run osmo-stp_10.42.42.5(pid=3941): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3941)] 06:21:44.670604 run osmo-stp_10.42.42.5(pid=3941): stdout: | (launched: 2022-12-10_06:21:43.374450) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:21:44.796696 run osmo-stp_10.42.42.5(pid=3941): stderr: | 20221210062143544 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062143544 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062143544 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062143545 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062143545 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062143545 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062143545 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:21:44.920102 run osmo-stp_10.42.42.5(pid=3941): stdout: | (launched: 2022-12-10_06:21:43.374450) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:21:45.037649 run osmo-stp_10.42.42.5(pid=3941): stderr: | 20221210062143544 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062143544 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062143544 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062143545 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062143545 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062143545 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062143545 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:21:45.178627 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3941): Process ended prematurely: osmo-stp_10.42.42.5(pid=3941) [trial-2370↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3941)] [trial-2370↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 06:21:45.187632 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 06:21:45.215041 run osmo-hlr_10.42.42.2(pid=3938): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3938)] 06:21:45.262232 run osmo-hlr_10.42.42.2(pid=3938): stdout: | (launched: 2022-12-10_06:21:42.440538) 06:21:45.310961 run osmo-hlr_10.42.42.2(pid=3938): stderr: | 20221210062142614 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210062142614 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210062142614 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210062142614 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210062142614 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210062142614 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210062142626 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210062142638 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210062142638 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210062142638 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:21:45.379068 run osmo-msc_10.42.42.6(pid=3944): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3944)] 06:21:45.426030 run osmo-msc_10.42.42.6(pid=3944): stdout: | (launched: 2022-12-10_06:21:44.323137) 06:21:45.474407 run osmo-msc_10.42.42.6(pid=3944): stderr: | 20221210062144596 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210062144597 DLGLOBAL DEBUG validating counter group 0x7efef206dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210062144597 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210062144597 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210062144597 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210062144597 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210062144599 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210062144599 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210062144599 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210062144599 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:21:45.523173 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3937): Terminating (SIGTERM) 06:21:45.562318 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3940): Terminating (SIGTERM) 06:21:45.601425 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3943): Terminating (SIGTERM) 06:21:45.641496 --- ParallelTerminationStrategy: PID 3937 died... 06:21:45.660325 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3937): Terminated: ok {rc=0} 06:21:45.703993 --- ParallelTerminationStrategy: PID 3940 died... 06:21:45.722506 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3940): Terminated: ok {rc=0} 06:21:45.765910 --- ParallelTerminationStrategy: PID 3943 died... 06:21:45.784469 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3943): Terminated: ok {rc=0} 06:21:45.878139 bus /sierra_3: Setting Powered False 06:21:46.991956 bus /sierra_3: Setting Powered False 06:21:48.111299 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 06:21:49.352161 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:21:49.358663 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 06:21:49.388126 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 06:21:49.414753 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 06:21:49.464451 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 06:21:49.493465 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 06:21:49.519795 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 06:21:50.073550 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 06:21:50.121328 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:21:50.132560 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 06:21:50.195887 tst mo_mt_call.py: using LAC 26452 06:21:50.310154 tst mo_mt_call.py: using RAC 187 06:21:50.425678 tst mo_mt_call.py: using CellId 26452 06:21:50.539983 tst mo_mt_call.py: using BVCI 26453 06:21:50.647475 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:21:50.658683 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:21:50.669649 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:21:50.680927 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:21:50.692310 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:21:50.703727 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 06:21:50.822810 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 06:21:50.942474 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:21:51.435095 run create_hlr_db(pid=3949): Launched 06:21:51.564793 bus /sierra_2: Setting Powered False 06:21:52.628751 run create_hlr_db(pid=3949): Terminated: ok {rc=0} 06:21:53.053591 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3951): Launched 06:21:53.349977 run osmo-hlr_10.42.42.2(pid=3952): Launched 06:21:53.462785 run osmo-stp_10.42.42.5: Starting osmo-stp 06:21:54.011065 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3954): Launched 06:21:54.328875 run osmo-stp_10.42.42.5(pid=3955): Launched 06:21:54.449875 run osmo-msc_10.42.42.6: Starting osmo-msc 06:21:55.023554 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3957): Launched 06:21:55.340271 run osmo-msc_10.42.42.6(pid=3958): Launched 06:21:55.517209 run osmo-stp_10.42.42.5(pid=3955): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3955)] 06:21:55.650362 run osmo-stp_10.42.42.5(pid=3955): stdout: | (launched: 2022-12-10_06:21:54.270678) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:21:55.784576 run osmo-stp_10.42.42.5(pid=3955): stderr: | 20221210062154463 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062154463 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062154464 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062154464 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062154465 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062154465 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062154465 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:21:55.919199 run osmo-stp_10.42.42.5(pid=3955): stdout: | (launched: 2022-12-10_06:21:54.270678) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:21:56.044597 run osmo-stp_10.42.42.5(pid=3955): stderr: | 20221210062154463 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062154463 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062154464 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062154464 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062154465 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062154465 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062154465 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:21:56.195628 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3955): Process ended prematurely: osmo-stp_10.42.42.5(pid=3955) [trial-2370↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3955)] [trial-2370↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 06:21:56.205425 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 06:21:56.233310 run osmo-hlr_10.42.42.2(pid=3952): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3952)] 06:21:56.283278 run osmo-hlr_10.42.42.2(pid=3952): stdout: | (launched: 2022-12-10_06:21:53.295436) 06:21:56.334792 run osmo-hlr_10.42.42.2(pid=3952): stderr: | 20221210062153471 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210062153471 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210062153471 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210062153471 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210062153471 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210062153471 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210062153483 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210062153492 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210062153492 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210062153492 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:21:56.406975 run osmo-msc_10.42.42.6(pid=3958): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3958)] 06:21:56.456758 run osmo-msc_10.42.42.6(pid=3958): stdout: | (launched: 2022-12-10_06:21:55.282005) 06:21:56.508181 run osmo-msc_10.42.42.6(pid=3958): stderr: | 20221210062155603 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210062155604 DLGLOBAL DEBUG validating counter group 0x7f4e306d8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210062155604 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210062155604 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210062155604 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210062155604 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210062155606 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210062155606 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210062155607 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210062155607 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:21:56.559902 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3951): Terminating (SIGTERM) 06:21:56.601286 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3954): Terminating (SIGTERM) 06:21:56.642794 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3957): Terminating (SIGTERM) 06:21:56.685188 --- ParallelTerminationStrategy: PID 3951 died... 06:21:56.705224 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3951): Terminated: ok {rc=0} 06:21:56.751396 --- ParallelTerminationStrategy: PID 3954 died... 06:21:56.771028 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3954): Terminated: ok {rc=0} 06:21:56.816763 --- ParallelTerminationStrategy: PID 3957 died... 06:21:56.836253 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3957): Terminated: ok {rc=0} 06:21:56.922799 bus /sierra_3: Setting Powered False 06:21:58.020988 bus /sierra_3: Setting Powered False 06:21:59.136350 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2370 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 06:22:00.280597 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:22:00.292894 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 06:22:00.359164 tst mo_mt_call_osmux.py: using LAC 26453 06:22:00.479485 tst mo_mt_call_osmux.py: using RAC 188 06:22:00.595427 tst mo_mt_call_osmux.py: using CellId 26453 06:22:00.709556 tst mo_mt_call_osmux.py: using BVCI 26454 06:22:00.816461 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:22:00.827744 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:22:00.845193 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:22:00.858233 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:22:00.871282 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:22:00.884050 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 06:22:01.005874 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 06:22:01.129586 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:22:01.641536 run create_hlr_db(pid=3960): Launched 06:22:01.805772 bus /sierra_2: Setting Powered False 06:22:02.868525 run create_hlr_db(pid=3960): Terminated: ok {rc=0} 06:22:03.293979 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3962): Launched 06:22:03.590287 run osmo-hlr_10.42.42.2(pid=3963): Launched 06:22:03.702834 run osmo-stp_10.42.42.5: Starting osmo-stp 06:22:04.223313 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3965): Launched 06:22:04.518970 run osmo-stp_10.42.42.5(pid=3966): Launched 06:22:04.631668 run osmo-msc_10.42.42.6: Starting osmo-msc 06:22:05.166538 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3968): Launched 06:22:05.461432 run osmo-msc_10.42.42.6(pid=3969): Launched 06:22:05.627286 run osmo-stp_10.42.42.5(pid=3966): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3966)] 06:22:05.752778 run osmo-stp_10.42.42.5(pid=3966): stdout: | (launched: 2022-12-10_06:22:04.464405) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:22:05.878403 run osmo-stp_10.42.42.5(pid=3966): stderr: | 20221210062204637 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062204638 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062204638 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062204638 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062204639 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062204639 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062204639 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:22:06.001662 run osmo-stp_10.42.42.5(pid=3966): stdout: | (launched: 2022-12-10_06:22:04.464405) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:22:06.118951 run osmo-stp_10.42.42.5(pid=3966): stderr: | 20221210062204637 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062204638 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062204638 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062204638 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062204639 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062204639 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062204639 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:22:06.259644 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3966): Process ended prematurely: osmo-stp_10.42.42.5(pid=3966) [trial-2370↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3966)] [trial-2370↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 06:22:06.268684 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 06:22:06.295557 run osmo-hlr_10.42.42.2(pid=3963): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3963)] 06:22:06.343559 run osmo-hlr_10.42.42.2(pid=3963): stdout: | (launched: 2022-12-10_06:22:03.534970) 06:22:06.393122 run osmo-hlr_10.42.42.2(pid=3963): stderr: | 20221210062203713 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210062203713 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210062203713 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210062203713 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210062203713 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210062203713 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210062203725 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210062203734 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210062203734 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210062203734 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:22:06.461939 run osmo-msc_10.42.42.6(pid=3969): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3969)] 06:22:06.509627 run osmo-msc_10.42.42.6(pid=3969): stdout: | (launched: 2022-12-10_06:22:05.406737) 06:22:06.558795 run osmo-msc_10.42.42.6(pid=3969): stderr: | 20221210062205678 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210062205678 DLGLOBAL DEBUG validating counter group 0x7feab59ffc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210062205678 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210062205678 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210062205679 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210062205679 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210062205680 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210062205681 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210062205681 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210062205681 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:22:06.608503 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3962): Terminating (SIGTERM) 06:22:06.647970 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3965): Terminating (SIGTERM) 06:22:06.687399 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3968): Terminating (SIGTERM) 06:22:06.727135 --- ParallelTerminationStrategy: PID 3962 died... 06:22:06.746485 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3962): Terminated: ok {rc=0} 06:22:06.791002 --- ParallelTerminationStrategy: PID 3965 died... 06:22:06.809735 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3965): Terminated: ok {rc=0} 06:22:06.853961 --- ParallelTerminationStrategy: PID 3968 died... 06:22:06.872538 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3968): Terminated: ok {rc=0} 06:22:06.957819 bus /sierra_3: Setting Powered False 06:22:08.056490 bus /sierra_3: Setting Powered False 06:22:09.172763 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 06:22:10.420672 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:22:10.428179 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 06:22:10.458584 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 06:22:10.486047 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 06:22:10.539263 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 06:22:10.569090 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 06:22:10.595863 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 06:22:11.152096 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 06:22:11.202580 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:22:11.214312 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 06:22:11.281030 tst mo_mt_call.py: using LAC 26454 06:22:11.405440 tst mo_mt_call.py: using RAC 189 06:22:11.530564 tst mo_mt_call.py: using CellId 26454 06:22:11.664774 tst mo_mt_call.py: using BVCI 26455 06:22:11.780792 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:22:11.792443 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:22:11.803950 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:22:11.815341 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:22:11.826863 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:22:11.838304 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 06:22:11.952072 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 06:22:12.069536 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:22:12.560098 run create_hlr_db(pid=3974): Launched 06:22:12.687818 bus /sierra_2: Setting Powered False 06:22:13.751592 run create_hlr_db(pid=3974): Terminated: ok {rc=0} 06:22:14.175060 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3976): Launched 06:22:14.473070 run osmo-hlr_10.42.42.2(pid=3977): Launched 06:22:14.586601 run osmo-stp_10.42.42.5: Starting osmo-stp 06:22:15.099939 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3979): Launched 06:22:15.395525 run osmo-stp_10.42.42.5(pid=3980): Launched 06:22:15.509297 run osmo-msc_10.42.42.6: Starting osmo-msc 06:22:16.077080 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3982): Launched 06:22:16.387498 run osmo-msc_10.42.42.6(pid=3983): Launched 06:22:16.729414 run osmo-stp_10.42.42.5(pid=3980): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3980)] 06:22:17.041296 run osmo-stp_10.42.42.5(pid=3980): stdout: | (launched: 2022-12-10_06:22:15.340848) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:22:17.204657 run osmo-stp_10.42.42.5(pid=3980): stderr: | 20221210062215511 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062215511 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062215511 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062215512 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062215512 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062215512 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062215512 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:22:17.333267 run osmo-stp_10.42.42.5(pid=3980): stdout: | (launched: 2022-12-10_06:22:15.340848) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:22:17.458164 run osmo-stp_10.42.42.5(pid=3980): stderr: | 20221210062215511 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062215511 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062215511 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062215512 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062215512 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062215512 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062215512 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:22:17.608852 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3980): Process ended prematurely: osmo-stp_10.42.42.5(pid=3980) [trial-2370↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3980)] [trial-2370↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 06:22:17.618575 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 06:22:17.646414 run osmo-hlr_10.42.42.2(pid=3977): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3977)] 06:22:17.695850 run osmo-hlr_10.42.42.2(pid=3977): stdout: | (launched: 2022-12-10_06:22:14.418281) 06:22:17.747138 run osmo-hlr_10.42.42.2(pid=3977): stderr: | 20221210062214593 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210062214593 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210062214594 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210062214594 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210062214594 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210062214594 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210062214606 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210062214615 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210062214616 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210062214616 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:22:17.818769 run osmo-msc_10.42.42.6(pid=3983): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3983)] 06:22:17.868268 run osmo-msc_10.42.42.6(pid=3983): stdout: | (launched: 2022-12-10_06:22:16.325465) 06:22:17.919810 run osmo-msc_10.42.42.6(pid=3983): stderr: | 20221210062216823 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210062216823 DLGLOBAL DEBUG validating counter group 0x7f87b0165c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210062216823 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210062216823 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210062216824 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210062216824 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210062216826 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210062216826 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210062216826 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210062216826 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:22:17.971220 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3976): Terminating (SIGTERM) 06:22:18.012361 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3979): Terminating (SIGTERM) 06:22:18.053439 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3982): Terminating (SIGTERM) 06:22:18.095111 --- ParallelTerminationStrategy: PID 3976 died... 06:22:18.114873 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3976): Terminated: ok {rc=0} 06:22:18.160512 --- ParallelTerminationStrategy: PID 3979 died... 06:22:18.180019 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3979): Terminated: ok {rc=0} 06:22:18.225523 --- ParallelTerminationStrategy: PID 3982 died... 06:22:18.244849 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3982): Terminated: ok {rc=0} 06:22:18.331434 bus /sierra_3: Setting Powered False 06:22:19.429934 bus /sierra_3: Setting Powered False 06:22:20.547091 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2370 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 06:22:21.690312 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:22:21.702826 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 06:22:21.773456 tst mo_mt_call_osmux.py: using LAC 26455 06:22:21.889596 tst mo_mt_call_osmux.py: using RAC 190 06:22:22.006488 tst mo_mt_call_osmux.py: using CellId 26455 06:22:22.121960 tst mo_mt_call_osmux.py: using BVCI 26456 06:22:22.231264 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:22:22.242730 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:22:22.253966 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:22:22.265227 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:22:22.276639 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:22:22.288144 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 06:22:22.405331 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 06:22:22.521208 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:22:22.979675 run create_hlr_db(pid=3985): Launched 06:22:23.092301 bus /sierra_2: Setting Powered False 06:22:24.151689 run create_hlr_db(pid=3985): Terminated: ok {rc=0} 06:22:24.563696 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3987): Launched 06:22:24.858283 run osmo-hlr_10.42.42.2(pid=3988): Launched 06:22:24.971389 run osmo-stp_10.42.42.5: Starting osmo-stp 06:22:25.480674 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3990): Launched 06:22:25.775065 run osmo-stp_10.42.42.5(pid=3991): Launched 06:22:25.888054 run osmo-msc_10.42.42.6: Starting osmo-msc 06:22:26.422189 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3993): Launched 06:22:26.717191 run osmo-msc_10.42.42.6(pid=3994): Launched 06:22:26.882755 run osmo-stp_10.42.42.5(pid=3991): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3991)] 06:22:27.009242 run osmo-stp_10.42.42.5(pid=3991): stdout: | (launched: 2022-12-10_06:22:25.720387) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:22:27.134716 run osmo-stp_10.42.42.5(pid=3991): stderr: | 20221210062225890 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062225891 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062225891 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062225891 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062225892 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062225892 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062225892 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:22:27.257849 run osmo-stp_10.42.42.5(pid=3991): stdout: | (launched: 2022-12-10_06:22:25.720387) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:22:27.374587 run osmo-stp_10.42.42.5(pid=3991): stderr: | 20221210062225890 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062225891 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062225891 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062225891 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062225892 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062225892 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062225892 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:22:27.514970 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3991): Process ended prematurely: osmo-stp_10.42.42.5(pid=3991) [trial-2370↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3991)] [trial-2370↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 06:22:27.523884 tst mo_mt_call_osmux.py:8: Test FAILED (5.9 sec) 06:22:27.550783 run osmo-hlr_10.42.42.2(pid=3988): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3988)] 06:22:27.598257 run osmo-hlr_10.42.42.2(pid=3988): stdout: | (launched: 2022-12-10_06:22:24.803841) 06:22:27.647145 run osmo-hlr_10.42.42.2(pid=3988): stderr: | 20221210062224978 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210062224978 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210062224978 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210062224978 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210062224978 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210062224978 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210062224991 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210062225000 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210062225000 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210062225000 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:22:27.715177 run osmo-msc_10.42.42.6(pid=3994): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3994)] 06:22:27.762254 run osmo-msc_10.42.42.6(pid=3994): stdout: | (launched: 2022-12-10_06:22:26.662494) 06:22:27.810903 run osmo-msc_10.42.42.6(pid=3994): stderr: | 20221210062226934 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210062226934 DLGLOBAL DEBUG validating counter group 0x7f8233063c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210062226934 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210062226934 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210062226934 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210062226935 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210062226937 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210062226937 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210062226937 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210062226937 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:22:27.860134 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3987): Terminating (SIGTERM) 06:22:27.899071 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3990): Terminating (SIGTERM) 06:22:27.938291 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3993): Terminating (SIGTERM) 06:22:27.977723 --- ParallelTerminationStrategy: PID 3987 died... 06:22:27.996503 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3987): Terminated: ok {rc=0} 06:22:28.040202 --- ParallelTerminationStrategy: PID 3990 died... 06:22:28.058722 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3990): Terminated: ok {rc=0} 06:22:28.102005 --- ParallelTerminationStrategy: PID 3993 died... 06:22:28.120397 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3993): Terminated: ok {rc=0} 06:22:28.203368 bus /sierra_3: Setting Powered False 06:22:29.300672 bus /sierra_3: Setting Powered False 06:22:30.413954 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 06:22:31.673909 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:22:31.684495 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 06:22:31.722624 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 06:22:31.760297 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 06:22:31.827558 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 06:22:31.865576 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 06:22:31.901818 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 06:22:32.436218 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 06:22:32.486941 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:22:32.499121 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 06:22:32.569724 tst mo_mt_call.py: using LAC 26456 06:22:32.693988 tst mo_mt_call.py: using RAC 191 06:22:32.814494 tst mo_mt_call.py: using CellId 26456 06:22:32.932786 tst mo_mt_call.py: using BVCI 26457 06:22:33.042675 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:22:33.054135 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:22:33.065454 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:22:33.077629 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:22:33.089653 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:22:33.101691 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:22:33.221906 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:22:33.336446 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:22:33.792941 run create_hlr_db(pid=3999): Launched 06:22:33.905730 bus /sierra_2: Setting Powered False 06:22:34.965338 run create_hlr_db(pid=3999): Terminated: ok {rc=0} 06:22:35.378032 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4001): Launched 06:22:35.673234 run osmo-hlr_10.42.42.2(pid=4002): Launched 06:22:35.786313 run osmo-stp_10.42.42.5: Starting osmo-stp 06:22:36.313191 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4005): Launched 06:22:36.608133 run osmo-stp_10.42.42.5(pid=4006): Launched 06:22:36.721453 run osmo-msc_10.42.42.6: Starting osmo-msc 06:22:37.256156 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4008): Launched 06:22:37.551237 run osmo-msc_10.42.42.6(pid=4009): Launched 06:22:37.717438 run osmo-stp_10.42.42.5(pid=4006): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4006)] 06:22:37.842839 run osmo-stp_10.42.42.5(pid=4006): stdout: | (launched: 2022-12-10_06:22:36.553770) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:22:37.968518 run osmo-stp_10.42.42.5(pid=4006): stderr: | 20221210062236724 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062236724 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062236724 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062236724 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062236725 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062236725 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062236725 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:22:38.092227 run osmo-stp_10.42.42.5(pid=4006): stdout: | (launched: 2022-12-10_06:22:36.553770) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:22:38.209778 run osmo-stp_10.42.42.5(pid=4006): stderr: | 20221210062236724 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062236724 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062236724 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062236724 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062236725 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062236725 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062236725 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:22:38.351026 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4006): Process ended prematurely: osmo-stp_10.42.42.5(pid=4006) [trial-2370↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4006)] [trial-2370↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 06:22:38.360059 tst mo_mt_call.py:8: Test FAILED (5.9 sec) 06:22:38.386755 run osmo-hlr_10.42.42.2(pid=4002): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4002)] 06:22:38.433829 run osmo-hlr_10.42.42.2(pid=4002): stdout: | (launched: 2022-12-10_06:22:35.619163) 06:22:38.482507 run osmo-hlr_10.42.42.2(pid=4002): stderr: | 20221210062235794 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210062235794 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210062235794 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210062235794 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210062235794 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210062235794 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210062235804 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210062235813 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210062235813 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210062235813 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:22:38.550524 run osmo-msc_10.42.42.6(pid=4009): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4009)] 06:22:38.597502 run osmo-msc_10.42.42.6(pid=4009): stdout: | (launched: 2022-12-10_06:22:37.497059) 06:22:38.645870 run osmo-msc_10.42.42.6(pid=4009): stderr: | 20221210062237767 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210062237767 DLGLOBAL DEBUG validating counter group 0x7f9df7a50c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210062237767 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210062237767 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210062237767 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210062237767 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210062237769 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210062237770 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210062237770 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210062237770 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:22:38.694977 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4001): Terminating (SIGTERM) 06:22:38.733703 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4005): Terminating (SIGTERM) 06:22:38.772519 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4008): Terminating (SIGTERM) 06:22:38.811925 --- ParallelTerminationStrategy: PID 4001 died... 06:22:38.830864 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4001): Terminated: ok {rc=0} 06:22:38.874544 --- ParallelTerminationStrategy: PID 4005 died... 06:22:38.892767 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4005): Terminated: ok {rc=0} 06:22:38.936640 --- ParallelTerminationStrategy: PID 4008 died... 06:22:38.955155 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4008): Terminated: ok {rc=0} 06:22:39.040105 bus /sierra_3: Setting Powered False 06:22:40.137901 bus /sierra_3: Setting Powered False 06:22:41.252207 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2370 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 06:22:42.396652 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:22:42.408747 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 06:22:42.474205 tst mo_mt_call_osmux.py: using LAC 26457 06:22:42.591535 tst mo_mt_call_osmux.py: using RAC 192 06:22:42.710366 tst mo_mt_call_osmux.py: using CellId 26457 06:22:42.828689 tst mo_mt_call_osmux.py: using BVCI 26458 06:22:42.935850 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:22:42.947438 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:22:42.958748 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:22:42.970290 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:22:42.981963 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:22:42.993615 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:22:43.107922 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:22:43.229495 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:22:43.719599 run create_hlr_db(pid=4011): Launched 06:22:43.847684 bus /sierra_2: Setting Powered False 06:22:44.909974 run create_hlr_db(pid=4011): Terminated: ok {rc=0} 06:22:45.350928 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4013): Launched 06:22:45.668181 run osmo-hlr_10.42.42.2(pid=4014): Launched 06:22:45.788593 run osmo-stp_10.42.42.5: Starting osmo-stp 06:22:46.509510 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4016): Launched 06:22:46.842008 run osmo-stp_10.42.42.5(pid=4017): Launched 06:22:47.047289 run osmo-msc_10.42.42.6: Starting osmo-msc 06:22:47.643635 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4019): Launched 06:22:47.961054 run osmo-msc_10.42.42.6(pid=4020): Launched 06:22:48.138515 run osmo-stp_10.42.42.5(pid=4017): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4017)] 06:22:48.271904 run osmo-stp_10.42.42.5(pid=4017): stdout: | (launched: 2022-12-10_06:22:46.783065) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:22:48.406100 run osmo-stp_10.42.42.5(pid=4017): stderr: | 20221210062247118 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062247118 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062247119 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062247119 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062247119 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062247120 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062247120 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:22:48.539457 run osmo-stp_10.42.42.5(pid=4017): stdout: | (launched: 2022-12-10_06:22:46.783065) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:22:48.664930 run osmo-stp_10.42.42.5(pid=4017): stderr: | 20221210062247118 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062247118 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062247119 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062247119 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062247119 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062247120 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062247120 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:22:48.815604 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4017): Process ended prematurely: osmo-stp_10.42.42.5(pid=4017) [trial-2370↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4017)] [trial-2370↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 06:22:48.825143 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 06:22:48.852841 run osmo-hlr_10.42.42.2(pid=4014): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4014)] 06:22:48.902277 run osmo-hlr_10.42.42.2(pid=4014): stdout: | (launched: 2022-12-10_06:22:45.609902) 06:22:48.953794 run osmo-hlr_10.42.42.2(pid=4014): stderr: | 20221210062245809 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210062245809 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210062245809 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210062245809 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210062245809 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210062245809 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210062245820 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210062245830 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210062245830 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210062245830 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:22:49.025654 run osmo-msc_10.42.42.6(pid=4020): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4020)] 06:22:49.075499 run osmo-msc_10.42.42.6(pid=4020): stdout: | (launched: 2022-12-10_06:22:47.902608) 06:22:49.126966 run osmo-msc_10.42.42.6(pid=4020): stderr: | 20221210062248223 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210062248223 DLGLOBAL DEBUG validating counter group 0x7f503018ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210062248223 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210062248223 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210062248223 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210062248223 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210062248225 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210062248226 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210062248226 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210062248226 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:22:49.178596 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4013): Terminating (SIGTERM) 06:22:49.219643 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4016): Terminating (SIGTERM) 06:22:49.260651 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4019): Terminating (SIGTERM) 06:22:49.302199 --- ParallelTerminationStrategy: PID 4013 died... 06:22:49.322018 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4013): Terminated: ok {rc=0} 06:22:49.367742 --- ParallelTerminationStrategy: PID 4016 died... 06:22:49.387173 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4016): Terminated: ok {rc=0} 06:22:49.432687 --- ParallelTerminationStrategy: PID 4019 died... 06:22:49.452103 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4019): Terminated: ok {rc=0} 06:22:49.539099 bus /sierra_3: Setting Powered False 06:22:50.637819 bus /sierra_3: Setting Powered False 06:22:51.752171 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 06:22:53.005213 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:22:53.011681 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 06:22:53.041775 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 06:22:53.068780 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 06:22:53.120525 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 06:22:53.149989 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 06:22:53.176896 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 06:22:53.728929 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 06:22:53.779342 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:22:53.790807 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 06:22:53.858147 tst mo_mt_call.py: using LAC 26458 06:22:53.985285 tst mo_mt_call.py: using RAC 193 06:22:54.112245 tst mo_mt_call.py: using CellId 26458 06:22:54.235837 tst mo_mt_call.py: using BVCI 26459 06:22:54.350158 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:22:54.361603 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:22:54.372775 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:22:54.384035 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:22:54.395497 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:22:54.406748 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 06:22:54.520197 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 06:22:54.636002 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:22:55.092839 run create_hlr_db(pid=4025): Launched 06:22:55.208016 bus /sierra_2: Setting Powered False 06:22:56.267879 run create_hlr_db(pid=4025): Terminated: ok {rc=0} 06:22:56.679496 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4027): Launched 06:22:56.974659 run osmo-hlr_10.42.42.2(pid=4028): Launched 06:22:57.087651 run osmo-stp_10.42.42.5: Starting osmo-stp 06:22:57.594701 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4030): Launched 06:22:57.889277 run osmo-stp_10.42.42.5(pid=4031): Launched 06:22:58.002366 run osmo-msc_10.42.42.6: Starting osmo-msc 06:22:58.535251 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4033): Launched 06:22:58.829813 run osmo-msc_10.42.42.6(pid=4034): Launched 06:22:58.994485 run osmo-stp_10.42.42.5(pid=4031): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4031)] 06:22:59.119692 run osmo-stp_10.42.42.5(pid=4031): stdout: | (launched: 2022-12-10_06:22:57.834933) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:22:59.246095 run osmo-stp_10.42.42.5(pid=4031): stderr: | 20221210062258003 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062258003 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062258003 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062258004 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062258004 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062258004 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062258004 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:22:59.369983 run osmo-stp_10.42.42.5(pid=4031): stdout: | (launched: 2022-12-10_06:22:57.834933) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:22:59.486999 run osmo-stp_10.42.42.5(pid=4031): stderr: | 20221210062258003 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062258003 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062258003 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062258004 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062258004 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062258004 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062258004 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:22:59.627560 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4031): Process ended prematurely: osmo-stp_10.42.42.5(pid=4031) [trial-2370↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4031)] [trial-2370↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 06:22:59.636417 tst mo_mt_call.py:8: Test FAILED (5.9 sec) 06:22:59.663178 run osmo-hlr_10.42.42.2(pid=4028): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4028)] 06:22:59.710307 run osmo-hlr_10.42.42.2(pid=4028): stdout: | (launched: 2022-12-10_06:22:56.920523) 06:22:59.759028 run osmo-hlr_10.42.42.2(pid=4028): stderr: | 20221210062257096 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210062257097 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210062257097 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210062257097 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210062257097 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210062257097 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210062257109 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210062257117 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210062257117 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210062257117 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:22:59.826958 run osmo-msc_10.42.42.6(pid=4034): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4034)] 06:22:59.874378 run osmo-msc_10.42.42.6(pid=4034): stdout: | (launched: 2022-12-10_06:22:58.775620) 06:22:59.923139 run osmo-msc_10.42.42.6(pid=4034): stderr: | 20221210062259048 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210062259048 DLGLOBAL DEBUG validating counter group 0x7f918fd99c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210062259048 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210062259048 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210062259048 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210062259049 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210062259050 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210062259051 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210062259051 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210062259051 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:22:59.972364 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4027): Terminating (SIGTERM) 06:23:00.011101 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4030): Terminating (SIGTERM) 06:23:00.049896 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4033): Terminating (SIGTERM) 06:23:00.089043 --- ParallelTerminationStrategy: PID 4027 died... 06:23:00.107805 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4027): Terminated: ok {rc=0} 06:23:00.151616 --- ParallelTerminationStrategy: PID 4030 died... 06:23:00.170227 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4030): Terminated: ok {rc=0} 06:23:00.213980 --- ParallelTerminationStrategy: PID 4033 died... 06:23:00.232464 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4033): Terminated: ok {rc=0} 06:23:00.315092 bus /sierra_3: Setting Powered False 06:23:01.408618 bus /sierra_3: Setting Powered False 06:23:02.521064 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2370 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 06:23:03.668140 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:23:03.680542 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 06:23:03.748720 tst mo_mt_call_osmux.py: using LAC 26459 06:23:03.872764 tst mo_mt_call_osmux.py: using RAC 194 06:23:03.998984 tst mo_mt_call_osmux.py: using CellId 26459 06:23:04.124525 tst mo_mt_call_osmux.py: using BVCI 26460 06:23:04.240686 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:23:04.252658 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:23:04.264202 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:23:04.275694 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:23:04.287124 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:23:04.298420 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 06:23:04.411298 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 06:23:04.528260 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:23:05.017711 run create_hlr_db(pid=4036): Launched 06:23:05.146270 bus /sierra_2: Setting Powered False 06:23:06.208661 run create_hlr_db(pid=4036): Terminated: ok {rc=0} 06:23:06.630193 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4038): Launched 06:23:06.925271 run osmo-hlr_10.42.42.2(pid=4039): Launched 06:23:07.038096 run osmo-stp_10.42.42.5: Starting osmo-stp 06:23:07.544738 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4041): Launched 06:23:07.839107 run osmo-stp_10.42.42.5(pid=4042): Launched 06:23:07.951473 run osmo-msc_10.42.42.6: Starting osmo-msc 06:23:08.483743 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4044): Launched 06:23:08.779561 run osmo-msc_10.42.42.6(pid=4045): Launched 06:23:08.945513 run osmo-stp_10.42.42.5(pid=4042): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4042)] 06:23:09.070949 run osmo-stp_10.42.42.5(pid=4042): stdout: | (launched: 2022-12-10_06:23:07.785306) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:23:09.196481 run osmo-stp_10.42.42.5(pid=4042): stderr: | 20221210062307956 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062307956 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062307956 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062307957 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062307957 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062307957 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062307957 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:23:09.320212 run osmo-stp_10.42.42.5(pid=4042): stdout: | (launched: 2022-12-10_06:23:07.785306) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:23:09.437394 run osmo-stp_10.42.42.5(pid=4042): stderr: | 20221210062307956 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062307956 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062307956 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062307957 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062307957 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062307957 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062307957 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:23:09.577222 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4042): Process ended prematurely: osmo-stp_10.42.42.5(pid=4042) [trial-2370↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4042)] [trial-2370↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 06:23:09.586233 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 06:23:09.613405 run osmo-hlr_10.42.42.2(pid=4039): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4039)] 06:23:09.660753 run osmo-hlr_10.42.42.2(pid=4039): stdout: | (launched: 2022-12-10_06:23:06.871015) 06:23:09.709656 run osmo-hlr_10.42.42.2(pid=4039): stderr: | 20221210062307048 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210062307048 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210062307048 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210062307048 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210062307048 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210062307048 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210062307061 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210062307070 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210062307070 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210062307070 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:23:09.777812 run osmo-msc_10.42.42.6(pid=4045): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4045)] 06:23:09.824926 run osmo-msc_10.42.42.6(pid=4045): stdout: | (launched: 2022-12-10_06:23:08.725362) 06:23:09.873379 run osmo-msc_10.42.42.6(pid=4045): stderr: | 20221210062308996 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210062308996 DLGLOBAL DEBUG validating counter group 0x7fc68ccc3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210062308996 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210062308996 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210062308996 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210062308997 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210062308998 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210062308999 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210062308999 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210062308999 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:23:09.921946 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4038): Terminating (SIGTERM) 06:23:09.961015 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4041): Terminating (SIGTERM) 06:23:09.999902 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4044): Terminating (SIGTERM) 06:23:10.039342 --- ParallelTerminationStrategy: PID 4038 died... 06:23:10.058209 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4038): Terminated: ok {rc=0} 06:23:10.102525 --- ParallelTerminationStrategy: PID 4041 died... 06:23:10.120721 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4041): Terminated: ok {rc=0} 06:23:10.164466 --- ParallelTerminationStrategy: PID 4044 died... 06:23:10.182949 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4044): Terminated: ok {rc=0} 06:23:10.266666 bus /sierra_3: Setting Powered False 06:23:11.363819 bus /sierra_3: Setting Powered False 06:23:12.474553 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 emergency:trx-lms-limenet-micro --------------------------------------------------------------------- 06:23:13.717843 tst emergency:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:23:13.722646 tst emergency:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 06:23:13.752531 tst emergency:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 06:23:13.780046 tst emergency:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 06:23:13.866663 tst emergency:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 06:23:13.896172 tst emergency:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 06:23:13.923172 tst emergency:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 06:23:14.508703 tst emergency:trx-lms-limenet-micro: RESERVED RESOURCES for emergency: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2370 emergency:trx-lms-limenet-micro emergency_mo_mt_call.py ---------------------------------------------- 06:23:14.514195 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:23:14.525646 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 06:23:14.571715 tst emergency_mo_mt_call.py: using LAC 26460 06:23:14.692747 tst emergency_mo_mt_call.py: using RAC 195 06:23:14.814242 tst emergency_mo_mt_call.py: using CellId 26460 06:23:14.937168 tst emergency_mo_mt_call.py: using BVCI 26461 06:23:15.051519 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:23:15.062864 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:23:15.073966 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:23:15.085161 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:23:15.096339 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:23:15.107441 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 06:23:15.220163 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 06:23:15.338385 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:23:15.819606 run create_hlr_db(pid=4050): Launched 06:23:15.991539 bus /sierra_2: Setting Powered False 06:23:17.075011 run create_hlr_db(pid=4050): Terminated: ok {rc=0} 06:23:17.606319 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4133): Launched 06:23:18.002206 run osmo-hlr_10.42.42.2(pid=4171): Launched 06:23:18.284078 run osmo-stp_10.42.42.5: Starting osmo-stp 06:23:19.085737 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4311): Launched 06:23:19.441762 run osmo-stp_10.42.42.5(pid=4325): Launched 06:23:19.593130 tst emergency_mo_mt_call.py: using MSISDN 7584 06:23:19.880719 run osmo-msc_10.42.42.6: Starting osmo-msc 06:23:20.485740 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4328): Launched 06:23:20.801725 run osmo-msc_10.42.42.6(pid=4329): Launched 06:23:21.127709 run osmo-stp_10.42.42.5(pid=4325): ERR: Terminated: ERROR {rc=1} [trial-2370↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4325)] 06:23:21.342242 run osmo-stp_10.42.42.5(pid=4325): stdout: | (launched: 2022-12-10_06:23:19.379281) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:23:21.587001 run osmo-stp_10.42.42.5(pid=4325): stderr: | 20221210062319722 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062319722 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062319722 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062319722 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062319723 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062319723 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062319723 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:23:21.719950 run osmo-stp_10.42.42.5(pid=4325): stdout: | (launched: 2022-12-10_06:23:19.379281) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:23:21.847443 run osmo-stp_10.42.42.5(pid=4325): stderr: | 20221210062319722 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062319722 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062319722 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062319722 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062319723 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062319723 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062319723 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:23:22.001488 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=4325): Process ended prematurely: osmo-stp_10.42.42.5(pid=4325) [trial-2370↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4325)] [trial-2370↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19] 06:23:22.011252 tst emergency_mo_mt_call.py:19: Test FAILED (7.5 sec) 06:23:22.039836 run osmo-hlr_10.42.42.2(pid=4171): ERR: Terminated: ERROR {rc=237} [trial-2370↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4171)] 06:23:22.092410 run osmo-hlr_10.42.42.2(pid=4171): stdout: | (launched: 2022-12-10_06:23:17.929705) 06:23:22.144942 run osmo-hlr_10.42.42.2(pid=4171): stderr: | 20221210062318293 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210062318293 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210062318293 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210062318293 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210062318293 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210062318293 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210062318317 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/emergency:trx-lms-limenet-micro/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210062318335 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210062318336 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210062318336 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:23:22.217324 run osmo-msc_10.42.42.6(pid=4329): ERR: Terminated: ERROR {rc=2} [trial-2370↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4329)] 06:23:22.269180 run osmo-msc_10.42.42.6(pid=4329): stdout: | (launched: 2022-12-10_06:23:20.733927) 06:23:22.321221 run osmo-msc_10.42.42.6(pid=4329): stderr: | 20221210062321331 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210062321331 DLGLOBAL DEBUG validating counter group 0x7fe2ffa0ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210062321331 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210062321331 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210062321331 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210062321331 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210062321345 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210062321346 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210062321346 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210062321346 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:23:22.373946 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4133): Terminating (SIGTERM) 06:23:22.416639 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4311): Terminating (SIGTERM) 06:23:22.462962 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4328): Terminating (SIGTERM) 06:23:22.507593 --- ParallelTerminationStrategy: PID 4133 died... 06:23:22.528209 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4133): Terminated: ok {rc=0} 06:23:22.576651 --- ParallelTerminationStrategy: PID 4311 died... 06:23:22.597569 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4311): Terminated: ok {rc=0} 06:23:22.644528 --- ParallelTerminationStrategy: PID 4328 died... 06:23:22.666414 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4328): Terminated: ok {rc=0} 06:23:22.755944 bus /sierra_3: Setting Powered False 06:23:23.857410 bus /sierra_3: Setting Powered False 06:23:24.976925 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2370 emergency:trx-lms-limenet-micro emergency_preemptive_call.py ---------------------------------------------- 06:23:26.067237 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:23:26.079711 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 06:23:26.129976 tst emergency_preemptive_call.py: using LAC 26461 06:23:26.246370 tst emergency_preemptive_call.py: using RAC 196 06:23:26.364895 tst emergency_preemptive_call.py: using CellId 26461 06:23:26.483995 tst emergency_preemptive_call.py: using BVCI 26462 06:23:26.595340 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:23:26.607441 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:23:26.619074 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:23:26.631469 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:23:26.644099 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:23:26.658814 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 06:23:26.774567 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 06:23:26.891948 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 06:23:27.009318 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 06:23:27.129141 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:23:27.603518 run create_hlr_db(pid=4333): Launched 06:23:27.742928 bus /sierra_2: Setting Powered False 06:23:28.802902 run create_hlr_db(pid=4333): Terminated: ok {rc=0} 06:23:29.228669 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4335): Launched 06:23:29.549875 run osmo-hlr_10.42.42.2(pid=4336): Launched 06:23:29.789886 run osmo-stp_10.42.42.5: Starting osmo-stp 06:23:30.436899 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4338): Launched 06:23:30.772050 run osmo-stp_10.42.42.5(pid=4339): Launched 06:23:31.027633 tst emergency_preemptive_call.py: using MSISDN 7585 06:23:31.261508 run osmo-msc_10.42.42.6: Starting osmo-msc 06:23:31.835286 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4341): Launched 06:23:32.195450 run osmo-msc_10.42.42.6(pid=4342): Launched 06:23:32.562633 run osmo-stp_10.42.42.5(pid=4339): ERR: Terminated: ERROR {rc=1} [trial-2370↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4339)] 06:23:32.820926 run osmo-stp_10.42.42.5(pid=4339): stdout: | (launched: 2022-12-10_06:23:30.706978) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:23:33.048860 run osmo-stp_10.42.42.5(pid=4339): stderr: | 20221210062331006 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062331006 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062331006 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062331007 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062331009 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062331009 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062331009 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:23:33.182864 run osmo-stp_10.42.42.5(pid=4339): stdout: | (launched: 2022-12-10_06:23:30.706978) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:23:33.309300 run osmo-stp_10.42.42.5(pid=4339): stderr: | 20221210062331006 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062331006 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062331006 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062331007 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062331009 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062331009 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062331009 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:23:33.460839 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=4339): Process ended prematurely: osmo-stp_10.42.42.5(pid=4339) [trial-2370↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4339)] [trial-2370↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32] 06:23:33.470844 tst emergency_preemptive_call.py:32: Test FAILED (7.4 sec) 06:23:33.499847 run osmo-hlr_10.42.42.2(pid=4336): ERR: Terminated: ERROR {rc=237} [trial-2370↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4336)] 06:23:33.550840 run osmo-hlr_10.42.42.2(pid=4336): stdout: | (launched: 2022-12-10_06:23:29.487131) 06:23:33.603489 run osmo-hlr_10.42.42.2(pid=4336): stderr: | 20221210062329795 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210062329795 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210062329795 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210062329795 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210062329795 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210062329795 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210062329811 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/emergency:trx-lms-limenet-micro/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210062329827 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210062329828 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210062329828 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:23:33.676627 run osmo-msc_10.42.42.6(pid=4342): ERR: Terminated: ERROR {rc=2} [trial-2370↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4342)] 06:23:33.727422 run osmo-msc_10.42.42.6(pid=4342): stdout: | (launched: 2022-12-10_06:23:32.134554) 06:23:33.779953 run osmo-msc_10.42.42.6(pid=4342): stderr: | 20221210062332677 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210062332678 DLGLOBAL DEBUG validating counter group 0x7f599160fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210062332678 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210062332678 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210062332678 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210062332678 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210062332680 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210062332680 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210062332680 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210062332680 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:23:33.832899 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4335): Terminating (SIGTERM) 06:23:33.875797 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4338): Terminating (SIGTERM) 06:23:33.918726 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4341): Terminating (SIGTERM) 06:23:33.964067 --- ParallelTerminationStrategy: PID 4335 died... 06:23:33.984867 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4335): Terminated: ok {rc=0} 06:23:34.033874 --- ParallelTerminationStrategy: PID 4338 died... 06:23:34.054357 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4338): Terminated: ok {rc=0} 06:23:34.101541 --- ParallelTerminationStrategy: PID 4341 died... 06:23:34.122059 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4341): Terminated: ok {rc=0} 06:23:34.210879 bus /sierra_9: Setting Powered False 06:23:35.310309 bus /sierra_9: Setting Powered False 06:23:36.426137 bus /sierra_8: Setting Powered False 06:23:37.527726 bus /sierra_8: Setting Powered False 06:23:38.644243 bus /sierra_3: Setting Powered False 06:23:39.745912 bus /sierra_3: Setting Powered False 06:23:40.862568 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 emergency:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 gprs:trx-lms-limenet-micro --------------------------------------------------------------------- 06:23:42.141539 tst gprs:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:23:42.146096 tst gprs:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 06:23:42.175670 tst gprs:trx-lms-limenet-micro: Verifying 9 x ip_address (candidates: 9) 06:23:42.214745 tst gprs:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 06:23:42.302423 tst gprs:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 06:23:42.331909 tst gprs:trx-lms-limenet-micro: Reserving 9 x ip_address (candidates: 9) 06:23:42.370662 tst gprs:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 06:23:42.964655 tst gprs:trx-lms-limenet-micro: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2370 gprs:trx-lms-limenet-micro cs_paging_gprs_active.py ---------------------------------------------- 06:23:43.015985 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:23:43.027115 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 06:23:43.072159 tst cs_paging_gprs_active.py: using LAC 26462 06:23:43.197966 tst cs_paging_gprs_active.py: using RAC 197 06:23:43.321760 tst cs_paging_gprs_active.py: using CellId 26462 06:23:43.445403 tst cs_paging_gprs_active.py: using BVCI 26463 06:23:43.560777 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:23:43.572054 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:23:43.583112 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:23:43.594123 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:23:43.604930 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:23:43.615940 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:23:43.627070 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:23:43.638018 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:23:43.649093 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 06:23:43.763839 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 06:23:43.882221 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 06:23:44.097383 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:23:44.416357 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4349): Launched 06:23:44.692813 run iperf3-srv_10.42.42.10(pid=4350): Launched 06:23:44.811814 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 06:23:45.025380 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:23:45.343265 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4351): Launched 06:23:45.620413 run iperf3-srv_10.42.42.10(pid=4352): Launched 06:23:45.739212 tst cs_paging_gprs_active.py:38: start network... 06:23:45.968921 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:23:46.452360 run create_hlr_db(pid=4353): Launched 06:23:46.574223 bus /sierra_2: Setting Powered False 06:23:47.636064 run create_hlr_db(pid=4353): Terminated: ok {rc=0} 06:23:48.058549 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4355): Launched 06:23:48.354664 run osmo-hlr_10.42.42.2(pid=4356): Launched 06:23:48.467795 run osmo-stp_10.42.42.5: Starting osmo-stp 06:23:48.987379 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4358): Launched 06:23:49.282669 run osmo-stp_10.42.42.5(pid=4359): Launched 06:23:49.395685 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:23:49.904287 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4361): Launched 06:23:50.018203 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:23:50.269606 run patchelf(pid=4362): Launched 06:23:50.434779 run osmo-stp_10.42.42.5(pid=4359): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4359)] 06:23:50.559972 run osmo-stp_10.42.42.5(pid=4359): stdout: | (launched: 2022-12-10_06:23:49.228418) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:23:50.687336 run osmo-stp_10.42.42.5(pid=4359): stderr: | 20221210062349397 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062349398 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062349398 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062349398 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062349399 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062349399 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062349399 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:23:50.814558 run osmo-stp_10.42.42.5(pid=4359): stdout: | (launched: 2022-12-10_06:23:49.228418) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:23:50.936234 run osmo-stp_10.42.42.5(pid=4359): stderr: | 20221210062349397 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062349398 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062349398 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062349398 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062349399 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062349399 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062349399 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:23:51.080164 run patchelf(pid=4362): Terminating (SIGINT) 06:23:51.246198 run patchelf(pid=4362): Terminated: ok {rc=0} 06:23:51.366081 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=4359): Process ended prematurely: osmo-stp_10.42.42.5(pid=4359) [trial-2370↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4359)] [trial-2370↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38] 06:23:51.375545 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 06:23:51.402894 run osmo-hlr_10.42.42.2(pid=4356): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4356)] 06:23:51.450117 run osmo-hlr_10.42.42.2(pid=4356): stdout: | (launched: 2022-12-10_06:23:48.299856) 06:23:51.499052 run osmo-hlr_10.42.42.2(pid=4356): stderr: | 20221210062348478 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210062348478 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210062348478 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210062348478 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210062348478 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210062348478 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210062348490 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-lms-limenet-micro/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210062348498 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210062348499 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210062348499 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:23:51.548253 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4349): Terminating (SIGTERM) 06:23:51.587940 run iperf3-srv_10.42.42.10(pid=4350): Terminating (SIGTERM) 06:23:51.627191 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4351): Terminating (SIGTERM) 06:23:51.666383 run iperf3-srv_10.42.42.10(pid=4352): Terminating (SIGTERM) 06:23:51.705574 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4355): Terminating (SIGTERM) 06:23:51.745015 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4358): Terminating (SIGTERM) 06:23:51.784395 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4361): Terminating (SIGTERM) 06:23:51.824305 --- ParallelTerminationStrategy: PID 4349 died... 06:23:51.843249 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4349): Terminated: ok {rc=0} 06:23:51.887590 --- ParallelTerminationStrategy: PID 4350 died... 06:23:51.906074 run iperf3-srv_10.42.42.10(pid=4350): Terminated {rc=256} 06:23:51.949832 --- ParallelTerminationStrategy: PID 4351 died... 06:23:51.968335 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4351): Terminated: ok {rc=0} 06:23:52.012311 --- ParallelTerminationStrategy: PID 4352 died... 06:23:52.030865 run iperf3-srv_10.42.42.10(pid=4352): Terminated {rc=256} 06:23:52.075043 --- ParallelTerminationStrategy: PID 4355 died... 06:23:52.093654 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4355): Terminated: ok {rc=0} 06:23:52.138022 --- ParallelTerminationStrategy: PID 4358 died... 06:23:52.156565 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4358): Terminated: ok {rc=0} 06:23:52.200574 --- ParallelTerminationStrategy: PID 4361 died... 06:23:52.219176 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4361): Terminated: ok {rc=0} 06:23:52.305126 bus /gobi_0: Setting Powered False 06:23:53.403643 bus /gobi_0: Setting Powered False 06:23:54.518699 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-lms-limenet-micro iperf3.py ---------------------------------------------- 06:23:55.663039 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:23:55.674903 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 06:23:55.722463 tst iperf3.py: using LAC 26463 06:23:55.839726 tst iperf3.py: using RAC 198 06:23:55.961473 tst iperf3.py: using CellId 26463 06:23:56.086195 tst iperf3.py: using BVCI 26464 06:23:56.202884 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:23:56.214173 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:23:56.225126 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:23:56.236051 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:23:56.246898 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:23:56.257875 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:23:56.268943 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:23:56.279827 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:23:56.290879 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 06:23:56.407710 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 06:23:56.620303 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:23:56.937696 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4363): Launched 06:23:57.213700 run iperf3-srv_10.42.42.10(pid=4364): Launched 06:23:57.332381 tst iperf3.py:8: start network... 06:23:57.545404 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:23:58.036145 run create_hlr_db(pid=4365): Launched 06:23:58.160007 bus /gobi_6: Setting Powered False 06:23:59.218428 run create_hlr_db(pid=4365): Terminated: ok {rc=0} 06:23:59.629268 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4367): Launched 06:23:59.924829 run osmo-hlr_10.42.42.2(pid=4368): Launched 06:24:00.037841 run osmo-stp_10.42.42.5: Starting osmo-stp 06:24:00.558786 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4370): Launched 06:24:00.863803 run osmo-stp_10.42.42.5(pid=4371): Launched 06:24:01.084810 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:24:01.850549 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4373): Launched 06:24:01.983399 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:24:02.258566 run patchelf(pid=4374): Launched 06:24:02.450039 run osmo-stp_10.42.42.5(pid=4371): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4371)] 06:24:02.584905 run osmo-stp_10.42.42.5(pid=4371): stdout: | (launched: 2022-12-10_06:24:00.798774) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:24:02.721052 run osmo-stp_10.42.42.5(pid=4371): stderr: | 20221210062401156 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062401156 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062401157 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062401158 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062401158 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062401158 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062401158 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:24:02.857701 run osmo-stp_10.42.42.5(pid=4371): stdout: | (launched: 2022-12-10_06:24:00.798774) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:24:02.988296 run osmo-stp_10.42.42.5(pid=4371): stderr: | 20221210062401156 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062401156 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062401157 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062401158 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062401158 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062401158 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062401158 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:24:03.143100 run patchelf(pid=4374): Terminating (SIGINT) 06:24:03.320715 run patchelf(pid=4374): Terminated: ok {rc=0} 06:24:03.449219 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4371): Process ended prematurely: osmo-stp_10.42.42.5(pid=4371) [trial-2370↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4371)] [trial-2370↪gprs:trx-lms-limenet-micro↪iperf3.py:8] 06:24:03.459404 tst iperf3.py:8: Test FAILED (7.8 sec) 06:24:03.488408 run osmo-hlr_10.42.42.2(pid=4368): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-lms-limenet-micro↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4368)] 06:24:03.538696 run osmo-hlr_10.42.42.2(pid=4368): stdout: | (launched: 2022-12-10_06:23:59.870261) 06:24:03.590124 run osmo-hlr_10.42.42.2(pid=4368): stderr: | 20221210062400046 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210062400046 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210062400046 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210062400046 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210062400046 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210062400046 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210062400058 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-lms-limenet-micro/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210062400068 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210062400068 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210062400068 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:24:03.642119 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4363): Terminating (SIGTERM) 06:24:03.684260 run iperf3-srv_10.42.42.10(pid=4364): Terminating (SIGTERM) 06:24:03.726212 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4367): Terminating (SIGTERM) 06:24:03.767916 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4370): Terminating (SIGTERM) 06:24:03.809496 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4373): Terminating (SIGTERM) 06:24:03.851406 --- ParallelTerminationStrategy: PID 4363 died... 06:24:03.871210 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4363): Terminated: ok {rc=0} 06:24:03.918381 --- ParallelTerminationStrategy: PID 4364 died... 06:24:03.937903 run iperf3-srv_10.42.42.10(pid=4364): Terminated {rc=256} 06:24:03.984929 --- ParallelTerminationStrategy: PID 4367 died... 06:24:04.004371 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4367): Terminated: ok {rc=0} 06:24:04.050978 --- ParallelTerminationStrategy: PID 4370 died... 06:24:04.070308 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4370): Terminated: ok {rc=0} 06:24:04.117355 --- ParallelTerminationStrategy: PID 4373 died... 06:24:04.136817 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4373): Terminated: ok {rc=0} 06:24:04.225773 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-lms-limenet-micro iperf3m4.py ---------------------------------------------- 06:24:05.374532 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:24:05.386475 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 06:24:05.437218 tst iperf3m4.py: using LAC 26464 06:24:05.560161 tst iperf3m4.py: using RAC 199 06:24:05.681483 tst iperf3m4.py: using CellId 26464 06:24:05.798112 tst iperf3m4.py: using BVCI 26465 06:24:05.908691 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:24:05.919674 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:24:05.930527 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:24:05.942096 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:24:05.953287 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:24:05.964469 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:24:05.976087 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:24:05.987320 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:24:05.998576 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 06:24:06.115416 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 06:24:06.234132 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 06:24:06.352995 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 06:24:06.478553 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 06:24:06.677290 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:24:06.974703 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4375): Launched 06:24:07.233063 run iperf3-srv_10.42.42.10(pid=4376): Launched 06:24:07.344294 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 06:24:07.541742 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:24:07.838709 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4377): Launched 06:24:08.095301 run iperf3-srv_10.42.42.10(pid=4378): Launched 06:24:08.206240 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 06:24:08.402510 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:24:08.698565 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4379): Launched 06:24:08.955696 run iperf3-srv_10.42.42.10(pid=4380): Launched 06:24:09.066889 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 06:24:09.264110 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:24:09.561627 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4381): Launched 06:24:09.819681 run iperf3-srv_10.42.42.10(pid=4382): Launched 06:24:09.930759 tst iperf3m4.py:8: start network... 06:24:10.127779 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:24:10.583752 run create_hlr_db(pid=4383): Launched 06:24:10.696343 bus /gobi_6: Setting Powered False 06:24:11.755189 run create_hlr_db(pid=4383): Terminated: ok {rc=0} 06:24:12.167940 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4385): Launched 06:24:12.464249 run osmo-hlr_10.42.42.2(pid=4386): Launched 06:24:12.577160 run osmo-stp_10.42.42.5: Starting osmo-stp 06:24:13.223936 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4388): Launched 06:24:13.534887 run osmo-stp_10.42.42.5(pid=4389): Launched 06:24:13.653173 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:24:14.191364 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4391): Launched 06:24:14.311102 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:24:14.574009 run patchelf(pid=4392): Launched 06:24:14.747411 run osmo-stp_10.42.42.5(pid=4389): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4389)] 06:24:14.879387 run osmo-stp_10.42.42.5(pid=4389): stdout: | (launched: 2022-12-10_06:24:13.478127) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:24:15.012937 run osmo-stp_10.42.42.5(pid=4389): stderr: | 20221210062413669 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062413669 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062413669 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062413670 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062413670 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062413670 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062413670 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:24:15.146394 run osmo-stp_10.42.42.5(pid=4389): stdout: | (launched: 2022-12-10_06:24:13.478127) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:24:15.274070 run osmo-stp_10.42.42.5(pid=4389): stderr: | 20221210062413669 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062413669 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062413669 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062413670 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062413670 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062413670 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062413670 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:24:15.425345 run patchelf(pid=4392): Terminating (SIGINT) 06:24:15.599648 run patchelf(pid=4392): Terminated: ok {rc=0} 06:24:15.725493 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4389): Process ended prematurely: osmo-stp_10.42.42.5(pid=4389) [trial-2370↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4389)] [trial-2370↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8] 06:24:15.735628 tst iperf3m4.py:8: Test FAILED (10.4 sec) 06:24:15.764345 run osmo-hlr_10.42.42.2(pid=4386): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-lms-limenet-micro↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4386)] 06:24:15.813623 run osmo-hlr_10.42.42.2(pid=4386): stdout: | (launched: 2022-12-10_06:24:12.409590) 06:24:15.865459 run osmo-hlr_10.42.42.2(pid=4386): stderr: | 20221210062412586 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210062412586 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210062412586 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210062412586 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210062412586 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210062412587 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210062412601 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-lms-limenet-micro/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210062412609 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210062412609 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210062412609 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:24:15.919344 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4375): Terminating (SIGTERM) 06:24:15.961493 run iperf3-srv_10.42.42.10(pid=4376): Terminating (SIGTERM) 06:24:16.006189 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4377): Terminating (SIGTERM) 06:24:16.048484 run iperf3-srv_10.42.42.10(pid=4378): Terminating (SIGTERM) 06:24:16.093061 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4379): Terminating (SIGTERM) 06:24:16.135359 run iperf3-srv_10.42.42.10(pid=4380): Terminating (SIGTERM) 06:24:16.179639 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4381): Terminating (SIGTERM) 06:24:16.222139 run iperf3-srv_10.42.42.10(pid=4382): Terminating (SIGTERM) 06:24:16.266504 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4385): Terminating (SIGTERM) 06:24:16.308338 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4388): Terminating (SIGTERM) 06:24:16.349687 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4391): Terminating (SIGTERM) 06:24:16.391732 --- ParallelTerminationStrategy: PID 4375 died... 06:24:16.411479 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4375): Terminated: ok {rc=0} 06:24:16.457602 --- ParallelTerminationStrategy: PID 4376 died... 06:24:16.477156 run iperf3-srv_10.42.42.10(pid=4376): Terminated {rc=256} 06:24:16.523134 --- ParallelTerminationStrategy: PID 4377 died... 06:24:16.542927 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4377): Terminated: ok {rc=0} 06:24:16.589333 --- ParallelTerminationStrategy: PID 4378 died... 06:24:16.608813 run iperf3-srv_10.42.42.10(pid=4378): Terminated {rc=256} 06:24:16.654660 --- ParallelTerminationStrategy: PID 4379 died... 06:24:16.674481 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4379): Terminated: ok {rc=0} 06:24:16.720577 --- ParallelTerminationStrategy: PID 4380 died... 06:24:16.740428 run iperf3-srv_10.42.42.10(pid=4380): Terminated {rc=256} 06:24:16.786385 --- ParallelTerminationStrategy: PID 4381 died... 06:24:16.806090 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4381): Terminated: ok {rc=0} 06:24:16.851797 --- ParallelTerminationStrategy: PID 4382 died... 06:24:16.871511 run iperf3-srv_10.42.42.10(pid=4382): Terminated {rc=256} 06:24:16.917159 --- ParallelTerminationStrategy: PID 4385 died... 06:24:16.936848 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4385): Terminated: ok {rc=0} 06:24:16.982811 --- ParallelTerminationStrategy: PID 4388 died... 06:24:17.002358 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4388): Terminated: ok {rc=0} 06:24:17.048446 --- ParallelTerminationStrategy: PID 4391 died... 06:24:17.068271 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4391): Terminated: ok {rc=0} 06:24:17.155215 bus /gobi_4: Setting Powered False 06:24:18.255309 bus /gobi_4: Setting Powered False 06:24:19.368374 bus /gobi_1: Setting Powered False 06:24:20.465134 bus /gobi_1: Setting Powered False 06:24:21.579835 bus /gobi_0: Setting Powered False 06:24:22.675846 bus /gobi_0: Setting Powered False 06:24:23.790145 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-lms-limenet-micro ping.py ---------------------------------------------- 06:24:24.891351 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:24:24.903277 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 06:24:24.952730 tst ping.py: using LAC 26465 06:24:25.074129 tst ping.py: using RAC 200 06:24:25.192531 tst ping.py: using CellId 26465 06:24:25.310696 tst ping.py: using BVCI 26466 06:24:25.421785 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:24:25.432789 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:24:25.443849 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:24:25.454788 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:24:25.465600 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:24:25.476376 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:24:25.487481 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:24:25.498425 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 06:24:25.611776 tst ping.py:19: start network... 06:24:25.802823 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:24:26.246494 run create_hlr_db(pid=4393): Launched 06:24:26.357383 bus /gobi_6: Setting Powered False 06:24:27.415864 run create_hlr_db(pid=4393): Terminated: ok {rc=0} 06:24:27.837107 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4395): Launched 06:24:28.145119 run osmo-hlr_10.42.42.2(pid=4396): Launched 06:24:28.262624 run osmo-stp_10.42.42.5: Starting osmo-stp 06:24:28.792848 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4398): Launched 06:24:29.099875 run osmo-stp_10.42.42.5(pid=4399): Launched 06:24:29.216577 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:24:29.745182 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4401): Launched 06:24:29.862444 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:24:30.121732 run patchelf(pid=4402): Launched 06:24:30.282363 run osmo-stp_10.42.42.5(pid=4399): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4399)] 06:24:30.404030 run osmo-stp_10.42.42.5(pid=4399): stdout: | (launched: 2022-12-10_06:24:29.044178) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:24:30.527795 run osmo-stp_10.42.42.5(pid=4399): stderr: | 20221210062429233 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062429234 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062429234 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062429234 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062429235 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062429235 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062429235 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:24:30.651461 run osmo-stp_10.42.42.5(pid=4399): stdout: | (launched: 2022-12-10_06:24:29.044178) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:24:30.769168 run osmo-stp_10.42.42.5(pid=4399): stderr: | 20221210062429233 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062429234 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062429234 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062429234 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062429235 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062429235 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062429235 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:24:30.937747 run patchelf(pid=4402): Terminating (SIGINT) 06:24:31.114093 run patchelf(pid=4402): Terminated: ok {rc=0} 06:24:31.241692 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=4399): Process ended prematurely: osmo-stp_10.42.42.5(pid=4399) [trial-2370↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4399)] [trial-2370↪gprs:trx-lms-limenet-micro↪ping.py:22] 06:24:31.251668 tst ping.py:22: Test FAILED (6.4 sec) 06:24:31.281379 run osmo-hlr_10.42.42.2(pid=4396): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-lms-limenet-micro↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4396)] 06:24:31.331771 run osmo-hlr_10.42.42.2(pid=4396): stdout: | (launched: 2022-12-10_06:24:28.089058) 06:24:31.384177 run osmo-hlr_10.42.42.2(pid=4396): stderr: | 20221210062428287 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210062428287 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210062428287 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210062428287 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210062428287 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210062428287 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210062428300 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-lms-limenet-micro/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210062428310 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210062428310 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210062428310 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:24:31.437143 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4395): Terminating (SIGTERM) 06:24:31.480672 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4398): Terminating (SIGTERM) 06:24:31.525283 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4401): Terminating (SIGTERM) 06:24:31.568024 --- ParallelTerminationStrategy: PID 4395 died... 06:24:31.588547 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4395): Terminated: ok {rc=0} 06:24:31.634843 --- ParallelTerminationStrategy: PID 4398 died... 06:24:31.654562 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4398): Terminated: ok {rc=0} 06:24:31.703368 --- ParallelTerminationStrategy: PID 4401 died... 06:24:31.723389 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4401): Terminated: ok {rc=0} 06:24:31.811408 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-lms-limenet-micro ping_idle_ping.py ---------------------------------------------- 06:24:32.898229 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:24:32.909916 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 06:24:32.956558 tst ping_idle_ping.py: using LAC 26466 06:24:33.069992 tst ping_idle_ping.py: using RAC 201 06:24:33.183464 tst ping_idle_ping.py: using CellId 26466 06:24:33.297963 tst ping_idle_ping.py: using BVCI 26467 06:24:33.402071 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:24:33.412710 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:24:33.423260 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:24:33.434159 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:24:33.444746 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:24:33.455416 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:24:33.466314 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:24:33.477096 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 06:24:33.589045 tst ping_idle_ping.py:24: start network... 06:24:33.779958 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:24:34.226201 run create_hlr_db(pid=4403): Launched 06:24:34.335293 bus /gobi_6: Setting Powered False 06:24:35.392468 run create_hlr_db(pid=4403): Terminated: ok {rc=0} 06:24:35.812668 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4405): Launched 06:24:36.121109 run osmo-hlr_10.42.42.2(pid=4406): Launched 06:24:36.238816 run osmo-stp_10.42.42.5: Starting osmo-stp 06:24:36.768655 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4408): Launched 06:24:37.075908 run osmo-stp_10.42.42.5(pid=4409): Launched 06:24:37.189855 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:24:37.686645 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4411): Launched 06:24:37.796795 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:24:38.038786 run patchelf(pid=4412): Launched 06:24:38.199282 run osmo-stp_10.42.42.5(pid=4409): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4409)] 06:24:38.321222 run osmo-stp_10.42.42.5(pid=4409): stdout: | (launched: 2022-12-10_06:24:37.019563) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:24:38.444622 run osmo-stp_10.42.42.5(pid=4409): stderr: | 20221210062437187 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062437187 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062437187 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062437188 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062437188 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062437188 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062437189 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:24:38.568494 run osmo-stp_10.42.42.5(pid=4409): stdout: | (launched: 2022-12-10_06:24:37.019563) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:24:38.686269 run osmo-stp_10.42.42.5(pid=4409): stderr: | 20221210062437187 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062437187 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062437187 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062437188 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062437188 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062437188 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062437189 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:24:38.825792 run patchelf(pid=4412): Terminating (SIGINT) 06:24:38.986924 run patchelf(pid=4412): Terminated: ok {rc=0} 06:24:39.103169 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=4409): Process ended prematurely: osmo-stp_10.42.42.5(pid=4409) [trial-2370↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4409)] [trial-2370↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27] 06:24:39.112035 tst ping_idle_ping.py:27: Test FAILED (6.2 sec) 06:24:39.138754 run osmo-hlr_10.42.42.2(pid=4406): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4406)] 06:24:39.185474 run osmo-hlr_10.42.42.2(pid=4406): stdout: | (launched: 2022-12-10_06:24:36.065149) 06:24:39.233798 run osmo-hlr_10.42.42.2(pid=4406): stderr: | 20221210062436259 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210062436259 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210062436259 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210062436259 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210062436259 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210062436259 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210062436273 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-lms-limenet-micro/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210062436283 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210062436283 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210062436283 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:24:39.282739 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4405): Terminating (SIGTERM) 06:24:39.321673 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4408): Terminating (SIGTERM) 06:24:39.360783 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4411): Terminating (SIGTERM) 06:24:39.400462 --- ParallelTerminationStrategy: PID 4405 died... 06:24:39.419449 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4405): Terminated: ok {rc=0} 06:24:39.462601 --- ParallelTerminationStrategy: PID 4408 died... 06:24:39.480624 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4408): Terminated: ok {rc=0} 06:24:39.523696 --- ParallelTerminationStrategy: PID 4411 died... 06:24:39.541765 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4411): Terminated: ok {rc=0} 06:24:39.625540 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2370 gprs:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 gprs:trx-lms-limenet-micro+mod-bts0-egprs --------------------------------------------------------------------- 06:24:40.924860 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:24:40.930767 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 06:24:40.960169 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 06:24:40.999189 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 06:24:41.086265 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 06:24:41.115249 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 06:24:41.153685 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 06:24:41.751091 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2370 gprs:trx-lms-limenet-micro+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 06:24:41.800839 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:24:41.812160 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:24:41.862802 tst cs_paging_gprs_active.py: using LAC 26467 06:24:41.986829 tst cs_paging_gprs_active.py: using RAC 202 06:24:42.110398 tst cs_paging_gprs_active.py: using CellId 26467 06:24:42.231386 tst cs_paging_gprs_active.py: using BVCI 26468 06:24:42.344332 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:24:42.355668 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:24:42.366796 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:24:42.377905 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:24:42.388999 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:24:42.400098 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:24:42.411270 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:24:42.422308 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:24:42.433597 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:24:42.546905 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:24:42.665255 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 06:24:42.860420 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:24:43.153191 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4416): Launched 06:24:43.408021 run iperf3-srv_10.42.42.10(pid=4417): Launched 06:24:43.517800 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 06:24:43.712237 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:24:44.005189 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4418): Launched 06:24:44.259574 run iperf3-srv_10.42.42.10(pid=4419): Launched 06:24:44.369473 tst cs_paging_gprs_active.py:38: start network... 06:24:44.563973 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:24:45.017410 run create_hlr_db(pid=4420): Launched 06:24:45.130721 bus /gobi_6: Setting Powered False 06:24:46.217710 run create_hlr_db(pid=4420): Terminated: ok {rc=0} 06:24:46.682299 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4422): Launched 06:24:47.019835 run osmo-hlr_10.42.42.2(pid=4423): Launched 06:24:47.193230 run osmo-stp_10.42.42.5: Starting osmo-stp 06:24:47.733660 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4425): Launched 06:24:48.046506 run osmo-stp_10.42.42.5(pid=4426): Launched 06:24:48.165198 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:24:48.705072 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4428): Launched 06:24:48.824573 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:24:49.088518 run patchelf(pid=4429): Launched 06:24:49.262853 run osmo-stp_10.42.42.5(pid=4426): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4426)] 06:24:49.395247 run osmo-stp_10.42.42.5(pid=4426): stdout: | (launched: 2022-12-10_06:24:47.989310) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:24:49.529220 run osmo-stp_10.42.42.5(pid=4426): stderr: | 20221210062448181 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062448181 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062448181 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062448182 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062448182 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062448182 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062448182 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:24:49.663259 run osmo-stp_10.42.42.5(pid=4426): stdout: | (launched: 2022-12-10_06:24:47.989310) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:24:49.791510 run osmo-stp_10.42.42.5(pid=4426): stderr: | 20221210062448181 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062448181 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062448181 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062448182 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062448182 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062448182 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062448182 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:24:49.943199 run patchelf(pid=4429): Terminating (SIGINT) 06:24:50.119192 run patchelf(pid=4429): Terminated: ok {rc=0} 06:24:50.245718 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=4426): Process ended prematurely: osmo-stp_10.42.42.5(pid=4426) [trial-2370↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4426)] [trial-2370↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 06:24:50.255738 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 06:24:50.283874 run osmo-hlr_10.42.42.2(pid=4423): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4423)] 06:24:50.333032 run osmo-hlr_10.42.42.2(pid=4423): stdout: | (launched: 2022-12-10_06:24:46.954871) 06:24:50.383819 run osmo-hlr_10.42.42.2(pid=4423): stderr: | 20221210062447197 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210062447197 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210062447197 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210062447197 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210062447197 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210062447197 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210062447209 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-lms-limenet-micro+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210062447218 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210062447218 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210062447218 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:24:50.435106 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4416): Terminating (SIGTERM) 06:24:50.475990 run iperf3-srv_10.42.42.10(pid=4417): Terminating (SIGTERM) 06:24:50.516731 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4418): Terminating (SIGTERM) 06:24:50.557772 run iperf3-srv_10.42.42.10(pid=4419): Terminating (SIGTERM) 06:24:50.598428 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4422): Terminating (SIGTERM) 06:24:50.639328 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4425): Terminating (SIGTERM) 06:24:50.680127 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4428): Terminating (SIGTERM) 06:24:50.721441 --- ParallelTerminationStrategy: PID 4416 died... 06:24:50.740897 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4416): Terminated: ok {rc=0} 06:24:50.786442 --- ParallelTerminationStrategy: PID 4417 died... 06:24:50.805475 run iperf3-srv_10.42.42.10(pid=4417): Terminated {rc=256} 06:24:50.850414 --- ParallelTerminationStrategy: PID 4418 died... 06:24:50.869500 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4418): Terminated: ok {rc=0} 06:24:50.914587 --- ParallelTerminationStrategy: PID 4419 died... 06:24:50.933674 run iperf3-srv_10.42.42.10(pid=4419): Terminated {rc=256} 06:24:50.978700 --- ParallelTerminationStrategy: PID 4422 died... 06:24:50.998202 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4422): Terminated: ok {rc=0} 06:24:51.043671 --- ParallelTerminationStrategy: PID 4425 died... 06:24:51.062979 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4425): Terminated: ok {rc=0} 06:24:51.108672 --- ParallelTerminationStrategy: PID 4428 died... 06:24:51.127949 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4428): Terminated: ok {rc=0} 06:24:51.213945 bus /gobi_0: Setting Powered False 06:24:52.311243 bus /gobi_0: Setting Powered False 06:24:53.425914 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3.py ---------------------------------------------- 06:24:54.566419 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:24:54.578083 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:24:54.624765 tst iperf3.py: using LAC 26468 06:24:54.741032 tst iperf3.py: using RAC 203 06:24:54.856555 tst iperf3.py: using CellId 26468 06:24:54.979806 tst iperf3.py: using BVCI 26469 06:24:55.095387 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:24:55.106843 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:24:55.117996 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:24:55.129224 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:24:55.140282 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:24:55.151477 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:24:55.162772 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:24:55.173878 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:24:55.185159 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:24:55.299313 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 06:24:55.493655 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:24:55.786035 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4430): Launched 06:24:56.039407 run iperf3-srv_10.42.42.10(pid=4431): Launched 06:24:56.149187 tst iperf3.py:8: start network... 06:24:56.342932 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:24:56.792886 run create_hlr_db(pid=4432): Launched 06:24:56.906159 bus /gobi_6: Setting Powered False 06:24:57.964806 run create_hlr_db(pid=4432): Terminated: ok {rc=0} 06:24:58.391425 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4434): Launched 06:24:58.702120 run osmo-hlr_10.42.42.2(pid=4435): Launched 06:24:58.820814 run osmo-stp_10.42.42.5: Starting osmo-stp 06:24:59.356332 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4437): Launched 06:24:59.667362 run osmo-stp_10.42.42.5(pid=4438): Launched 06:24:59.785875 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:25:00.322673 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4440): Launched 06:25:00.442147 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:25:00.704880 run patchelf(pid=4441): Launched 06:25:00.880128 run osmo-stp_10.42.42.5(pid=4438): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4438)] 06:25:01.020140 run osmo-stp_10.42.42.5(pid=4438): stdout: | (launched: 2022-12-10_06:24:59.610251) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:25:01.156162 run osmo-stp_10.42.42.5(pid=4438): stderr: | 20221210062459800 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062459800 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062459800 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062459801 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062459801 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062459801 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062459801 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:25:01.292192 run osmo-stp_10.42.42.5(pid=4438): stdout: | (launched: 2022-12-10_06:24:59.610251) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:25:01.422542 run osmo-stp_10.42.42.5(pid=4438): stderr: | 20221210062459800 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062459800 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062459800 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062459801 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062459801 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062459801 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062459801 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:25:01.576416 run patchelf(pid=4441): Terminating (SIGINT) 06:25:01.778636 run patchelf(pid=4441): Terminated: ok {rc=0} 06:25:01.910448 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4438): Process ended prematurely: osmo-stp_10.42.42.5(pid=4438) [trial-2370↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4438)] [trial-2370↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8] 06:25:01.921233 tst iperf3.py:8: Test FAILED (7.4 sec) 06:25:01.950699 run osmo-hlr_10.42.42.2(pid=4435): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4435)] 06:25:02.002939 run osmo-hlr_10.42.42.2(pid=4435): stdout: | (launched: 2022-12-10_06:24:58.645491) 06:25:02.055023 run osmo-hlr_10.42.42.2(pid=4435): stderr: | 20221210062458840 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210062458840 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210062458840 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210062458840 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210062458840 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210062458840 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210062458853 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210062458861 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210062458862 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210062458862 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:25:02.107184 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4430): Terminating (SIGTERM) 06:25:02.150660 run iperf3-srv_10.42.42.10(pid=4431): Terminating (SIGTERM) 06:25:02.195375 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4434): Terminating (SIGTERM) 06:25:02.237394 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4437): Terminating (SIGTERM) 06:25:02.278834 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4440): Terminating (SIGTERM) 06:25:02.320617 --- ParallelTerminationStrategy: PID 4430 died... 06:25:02.340374 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4430): Terminated: ok {rc=0} 06:25:02.385401 --- ParallelTerminationStrategy: PID 4431 died... 06:25:02.403373 run iperf3-srv_10.42.42.10(pid=4431): Terminated {rc=256} 06:25:02.446502 --- ParallelTerminationStrategy: PID 4434 died... 06:25:02.464795 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4434): Terminated: ok {rc=0} 06:25:02.507861 --- ParallelTerminationStrategy: PID 4437 died... 06:25:02.525966 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4437): Terminated: ok {rc=0} 06:25:02.569150 --- ParallelTerminationStrategy: PID 4440 died... 06:25:02.587201 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4440): Terminated: ok {rc=0} 06:25:02.671192 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 06:25:03.814336 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:25:03.826126 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:25:03.873568 tst iperf3m4.py: using LAC 26469 06:25:03.997928 tst iperf3m4.py: using RAC 204 06:25:04.121581 tst iperf3m4.py: using CellId 26469 06:25:04.246328 tst iperf3m4.py: using BVCI 26470 06:25:04.359543 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:25:04.371165 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:25:04.382560 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:25:04.394414 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:25:04.405682 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:25:04.416922 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:25:04.428385 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:25:04.439626 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:25:04.451168 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:25:04.569891 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:25:04.687394 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:25:04.804869 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:25:04.924732 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 06:25:05.119190 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:25:05.411218 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4445): Launched 06:25:05.664792 run iperf3-srv_10.42.42.10(pid=4446): Launched 06:25:05.774468 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 06:25:05.969075 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:25:06.261144 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4447): Launched 06:25:06.514130 run iperf3-srv_10.42.42.10(pid=4448): Launched 06:25:06.623131 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 06:25:06.817323 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:25:07.108530 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4449): Launched 06:25:07.361382 run iperf3-srv_10.42.42.10(pid=4450): Launched 06:25:07.470543 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 06:25:07.663706 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:25:07.954592 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4451): Launched 06:25:08.208573 run iperf3-srv_10.42.42.10(pid=4452): Launched 06:25:08.318050 tst iperf3m4.py:8: start network... 06:25:08.512121 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:25:08.965366 run create_hlr_db(pid=4453): Launched 06:25:09.078352 bus /gobi_6: Setting Powered False 06:25:10.136769 run create_hlr_db(pid=4453): Terminated: ok {rc=0} 06:25:10.542778 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4455): Launched 06:25:10.833844 run osmo-hlr_10.42.42.2(pid=4456): Launched 06:25:10.944399 run osmo-stp_10.42.42.5: Starting osmo-stp 06:25:11.444119 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4458): Launched 06:25:11.736405 run osmo-stp_10.42.42.5(pid=4459): Launched 06:25:11.848038 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:25:12.351382 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4461): Launched 06:25:12.463515 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:25:12.710830 run patchelf(pid=4462): Launched 06:25:12.874766 run osmo-stp_10.42.42.5(pid=4459): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4459)] 06:25:12.999029 run osmo-stp_10.42.42.5(pid=4459): stdout: | (launched: 2022-12-10_06:25:11.682561) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:25:13.124654 run osmo-stp_10.42.42.5(pid=4459): stderr: | 20221210062511850 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062511850 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062511850 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062511851 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062511853 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062511853 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062511853 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:25:13.250264 run osmo-stp_10.42.42.5(pid=4459): stdout: | (launched: 2022-12-10_06:25:11.682561) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:25:13.370358 run osmo-stp_10.42.42.5(pid=4459): stderr: | 20221210062511850 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062511850 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062511850 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062511851 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062511853 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062511853 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062511853 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:25:13.512273 run patchelf(pid=4462): Terminating (SIGINT) 06:25:13.676273 run patchelf(pid=4462): Terminated: ok {rc=0} 06:25:13.794617 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4459): Process ended prematurely: osmo-stp_10.42.42.5(pid=4459) [trial-2370↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4459)] [trial-2370↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8] 06:25:13.804311 tst iperf3m4.py:8: Test FAILED (10.0 sec) 06:25:13.831873 run osmo-hlr_10.42.42.2(pid=4456): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4456)] 06:25:13.878981 run osmo-hlr_10.42.42.2(pid=4456): stdout: | (launched: 2022-12-10_06:25:10.780430) 06:25:13.928007 run osmo-hlr_10.42.42.2(pid=4456): stderr: | 20221210062510954 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210062510954 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210062510954 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210062510954 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210062510954 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210062510954 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210062510971 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210062510981 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210062510981 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210062510981 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:25:13.977271 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4445): Terminating (SIGTERM) 06:25:14.016617 run iperf3-srv_10.42.42.10(pid=4446): Terminating (SIGTERM) 06:25:14.055765 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4447): Terminating (SIGTERM) 06:25:14.094900 run iperf3-srv_10.42.42.10(pid=4448): Terminating (SIGTERM) 06:25:14.133817 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4449): Terminating (SIGTERM) 06:25:14.173047 run iperf3-srv_10.42.42.10(pid=4450): Terminating (SIGTERM) 06:25:14.211959 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4451): Terminating (SIGTERM) 06:25:14.251334 run iperf3-srv_10.42.42.10(pid=4452): Terminating (SIGTERM) 06:25:14.290385 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4455): Terminating (SIGTERM) 06:25:14.329453 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4458): Terminating (SIGTERM) 06:25:14.368737 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4461): Terminating (SIGTERM) 06:25:14.408268 --- ParallelTerminationStrategy: PID 4445 died... 06:25:14.427086 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4445): Terminated: ok {rc=0} 06:25:14.470988 --- ParallelTerminationStrategy: PID 4446 died... 06:25:14.489326 run iperf3-srv_10.42.42.10(pid=4446): Terminated {rc=256} 06:25:14.532505 --- ParallelTerminationStrategy: PID 4447 died... 06:25:14.550673 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4447): Terminated: ok {rc=0} 06:25:14.594037 --- ParallelTerminationStrategy: PID 4448 died... 06:25:14.612044 run iperf3-srv_10.42.42.10(pid=4448): Terminated {rc=256} 06:25:14.655508 --- ParallelTerminationStrategy: PID 4449 died... 06:25:14.673720 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4449): Terminated: ok {rc=0} 06:25:14.717081 --- ParallelTerminationStrategy: PID 4450 died... 06:25:14.735105 run iperf3-srv_10.42.42.10(pid=4450): Terminated {rc=256} 06:25:14.778102 --- ParallelTerminationStrategy: PID 4451 died... 06:25:14.796339 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4451): Terminated: ok {rc=0} 06:25:14.839689 --- ParallelTerminationStrategy: PID 4452 died... 06:25:14.857919 run iperf3-srv_10.42.42.10(pid=4452): Terminated {rc=256} 06:25:14.901542 --- ParallelTerminationStrategy: PID 4455 died... 06:25:14.919645 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4455): Terminated: ok {rc=0} 06:25:14.963223 --- ParallelTerminationStrategy: PID 4458 died... 06:25:14.981358 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4458): Terminated: ok {rc=0} 06:25:15.025349 --- ParallelTerminationStrategy: PID 4461 died... 06:25:15.043688 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4461): Terminated: ok {rc=0} 06:25:15.129127 bus /gobi_4: Setting Powered False 06:25:16.238263 bus /gobi_4: Setting Powered False 06:25:17.363256 bus /gobi_1: Setting Powered False 06:25:18.461449 bus /gobi_1: Setting Powered False 06:25:19.579025 bus /gobi_0: Setting Powered False 06:25:20.677274 bus /gobi_0: Setting Powered False 06:25:21.792902 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping.py ---------------------------------------------- 06:25:22.896265 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:25:22.907890 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:25:22.953449 tst ping.py: using LAC 26470 06:25:23.075886 tst ping.py: using RAC 205 06:25:23.198534 tst ping.py: using CellId 26470 06:25:23.319071 tst ping.py: using BVCI 26471 06:25:23.431285 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:25:23.442836 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:25:23.454256 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:25:23.466108 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:25:23.477856 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:25:23.489442 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:25:23.501230 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:25:23.512665 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:25:23.627552 tst ping.py:19: start network... 06:25:23.834608 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:25:24.309478 run create_hlr_db(pid=4463): Launched 06:25:24.434942 bus /gobi_6: Setting Powered False 06:25:25.495639 run create_hlr_db(pid=4463): Terminated: ok {rc=0} 06:25:25.907659 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4465): Launched 06:25:26.193856 run osmo-hlr_10.42.42.2(pid=4466): Launched 06:25:26.302712 run osmo-stp_10.42.42.5: Starting osmo-stp 06:25:26.808690 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4468): Launched 06:25:27.094614 run osmo-stp_10.42.42.5(pid=4469): Launched 06:25:27.203249 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:25:27.697574 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4471): Launched 06:25:27.807284 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:25:28.048775 run patchelf(pid=4472): Launched 06:25:28.209218 run osmo-stp_10.42.42.5(pid=4469): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4469)] 06:25:28.331624 run osmo-stp_10.42.42.5(pid=4469): stdout: | (launched: 2022-12-10_06:25:27.042096) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:25:28.455657 run osmo-stp_10.42.42.5(pid=4469): stderr: | 20221210062527208 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062527208 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062527209 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062527209 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062527210 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062527210 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062527210 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:25:28.579438 run osmo-stp_10.42.42.5(pid=4469): stdout: | (launched: 2022-12-10_06:25:27.042096) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:25:28.697223 run osmo-stp_10.42.42.5(pid=4469): stderr: | 20221210062527208 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062527208 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062527209 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062527209 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062527210 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062527210 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062527210 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:25:28.836592 run patchelf(pid=4472): Terminating (SIGINT) 06:25:28.997858 run patchelf(pid=4472): Terminated: ok {rc=0} 06:25:29.114218 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=4469): Process ended prematurely: osmo-stp_10.42.42.5(pid=4469) [trial-2370↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4469)] [trial-2370↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22] 06:25:29.123053 tst ping.py:22: Test FAILED (6.2 sec) 06:25:29.149832 run osmo-hlr_10.42.42.2(pid=4466): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4466)] 06:25:29.197421 run osmo-hlr_10.42.42.2(pid=4466): stdout: | (launched: 2022-12-10_06:25:26.141207) 06:25:29.246388 run osmo-hlr_10.42.42.2(pid=4466): stderr: | 20221210062526317 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210062526317 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210062526317 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210062526317 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210062526317 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210062526317 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210062526329 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210062526337 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210062526337 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210062526337 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:25:29.295978 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4465): Terminating (SIGTERM) 06:25:29.335193 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4468): Terminating (SIGTERM) 06:25:29.374424 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4471): Terminating (SIGTERM) 06:25:29.413792 --- ParallelTerminationStrategy: PID 4465 died... 06:25:29.432420 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4465): Terminated: ok {rc=0} 06:25:29.476584 --- ParallelTerminationStrategy: PID 4468 died... 06:25:29.494768 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4468): Terminated: ok {rc=0} 06:25:29.538904 --- ParallelTerminationStrategy: PID 4471 died... 06:25:29.557446 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4471): Terminated: ok {rc=0} 06:25:29.639890 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 06:25:30.725494 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:25:30.738153 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:25:30.788789 tst ping_idle_ping.py: using LAC 26471 06:25:30.926788 tst ping_idle_ping.py: using RAC 206 06:25:31.067683 tst ping_idle_ping.py: using CellId 26471 06:25:31.190124 tst ping_idle_ping.py: using BVCI 26472 06:25:31.334847 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:25:31.349787 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:25:31.365657 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:25:31.379024 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:25:31.390941 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:25:31.403237 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:25:31.415827 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:25:31.427651 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:25:31.571800 tst ping_idle_ping.py:24: start network... 06:25:31.767543 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:25:32.229269 run create_hlr_db(pid=4473): Launched 06:25:32.372768 bus /gobi_6: Setting Powered False 06:25:33.430911 run create_hlr_db(pid=4473): Terminated: ok {rc=0} 06:25:33.861881 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4475): Launched 06:25:34.169745 run osmo-hlr_10.42.42.2(pid=4476): Launched 06:25:34.286734 run osmo-stp_10.42.42.5: Starting osmo-stp 06:25:34.817124 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4478): Launched 06:25:35.124265 run osmo-stp_10.42.42.5(pid=4479): Launched 06:25:35.240781 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:25:35.769829 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4481): Launched 06:25:35.887195 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:25:36.146325 run patchelf(pid=4482): Launched 06:25:36.317784 run osmo-stp_10.42.42.5(pid=4479): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4479)] 06:25:36.449307 run osmo-stp_10.42.42.5(pid=4479): stdout: | (launched: 2022-12-10_06:25:35.068192) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:25:36.581993 run osmo-stp_10.42.42.5(pid=4479): stderr: | 20221210062535259 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062535259 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062535259 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062535260 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062535260 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062535260 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062535260 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:25:36.714502 run osmo-stp_10.42.42.5(pid=4479): stdout: | (launched: 2022-12-10_06:25:35.068192) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:25:36.840514 run osmo-stp_10.42.42.5(pid=4479): stderr: | 20221210062535259 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062535259 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062535259 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062535260 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062535260 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062535260 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062535260 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:25:36.990383 run patchelf(pid=4482): Terminating (SIGINT) 06:25:37.163343 run patchelf(pid=4482): Terminated: ok {rc=0} 06:25:37.287210 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=4479): Process ended prematurely: osmo-stp_10.42.42.5(pid=4479) [trial-2370↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4479)] [trial-2370↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27] 06:25:37.296712 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 06:25:37.324421 run osmo-hlr_10.42.42.2(pid=4476): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4476)] 06:25:37.373486 run osmo-hlr_10.42.42.2(pid=4476): stdout: | (launched: 2022-12-10_06:25:34.113872) 06:25:37.424369 run osmo-hlr_10.42.42.2(pid=4476): stderr: | 20221210062534309 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210062534309 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210062534309 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210062534309 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210062534309 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210062534309 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210062534322 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210062534332 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210062534333 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210062534333 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:25:37.475575 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4475): Terminating (SIGTERM) 06:25:37.516847 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4478): Terminating (SIGTERM) 06:25:37.558080 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4481): Terminating (SIGTERM) 06:25:37.599589 --- ParallelTerminationStrategy: PID 4475 died... 06:25:37.619285 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4475): Terminated: ok {rc=0} 06:25:37.664739 --- ParallelTerminationStrategy: PID 4478 died... 06:25:37.684063 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4478): Terminated: ok {rc=0} 06:25:37.729384 --- ParallelTerminationStrategy: PID 4481 died... 06:25:37.748493 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4481): Terminated: ok {rc=0} 06:25:37.835067 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2370 gprs:trx-lms-limenet-micro+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa --------------------------------------------------------------------- 06:25:39.132729 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:25:39.138727 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 06:25:39.168553 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 06:25:39.206475 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 06:25:39.291387 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 06:25:39.320252 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 06:25:39.358423 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 06:25:39.953553 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2370 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 06:25:40.001232 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:25:40.012084 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:25:40.077306 tst cs_paging_gprs_active.py: using LAC 26472 06:25:40.191910 tst cs_paging_gprs_active.py: using RAC 207 06:25:40.306646 tst cs_paging_gprs_active.py: using CellId 26472 06:25:40.421352 tst cs_paging_gprs_active.py: using BVCI 26473 06:25:40.528410 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:25:40.539558 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:25:40.550422 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:25:40.561616 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:25:40.572620 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:25:40.583624 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:25:40.594768 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:25:40.605724 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:25:40.616699 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:25:40.733879 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:25:40.847892 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 06:25:41.042830 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:25:41.336006 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4486): Launched 06:25:41.591511 run iperf3-srv_10.42.42.10(pid=4487): Launched 06:25:41.701745 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 06:25:41.921512 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:25:42.214474 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4488): Launched 06:25:42.469896 run iperf3-srv_10.42.42.10(pid=4489): Launched 06:25:42.579355 tst cs_paging_gprs_active.py:38: start network... 06:25:42.773252 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:25:43.224639 run create_hlr_db(pid=4490): Launched 06:25:43.336567 bus /gobi_6: Setting Powered False 06:25:44.394957 run create_hlr_db(pid=4490): Terminated: ok {rc=0} 06:25:44.823955 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4492): Launched 06:25:45.137581 run osmo-hlr_10.42.42.2(pid=4493): Launched 06:25:45.257444 run osmo-stp_10.42.42.5: Starting osmo-stp 06:25:45.794916 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4495): Launched 06:25:46.129770 run osmo-stp_10.42.42.5(pid=4496): Launched 06:25:46.356792 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:25:47.005682 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4498): Launched 06:25:47.151180 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:25:47.419677 run patchelf(pid=4499): Launched 06:25:47.594562 run osmo-stp_10.42.42.5(pid=4496): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4496)] 06:25:47.727344 run osmo-stp_10.42.42.5(pid=4496): stdout: | (launched: 2022-12-10_06:25:46.066319) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:25:47.861842 run osmo-stp_10.42.42.5(pid=4496): stderr: | 20221210062546383 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062546383 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062546383 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062546383 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062546384 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062546384 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062546384 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:25:47.995776 run osmo-stp_10.42.42.5(pid=4496): stdout: | (launched: 2022-12-10_06:25:46.066319) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:25:48.125130 run osmo-stp_10.42.42.5(pid=4496): stderr: | 20221210062546383 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062546383 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062546383 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062546383 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062546384 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062546384 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062546384 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:25:48.277698 run patchelf(pid=4499): Terminating (SIGINT) 06:25:48.453149 run patchelf(pid=4499): Terminated: ok {rc=0} 06:25:48.580874 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=4496): Process ended prematurely: osmo-stp_10.42.42.5(pid=4496) [trial-2370↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4496)] [trial-2370↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 06:25:48.591058 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 06:25:48.619168 run osmo-hlr_10.42.42.2(pid=4493): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4493)] 06:25:48.668038 run osmo-hlr_10.42.42.2(pid=4493): stdout: | (launched: 2022-12-10_06:25:45.080541) 06:25:48.718808 run osmo-hlr_10.42.42.2(pid=4493): stderr: | 20221210062545275 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210062545275 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210062545275 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210062545275 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210062545275 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210062545275 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210062545288 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210062545296 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210062545296 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210062545296 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:25:48.769847 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4486): Terminating (SIGTERM) 06:25:48.810550 run iperf3-srv_10.42.42.10(pid=4487): Terminating (SIGTERM) 06:25:48.851396 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4488): Terminating (SIGTERM) 06:25:48.892257 run iperf3-srv_10.42.42.10(pid=4489): Terminating (SIGTERM) 06:25:48.933046 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4492): Terminating (SIGTERM) 06:25:48.974144 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4495): Terminating (SIGTERM) 06:25:49.015310 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4498): Terminating (SIGTERM) 06:25:49.056398 --- ParallelTerminationStrategy: PID 4486 died... 06:25:49.076125 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4486): Terminated: ok {rc=0} 06:25:49.121566 --- ParallelTerminationStrategy: PID 4487 died... 06:25:49.140564 run iperf3-srv_10.42.42.10(pid=4487): Terminated {rc=256} 06:25:49.185606 --- ParallelTerminationStrategy: PID 4488 died... 06:25:49.204659 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4488): Terminated: ok {rc=0} 06:25:49.249802 --- ParallelTerminationStrategy: PID 4489 died... 06:25:49.268917 run iperf3-srv_10.42.42.10(pid=4489): Terminated {rc=256} 06:25:49.314089 --- ParallelTerminationStrategy: PID 4492 died... 06:25:49.333333 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4492): Terminated: ok {rc=0} 06:25:49.378675 --- ParallelTerminationStrategy: PID 4495 died... 06:25:49.397832 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4495): Terminated: ok {rc=0} 06:25:49.443026 --- ParallelTerminationStrategy: PID 4498 died... 06:25:49.462226 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4498): Terminated: ok {rc=0} 06:25:49.548098 bus /gobi_0: Setting Powered False 06:25:50.644225 bus /gobi_0: Setting Powered False 06:25:51.758428 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 06:25:52.900221 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:25:52.912046 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:25:52.982563 tst iperf3.py: using LAC 26473 06:25:53.106254 tst iperf3.py: using RAC 208 06:25:53.230199 tst iperf3.py: using CellId 26473 06:25:53.353168 tst iperf3.py: using BVCI 26474 06:25:53.466190 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:25:53.477758 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:25:53.489037 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:25:53.500317 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:25:53.511627 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:25:53.522984 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:25:53.534378 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:25:53.545637 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:25:53.557020 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:25:53.671716 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 06:25:53.868215 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:25:54.162031 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4500): Launched 06:25:54.417251 run iperf3-srv_10.42.42.10(pid=4501): Launched 06:25:54.528072 tst iperf3.py:8: start network... 06:25:54.723893 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:25:55.206763 run create_hlr_db(pid=4502): Launched 06:25:55.334189 bus /gobi_6: Setting Powered False 06:25:56.395031 run create_hlr_db(pid=4502): Terminated: ok {rc=0} 06:25:56.829926 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4504): Launched 06:25:57.142497 run osmo-hlr_10.42.42.2(pid=4505): Launched 06:25:57.260699 run osmo-stp_10.42.42.5: Starting osmo-stp 06:25:57.807075 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4507): Launched 06:25:58.119031 run osmo-stp_10.42.42.5(pid=4508): Launched 06:25:58.237648 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:25:58.774387 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4510): Launched 06:25:58.894507 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:25:59.158609 run patchelf(pid=4511): Launched 06:25:59.332017 run osmo-stp_10.42.42.5(pid=4508): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4508)] 06:25:59.464154 run osmo-stp_10.42.42.5(pid=4508): stdout: | (launched: 2022-12-10_06:25:58.062155) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:25:59.597987 run osmo-stp_10.42.42.5(pid=4508): stderr: | 20221210062558251 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062558252 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062558252 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062558252 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062558253 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062558253 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062558253 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:25:59.731678 run osmo-stp_10.42.42.5(pid=4508): stdout: | (launched: 2022-12-10_06:25:58.062155) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:25:59.859532 run osmo-stp_10.42.42.5(pid=4508): stderr: | 20221210062558251 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062558252 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062558252 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062558252 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062558253 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062558253 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062558253 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:26:00.010780 run patchelf(pid=4511): Terminating (SIGINT) 06:26:00.184914 run patchelf(pid=4511): Terminated: ok {rc=0} 06:26:00.310553 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4508): Process ended prematurely: osmo-stp_10.42.42.5(pid=4508) [trial-2370↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4508)] [trial-2370↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8] 06:26:00.320462 tst iperf3.py:8: Test FAILED (7.5 sec) 06:26:00.348390 run osmo-hlr_10.42.42.2(pid=4505): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4505)] 06:26:00.397131 run osmo-hlr_10.42.42.2(pid=4505): stdout: | (launched: 2022-12-10_06:25:57.085607) 06:26:00.447782 run osmo-hlr_10.42.42.2(pid=4505): stderr: | 20221210062557281 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210062557281 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210062557281 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210062557281 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210062557281 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210062557281 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210062557294 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210062557302 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210062557302 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210062557302 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:26:00.499129 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4500): Terminating (SIGTERM) 06:26:00.540057 run iperf3-srv_10.42.42.10(pid=4501): Terminating (SIGTERM) 06:26:00.582411 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4504): Terminating (SIGTERM) 06:26:00.624099 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4507): Terminating (SIGTERM) 06:26:00.664930 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4510): Terminating (SIGTERM) 06:26:00.706450 --- ParallelTerminationStrategy: PID 4500 died... 06:26:00.725940 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4500): Terminated: ok {rc=0} 06:26:00.773235 --- ParallelTerminationStrategy: PID 4501 died... 06:26:00.792075 run iperf3-srv_10.42.42.10(pid=4501): Terminated {rc=256} 06:26:00.837140 --- ParallelTerminationStrategy: PID 4504 died... 06:26:00.856503 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4504): Terminated: ok {rc=0} 06:26:00.910239 --- ParallelTerminationStrategy: PID 4507 died... 06:26:00.930252 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4507): Terminated: ok {rc=0} 06:26:00.977411 --- ParallelTerminationStrategy: PID 4510 died... 06:26:00.997222 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4510): Terminated: ok {rc=0} 06:26:01.104727 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 06:26:02.266409 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:26:02.278918 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:26:02.347930 tst iperf3m4.py: using LAC 26474 06:26:02.471477 tst iperf3m4.py: using RAC 209 06:26:02.593587 tst iperf3m4.py: using CellId 26474 06:26:02.711942 tst iperf3m4.py: using BVCI 26475 06:26:02.818890 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:26:02.830022 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:26:02.840893 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:26:02.852633 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:26:02.864264 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:26:02.875796 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:26:02.887496 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:26:02.899117 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:26:02.910823 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:26:03.030778 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:26:03.150777 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:26:03.265869 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:26:03.381189 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 06:26:03.577709 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:26:03.871536 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4513): Launched 06:26:04.127415 run iperf3-srv_10.42.42.10(pid=4514): Launched 06:26:04.238643 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 06:26:04.433995 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:26:04.728153 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4515): Launched 06:26:04.983843 run iperf3-srv_10.42.42.10(pid=4516): Launched 06:26:05.094248 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 06:26:05.290013 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:26:05.584526 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4517): Launched 06:26:05.839906 run iperf3-srv_10.42.42.10(pid=4518): Launched 06:26:05.949794 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 06:26:06.145447 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:26:06.439429 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4519): Launched 06:26:06.695074 run iperf3-srv_10.42.42.10(pid=4520): Launched 06:26:06.805161 tst iperf3m4.py:8: start network... 06:26:07.000423 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:26:07.454076 run create_hlr_db(pid=4521): Launched 06:26:07.567170 bus /gobi_6: Setting Powered False 06:26:08.625389 run create_hlr_db(pid=4521): Terminated: ok {rc=0} 06:26:09.054604 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4523): Launched 06:26:09.369094 run osmo-hlr_10.42.42.2(pid=4524): Launched 06:26:09.488752 run osmo-stp_10.42.42.5: Starting osmo-stp 06:26:10.030179 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4526): Launched 06:26:10.343091 run osmo-stp_10.42.42.5(pid=4527): Launched 06:26:10.462203 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:26:11.002034 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4529): Launched 06:26:11.122614 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:26:11.386501 run patchelf(pid=4530): Launched 06:26:11.560609 run osmo-stp_10.42.42.5(pid=4527): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4527)] 06:26:11.693589 run osmo-stp_10.42.42.5(pid=4527): stdout: | (launched: 2022-12-10_06:26:10.286040) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:26:11.827676 run osmo-stp_10.42.42.5(pid=4527): stderr: | 20221210062610477 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062610477 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062610478 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062610478 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062610479 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062610479 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062610479 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:26:11.962068 run osmo-stp_10.42.42.5(pid=4527): stdout: | (launched: 2022-12-10_06:26:10.286040) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:26:12.091576 run osmo-stp_10.42.42.5(pid=4527): stderr: | 20221210062610477 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062610477 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062610478 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062610478 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062610479 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062610479 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062610479 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:26:12.243996 run patchelf(pid=4530): Terminating (SIGINT) 06:26:12.419573 run patchelf(pid=4530): Terminated: ok {rc=0} 06:26:12.546157 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4527): Process ended prematurely: osmo-stp_10.42.42.5(pid=4527) [trial-2370↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4527)] [trial-2370↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8] 06:26:12.556592 tst iperf3m4.py:8: Test FAILED (10.3 sec) 06:26:12.586222 run osmo-hlr_10.42.42.2(pid=4524): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4524)] 06:26:12.635965 run osmo-hlr_10.42.42.2(pid=4524): stdout: | (launched: 2022-12-10_06:26:09.311904) 06:26:12.687698 run osmo-hlr_10.42.42.2(pid=4524): stderr: | 20221210062609508 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210062609508 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210062609508 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210062609508 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210062609508 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210062609509 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210062609565 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210062609574 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210062609574 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210062609574 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:26:12.739435 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4513): Terminating (SIGTERM) 06:26:12.780731 run iperf3-srv_10.42.42.10(pid=4514): Terminating (SIGTERM) 06:26:12.822047 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4515): Terminating (SIGTERM) 06:26:12.863354 run iperf3-srv_10.42.42.10(pid=4516): Terminating (SIGTERM) 06:26:12.904465 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4517): Terminating (SIGTERM) 06:26:12.945667 run iperf3-srv_10.42.42.10(pid=4518): Terminating (SIGTERM) 06:26:12.986797 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4519): Terminating (SIGTERM) 06:26:13.028404 run iperf3-srv_10.42.42.10(pid=4520): Terminating (SIGTERM) 06:26:13.070599 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4523): Terminating (SIGTERM) 06:26:13.113623 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4526): Terminating (SIGTERM) 06:26:13.152856 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4529): Terminating (SIGTERM) 06:26:13.192235 --- ParallelTerminationStrategy: PID 4513 died... 06:26:13.211002 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4513): Terminated: ok {rc=0} 06:26:13.255038 --- ParallelTerminationStrategy: PID 4514 died... 06:26:13.273553 run iperf3-srv_10.42.42.10(pid=4514): Terminated {rc=256} 06:26:13.317079 --- ParallelTerminationStrategy: PID 4515 died... 06:26:13.335456 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4515): Terminated: ok {rc=0} 06:26:13.379172 --- ParallelTerminationStrategy: PID 4516 died... 06:26:13.397513 run iperf3-srv_10.42.42.10(pid=4516): Terminated {rc=256} 06:26:13.440870 --- ParallelTerminationStrategy: PID 4517 died... 06:26:13.459587 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4517): Terminated: ok {rc=0} 06:26:13.503329 --- ParallelTerminationStrategy: PID 4518 died... 06:26:13.521761 run iperf3-srv_10.42.42.10(pid=4518): Terminated {rc=256} 06:26:13.565244 --- ParallelTerminationStrategy: PID 4519 died... 06:26:13.583654 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4519): Terminated: ok {rc=0} 06:26:13.627572 --- ParallelTerminationStrategy: PID 4520 died... 06:26:13.646165 run iperf3-srv_10.42.42.10(pid=4520): Terminated {rc=256} 06:26:13.689766 --- ParallelTerminationStrategy: PID 4523 died... 06:26:13.708197 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4523): Terminated: ok {rc=0} 06:26:13.752004 --- ParallelTerminationStrategy: PID 4526 died... 06:26:13.770555 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4526): Terminated: ok {rc=0} 06:26:13.814378 --- ParallelTerminationStrategy: PID 4529 died... 06:26:13.832674 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4529): Terminated: ok {rc=0} 06:26:13.918288 bus /gobi_4: Setting Powered False 06:26:15.015772 bus /gobi_4: Setting Powered False 06:26:16.143974 bus /gobi_1: Setting Powered False 06:26:17.262855 bus /gobi_1: Setting Powered False 06:26:18.378376 bus /gobi_0: Setting Powered False 06:26:19.475939 bus /gobi_0: Setting Powered False 06:26:20.591742 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 06:26:21.694466 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:26:21.706759 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:26:21.775545 tst ping.py: using LAC 26475 06:26:21.895695 tst ping.py: using RAC 210 06:26:22.017125 tst ping.py: using CellId 26475 06:26:22.141623 tst ping.py: using BVCI 26476 06:26:22.253978 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:26:22.265748 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:26:22.277112 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:26:22.288586 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:26:22.299932 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:26:22.311308 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:26:22.322871 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:26:22.334398 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:26:22.450796 tst ping.py:19: start network... 06:26:22.657123 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:26:23.132406 run create_hlr_db(pid=4531): Launched 06:26:23.257803 bus /gobi_6: Setting Powered False 06:26:24.319840 run create_hlr_db(pid=4531): Terminated: ok {rc=0} 06:26:24.749529 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4533): Launched 06:26:25.057118 run osmo-hlr_10.42.42.2(pid=4534): Launched 06:26:25.174261 run osmo-stp_10.42.42.5: Starting osmo-stp 06:26:25.707973 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4536): Launched 06:26:26.014408 run osmo-stp_10.42.42.5(pid=4537): Launched 06:26:26.131423 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:26:26.659716 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4539): Launched 06:26:26.777455 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:26:27.037474 run patchelf(pid=4540): Launched 06:26:27.208835 run osmo-stp_10.42.42.5(pid=4537): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4537)] 06:26:27.339648 run osmo-stp_10.42.42.5(pid=4537): stdout: | (launched: 2022-12-10_06:26:25.958567) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:26:27.471715 run osmo-stp_10.42.42.5(pid=4537): stderr: | 20221210062626147 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062626148 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062626148 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062626148 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062626149 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062626149 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062626149 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:26:27.604348 run osmo-stp_10.42.42.5(pid=4537): stdout: | (launched: 2022-12-10_06:26:25.958567) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:26:27.730430 run osmo-stp_10.42.42.5(pid=4537): stderr: | 20221210062626147 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062626148 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062626148 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062626148 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062626149 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062626149 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062626149 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:26:27.879641 run patchelf(pid=4540): Terminating (SIGINT) 06:26:28.051655 run patchelf(pid=4540): Terminated: ok {rc=0} 06:26:28.176005 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=4537): Process ended prematurely: osmo-stp_10.42.42.5(pid=4537) [trial-2370↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4537)] [trial-2370↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22] 06:26:28.185469 tst ping.py:22: Test FAILED (6.5 sec) 06:26:28.213300 run osmo-hlr_10.42.42.2(pid=4534): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4534)] 06:26:28.262434 run osmo-hlr_10.42.42.2(pid=4534): stdout: | (launched: 2022-12-10_06:26:25.000448) 06:26:28.313436 run osmo-hlr_10.42.42.2(pid=4534): stderr: | 20221210062625198 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210062625198 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210062625198 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210062625198 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210062625198 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210062625198 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210062625212 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210062625221 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210062625221 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210062625221 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:26:28.365473 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4533): Terminating (SIGTERM) 06:26:28.406526 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4536): Terminating (SIGTERM) 06:26:28.447626 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4539): Terminating (SIGTERM) 06:26:28.489006 --- ParallelTerminationStrategy: PID 4533 died... 06:26:28.508481 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4533): Terminated: ok {rc=0} 06:26:28.553838 --- ParallelTerminationStrategy: PID 4536 died... 06:26:28.573376 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4536): Terminated: ok {rc=0} 06:26:28.618890 --- ParallelTerminationStrategy: PID 4539 died... 06:26:28.638211 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4539): Terminated: ok {rc=0} 06:26:28.725719 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 06:26:29.812327 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:26:29.825090 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:26:29.893852 tst ping_idle_ping.py: using LAC 26476 06:26:30.016306 tst ping_idle_ping.py: using RAC 211 06:26:30.138709 tst ping_idle_ping.py: using CellId 26476 06:26:30.260030 tst ping_idle_ping.py: using BVCI 26477 06:26:30.375129 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:26:30.386502 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:26:30.397733 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:26:30.409116 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:26:30.420381 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:26:30.431792 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:26:30.443186 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:26:30.454530 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:26:30.567996 tst ping_idle_ping.py:24: start network... 06:26:30.758466 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:26:31.242669 run create_hlr_db(pid=4541): Launched 06:26:31.368013 bus /gobi_6: Setting Powered False 06:26:32.426209 run create_hlr_db(pid=4541): Terminated: ok {rc=0} 06:26:32.846550 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4543): Launched 06:26:33.155012 run osmo-hlr_10.42.42.2(pid=4544): Launched 06:26:33.272635 run osmo-stp_10.42.42.5: Starting osmo-stp 06:26:33.800688 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4546): Launched 06:26:34.108609 run osmo-stp_10.42.42.5(pid=4547): Launched 06:26:34.225904 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:26:34.756208 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4549): Launched 06:26:34.875136 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:26:35.136556 run patchelf(pid=4550): Launched 06:26:35.308622 run osmo-stp_10.42.42.5(pid=4547): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4547)] 06:26:35.439820 run osmo-stp_10.42.42.5(pid=4547): stdout: | (launched: 2022-12-10_06:26:34.052512) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:26:35.572785 run osmo-stp_10.42.42.5(pid=4547): stderr: | 20221210062634243 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062634244 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062634244 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062634244 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062634245 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062634245 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062634245 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:26:35.705639 run osmo-stp_10.42.42.5(pid=4547): stdout: | (launched: 2022-12-10_06:26:34.052512) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:26:35.832004 run osmo-stp_10.42.42.5(pid=4547): stderr: | 20221210062634243 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062634244 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062634244 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062634244 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062634245 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062634245 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062634245 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:26:35.981879 run patchelf(pid=4550): Terminating (SIGINT) 06:26:36.155120 run patchelf(pid=4550): Terminated: ok {rc=0} 06:26:36.279828 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=4547): Process ended prematurely: osmo-stp_10.42.42.5(pid=4547) [trial-2370↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4547)] [trial-2370↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 06:26:36.289320 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 06:26:36.317142 run osmo-hlr_10.42.42.2(pid=4544): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4544)] 06:26:36.366152 run osmo-hlr_10.42.42.2(pid=4544): stdout: | (launched: 2022-12-10_06:26:33.098769) 06:26:36.416920 run osmo-hlr_10.42.42.2(pid=4544): stderr: | 20221210062633296 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210062633296 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210062633296 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210062633296 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210062633296 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210062633296 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210062633355 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210062633365 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210062633366 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210062633366 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:26:36.468451 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4543): Terminating (SIGTERM) 06:26:36.509796 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4546): Terminating (SIGTERM) 06:26:36.551251 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4549): Terminating (SIGTERM) 06:26:36.592821 --- ParallelTerminationStrategy: PID 4543 died... 06:26:36.612533 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4543): Terminated: ok {rc=0} 06:26:36.658141 --- ParallelTerminationStrategy: PID 4546 died... 06:26:36.677337 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4546): Terminated: ok {rc=0} 06:26:36.722872 --- ParallelTerminationStrategy: PID 4549 died... 06:26:36.742301 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4549): Terminated: ok {rc=0} 06:26:36.829181 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2370 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 06:26:38.131161 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:26:38.138038 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 06:26:38.168304 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 06:26:38.207338 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 06:26:38.295011 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 06:26:38.324790 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 06:26:38.364083 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 06:26:38.960629 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2370 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 06:26:39.011577 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:26:39.023176 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 06:26:39.091211 tst cs_paging_gprs_active.py: using LAC 26477 06:26:39.214050 tst cs_paging_gprs_active.py: using RAC 212 06:26:39.338730 tst cs_paging_gprs_active.py: using CellId 26477 06:26:39.461468 tst cs_paging_gprs_active.py: using BVCI 26478 06:26:39.575039 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:26:39.586494 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:26:39.597808 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:26:39.609331 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:26:39.620673 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:26:39.632122 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:26:39.643610 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:26:39.655154 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:26:39.666802 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:26:39.782098 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:26:39.894942 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 06:26:40.091104 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:26:40.384927 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4555): Launched 06:26:40.641527 run iperf3-srv_10.42.42.10(pid=4556): Launched 06:26:40.751865 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 06:26:40.947630 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:26:41.242215 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4557): Launched 06:26:41.498185 run iperf3-srv_10.42.42.10(pid=4558): Launched 06:26:41.609079 tst cs_paging_gprs_active.py:38: start network... 06:26:41.804880 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:26:42.258612 run create_hlr_db(pid=4559): Launched 06:26:42.372396 bus /gobi_6: Setting Powered False 06:26:43.434825 run create_hlr_db(pid=4559): Terminated: ok {rc=0} 06:26:43.871871 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4561): Launched 06:26:44.185679 run osmo-hlr_10.42.42.2(pid=4562): Launched 06:26:44.305155 run osmo-stp_10.42.42.5: Starting osmo-stp 06:26:44.847775 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4564): Launched 06:26:45.162546 run osmo-stp_10.42.42.5(pid=4565): Launched 06:26:45.282298 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:26:45.825677 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4567): Launched 06:26:45.954163 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:26:46.220134 run patchelf(pid=4568): Launched 06:26:46.403906 run osmo-stp_10.42.42.5(pid=4565): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4565)] 06:26:46.534337 run osmo-stp_10.42.42.5(pid=4565): stdout: | (launched: 2022-12-10_06:26:45.105360) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:26:46.667422 run osmo-stp_10.42.42.5(pid=4565): stderr: | 20221210062645295 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062645295 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062645296 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062645296 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062645296 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062645297 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062645297 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:26:46.799180 run osmo-stp_10.42.42.5(pid=4565): stdout: | (launched: 2022-12-10_06:26:45.105360) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:26:46.925581 run osmo-stp_10.42.42.5(pid=4565): stderr: | 20221210062645295 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062645295 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062645296 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062645296 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062645296 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062645297 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062645297 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:26:47.076002 run patchelf(pid=4568): Terminating (SIGINT) 06:26:47.246503 run patchelf(pid=4568): Terminated: ok {rc=0} 06:26:47.366539 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=4565): Process ended prematurely: osmo-stp_10.42.42.5(pid=4565) [trial-2370↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4565)] [trial-2370↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 06:26:47.376299 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 06:26:47.404462 run osmo-hlr_10.42.42.2(pid=4562): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4562)] 06:26:47.452531 run osmo-hlr_10.42.42.2(pid=4562): stdout: | (launched: 2022-12-10_06:26:44.128594) 06:26:47.502199 run osmo-hlr_10.42.42.2(pid=4562): stderr: | 20221210062644327 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210062644327 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210062644327 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210062644327 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210062644327 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210062644327 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210062644340 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210062644348 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210062644348 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210062644348 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:26:47.552358 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4555): Terminating (SIGTERM) 06:26:47.592530 run iperf3-srv_10.42.42.10(pid=4556): Terminating (SIGTERM) 06:26:47.632410 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4557): Terminating (SIGTERM) 06:26:47.672348 run iperf3-srv_10.42.42.10(pid=4558): Terminating (SIGTERM) 06:26:47.712060 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4561): Terminating (SIGTERM) 06:26:47.752140 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4564): Terminating (SIGTERM) 06:26:47.791953 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4567): Terminating (SIGTERM) 06:26:47.832117 --- ParallelTerminationStrategy: PID 4555 died... 06:26:47.851284 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4555): Terminated: ok {rc=0} 06:26:47.895831 --- ParallelTerminationStrategy: PID 4556 died... 06:26:47.914482 run iperf3-srv_10.42.42.10(pid=4556): Terminated {rc=256} 06:26:47.958676 --- ParallelTerminationStrategy: PID 4557 died... 06:26:47.977283 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4557): Terminated: ok {rc=0} 06:26:48.021394 --- ParallelTerminationStrategy: PID 4558 died... 06:26:48.039870 run iperf3-srv_10.42.42.10(pid=4558): Terminated {rc=256} 06:26:48.084482 --- ParallelTerminationStrategy: PID 4561 died... 06:26:48.103487 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4561): Terminated: ok {rc=0} 06:26:48.147974 --- ParallelTerminationStrategy: PID 4564 died... 06:26:48.166593 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4564): Terminated: ok {rc=0} 06:26:48.210779 --- ParallelTerminationStrategy: PID 4567 died... 06:26:48.229365 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4567): Terminated: ok {rc=0} 06:26:48.313179 bus /gobi_0: Setting Powered False 06:26:49.410431 bus /gobi_0: Setting Powered False 06:26:50.525432 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 06:26:51.672182 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:26:51.684386 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 06:26:51.752319 tst iperf3.py: using LAC 26478 06:26:51.878382 tst iperf3.py: using RAC 213 06:26:52.004468 tst iperf3.py: using CellId 26478 06:26:52.127738 tst iperf3.py: using BVCI 26479 06:26:52.240815 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:26:52.252262 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:26:52.263486 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:26:52.274734 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:26:52.286068 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:26:52.297376 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:26:52.308690 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:26:52.319935 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:26:52.331429 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:26:52.448110 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 06:26:52.659034 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:26:52.973210 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4569): Launched 06:26:53.246769 run iperf3-srv_10.42.42.10(pid=4570): Launched 06:26:53.364085 tst iperf3.py:8: start network... 06:26:53.574083 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:26:54.057749 run create_hlr_db(pid=4571): Launched 06:26:54.185013 bus /gobi_6: Setting Powered False 06:26:55.247237 run create_hlr_db(pid=4571): Terminated: ok {rc=0} 06:26:55.665487 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4573): Launched 06:26:55.957687 run osmo-hlr_10.42.42.2(pid=4574): Launched 06:26:56.069252 run osmo-stp_10.42.42.5: Starting osmo-stp 06:26:56.591071 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4576): Launched 06:26:56.884188 run osmo-stp_10.42.42.5(pid=4577): Launched 06:26:56.996363 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:26:57.501605 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4579): Launched 06:26:57.614381 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:26:57.861559 run patchelf(pid=4580): Launched 06:26:58.025115 run osmo-stp_10.42.42.5(pid=4577): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4577)] 06:26:58.150043 run osmo-stp_10.42.42.5(pid=4577): stdout: | (launched: 2022-12-10_06:26:56.830515) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:26:58.275813 run osmo-stp_10.42.42.5(pid=4577): stderr: | 20221210062656998 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062656998 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062656999 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062656999 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062657000 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062657000 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062657000 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:26:58.401683 run osmo-stp_10.42.42.5(pid=4577): stdout: | (launched: 2022-12-10_06:26:56.830515) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:26:58.522741 run osmo-stp_10.42.42.5(pid=4577): stderr: | 20221210062656998 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062656998 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062656999 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062656999 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062657000 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062657000 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062657000 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:26:58.665690 run patchelf(pid=4580): Terminating (SIGINT) 06:26:58.830668 run patchelf(pid=4580): Terminated: ok {rc=0} 06:26:58.949621 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4577): Process ended prematurely: osmo-stp_10.42.42.5(pid=4577) [trial-2370↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4577)] [trial-2370↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8] 06:26:58.958951 tst iperf3.py:8: Test FAILED (7.3 sec) 06:26:58.986215 run osmo-hlr_10.42.42.2(pid=4574): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4574)] 06:26:59.033742 run osmo-hlr_10.42.42.2(pid=4574): stdout: | (launched: 2022-12-10_06:26:55.903547) 06:26:59.083082 run osmo-hlr_10.42.42.2(pid=4574): stderr: | 20221210062656081 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210062656081 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210062656081 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210062656081 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210062656081 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210062656081 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210062656094 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210062656103 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210062656103 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210062656103 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:26:59.132720 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4569): Terminating (SIGTERM) 06:26:59.171943 run iperf3-srv_10.42.42.10(pid=4570): Terminating (SIGTERM) 06:26:59.211701 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4573): Terminating (SIGTERM) 06:26:59.251249 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4576): Terminating (SIGTERM) 06:26:59.290701 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4579): Terminating (SIGTERM) 06:26:59.330445 --- ParallelTerminationStrategy: PID 4569 died... 06:26:59.349385 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4569): Terminated: ok {rc=0} 06:26:59.393561 --- ParallelTerminationStrategy: PID 4570 died... 06:26:59.411929 run iperf3-srv_10.42.42.10(pid=4570): Terminated {rc=256} 06:26:59.455381 --- ParallelTerminationStrategy: PID 4573 died... 06:26:59.473725 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4573): Terminated: ok {rc=0} 06:26:59.517294 --- ParallelTerminationStrategy: PID 4576 died... 06:26:59.535630 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4576): Terminated: ok {rc=0} 06:26:59.579648 --- ParallelTerminationStrategy: PID 4579 died... 06:26:59.598144 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4579): Terminated: ok {rc=0} 06:26:59.682989 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 06:27:00.828306 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:27:00.840500 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 06:27:00.909649 tst iperf3m4.py: using LAC 26479 06:27:01.032166 tst iperf3m4.py: using RAC 214 06:27:01.151153 tst iperf3m4.py: using CellId 26479 06:27:01.309788 tst iperf3m4.py: using BVCI 26480 06:27:01.449566 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:27:01.461616 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:27:01.473409 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:27:01.485677 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:27:01.497850 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:27:01.509859 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:27:01.522235 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:27:01.534669 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:27:01.546526 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:27:01.669757 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:27:01.793787 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:27:01.915928 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:27:02.035461 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 06:27:02.252654 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:27:02.552369 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4581): Launched 06:27:02.808728 run iperf3-srv_10.42.42.10(pid=4582): Launched 06:27:02.919410 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 06:27:03.115552 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:27:03.409744 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4583): Launched 06:27:03.666455 run iperf3-srv_10.42.42.10(pid=4584): Launched 06:27:03.777040 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 06:27:03.972496 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:27:04.266268 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4585): Launched 06:27:04.521818 run iperf3-srv_10.42.42.10(pid=4586): Launched 06:27:04.632020 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 06:27:04.826862 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:27:05.121173 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4587): Launched 06:27:05.377064 run iperf3-srv_10.42.42.10(pid=4588): Launched 06:27:05.487090 tst iperf3m4.py:8: start network... 06:27:05.682792 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:27:06.136159 run create_hlr_db(pid=4589): Launched 06:27:06.248585 bus /gobi_6: Setting Powered False 06:27:07.307455 run create_hlr_db(pid=4589): Terminated: ok {rc=0} 06:27:07.736423 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4591): Launched 06:27:08.050870 run osmo-hlr_10.42.42.2(pid=4592): Launched 06:27:08.171377 run osmo-stp_10.42.42.5: Starting osmo-stp 06:27:08.713099 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4594): Launched 06:27:09.027466 run osmo-stp_10.42.42.5(pid=4595): Launched 06:27:09.148417 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:27:09.689885 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4597): Launched 06:27:09.810273 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:27:10.075169 run patchelf(pid=4598): Launched 06:27:10.239139 run osmo-stp_10.42.42.5(pid=4595): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4595)] 06:27:10.363776 run osmo-stp_10.42.42.5(pid=4595): stdout: | (launched: 2022-12-10_06:27:08.970173) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:27:10.489433 run osmo-stp_10.42.42.5(pid=4595): stderr: | 20221210062709161 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062709161 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062709161 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062709161 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062709162 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062709162 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062709162 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:27:10.615400 run osmo-stp_10.42.42.5(pid=4595): stdout: | (launched: 2022-12-10_06:27:08.970173) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:27:10.735618 run osmo-stp_10.42.42.5(pid=4595): stderr: | 20221210062709161 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062709161 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062709161 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062709161 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062709162 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062709162 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062709162 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:27:10.878259 run patchelf(pid=4598): Terminating (SIGINT) 06:27:11.042509 run patchelf(pid=4598): Terminated: ok {rc=0} 06:27:11.162041 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4595): Process ended prematurely: osmo-stp_10.42.42.5(pid=4595) [trial-2370↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4595)] [trial-2370↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8] 06:27:11.171548 tst iperf3m4.py:8: Test FAILED (10.4 sec) 06:27:11.199425 run osmo-hlr_10.42.42.2(pid=4592): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4592)] 06:27:11.246471 run osmo-hlr_10.42.42.2(pid=4592): stdout: | (launched: 2022-12-10_06:27:07.993806) 06:27:11.295134 run osmo-hlr_10.42.42.2(pid=4592): stderr: | 20221210062708190 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210062708190 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210062708190 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210062708190 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210062708190 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210062708190 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210062708202 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210062708210 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210062708210 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210062708210 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:27:11.344106 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4581): Terminating (SIGTERM) 06:27:11.383576 run iperf3-srv_10.42.42.10(pid=4582): Terminating (SIGTERM) 06:27:11.422891 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4583): Terminating (SIGTERM) 06:27:11.462178 run iperf3-srv_10.42.42.10(pid=4584): Terminating (SIGTERM) 06:27:11.501371 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4585): Terminating (SIGTERM) 06:27:11.541107 run iperf3-srv_10.42.42.10(pid=4586): Terminating (SIGTERM) 06:27:11.580220 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4587): Terminating (SIGTERM) 06:27:11.619437 run iperf3-srv_10.42.42.10(pid=4588): Terminating (SIGTERM) 06:27:11.658563 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4591): Terminating (SIGTERM) 06:27:11.697841 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4594): Terminating (SIGTERM) 06:27:11.737133 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4597): Terminating (SIGTERM) 06:27:11.776512 --- ParallelTerminationStrategy: PID 4581 died... 06:27:11.795542 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4581): Terminated: ok {rc=0} 06:27:11.839399 --- ParallelTerminationStrategy: PID 4582 died... 06:27:11.857797 run iperf3-srv_10.42.42.10(pid=4582): Terminated {rc=256} 06:27:11.901333 --- ParallelTerminationStrategy: PID 4583 died... 06:27:11.919611 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4583): Terminated: ok {rc=0} 06:27:11.963612 --- ParallelTerminationStrategy: PID 4584 died... 06:27:11.982008 run iperf3-srv_10.42.42.10(pid=4584): Terminated {rc=256} 06:27:12.025313 --- ParallelTerminationStrategy: PID 4585 died... 06:27:12.043429 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4585): Terminated: ok {rc=0} 06:27:12.087186 --- ParallelTerminationStrategy: PID 4586 died... 06:27:12.105514 run iperf3-srv_10.42.42.10(pid=4586): Terminated {rc=256} 06:27:12.148931 --- ParallelTerminationStrategy: PID 4587 died... 06:27:12.167462 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4587): Terminated: ok {rc=0} 06:27:12.211225 --- ParallelTerminationStrategy: PID 4588 died... 06:27:12.229500 run iperf3-srv_10.42.42.10(pid=4588): Terminated {rc=256} 06:27:12.272866 --- ParallelTerminationStrategy: PID 4591 died... 06:27:12.291574 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4591): Terminated: ok {rc=0} 06:27:12.335208 --- ParallelTerminationStrategy: PID 4594 died... 06:27:12.353651 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4594): Terminated: ok {rc=0} 06:27:12.397488 --- ParallelTerminationStrategy: PID 4597 died... 06:27:12.416023 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4597): Terminated: ok {rc=0} 06:27:12.499565 bus /gobi_4: Setting Powered False 06:27:13.597059 bus /gobi_4: Setting Powered False 06:27:14.711539 bus /gobi_1: Setting Powered False 06:27:15.809132 bus /gobi_1: Setting Powered False 06:27:16.929458 bus /gobi_0: Setting Powered False 06:27:18.026493 bus /gobi_0: Setting Powered False 06:27:19.142377 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 06:27:20.245720 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:27:20.257279 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 06:27:20.322764 tst ping.py: using LAC 26480 06:27:20.444711 tst ping.py: using RAC 215 06:27:20.564718 tst ping.py: using CellId 26480 06:27:20.685534 tst ping.py: using BVCI 26481 06:27:20.797732 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:27:20.809428 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:27:20.820826 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:27:20.832354 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:27:20.843624 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:27:20.854915 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:27:20.866280 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:27:20.877598 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:27:20.989658 tst ping.py:19: start network... 06:27:21.180873 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:27:21.625276 run create_hlr_db(pid=4599): Launched 06:27:21.735128 bus /gobi_6: Setting Powered False 06:27:22.792877 run create_hlr_db(pid=4599): Terminated: ok {rc=0} 06:27:23.214668 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4601): Launched 06:27:23.523117 run osmo-hlr_10.42.42.2(pid=4602): Launched 06:27:23.641059 run osmo-stp_10.42.42.5: Starting osmo-stp 06:27:24.175967 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4604): Launched 06:27:24.483722 run osmo-stp_10.42.42.5(pid=4605): Launched 06:27:24.601786 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:27:25.133051 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4607): Launched 06:27:25.250926 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:27:25.511300 run patchelf(pid=4608): Launched 06:27:25.684176 run osmo-stp_10.42.42.5(pid=4605): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4605)] 06:27:25.815104 run osmo-stp_10.42.42.5(pid=4605): stdout: | (launched: 2022-12-10_06:27:24.427335) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:27:25.947486 run osmo-stp_10.42.42.5(pid=4605): stderr: | 20221210062724618 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062724618 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062724618 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062724619 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062724619 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062724619 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062724619 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:27:26.080456 run osmo-stp_10.42.42.5(pid=4605): stdout: | (launched: 2022-12-10_06:27:24.427335) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:27:26.207032 run osmo-stp_10.42.42.5(pid=4605): stderr: | 20221210062724618 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062724618 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062724618 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062724619 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062724619 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062724619 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062724619 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:27:26.356774 run patchelf(pid=4608): Terminating (SIGINT) 06:27:26.529635 run patchelf(pid=4608): Terminated: ok {rc=0} 06:27:26.654327 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=4605): Process ended prematurely: osmo-stp_10.42.42.5(pid=4605) [trial-2370↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4605)] [trial-2370↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22] 06:27:26.663727 tst ping.py:22: Test FAILED (6.4 sec) 06:27:26.691717 run osmo-hlr_10.42.42.2(pid=4602): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4602)] 06:27:26.741490 run osmo-hlr_10.42.42.2(pid=4602): stdout: | (launched: 2022-12-10_06:27:23.466824) 06:27:26.793053 run osmo-hlr_10.42.42.2(pid=4602): stderr: | 20221210062723664 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210062723664 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210062723664 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210062723664 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210062723664 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210062723664 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210062723677 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210062723685 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210062723686 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210062723686 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:27:26.844492 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4601): Terminating (SIGTERM) 06:27:26.886170 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4604): Terminating (SIGTERM) 06:27:26.927633 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4607): Terminating (SIGTERM) 06:27:26.969714 --- ParallelTerminationStrategy: PID 4601 died... 06:27:26.989767 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4601): Terminated: ok {rc=0} 06:27:27.035823 --- ParallelTerminationStrategy: PID 4604 died... 06:27:27.055711 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4604): Terminated: ok {rc=0} 06:27:27.101768 --- ParallelTerminationStrategy: PID 4607 died... 06:27:27.121268 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4607): Terminated: ok {rc=0} 06:27:27.208601 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 06:27:28.297910 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:27:28.310140 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 06:27:28.378947 tst ping_idle_ping.py: using LAC 26481 06:27:28.500535 tst ping_idle_ping.py: using RAC 216 06:27:28.621198 tst ping_idle_ping.py: using CellId 26481 06:27:28.741920 tst ping_idle_ping.py: using BVCI 26482 06:27:28.853464 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:27:28.865155 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:27:28.876644 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:27:28.888219 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:27:28.899631 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:27:28.911134 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:27:28.922812 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:27:28.934397 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:27:29.050947 tst ping_idle_ping.py:24: start network... 06:27:29.257780 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:27:29.736661 run create_hlr_db(pid=4609): Launched 06:27:29.862105 bus /gobi_6: Setting Powered False 06:27:30.927625 run create_hlr_db(pid=4609): Terminated: ok {rc=0} 06:27:31.373753 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4611): Launched 06:27:31.768674 run osmo-hlr_10.42.42.2(pid=4612): Launched 06:27:32.011028 run osmo-stp_10.42.42.5: Starting osmo-stp 06:27:32.574078 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4614): Launched 06:27:32.861602 run osmo-stp_10.42.42.5(pid=4615): Launched 06:27:32.971153 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:27:33.468861 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4617): Launched 06:27:33.579906 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:27:33.822900 run patchelf(pid=4618): Launched 06:27:33.983895 run osmo-stp_10.42.42.5(pid=4615): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4615)] 06:27:34.106257 run osmo-stp_10.42.42.5(pid=4615): stdout: | (launched: 2022-12-10_06:27:32.808602) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:27:34.230145 run osmo-stp_10.42.42.5(pid=4615): stderr: | 20221210062732978 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062732978 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062732978 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062732978 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062732979 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062732979 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062732979 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:27:34.354024 run osmo-stp_10.42.42.5(pid=4615): stdout: | (launched: 2022-12-10_06:27:32.808602) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:27:34.472039 run osmo-stp_10.42.42.5(pid=4615): stderr: | 20221210062732978 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062732978 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062732978 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062732978 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062732979 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062732979 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062732979 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:27:34.611911 run patchelf(pid=4618): Terminating (SIGINT) 06:27:34.773510 run patchelf(pid=4618): Terminated: ok {rc=0} 06:27:34.889933 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=4615): Process ended prematurely: osmo-stp_10.42.42.5(pid=4615) [trial-2370↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4615)] [trial-2370↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 06:27:34.898807 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 06:27:34.925436 run osmo-hlr_10.42.42.2(pid=4612): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4612)] 06:27:34.972590 run osmo-hlr_10.42.42.2(pid=4612): stdout: | (launched: 2022-12-10_06:27:31.695461) 06:27:35.021278 run osmo-hlr_10.42.42.2(pid=4612): stderr: | 20221210062731942 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210062731942 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210062731942 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210062731942 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210062731942 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210062731942 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210062731960 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210062731976 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210062731976 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210062731976 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:27:35.070225 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4611): Terminating (SIGTERM) 06:27:35.109345 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4614): Terminating (SIGTERM) 06:27:35.148125 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4617): Terminating (SIGTERM) 06:27:35.187254 --- ParallelTerminationStrategy: PID 4611 died... 06:27:35.205967 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4611): Terminated: ok {rc=0} 06:27:35.249376 --- ParallelTerminationStrategy: PID 4614 died... 06:27:35.267676 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4614): Terminated: ok {rc=0} 06:27:35.311429 --- ParallelTerminationStrategy: PID 4617 died... 06:27:35.329701 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4617): Terminated: ok {rc=0} 06:27:35.414892 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2370 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 06:27:36.712760 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:27:36.719342 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 06:27:36.748620 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 06:27:36.782603 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 06:27:36.835643 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 06:27:36.865400 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 06:27:36.899456 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 06:27:37.455922 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2370 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 06:27:37.461269 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:27:37.472482 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 06:27:37.537115 tst switch_tch_pdch.py: using LAC 26482 06:27:37.650510 tst switch_tch_pdch.py: using RAC 217 06:27:37.765046 tst switch_tch_pdch.py: using CellId 26482 06:27:37.879858 tst switch_tch_pdch.py: using BVCI 26483 06:27:37.983159 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:27:37.994529 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:27:38.005799 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:27:38.017276 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:27:38.028622 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:27:38.040002 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:27:38.051629 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:27:38.063110 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:27:38.177142 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:27:38.288910 tst switch_tch_pdch.py:51: start network... 06:27:38.479671 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:27:38.922736 run create_hlr_db(pid=4623): Launched 06:27:39.031739 bus /gobi_6: Setting Powered False 06:27:40.089431 run create_hlr_db(pid=4623): Terminated: ok {rc=0} 06:27:40.510943 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4625): Launched 06:27:40.818290 run osmo-hlr_10.42.42.2(pid=4626): Launched 06:27:40.935487 run osmo-stp_10.42.42.5: Starting osmo-stp 06:27:41.464659 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4628): Launched 06:27:41.770870 run osmo-stp_10.42.42.5(pid=4629): Launched 06:27:41.888129 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:27:42.420190 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4631): Launched 06:27:42.537396 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:27:42.796393 run patchelf(pid=4632): Launched 06:27:42.967077 run osmo-stp_10.42.42.5(pid=4629): ERR: Terminated: ERROR {rc=1} [trial-2370↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4629)] 06:27:43.097075 run osmo-stp_10.42.42.5(pid=4629): stdout: | (launched: 2022-12-10_06:27:41.714956) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:27:43.229191 run osmo-stp_10.42.42.5(pid=4629): stderr: | 20221210062741905 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062741905 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062741905 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062741905 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062741906 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062741906 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062741906 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:27:43.361187 run osmo-stp_10.42.42.5(pid=4629): stdout: | (launched: 2022-12-10_06:27:41.714956) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:27:43.487085 run osmo-stp_10.42.42.5(pid=4629): stderr: | 20221210062741905 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062741905 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062741905 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062741905 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062741906 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062741906 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062741906 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:27:43.635649 run patchelf(pid=4632): Terminating (SIGINT) 06:27:43.807227 run patchelf(pid=4632): Terminated: ok {rc=0} 06:27:43.930682 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=4629): Process ended prematurely: osmo-stp_10.42.42.5(pid=4629) [trial-2370↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4629)] [trial-2370↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 06:27:43.940177 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 06:27:43.967682 run osmo-hlr_10.42.42.2(pid=4626): ERR: Terminated: ERROR {rc=237} [trial-2370↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4626)] 06:27:44.016567 run osmo-hlr_10.42.42.2(pid=4626): stdout: | (launched: 2022-12-10_06:27:40.762317) 06:27:44.067849 run osmo-hlr_10.42.42.2(pid=4626): stderr: | 20221210062740957 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210062740957 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210062740957 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210062740957 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210062740958 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210062740958 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210062740970 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210062740978 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210062740978 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210062740978 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:27:44.119003 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4625): Terminating (SIGTERM) 06:27:44.159926 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4628): Terminating (SIGTERM) 06:27:44.200786 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4631): Terminating (SIGTERM) 06:27:44.242481 --- ParallelTerminationStrategy: PID 4625 died... 06:27:44.262012 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4625): Terminated: ok {rc=0} 06:27:44.307114 --- ParallelTerminationStrategy: PID 4628 died... 06:27:44.326523 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4628): Terminated: ok {rc=0} 06:27:44.372132 --- ParallelTerminationStrategy: PID 4631 died... 06:27:44.391447 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4631): Terminated: ok {rc=0} 06:27:44.477209 bus /gobi_0: Setting Powered False 06:27:45.572923 bus /gobi_0: Setting Powered False 06:27:46.688218 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2370 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 06:27:47.945905 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:27:47.951737 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 06:27:47.980699 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 06:27:48.014444 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 06:27:48.071510 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 06:27:48.100160 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 06:27:48.133912 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 06:27:48.683781 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2370 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 06:27:48.689044 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:27:48.700180 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 06:27:48.762604 tst switch_tch_pdch.py: using LAC 26483 06:27:48.873384 tst switch_tch_pdch.py: using RAC 218 06:27:48.986242 tst switch_tch_pdch.py: using CellId 26483 06:27:49.097397 tst switch_tch_pdch.py: using BVCI 26484 06:27:49.200498 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:27:49.211775 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:27:49.222820 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:27:49.234047 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:27:49.245207 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:27:49.256260 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:27:49.267544 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:27:49.278741 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 06:27:49.390097 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 06:27:49.509116 tst switch_tch_pdch.py:51: start network... 06:27:49.715644 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:27:50.164454 run create_hlr_db(pid=4636): Launched 06:27:50.289496 bus /gobi_6: Setting Powered False 06:27:51.351194 run create_hlr_db(pid=4636): Terminated: ok {rc=0} 06:27:51.739069 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4638): Launched 06:27:52.026295 run osmo-hlr_10.42.42.2(pid=4639): Launched 06:27:52.135373 run osmo-stp_10.42.42.5: Starting osmo-stp 06:27:52.604899 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4641): Launched 06:27:52.891789 run osmo-stp_10.42.42.5(pid=4642): Launched 06:27:53.001729 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:27:53.472001 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4644): Launched 06:27:53.583000 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:27:53.825037 run patchelf(pid=4645): Launched 06:27:53.985617 run osmo-stp_10.42.42.5(pid=4642): ERR: Terminated: ERROR {rc=1} [trial-2370↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4642)] 06:27:54.107892 run osmo-stp_10.42.42.5(pid=4642): stdout: | (launched: 2022-12-10_06:27:52.839088) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:27:54.231605 run osmo-stp_10.42.42.5(pid=4642): stderr: | 20221210062753008 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062753008 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062753008 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062753008 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062753009 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062753009 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062753009 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:27:54.355281 run osmo-stp_10.42.42.5(pid=4642): stdout: | (launched: 2022-12-10_06:27:52.839088) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:27:54.473190 run osmo-stp_10.42.42.5(pid=4642): stderr: | 20221210062753008 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062753008 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062753008 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062753008 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062753009 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062753009 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062753009 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:27:54.612638 run patchelf(pid=4645): Terminating (SIGINT) 06:27:54.773487 run patchelf(pid=4645): Terminated: ok {rc=0} 06:27:54.890723 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=4642): Process ended prematurely: osmo-stp_10.42.42.5(pid=4642) [trial-2370↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4642)] [trial-2370↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 06:27:54.899601 tst switch_tch_pdch.py:54: Test FAILED (6.2 sec) 06:27:54.926208 run osmo-hlr_10.42.42.2(pid=4639): ERR: Terminated: ERROR {rc=237} [trial-2370↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4639)] 06:27:54.973561 run osmo-hlr_10.42.42.2(pid=4639): stdout: | (launched: 2022-12-10_06:27:51.973308) 06:27:55.022498 run osmo-hlr_10.42.42.2(pid=4639): stderr: | 20221210062752147 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210062752147 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210062752147 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210062752147 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210062752147 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210062752147 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210062752159 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210062752167 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210062752167 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210062752167 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:27:55.071726 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4638): Terminating (SIGTERM) 06:27:55.111058 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4641): Terminating (SIGTERM) 06:27:55.150357 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4644): Terminating (SIGTERM) 06:27:55.189969 --- ParallelTerminationStrategy: PID 4638 died... 06:27:55.208531 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4638): Terminated: ok {rc=0} 06:27:55.252472 --- ParallelTerminationStrategy: PID 4641 died... 06:27:55.270765 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4641): Terminated: ok {rc=0} 06:27:55.314240 --- ParallelTerminationStrategy: PID 4644 died... 06:27:55.332516 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4644): Terminated: ok {rc=0} 06:27:55.417959 bus /gobi_0: Setting Powered False 06:27:56.516366 bus /gobi_0: Setting Powered False 06:27:57.627432 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2370 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 nitb_sms:nanobts --------------------------------------------------------------------- 06:27:58.870443 tst nitb_sms:nanobts: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:27:58.874083 tst nitb_sms:nanobts: Verifying 1 x bts (candidates: 11) 06:27:58.897301 tst nitb_sms:nanobts: Verifying 1 x ip_address (candidates: 9) 06:27:58.904615 tst nitb_sms:nanobts: Verifying 2 x modem (candidates: 12) 06:27:58.954640 tst nitb_sms:nanobts: Reserving 1 x bts (candidates: 11) 06:27:58.977796 tst nitb_sms:nanobts: Reserving 1 x ip_address (candidates: 9) 06:27:58.984650 tst nitb_sms:nanobts: Reserving 2 x modem (candidates: 12) 06:27:59.522971 tst nitb_sms:nanobts: RESERVED RESOURCES for nitb_sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 nitb_sms:nanobts mo_mt_sms.py ---------------------------------------------- 06:27:59.527814 tst nitb_sms:nanobts: Using 1 x ip_address (candidates: 1) 06:27:59.538552 tst nitb_sms:nanobts: Using 1 x bts (candidates: 1) 06:27:59.575330 tst mo_mt_sms.py: using LAC 26484 06:27:59.686131 tst mo_mt_sms.py: using RAC 219 06:27:59.796490 tst mo_mt_sms.py: using CellId 26484 06:27:59.907470 tst mo_mt_sms.py: using BVCI 26485 06:28:00.010971 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 06:28:00.126285 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 06:28:00.241130 tst mo_mt_sms.py:9: start nitb and bts... 06:28:00.446660 run osmo-nitb_10.42.42.2: Starting osmo-nitb 06:28:01.087698 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=4649): Launched 06:28:01.405936 run osmo-nitb_10.42.42.2(pid=4650): Launched 06:28:01.592739 run osmo-nitb_10.42.42.2(pid=4650): ERR: Terminated: ERROR {rc=2} [trial-2370↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4650)] 06:28:01.733910 run osmo-nitb_10.42.42.2(pid=4650): stdout: | (launched: 2022-12-10_06:28:01.344553) 06:28:01.876343 run osmo-nitb_10.42.42.2(pid=4650): stderr: | (launched: 2022-12-10_06:28:01.391239) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:28:02.018789 run osmo-nitb_10.42.42.2(pid=4650): stdout: | (launched: 2022-12-10_06:28:01.344553) 06:28:02.155252 run osmo-nitb_10.42.42.2(pid=4650): stderr: | (launched: 2022-12-10_06:28:01.391239) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=4650): Process ended prematurely: osmo-nitb_10.42.42.2(pid=4650) [trial-2370↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4650)] 06:28:02.536097 tst osmo-nitb_10.42.42.2(pid=4650): stdout: | (launched: 2022-12-10_06:28:01.344553) 06:28:02.660310 tst osmo-nitb_10.42.42.2(pid=4650): stderr: | (launched: 2022-12-10_06:28:01.391239) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:28:02.807194 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=4650): Process ended prematurely: osmo-nitb_10.42.42.2(pid=4650) [trial-2370↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4650)] [trial-2370↪nitb_sms:nanobts↪mo_mt_sms.py:11] 06:28:02.816043 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 06:28:02.822890 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=4649): Terminating (SIGTERM) 06:28:03.033963 --- ParallelTerminationStrategy: PID 4649 died... 06:28:03.055388 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=4649): Terminated: ok {rc=0} 06:28:03.142826 bus /sierra_3: Setting Powered False 06:28:04.241444 bus /sierra_3: Setting Powered False 06:28:05.359213 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 nitb_sms:nanobts FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 sms:nanobts+band-1900 --------------------------------------------------------------------- 06:28:06.543925 tst sms:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:28:06.548676 tst sms:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 06:28:06.572349 tst sms:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 06:28:06.599139 tst sms:nanobts+band-1900: Verifying 2 x modem (candidates: 12) 06:28:06.648522 tst sms:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 06:28:06.672837 tst sms:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 06:28:06.700596 tst sms:nanobts+band-1900: Reserving 2 x modem (candidates: 12) 06:28:07.248594 tst sms:nanobts+band-1900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 sms:nanobts+band-1900 mo_mt_sms.py ---------------------------------------------- 06:28:07.253739 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 06:28:07.264580 tst sms:nanobts+band-1900: Using 1 x bts (candidates: 1) 06:28:07.302612 tst mo_mt_sms.py: using LAC 26485 06:28:07.422658 tst mo_mt_sms.py: using RAC 220 06:28:07.540647 tst mo_mt_sms.py: using CellId 26485 06:28:07.661581 tst mo_mt_sms.py: using BVCI 26486 06:28:07.772156 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 06:28:07.783242 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 06:28:07.794226 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 06:28:07.805217 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 06:28:07.816076 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 06:28:07.826958 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 06:28:07.938145 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 06:28:08.053781 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:28:08.499173 run create_hlr_db(pid=4654): Launched 06:28:08.609294 bus /sierra_2: Setting Powered False 06:28:09.667226 run create_hlr_db(pid=4654): Terminated: ok {rc=0} 06:28:10.068076 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4656): Launched 06:28:10.353946 run osmo-hlr_10.42.42.2(pid=4657): Launched 06:28:10.462871 run osmo-stp_10.42.42.5: Starting osmo-stp 06:28:10.954805 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4659): Launched 06:28:11.240449 run osmo-stp_10.42.42.5(pid=4660): Launched 06:28:11.350039 run osmo-msc_10.42.42.6: Starting osmo-msc 06:28:11.869530 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4662): Launched 06:28:12.156567 run osmo-msc_10.42.42.6(pid=4663): Launched 06:28:12.318406 run osmo-stp_10.42.42.5(pid=4660): ERR: Terminated: ERROR {rc=1} [trial-2370↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4660)] 06:28:12.440449 run osmo-stp_10.42.42.5(pid=4660): stdout: | (launched: 2022-12-10_06:28:11.187664) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:28:12.563702 run osmo-stp_10.42.42.5(pid=4660): stderr: | 20221210062811356 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062811356 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062811357 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062811357 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062811358 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062811358 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062811358 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:28:12.683331 run osmo-stp_10.42.42.5(pid=4660): stdout: | (launched: 2022-12-10_06:28:11.187664) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:28:12.797570 run osmo-stp_10.42.42.5(pid=4660): stderr: | 20221210062811356 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062811356 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062811357 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062811357 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062811358 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062811358 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062811358 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:28:12.934226 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=4660): Process ended prematurely: osmo-stp_10.42.42.5(pid=4660) [trial-2370↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4660)] [trial-2370↪sms:nanobts+band-1900↪mo_mt_sms.py:16] 06:28:12.942568 tst mo_mt_sms.py:16: Test FAILED (5.7 sec) 06:28:12.968576 run osmo-hlr_10.42.42.2(pid=4657): ERR: Terminated: ERROR {rc=237} [trial-2370↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4657)] 06:28:13.015546 run osmo-hlr_10.42.42.2(pid=4657): stdout: | (launched: 2022-12-10_06:28:10.301522) 06:28:13.064453 run osmo-hlr_10.42.42.2(pid=4657): stderr: | 20221210062810474 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210062810474 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210062810474 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210062810474 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210062810474 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210062810474 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210062810487 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/sms:nanobts+band-1900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210062810495 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210062810495 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210062810495 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:28:13.131932 run osmo-msc_10.42.42.6(pid=4663): ERR: Terminated: ERROR {rc=2} [trial-2370↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4663)] 06:28:13.179026 run osmo-msc_10.42.42.6(pid=4663): stdout: | (launched: 2022-12-10_06:28:12.103688) 06:28:13.227739 run osmo-msc_10.42.42.6(pid=4663): stderr: | 20221210062812372 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210062812372 DLGLOBAL DEBUG validating counter group 0x7fd86553ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210062812372 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210062812372 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210062812373 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210062812373 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210062812374 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210062812375 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210062812375 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210062812375 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:28:13.276674 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4656): Terminating (SIGTERM) 06:28:13.315656 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4659): Terminating (SIGTERM) 06:28:13.354554 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4662): Terminating (SIGTERM) 06:28:13.393975 --- ParallelTerminationStrategy: PID 4656 died... 06:28:13.412803 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4656): Terminated: ok {rc=0} 06:28:13.456474 --- ParallelTerminationStrategy: PID 4659 died... 06:28:13.474652 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4659): Terminated: ok {rc=0} 06:28:13.517915 --- ParallelTerminationStrategy: PID 4662 died... 06:28:13.536187 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4662): Terminated: ok {rc=0} 06:28:13.618721 bus /sierra_3: Setting Powered False 06:28:14.712384 bus /sierra_3: Setting Powered False 06:28:15.825401 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 sms:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 nitb_ussd:nanobts+band-1900 --------------------------------------------------------------------- 06:28:17.065304 tst nitb_ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:28:17.072029 tst nitb_ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 06:28:17.103077 tst nitb_ussd:nanobts+band-1900: Verifying 1 x ip_address (candidates: 9) 06:28:17.113093 tst nitb_ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 06:28:17.158134 tst nitb_ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 06:28:17.187420 tst nitb_ussd:nanobts+band-1900: Reserving 1 x ip_address (candidates: 9) 06:28:17.194812 tst nitb_ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 06:28:17.705331 tst nitb_ussd:nanobts+band-1900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2370 nitb_ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 06:28:17.711105 tst nitb_ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 1) 06:28:17.722581 tst nitb_ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 06:28:17.762258 tst assert_extension.py: using LAC 26486 06:28:17.876334 tst assert_extension.py: using RAC 221 06:28:17.988761 tst assert_extension.py: using CellId 26486 06:28:18.102214 tst assert_extension.py: using BVCI 26487 06:28:18.209209 tst nitb_ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 06:28:18.323624 tst assert_extension.py:10: start nitb and bts... 06:28:18.529413 run osmo-nitb_10.42.42.2: Starting osmo-nitb 06:28:19.155283 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=4668): Launched 06:28:19.461688 run osmo-nitb_10.42.42.2(pid=4669): Launched 06:28:19.631340 run osmo-nitb_10.42.42.2(pid=4669): ERR: Terminated: ERROR {rc=2} [trial-2370↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4669)] 06:28:19.769865 run osmo-nitb_10.42.42.2(pid=4669): stdout: | (launched: 2022-12-10_06:28:19.405909) 06:28:19.909285 run osmo-nitb_10.42.42.2(pid=4669): stderr: | (launched: 2022-12-10_06:28:19.451319) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:28:20.048754 run osmo-nitb_10.42.42.2(pid=4669): stdout: | (launched: 2022-12-10_06:28:19.405909) 06:28:20.182805 run osmo-nitb_10.42.42.2(pid=4669): stderr: | (launched: 2022-12-10_06:28:19.451319) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=4669): Process ended prematurely: osmo-nitb_10.42.42.2(pid=4669) [trial-2370↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4669)] 06:28:20.576698 tst osmo-nitb_10.42.42.2(pid=4669): stdout: | (launched: 2022-12-10_06:28:19.405909) 06:28:20.700415 tst osmo-nitb_10.42.42.2(pid=4669): stderr: | (launched: 2022-12-10_06:28:19.451319) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:28:20.846609 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=4669): Process ended prematurely: osmo-nitb_10.42.42.2(pid=4669) [trial-2370↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4669)] [trial-2370↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12] 06:28:20.855602 tst assert_extension.py:12: Test FAILED (3.1 sec) 06:28:20.862698 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=4668): Terminating (SIGTERM) 06:28:21.072192 --- ParallelTerminationStrategy: PID 4668 died... 06:28:21.093730 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=4668): Terminated: ok {rc=0} 06:28:21.180495 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 nitb_ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 ussd:nanobts+band-1900 --------------------------------------------------------------------- 06:28:22.344835 tst ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:28:22.349725 tst ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 06:28:22.373245 tst ussd:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 06:28:22.399408 tst ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 06:28:22.435597 tst ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 06:28:22.458616 tst ussd:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 06:28:22.484695 tst ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 06:28:23.016459 tst ussd:nanobts+band-1900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2370 ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 06:28:23.021911 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 06:28:23.033018 tst ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 06:28:23.077711 tst assert_extension.py: using LAC 26487 06:28:23.210584 tst assert_extension.py: using RAC 222 06:28:23.330911 tst assert_extension.py: using CellId 26487 06:28:23.449411 tst assert_extension.py: using BVCI 26488 06:28:23.553716 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 06:28:23.564498 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 06:28:23.575144 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 06:28:23.586057 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 06:28:23.596841 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 06:28:23.607797 tst ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 06:28:23.721981 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:28:24.196207 run create_hlr_db(pid=4673): Launched 06:28:24.320675 bus /sierra_2: Setting Powered False 06:28:25.381694 run create_hlr_db(pid=4673): Terminated: ok {rc=0} 06:28:25.811544 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4675): Launched 06:28:26.118652 run osmo-hlr_10.42.42.2(pid=4676): Launched 06:28:26.236150 run osmo-stp_10.42.42.5: Starting osmo-stp 06:28:26.765351 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4678): Launched 06:28:27.072371 run osmo-stp_10.42.42.5(pid=4679): Launched 06:28:27.191341 run osmo-msc_10.42.42.6: Starting osmo-msc 06:28:27.746959 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4681): Launched 06:28:28.054485 run osmo-msc_10.42.42.6(pid=4682): Launched 06:28:28.226170 run osmo-stp_10.42.42.5(pid=4679): ERR: Terminated: ERROR {rc=1} [trial-2370↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4679)] 06:28:28.355513 run osmo-stp_10.42.42.5(pid=4679): stdout: | (launched: 2022-12-10_06:28:27.016114) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:28:28.485520 run osmo-stp_10.42.42.5(pid=4679): stderr: | 20221210062827209 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062827209 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062827209 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062827210 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062827210 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062827210 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062827210 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:28:28.614611 run osmo-stp_10.42.42.5(pid=4679): stdout: | (launched: 2022-12-10_06:28:27.016114) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:28:28.736329 run osmo-stp_10.42.42.5(pid=4679): stderr: | 20221210062827209 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062827209 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062827209 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062827210 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062827210 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062827210 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062827210 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:28:28.882210 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=4679): Process ended prematurely: osmo-stp_10.42.42.5(pid=4679) [trial-2370↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4679)] [trial-2370↪ussd:nanobts+band-1900↪assert_extension.py:17] 06:28:28.891061 tst assert_extension.py:17: Test FAILED (5.9 sec) 06:28:28.917920 run osmo-hlr_10.42.42.2(pid=4676): ERR: Terminated: ERROR {rc=237} [trial-2370↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4676)] 06:28:28.967119 run osmo-hlr_10.42.42.2(pid=4676): stdout: | (launched: 2022-12-10_06:28:26.062167) 06:28:29.018408 run osmo-hlr_10.42.42.2(pid=4676): stderr: | 20221210062826256 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210062826256 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210062826256 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210062826256 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210062826256 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210062826256 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210062826296 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/ussd:nanobts+band-1900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210062826306 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210062826306 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210062826306 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:28:29.089430 run osmo-msc_10.42.42.6(pid=4682): ERR: Terminated: ERROR {rc=2} [trial-2370↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4682)] 06:28:29.138846 run osmo-msc_10.42.42.6(pid=4682): stdout: | (launched: 2022-12-10_06:28:27.998356) 06:28:29.189569 run osmo-msc_10.42.42.6(pid=4682): stderr: | 20221210062828318 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210062828318 DLGLOBAL DEBUG validating counter group 0x7f028a0b4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210062828318 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210062828318 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210062828319 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210062828319 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210062828320 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210062828321 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210062828321 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210062828321 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:28:29.240755 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4675): Terminating (SIGTERM) 06:28:29.282001 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4678): Terminating (SIGTERM) 06:28:29.322886 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4681): Terminating (SIGTERM) 06:28:29.364139 --- ParallelTerminationStrategy: PID 4675 died... 06:28:29.383415 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4675): Terminated: ok {rc=0} 06:28:29.428557 --- ParallelTerminationStrategy: PID 4678 died... 06:28:29.447731 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4678): Terminated: ok {rc=0} 06:28:29.492634 --- ParallelTerminationStrategy: PID 4681 died... 06:28:29.511887 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4681): Terminated: ok {rc=0} 06:28:29.597728 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 06:28:30.795631 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:28:30.805196 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 06:28:30.829429 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 06:28:30.863683 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 06:28:30.924799 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 06:28:30.968232 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 06:28:30.996752 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 06:28:31.527534 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 06:28:31.579366 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:28:31.591617 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 06:28:31.653531 tst mo_mt_call.py: using LAC 26488 06:28:31.806044 tst mo_mt_call.py: using RAC 223 06:28:31.931246 tst mo_mt_call.py: using CellId 26488 06:28:32.048832 tst mo_mt_call.py: using BVCI 26489 06:28:32.186851 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:28:32.199110 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:28:32.211138 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:28:32.224264 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:28:32.237462 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:28:32.250438 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 06:28:32.376517 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 06:28:32.490197 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:28:32.943377 run create_hlr_db(pid=4687): Launched 06:28:33.056186 bus /sierra_2: Setting Powered False 06:28:34.115206 run create_hlr_db(pid=4687): Terminated: ok {rc=0} 06:28:34.522309 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4689): Launched 06:28:34.814903 run osmo-hlr_10.42.42.2(pid=4690): Launched 06:28:34.926916 run osmo-stp_10.42.42.5: Starting osmo-stp 06:28:35.427463 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4692): Launched 06:28:35.719390 run osmo-stp_10.42.42.5(pid=4693): Launched 06:28:35.831980 run osmo-msc_10.42.42.6: Starting osmo-msc 06:28:36.372785 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4695): Launched 06:28:36.667252 run osmo-msc_10.42.42.6(pid=4696): Launched 06:28:36.831247 run osmo-stp_10.42.42.5(pid=4693): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4693)] 06:28:36.955199 run osmo-stp_10.42.42.5(pid=4693): stdout: | (launched: 2022-12-10_06:28:35.666094) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:28:37.079953 run osmo-stp_10.42.42.5(pid=4693): stderr: | 20221210062835833 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062835834 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062835834 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062835834 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062835836 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062835837 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062835837 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:28:37.203113 run osmo-stp_10.42.42.5(pid=4693): stdout: | (launched: 2022-12-10_06:28:35.666094) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:28:37.319906 run osmo-stp_10.42.42.5(pid=4693): stderr: | 20221210062835833 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062835834 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062835834 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062835834 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062835836 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062835837 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062835837 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:28:37.459831 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4693): Process ended prematurely: osmo-stp_10.42.42.5(pid=4693) [trial-2370↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4693)] [trial-2370↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 06:28:37.468943 tst mo_mt_call.py:8: Test FAILED (5.9 sec) 06:28:37.495675 run osmo-hlr_10.42.42.2(pid=4690): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4690)] 06:28:37.543761 run osmo-hlr_10.42.42.2(pid=4690): stdout: | (launched: 2022-12-10_06:28:34.761267) 06:28:37.592714 run osmo-hlr_10.42.42.2(pid=4690): stderr: | 20221210062834934 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210062834934 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210062834934 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210062834934 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210062834934 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210062834934 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210062835067 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210062835077 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210062835078 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210062835078 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:28:37.661085 run osmo-msc_10.42.42.6(pid=4696): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4696)] 06:28:37.708435 run osmo-msc_10.42.42.6(pid=4696): stdout: | (launched: 2022-12-10_06:28:36.613165) 06:28:37.757370 run osmo-msc_10.42.42.6(pid=4696): stderr: | 20221210062836886 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210062836886 DLGLOBAL DEBUG validating counter group 0x7f3f11a0fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210062836887 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210062836887 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210062836887 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210062836887 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210062836889 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210062836889 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210062836889 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210062836889 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:28:37.806871 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4689): Terminating (SIGTERM) 06:28:37.846439 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4692): Terminating (SIGTERM) 06:28:37.886071 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4695): Terminating (SIGTERM) 06:28:37.925726 --- ParallelTerminationStrategy: PID 4689 died... 06:28:37.944276 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4689): Terminated: ok {rc=0} 06:28:37.988579 --- ParallelTerminationStrategy: PID 4692 died... 06:28:38.006769 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4692): Terminated: ok {rc=0} 06:28:38.050991 --- ParallelTerminationStrategy: PID 4695 died... 06:28:38.069207 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4695): Terminated: ok {rc=0} 06:28:38.152012 bus /sierra_3: Setting Powered False 06:28:39.248885 bus /sierra_3: Setting Powered False 06:28:40.362029 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2370 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 06:28:41.508289 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:28:41.520585 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 06:28:41.582369 tst mo_mt_call_osmux.py: using LAC 26489 06:28:41.705503 tst mo_mt_call_osmux.py: using RAC 224 06:28:41.821103 tst mo_mt_call_osmux.py: using CellId 26489 06:28:41.937067 tst mo_mt_call_osmux.py: using BVCI 26490 06:28:42.045352 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:28:42.056463 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:28:42.067427 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:28:42.078699 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:28:42.090072 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:28:42.101394 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 06:28:42.216827 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 06:28:42.332127 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:28:42.784236 run create_hlr_db(pid=4698): Launched 06:28:42.894931 bus /sierra_2: Setting Powered False 06:28:43.953870 run create_hlr_db(pid=4698): Terminated: ok {rc=0} 06:28:44.380868 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4701): Launched 06:28:44.694097 run osmo-hlr_10.42.42.2(pid=4702): Launched 06:28:44.812636 run osmo-stp_10.42.42.5: Starting osmo-stp 06:28:45.356165 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4704): Launched 06:28:45.669415 run osmo-stp_10.42.42.5(pid=4705): Launched 06:28:45.788118 run osmo-msc_10.42.42.6: Starting osmo-msc 06:28:46.508111 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4707): Launched 06:28:46.849753 run osmo-msc_10.42.42.6(pid=4708): Launched 06:28:47.147625 run osmo-stp_10.42.42.5(pid=4705): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4705)] 06:28:47.360916 run osmo-stp_10.42.42.5(pid=4705): stdout: | (launched: 2022-12-10_06:28:45.612161) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:28:47.509977 run osmo-stp_10.42.42.5(pid=4705): stderr: | 20221210062845803 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062845803 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062845803 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062845804 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062845804 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062845804 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062845804 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:28:47.632616 run osmo-stp_10.42.42.5(pid=4705): stdout: | (launched: 2022-12-10_06:28:45.612161) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:28:47.749038 run osmo-stp_10.42.42.5(pid=4705): stderr: | 20221210062845803 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062845803 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062845803 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062845804 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062845804 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062845804 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062845804 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:28:47.889558 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4705): Process ended prematurely: osmo-stp_10.42.42.5(pid=4705) [trial-2370↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4705)] [trial-2370↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 06:28:47.898453 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 06:28:47.925079 run osmo-hlr_10.42.42.2(pid=4702): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4702)] 06:28:47.972048 run osmo-hlr_10.42.42.2(pid=4702): stdout: | (launched: 2022-12-10_06:28:44.637217) 06:28:48.020305 run osmo-hlr_10.42.42.2(pid=4702): stderr: | 20221210062844834 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210062844834 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210062844834 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210062844834 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210062844834 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210062844834 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210062844846 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210062844855 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210062844855 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210062844855 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:28:48.087744 run osmo-msc_10.42.42.6(pid=4708): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4708)] 06:28:48.134635 run osmo-msc_10.42.42.6(pid=4708): stdout: | (launched: 2022-12-10_06:28:46.779509) 06:28:48.182761 run osmo-msc_10.42.42.6(pid=4708): stderr: | 20221210062847210 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210062847211 DLGLOBAL DEBUG validating counter group 0x7f763cc65c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210062847211 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210062847211 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210062847211 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210062847211 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210062847215 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210062847217 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210062847218 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210062847218 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:28:48.231298 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4701): Terminating (SIGTERM) 06:28:48.269881 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4704): Terminating (SIGTERM) 06:28:48.308445 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4707): Terminating (SIGTERM) 06:28:48.347589 --- ParallelTerminationStrategy: PID 4701 died... 06:28:48.366140 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4701): Terminated: ok {rc=0} 06:28:48.409310 --- ParallelTerminationStrategy: PID 4704 died... 06:28:48.427235 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4704): Terminated: ok {rc=0} 06:28:48.470614 --- ParallelTerminationStrategy: PID 4707 died... 06:28:48.488598 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4707): Terminated: ok {rc=0} 06:28:48.573438 bus /sierra_3: Setting Powered False 06:28:49.670938 bus /sierra_3: Setting Powered False 06:28:50.783041 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 06:28:52.027524 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:28:52.035629 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 06:28:52.059698 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 06:28:52.087593 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 06:28:52.139561 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 06:28:52.163370 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 06:28:52.190103 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 06:28:52.748560 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 06:28:52.799561 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:28:52.811102 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 06:28:52.874549 tst mo_mt_call.py: using LAC 26490 06:28:52.996524 tst mo_mt_call.py: using RAC 225 06:28:53.118445 tst mo_mt_call.py: using CellId 26490 06:28:53.239898 tst mo_mt_call.py: using BVCI 26491 06:28:53.353726 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:28:53.365519 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:28:53.376794 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:28:53.388182 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:28:53.399639 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:28:53.411023 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 06:28:53.526207 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 06:28:53.643944 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:28:54.128180 run create_hlr_db(pid=4714): Launched 06:28:54.255258 bus /sierra_2: Setting Powered False 06:28:55.316761 run create_hlr_db(pid=4714): Terminated: ok {rc=0} 06:28:55.734311 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4716): Launched 06:28:56.025965 run osmo-hlr_10.42.42.2(pid=4717): Launched 06:28:56.137107 run osmo-stp_10.42.42.5: Starting osmo-stp 06:28:56.639583 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4719): Launched 06:28:56.931280 run osmo-stp_10.42.42.5(pid=4720): Launched 06:28:57.042662 run osmo-msc_10.42.42.6: Starting osmo-msc 06:28:57.571671 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4722): Launched 06:28:57.864699 run osmo-msc_10.42.42.6(pid=4723): Launched 06:28:58.029548 run osmo-stp_10.42.42.5(pid=4720): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4720)] 06:28:58.154547 run osmo-stp_10.42.42.5(pid=4720): stdout: | (launched: 2022-12-10_06:28:56.877985) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:28:58.279450 run osmo-stp_10.42.42.5(pid=4720): stderr: | 20221210062857045 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062857045 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062857045 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062857046 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062857048 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062857048 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062857048 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:28:58.402066 run osmo-stp_10.42.42.5(pid=4720): stdout: | (launched: 2022-12-10_06:28:56.877985) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:28:58.518286 run osmo-stp_10.42.42.5(pid=4720): stderr: | 20221210062857045 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062857045 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062857045 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062857046 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062857048 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062857048 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062857048 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:28:58.657386 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4720): Process ended prematurely: osmo-stp_10.42.42.5(pid=4720) [trial-2370↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4720)] [trial-2370↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 06:28:58.666235 tst mo_mt_call.py:8: Test FAILED (5.9 sec) 06:28:58.692461 run osmo-hlr_10.42.42.2(pid=4717): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4717)] 06:28:58.739210 run osmo-hlr_10.42.42.2(pid=4717): stdout: | (launched: 2022-12-10_06:28:55.971713) 06:28:58.787389 run osmo-hlr_10.42.42.2(pid=4717): stderr: | 20221210062856147 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210062856147 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210062856147 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210062856147 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210062856147 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210062856147 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210062856160 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210062856169 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210062856170 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210062856170 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:28:58.855428 run osmo-msc_10.42.42.6(pid=4723): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4723)] 06:28:58.902171 run osmo-msc_10.42.42.6(pid=4723): stdout: | (launched: 2022-12-10_06:28:57.810850) 06:28:58.950276 run osmo-msc_10.42.42.6(pid=4723): stderr: | 20221210062858082 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210062858084 DLGLOBAL DEBUG validating counter group 0x7fabce116c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210062858084 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210062858084 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210062858084 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210062858084 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210062858086 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210062858086 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210062858087 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210062858087 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:28:58.998698 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4716): Terminating (SIGTERM) 06:28:59.037362 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4719): Terminating (SIGTERM) 06:28:59.075972 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4722): Terminating (SIGTERM) 06:28:59.115692 --- ParallelTerminationStrategy: PID 4716 died... 06:28:59.134330 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4716): Terminated: ok {rc=0} 06:28:59.177593 --- ParallelTerminationStrategy: PID 4719 died... 06:28:59.195578 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4719): Terminated: ok {rc=0} 06:28:59.238551 --- ParallelTerminationStrategy: PID 4722 died... 06:28:59.256616 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4722): Terminated: ok {rc=0} 06:28:59.341628 bus /sierra_3: Setting Powered False 06:29:00.437935 bus /sierra_3: Setting Powered False 06:29:01.546361 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2370 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 06:29:02.693208 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:29:02.705261 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 06:29:02.765442 tst mo_mt_call_osmux.py: using LAC 26491 06:29:02.887738 tst mo_mt_call_osmux.py: using RAC 226 06:29:03.010701 tst mo_mt_call_osmux.py: using CellId 26491 06:29:03.135315 tst mo_mt_call_osmux.py: using BVCI 26492 06:29:03.248206 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:29:03.259841 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:29:03.271250 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:29:03.282646 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:29:03.294221 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:29:03.305759 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 06:29:03.419784 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 06:29:03.532923 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:29:03.985491 run create_hlr_db(pid=4725): Launched 06:29:04.098003 bus /sierra_2: Setting Powered False 06:29:05.161167 run create_hlr_db(pid=4725): Terminated: ok {rc=0} 06:29:05.596637 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4727): Launched 06:29:05.909528 run osmo-hlr_10.42.42.2(pid=4728): Launched 06:29:06.029048 run osmo-stp_10.42.42.5: Starting osmo-stp 06:29:06.573484 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4730): Launched 06:29:06.885949 run osmo-stp_10.42.42.5(pid=4731): Launched 06:29:07.005805 run osmo-msc_10.42.42.6: Starting osmo-msc 06:29:07.573472 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4733): Launched 06:29:07.887501 run osmo-msc_10.42.42.6(pid=4734): Launched 06:29:08.062873 run osmo-stp_10.42.42.5(pid=4731): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4731)] 06:29:08.196269 run osmo-stp_10.42.42.5(pid=4731): stdout: | (launched: 2022-12-10_06:29:06.828900) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:29:08.329318 run osmo-stp_10.42.42.5(pid=4731): stderr: | 20221210062907018 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062907019 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062907019 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062907019 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062907020 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062907020 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062907020 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:29:08.461429 run osmo-stp_10.42.42.5(pid=4731): stdout: | (launched: 2022-12-10_06:29:06.828900) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:29:08.585853 run osmo-stp_10.42.42.5(pid=4731): stderr: | 20221210062907018 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062907019 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062907019 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062907019 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062907020 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062907020 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062907020 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:29:08.734680 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4731): Process ended prematurely: osmo-stp_10.42.42.5(pid=4731) [trial-2370↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4731)] [trial-2370↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 06:29:08.744004 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 06:29:08.771406 run osmo-hlr_10.42.42.2(pid=4728): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4728)] 06:29:08.820504 run osmo-hlr_10.42.42.2(pid=4728): stdout: | (launched: 2022-12-10_06:29:05.852561) 06:29:08.871297 run osmo-hlr_10.42.42.2(pid=4728): stderr: | 20221210062906050 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210062906050 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210062906050 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210062906050 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210062906050 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210062906050 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210062906062 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210062906070 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210062906070 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210062906070 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:29:08.942216 run osmo-msc_10.42.42.6(pid=4734): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4734)] 06:29:08.991149 run osmo-msc_10.42.42.6(pid=4734): stdout: | (launched: 2022-12-10_06:29:07.829070) 06:29:09.041867 run osmo-msc_10.42.42.6(pid=4734): stderr: | 20221210062908151 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210062908151 DLGLOBAL DEBUG validating counter group 0x7f1c12b79c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210062908151 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210062908151 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210062908151 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210062908152 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210062908153 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210062908154 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210062908154 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210062908154 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:29:09.092790 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4727): Terminating (SIGTERM) 06:29:09.135951 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4730): Terminating (SIGTERM) 06:29:09.175197 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4733): Terminating (SIGTERM) 06:29:09.215083 --- ParallelTerminationStrategy: PID 4727 died... 06:29:09.233566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4727): Terminated: ok {rc=0} 06:29:09.277723 --- ParallelTerminationStrategy: PID 4730 died... 06:29:09.295833 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4730): Terminated: ok {rc=0} 06:29:09.340276 --- ParallelTerminationStrategy: PID 4733 died... 06:29:09.358603 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4733): Terminated: ok {rc=0} 06:29:09.444015 bus /sierra_3: Setting Powered False 06:29:10.543169 bus /sierra_3: Setting Powered False 06:29:11.657402 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 06:29:12.896245 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:29:12.904089 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 06:29:12.928206 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 06:29:12.955159 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 06:29:13.008590 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 06:29:13.033593 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 06:29:13.060466 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 06:29:13.611000 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 06:29:13.660887 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:29:13.672464 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 06:29:13.732942 tst mo_mt_call.py: using LAC 26492 06:29:13.856701 tst mo_mt_call.py: using RAC 227 06:29:13.979061 tst mo_mt_call.py: using CellId 26492 06:29:14.100828 tst mo_mt_call.py: using BVCI 26493 06:29:14.216846 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:29:14.228430 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:29:14.239784 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:29:14.251092 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:29:14.262573 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:29:14.273921 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 06:29:14.387367 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 06:29:14.502084 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:29:14.954864 run create_hlr_db(pid=4740): Launched 06:29:15.067797 bus /sierra_2: Setting Powered False 06:29:16.125488 run create_hlr_db(pid=4740): Terminated: ok {rc=0} 06:29:16.569778 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4742): Launched 06:29:16.889765 run osmo-hlr_10.42.42.2(pid=4743): Launched 06:29:17.118361 run osmo-stp_10.42.42.5: Starting osmo-stp 06:29:17.701380 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4745): Launched 06:29:18.015139 run osmo-stp_10.42.42.5(pid=4746): Launched 06:29:18.135245 run osmo-msc_10.42.42.6: Starting osmo-msc 06:29:18.702231 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4748): Launched 06:29:19.015871 run osmo-msc_10.42.42.6(pid=4749): Launched 06:29:19.191844 run osmo-stp_10.42.42.5(pid=4746): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4746)] 06:29:19.325179 run osmo-stp_10.42.42.5(pid=4746): stdout: | (launched: 2022-12-10_06:29:17.957965) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:29:19.458012 run osmo-stp_10.42.42.5(pid=4746): stderr: | 20221210062918151 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062918151 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062918151 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062918151 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062918152 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062918152 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062918152 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:29:19.591000 run osmo-stp_10.42.42.5(pid=4746): stdout: | (launched: 2022-12-10_06:29:17.957965) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:29:19.715292 run osmo-stp_10.42.42.5(pid=4746): stderr: | 20221210062918151 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062918151 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062918151 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062918151 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062918152 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062918152 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062918152 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:29:19.864727 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4746): Process ended prematurely: osmo-stp_10.42.42.5(pid=4746) [trial-2370↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4746)] [trial-2370↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 06:29:19.874313 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 06:29:19.901652 run osmo-hlr_10.42.42.2(pid=4743): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4743)] 06:29:19.950379 run osmo-hlr_10.42.42.2(pid=4743): stdout: | (launched: 2022-12-10_06:29:16.821227) 06:29:20.001271 run osmo-hlr_10.42.42.2(pid=4743): stderr: | 20221210062917165 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210062917165 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210062917165 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210062917165 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210062917165 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210062917165 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210062917182 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210062917198 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210062917199 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210062917199 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:29:20.071790 run osmo-msc_10.42.42.6(pid=4749): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4749)] 06:29:20.121289 run osmo-msc_10.42.42.6(pid=4749): stdout: | (launched: 2022-12-10_06:29:18.958729) 06:29:20.172233 run osmo-msc_10.42.42.6(pid=4749): stderr: | 20221210062919281 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210062919281 DLGLOBAL DEBUG validating counter group 0x7f1e3458ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210062919282 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210062919282 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210062919282 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210062919282 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210062919285 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210062919285 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210062919285 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210062919285 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:29:20.223500 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4742): Terminating (SIGTERM) 06:29:20.264277 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4745): Terminating (SIGTERM) 06:29:20.305233 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4748): Terminating (SIGTERM) 06:29:20.346523 --- ParallelTerminationStrategy: PID 4742 died... 06:29:20.366252 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4742): Terminated: ok {rc=0} 06:29:20.411560 --- ParallelTerminationStrategy: PID 4745 died... 06:29:20.430746 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4745): Terminated: ok {rc=0} 06:29:20.475913 --- ParallelTerminationStrategy: PID 4748 died... 06:29:20.495194 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4748): Terminated: ok {rc=0} 06:29:20.581744 bus /sierra_3: Setting Powered False 06:29:21.679236 bus /sierra_3: Setting Powered False 06:29:22.793503 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2370 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 06:29:23.938534 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:29:23.950809 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 06:29:24.011790 tst mo_mt_call_osmux.py: using LAC 26493 06:29:24.127351 tst mo_mt_call_osmux.py: using RAC 228 06:29:24.242584 tst mo_mt_call_osmux.py: using CellId 26493 06:29:24.357618 tst mo_mt_call_osmux.py: using BVCI 26494 06:29:24.466196 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:29:24.477344 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:29:24.488297 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:29:24.499633 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:29:24.510634 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:29:24.521535 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 06:29:24.640212 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 06:29:24.755221 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:29:25.210394 run create_hlr_db(pid=4751): Launched 06:29:25.321382 bus /sierra_2: Setting Powered False 06:29:26.379970 run create_hlr_db(pid=4751): Terminated: ok {rc=0} 06:29:26.786610 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4753): Launched 06:29:27.079132 run osmo-hlr_10.42.42.2(pid=4754): Launched 06:29:27.191194 run osmo-stp_10.42.42.5: Starting osmo-stp 06:29:27.704743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4756): Launched 06:29:27.997165 run osmo-stp_10.42.42.5(pid=4757): Launched 06:29:28.109611 run osmo-msc_10.42.42.6: Starting osmo-msc 06:29:28.645053 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4759): Launched 06:29:28.938901 run osmo-msc_10.42.42.6(pid=4760): Launched 06:29:29.103343 run osmo-stp_10.42.42.5(pid=4757): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4757)] 06:29:29.228313 run osmo-stp_10.42.42.5(pid=4757): stdout: | (launched: 2022-12-10_06:29:27.943444) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:29:29.353595 run osmo-stp_10.42.42.5(pid=4757): stderr: | 20221210062928113 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062928113 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062928113 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062928114 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062928114 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062928114 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062928114 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:29:29.476444 run osmo-stp_10.42.42.5(pid=4757): stdout: | (launched: 2022-12-10_06:29:27.943444) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:29:29.593460 run osmo-stp_10.42.42.5(pid=4757): stderr: | 20221210062928113 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062928113 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062928113 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062928114 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062928114 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062928114 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062928114 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:29:29.733534 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4757): Process ended prematurely: osmo-stp_10.42.42.5(pid=4757) [trial-2370↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4757)] [trial-2370↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 06:29:29.742307 tst mo_mt_call_osmux.py:8: Test FAILED (5.8 sec) 06:29:29.768552 run osmo-hlr_10.42.42.2(pid=4754): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4754)] 06:29:29.815330 run osmo-hlr_10.42.42.2(pid=4754): stdout: | (launched: 2022-12-10_06:29:27.025613) 06:29:29.863485 run osmo-hlr_10.42.42.2(pid=4754): stderr: | 20221210062927199 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210062927199 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210062927199 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210062927199 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210062927199 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210062927199 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210062927211 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210062927220 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210062927220 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210062927220 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:29:29.931089 run osmo-msc_10.42.42.6(pid=4760): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4760)] 06:29:29.977690 run osmo-msc_10.42.42.6(pid=4760): stdout: | (launched: 2022-12-10_06:29:28.884867) 06:29:30.025802 run osmo-msc_10.42.42.6(pid=4760): stderr: | 20221210062929155 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210062929155 DLGLOBAL DEBUG validating counter group 0x7f55a96e6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210062929155 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210062929155 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210062929155 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210062929156 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210062929157 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210062929158 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210062929158 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210062929158 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:29:30.074440 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4753): Terminating (SIGTERM) 06:29:30.113311 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4756): Terminating (SIGTERM) 06:29:30.151984 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4759): Terminating (SIGTERM) 06:29:30.190983 --- ParallelTerminationStrategy: PID 4753 died... 06:29:30.209584 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4753): Terminated: ok {rc=0} 06:29:30.253144 --- ParallelTerminationStrategy: PID 4756 died... 06:29:30.271343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4756): Terminated: ok {rc=0} 06:29:30.314506 --- ParallelTerminationStrategy: PID 4759 died... 06:29:30.332740 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4759): Terminated: ok {rc=0} 06:29:30.415293 bus /sierra_3: Setting Powered False 06:29:31.510072 bus /sierra_3: Setting Powered False 06:29:32.628472 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 06:29:33.862379 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:29:33.869491 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 06:29:33.893162 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 06:29:33.919443 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 06:29:33.971484 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 06:29:33.995035 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 06:29:34.021160 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 06:29:34.574543 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 06:29:34.624804 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:29:34.636741 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 06:29:34.695677 tst mo_mt_call.py: using LAC 26494 06:29:34.817987 tst mo_mt_call.py: using RAC 229 06:29:34.940065 tst mo_mt_call.py: using CellId 26494 06:29:35.062457 tst mo_mt_call.py: using BVCI 26495 06:29:35.177547 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:29:35.189208 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:29:35.200671 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:29:35.212121 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:29:35.223735 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:29:35.235105 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 06:29:35.347700 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 06:29:35.465133 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:29:35.948019 run create_hlr_db(pid=4765): Launched 06:29:36.074917 bus /sierra_2: Setting Powered False 06:29:37.136866 run create_hlr_db(pid=4765): Terminated: ok {rc=0} 06:29:37.572081 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4767): Launched 06:29:37.885098 run osmo-hlr_10.42.42.2(pid=4768): Launched 06:29:38.003470 run osmo-stp_10.42.42.5: Starting osmo-stp 06:29:38.543280 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4770): Launched 06:29:38.856677 run osmo-stp_10.42.42.5(pid=4771): Launched 06:29:38.976502 run osmo-msc_10.42.42.6: Starting osmo-msc 06:29:39.544314 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4773): Launched 06:29:39.856838 run osmo-msc_10.42.42.6(pid=4774): Launched 06:29:40.033147 run osmo-stp_10.42.42.5(pid=4771): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4771)] 06:29:40.165698 run osmo-stp_10.42.42.5(pid=4771): stdout: | (launched: 2022-12-10_06:29:38.799748) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:29:40.298944 run osmo-stp_10.42.42.5(pid=4771): stderr: | 20221210062938990 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062938990 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062938991 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062938991 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062938991 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062938991 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062938991 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:29:40.431721 run osmo-stp_10.42.42.5(pid=4771): stdout: | (launched: 2022-12-10_06:29:38.799748) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:29:40.555960 run osmo-stp_10.42.42.5(pid=4771): stderr: | 20221210062938990 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062938990 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062938991 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062938991 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062938991 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062938991 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062938991 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:29:40.704667 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4771): Process ended prematurely: osmo-stp_10.42.42.5(pid=4771) [trial-2370↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4771)] [trial-2370↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 06:29:40.714064 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 06:29:40.741282 run osmo-hlr_10.42.42.2(pid=4768): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4768)] 06:29:40.790252 run osmo-hlr_10.42.42.2(pid=4768): stdout: | (launched: 2022-12-10_06:29:37.827447) 06:29:40.840778 run osmo-hlr_10.42.42.2(pid=4768): stderr: | 20221210062938023 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210062938023 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210062938023 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210062938023 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210062938023 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210062938023 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210062938036 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210062938045 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210062938045 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210062938045 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:29:40.911742 run osmo-msc_10.42.42.6(pid=4774): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4774)] 06:29:40.960550 run osmo-msc_10.42.42.6(pid=4774): stdout: | (launched: 2022-12-10_06:29:39.799814) 06:29:41.011043 run osmo-msc_10.42.42.6(pid=4774): stderr: | 20221210062940121 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210062940122 DLGLOBAL DEBUG validating counter group 0x7f7d08d65c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210062940122 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210062940122 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210062940122 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210062940122 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210062940124 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210062940124 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210062940124 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210062940124 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:29:41.062221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4767): Terminating (SIGTERM) 06:29:41.102487 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4770): Terminating (SIGTERM) 06:29:41.143315 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4773): Terminating (SIGTERM) 06:29:41.184178 --- ParallelTerminationStrategy: PID 4767 died... 06:29:41.203767 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4767): Terminated: ok {rc=0} 06:29:41.248750 --- ParallelTerminationStrategy: PID 4770 died... 06:29:41.267847 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4770): Terminated: ok {rc=0} 06:29:41.312549 --- ParallelTerminationStrategy: PID 4773 died... 06:29:41.331681 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4773): Terminated: ok {rc=0} 06:29:41.417771 bus /sierra_3: Setting Powered False 06:29:42.513386 bus /sierra_3: Setting Powered False 06:29:43.627345 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2370 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 06:29:44.768396 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:29:44.780181 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 06:29:44.839071 tst mo_mt_call_osmux.py: using LAC 26495 06:29:44.954849 tst mo_mt_call_osmux.py: using RAC 230 06:29:45.069119 tst mo_mt_call_osmux.py: using CellId 26495 06:29:45.186464 tst mo_mt_call_osmux.py: using BVCI 26496 06:29:45.294064 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:29:45.305139 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:29:45.315982 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:29:45.327186 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:29:45.338357 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:29:45.349546 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 06:29:45.465373 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 06:29:45.580681 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:29:46.073903 run create_hlr_db(pid=4776): Launched 06:29:46.239946 bus /sierra_2: Setting Powered False 06:29:47.300529 run create_hlr_db(pid=4776): Terminated: ok {rc=0} 06:29:47.724368 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4778): Launched 06:29:48.017695 run osmo-hlr_10.42.42.2(pid=4779): Launched 06:29:48.129682 run osmo-stp_10.42.42.5: Starting osmo-stp 06:29:48.646142 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4781): Launched 06:29:48.938386 run osmo-stp_10.42.42.5(pid=4782): Launched 06:29:49.049761 run osmo-msc_10.42.42.6: Starting osmo-msc 06:29:49.578619 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4784): Launched 06:29:49.871080 run osmo-msc_10.42.42.6(pid=4785): Launched 06:29:50.034963 run osmo-stp_10.42.42.5(pid=4782): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4782)] 06:29:50.159099 run osmo-stp_10.42.42.5(pid=4782): stdout: | (launched: 2022-12-10_06:29:48.884593) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:29:50.283901 run osmo-stp_10.42.42.5(pid=4782): stderr: | 20221210062949053 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062949054 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062949054 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062949054 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062949055 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062949055 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062949055 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:29:50.406091 run osmo-stp_10.42.42.5(pid=4782): stdout: | (launched: 2022-12-10_06:29:48.884593) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:29:50.522750 run osmo-stp_10.42.42.5(pid=4782): stderr: | 20221210062949053 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062949054 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062949054 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062949054 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062949055 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062949055 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062949055 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:29:50.662276 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4782): Process ended prematurely: osmo-stp_10.42.42.5(pid=4782) [trial-2370↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4782)] [trial-2370↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 06:29:50.671253 tst mo_mt_call_osmux.py:8: Test FAILED (5.9 sec) 06:29:50.697875 run osmo-hlr_10.42.42.2(pid=4779): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4779)] 06:29:50.744769 run osmo-hlr_10.42.42.2(pid=4779): stdout: | (launched: 2022-12-10_06:29:47.963997) 06:29:50.793277 run osmo-hlr_10.42.42.2(pid=4779): stderr: | 20221210062948138 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210062948138 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210062948138 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210062948138 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210062948138 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210062948138 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210062948151 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210062948161 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210062948161 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210062948161 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:29:50.860842 run osmo-msc_10.42.42.6(pid=4785): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4785)] 06:29:50.907541 run osmo-msc_10.42.42.6(pid=4785): stdout: | (launched: 2022-12-10_06:29:49.817280) 06:29:50.955928 run osmo-msc_10.42.42.6(pid=4785): stderr: | 20221210062950091 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210062950091 DLGLOBAL DEBUG validating counter group 0x7f409c97ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210062950091 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210062950091 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210062950092 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210062950092 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210062950094 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210062950094 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210062950094 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210062950094 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:29:51.004747 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4778): Terminating (SIGTERM) 06:29:51.043593 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4781): Terminating (SIGTERM) 06:29:51.082779 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4784): Terminating (SIGTERM) 06:29:51.121956 --- ParallelTerminationStrategy: PID 4778 died... 06:29:51.140554 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4778): Terminated: ok {rc=0} 06:29:51.184016 --- ParallelTerminationStrategy: PID 4781 died... 06:29:51.202271 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4781): Terminated: ok {rc=0} 06:29:51.245900 --- ParallelTerminationStrategy: PID 4784 died... 06:29:51.264160 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4784): Terminated: ok {rc=0} 06:29:51.348643 bus /sierra_3: Setting Powered False 06:29:52.445391 bus /sierra_3: Setting Powered False 06:29:53.558777 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 06:29:54.792634 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:29:54.799892 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 06:29:54.823408 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 06:29:54.850803 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 06:29:54.902398 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 06:29:54.926227 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 06:29:54.952792 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 06:29:55.503601 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 06:29:55.550797 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:29:55.562116 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 06:29:55.624639 tst mo_mt_call.py: using LAC 26496 06:29:55.738974 tst mo_mt_call.py: using RAC 231 06:29:55.851940 tst mo_mt_call.py: using CellId 26496 06:29:55.964804 tst mo_mt_call.py: using BVCI 26497 06:29:56.070863 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:29:56.082201 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:29:56.093151 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:29:56.104554 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:29:56.116016 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:29:56.127398 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:29:56.244716 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:29:56.360028 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:29:56.814751 run create_hlr_db(pid=4790): Launched 06:29:56.926512 bus /sierra_2: Setting Powered False 06:29:57.985340 run create_hlr_db(pid=4790): Terminated: ok {rc=0} 06:29:58.414985 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4792): Launched 06:29:58.730038 run osmo-hlr_10.42.42.2(pid=4793): Launched 06:29:58.850229 run osmo-stp_10.42.42.5: Starting osmo-stp 06:29:59.391802 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4795): Launched 06:29:59.706077 run osmo-stp_10.42.42.5(pid=4796): Launched 06:29:59.826110 run osmo-msc_10.42.42.6: Starting osmo-msc 06:30:00.397560 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4798): Launched 06:30:00.709993 run osmo-msc_10.42.42.6(pid=4799): Launched 06:30:00.884161 run osmo-stp_10.42.42.5(pid=4796): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4796)] 06:30:01.130018 run osmo-stp_10.42.42.5(pid=4796): stdout: | (launched: 2022-12-10_06:29:59.648791) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:30:01.467178 run osmo-stp_10.42.42.5(pid=4796): stderr: | 20221210062959839 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062959840 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062959840 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062959840 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062959841 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062959841 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062959841 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:30:01.642062 run osmo-stp_10.42.42.5(pid=4796): stdout: | (launched: 2022-12-10_06:29:59.648791) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:30:01.783821 run osmo-stp_10.42.42.5(pid=4796): stderr: | 20221210062959839 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210062959840 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210062959840 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210062959840 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210062959841 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210062959841 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210062959841 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:30:01.995678 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4796): Process ended prematurely: osmo-stp_10.42.42.5(pid=4796) [trial-2370↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4796)] [trial-2370↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 06:30:02.011838 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 06:30:02.052183 run osmo-hlr_10.42.42.2(pid=4793): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4793)] 06:30:02.107226 run osmo-hlr_10.42.42.2(pid=4793): stdout: | (launched: 2022-12-10_06:29:58.672701) 06:30:02.159904 run osmo-hlr_10.42.42.2(pid=4793): stderr: | 20221210062958870 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210062958870 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210062958870 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210062958871 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210062958871 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210062958871 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210062958885 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210062958893 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210062958893 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210062958893 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:30:02.231735 run osmo-msc_10.42.42.6(pid=4799): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4799)] 06:30:02.281270 run osmo-msc_10.42.42.6(pid=4799): stdout: | (launched: 2022-12-10_06:30:00.652942) 06:30:02.344698 run osmo-msc_10.42.42.6(pid=4799): stderr: | 20221210063001138 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210063001138 DLGLOBAL DEBUG validating counter group 0x7fe3d0687c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210063001139 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210063001139 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210063001139 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210063001139 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210063001151 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210063001152 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210063001152 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210063001152 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:30:02.410744 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4792): Terminating (SIGTERM) 06:30:02.462470 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4795): Terminating (SIGTERM) 06:30:02.514740 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4798): Terminating (SIGTERM) 06:30:02.568255 --- ParallelTerminationStrategy: PID 4792 died... 06:30:02.593962 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4792): Terminated: ok {rc=0} 06:30:02.651618 --- ParallelTerminationStrategy: PID 4795 died... 06:30:02.675590 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4795): Terminated: ok {rc=0} 06:30:02.734368 --- ParallelTerminationStrategy: PID 4798 died... 06:30:02.759338 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4798): Terminated: ok {rc=0} 06:30:02.860014 bus /sierra_3: Setting Powered False 06:30:03.956565 bus /sierra_3: Setting Powered False 06:30:05.071011 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2370 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 06:30:06.213456 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:30:06.225496 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 06:30:06.285501 tst mo_mt_call_osmux.py: using LAC 26497 06:30:06.402137 tst mo_mt_call_osmux.py: using RAC 232 06:30:06.526589 tst mo_mt_call_osmux.py: using CellId 26497 06:30:06.642953 tst mo_mt_call_osmux.py: using BVCI 26498 06:30:06.750570 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:30:06.761910 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:30:06.772942 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:30:06.784293 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:30:06.795471 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:30:06.806643 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:30:06.921600 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:30:07.040553 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:30:07.527626 run create_hlr_db(pid=4811): Launched 06:30:07.655316 bus /sierra_2: Setting Powered False 06:30:08.717447 run create_hlr_db(pid=4811): Terminated: ok {rc=0} 06:30:09.152670 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4813): Launched 06:30:09.465907 run osmo-hlr_10.42.42.2(pid=4814): Launched 06:30:09.585779 run osmo-stp_10.42.42.5: Starting osmo-stp 06:30:10.131314 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4816): Launched 06:30:10.446112 run osmo-stp_10.42.42.5(pid=4817): Launched 06:30:10.567124 run osmo-msc_10.42.42.6: Starting osmo-msc 06:30:11.137134 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4819): Launched 06:30:11.451629 run osmo-msc_10.42.42.6(pid=4820): Launched 06:30:11.628290 run osmo-stp_10.42.42.5(pid=4817): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4817)] 06:30:11.761693 run osmo-stp_10.42.42.5(pid=4817): stdout: | (launched: 2022-12-10_06:30:10.388847) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:30:11.895407 run osmo-stp_10.42.42.5(pid=4817): stderr: | 20221210063010581 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063010581 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063010581 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063010582 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063010584 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063010584 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063010584 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:30:12.028791 run osmo-stp_10.42.42.5(pid=4817): stdout: | (launched: 2022-12-10_06:30:10.388847) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:30:12.154657 run osmo-stp_10.42.42.5(pid=4817): stderr: | 20221210063010581 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063010581 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063010581 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063010582 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063010584 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063010584 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063010584 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:30:12.307983 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4817): Process ended prematurely: osmo-stp_10.42.42.5(pid=4817) [trial-2370↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4817)] [trial-2370↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 06:30:12.317930 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 06:30:12.346020 run osmo-hlr_10.42.42.2(pid=4814): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4814)] 06:30:12.395955 run osmo-hlr_10.42.42.2(pid=4814): stdout: | (launched: 2022-12-10_06:30:09.409040) 06:30:12.447661 run osmo-hlr_10.42.42.2(pid=4814): stderr: | 20221210063009607 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210063009607 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210063009607 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210063009607 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210063009607 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210063009607 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210063009620 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210063009630 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210063009630 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210063009630 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:30:12.519695 run osmo-msc_10.42.42.6(pid=4820): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4820)] 06:30:12.570714 run osmo-msc_10.42.42.6(pid=4820): stdout: | (launched: 2022-12-10_06:30:11.394348) 06:30:12.623880 run osmo-msc_10.42.42.6(pid=4820): stderr: | 20221210063011716 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210063011716 DLGLOBAL DEBUG validating counter group 0x7feb2be31c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210063011716 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210063011716 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210063011716 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210063011717 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210063011718 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210063011719 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210063011719 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210063011719 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:30:12.676599 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4813): Terminating (SIGTERM) 06:30:12.719033 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4816): Terminating (SIGTERM) 06:30:12.763322 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4819): Terminating (SIGTERM) 06:30:12.804924 --- ParallelTerminationStrategy: PID 4813 died... 06:30:12.824795 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4813): Terminated: ok {rc=0} 06:30:12.870730 --- ParallelTerminationStrategy: PID 4816 died... 06:30:12.890442 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4816): Terminated: ok {rc=0} 06:30:12.937230 --- ParallelTerminationStrategy: PID 4819 died... 06:30:12.956733 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4819): Terminated: ok {rc=0} 06:30:13.045221 bus /sierra_3: Setting Powered False 06:30:14.145393 bus /sierra_3: Setting Powered False 06:30:15.262578 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 emergency:nanobts+band-1900 --------------------------------------------------------------------- 06:30:16.516485 tst emergency:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:30:16.523080 tst emergency:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 06:30:16.548459 tst emergency:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 06:30:16.576842 tst emergency:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 06:30:16.665141 tst emergency:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 06:30:16.699425 tst emergency:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 06:30:16.735327 tst emergency:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 06:30:17.317574 tst emergency:nanobts+band-1900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2370 emergency:nanobts+band-1900 emergency_mo_mt_call.py ---------------------------------------------- 06:30:17.323479 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 06:30:17.335202 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 06:30:17.377705 tst emergency_mo_mt_call.py: using LAC 26498 06:30:17.497368 tst emergency_mo_mt_call.py: using RAC 233 06:30:17.616860 tst emergency_mo_mt_call.py: using CellId 26498 06:30:17.739000 tst emergency_mo_mt_call.py: using BVCI 26499 06:30:17.850415 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 06:30:17.861481 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 06:30:17.872468 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 06:30:17.883457 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 06:30:17.894397 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 06:30:17.905288 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 06:30:18.018872 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 06:30:18.134010 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:30:18.611412 run create_hlr_db(pid=5176): Launched 06:30:18.737057 bus /sierra_2: Setting Powered False 06:30:19.798844 run create_hlr_db(pid=5176): Terminated: ok {rc=0} 06:30:20.229008 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5178): Launched 06:30:20.536274 run osmo-hlr_10.42.42.2(pid=5179): Launched 06:30:20.654123 run osmo-stp_10.42.42.5: Starting osmo-stp 06:30:21.189600 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5181): Launched 06:30:21.495046 run osmo-stp_10.42.42.5(pid=5182): Launched 06:30:21.622824 tst emergency_mo_mt_call.py: using MSISDN 7586 06:30:21.779100 run osmo-msc_10.42.42.6: Starting osmo-msc 06:30:22.332476 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5184): Launched 06:30:22.647069 run osmo-msc_10.42.42.6(pid=5190): Launched 06:30:22.859551 run osmo-stp_10.42.42.5(pid=5182): ERR: Terminated: ERROR {rc=1} [trial-2370↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5182)] 06:30:23.090003 run osmo-stp_10.42.42.5(pid=5182): stdout: | (launched: 2022-12-10_06:30:21.438961) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:30:23.258512 run osmo-stp_10.42.42.5(pid=5182): stderr: | 20221210063021628 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063021629 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063021629 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063021629 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063021631 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063021632 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063021632 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:30:23.433829 run osmo-stp_10.42.42.5(pid=5182): stdout: | (launched: 2022-12-10_06:30:21.438961) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:30:23.599430 run osmo-stp_10.42.42.5(pid=5182): stderr: | 20221210063021628 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063021629 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063021629 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063021629 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063021631 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063021632 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063021632 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:30:23.749197 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=5182): Process ended prematurely: osmo-stp_10.42.42.5(pid=5182) [trial-2370↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5182)] [trial-2370↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19] 06:30:23.761923 tst emergency_mo_mt_call.py:19: Test FAILED (6.4 sec) 06:30:23.790484 run osmo-hlr_10.42.42.2(pid=5179): ERR: Terminated: ERROR {rc=237} [trial-2370↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5179)] 06:30:23.840854 run osmo-hlr_10.42.42.2(pid=5179): stdout: | (launched: 2022-12-10_06:30:20.480000) 06:30:23.892503 run osmo-hlr_10.42.42.2(pid=5179): stderr: | 20221210063020676 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210063020676 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210063020677 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210063020677 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210063020677 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210063020677 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210063020689 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/emergency:nanobts+band-1900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210063020698 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210063020699 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210063020699 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:30:23.964842 run osmo-msc_10.42.42.6(pid=5190): ERR: Terminated: ERROR {rc=2} [trial-2370↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5190)] 06:30:24.015733 run osmo-msc_10.42.42.6(pid=5190): stdout: | (launched: 2022-12-10_06:30:22.585212) 06:30:24.067989 run osmo-msc_10.42.42.6(pid=5190): stderr: | 20221210063023115 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210063023115 DLGLOBAL DEBUG validating counter group 0x7f59dc32fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210063023115 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210063023115 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210063023115 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210063023115 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210063023117 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210063023118 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210063023118 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210063023118 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:30:24.120794 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5178): Terminating (SIGTERM) 06:30:24.164363 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5181): Terminating (SIGTERM) 06:30:24.209587 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5184): Terminating (SIGTERM) 06:30:24.254684 --- ParallelTerminationStrategy: PID 5178 died... 06:30:24.275480 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5178): Terminated: ok {rc=0} 06:30:24.323853 --- ParallelTerminationStrategy: PID 5181 died... 06:30:24.344483 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5181): Terminated: ok {rc=0} 06:30:24.391351 --- ParallelTerminationStrategy: PID 5184 died... 06:30:24.411698 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5184): Terminated: ok {rc=0} 06:30:24.502071 bus /sierra_3: Setting Powered False 06:30:25.599260 bus /sierra_3: Setting Powered False 06:30:26.717076 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2370 emergency:nanobts+band-1900 emergency_preemptive_call.py ---------------------------------------------- 06:30:27.808009 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 06:30:27.821248 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 06:30:27.864801 tst emergency_preemptive_call.py: using LAC 26499 06:30:27.988811 tst emergency_preemptive_call.py: using RAC 234 06:30:28.111590 tst emergency_preemptive_call.py: using CellId 26499 06:30:28.238398 tst emergency_preemptive_call.py: using BVCI 26500 06:30:28.354894 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 06:30:28.367082 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 06:30:28.379128 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 06:30:28.391485 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 06:30:28.403570 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 06:30:28.415755 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 06:30:28.539593 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 06:30:28.665389 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 06:30:28.788651 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 06:30:28.907098 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:30:29.354421 run create_hlr_db(pid=5363): Launched 06:30:29.463669 bus /sierra_2: Setting Powered False 06:30:30.522607 run create_hlr_db(pid=5363): Terminated: ok {rc=0} 06:30:30.961707 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5365): Launched 06:30:31.291578 run osmo-hlr_10.42.42.2(pid=5366): Launched 06:30:31.535470 run osmo-stp_10.42.42.5: Starting osmo-stp 06:30:32.181640 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5368): Launched 06:30:32.489759 run osmo-stp_10.42.42.5(pid=5369): Launched 06:30:32.617818 tst emergency_preemptive_call.py: using MSISDN 7587 06:30:32.778997 run osmo-msc_10.42.42.6: Starting osmo-msc 06:30:33.334067 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5371): Launched 06:30:33.642216 run osmo-msc_10.42.42.6(pid=5372): Launched 06:30:33.814240 run osmo-stp_10.42.42.5(pid=5369): ERR: Terminated: ERROR {rc=1} [trial-2370↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5369)] 06:30:33.945445 run osmo-stp_10.42.42.5(pid=5369): stdout: | (launched: 2022-12-10_06:30:32.433532) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:30:34.076603 run osmo-stp_10.42.42.5(pid=5369): stderr: | 20221210063032623 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063032623 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063032624 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063032624 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063032624 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063032625 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063032625 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:30:34.207028 run osmo-stp_10.42.42.5(pid=5369): stdout: | (launched: 2022-12-10_06:30:32.433532) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:30:34.329404 run osmo-stp_10.42.42.5(pid=5369): stderr: | 20221210063032623 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063032623 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063032624 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063032624 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063032624 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063032625 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063032625 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:30:34.476375 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=5369): Process ended prematurely: osmo-stp_10.42.42.5(pid=5369) [trial-2370↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5369)] [trial-2370↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32] 06:30:34.485345 tst emergency_preemptive_call.py:32: Test FAILED (6.7 sec) 06:30:34.512490 run osmo-hlr_10.42.42.2(pid=5366): ERR: Terminated: ERROR {rc=237} [trial-2370↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5366)] 06:30:34.561620 run osmo-hlr_10.42.42.2(pid=5366): stdout: | (launched: 2022-12-10_06:30:31.230714) 06:30:34.612256 run osmo-hlr_10.42.42.2(pid=5366): stderr: | 20221210063031527 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210063031527 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210063031527 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210063031528 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210063031528 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210063031528 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210063031551 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/emergency:nanobts+band-1900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210063031561 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210063031561 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210063031561 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:30:34.683291 run osmo-msc_10.42.42.6(pid=5372): ERR: Terminated: ERROR {rc=2} [trial-2370↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5372)] 06:30:34.732335 run osmo-msc_10.42.42.6(pid=5372): stdout: | (launched: 2022-12-10_06:30:33.585728) 06:30:34.783441 run osmo-msc_10.42.42.6(pid=5372): stderr: | 20221210063033907 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210063033907 DLGLOBAL DEBUG validating counter group 0x7eff01886c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210063033907 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210063033907 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210063033907 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210063033907 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210063033911 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210063033912 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210063033912 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210063033912 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:30:34.834661 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5365): Terminating (SIGTERM) 06:30:34.875552 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5368): Terminating (SIGTERM) 06:30:34.916660 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5371): Terminating (SIGTERM) 06:30:34.958003 --- ParallelTerminationStrategy: PID 5365 died... 06:30:34.977732 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5365): Terminated: ok {rc=0} 06:30:35.023285 --- ParallelTerminationStrategy: PID 5368 died... 06:30:35.042595 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5368): Terminated: ok {rc=0} 06:30:35.087756 --- ParallelTerminationStrategy: PID 5371 died... 06:30:35.106954 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5371): Terminated: ok {rc=0} 06:30:35.193342 bus /sierra_9: Setting Powered False 06:30:36.290847 bus /sierra_9: Setting Powered False 06:30:37.406312 bus /sierra_8: Setting Powered False 06:30:38.502666 bus /sierra_8: Setting Powered False 06:30:39.615338 bus /sierra_3: Setting Powered False 06:30:40.709608 bus /sierra_3: Setting Powered False 06:30:41.822416 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 emergency:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 gprs:nanobts+band-1900 --------------------------------------------------------------------- 06:30:43.085668 tst gprs:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:30:43.090617 tst gprs:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 06:30:43.113744 tst gprs:nanobts+band-1900: Verifying 9 x ip_address (candidates: 9) 06:30:43.151508 tst gprs:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 06:30:43.236374 tst gprs:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 06:30:43.259349 tst gprs:nanobts+band-1900: Reserving 9 x ip_address (candidates: 9) 06:30:43.296813 tst gprs:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 06:30:43.886466 tst gprs:nanobts+band-1900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2370 gprs:nanobts+band-1900 cs_paging_gprs_active.py ---------------------------------------------- 06:30:43.934385 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:30:43.944900 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 06:30:43.983022 tst cs_paging_gprs_active.py: using LAC 26500 06:30:44.099404 tst cs_paging_gprs_active.py: using RAC 235 06:30:44.214755 tst cs_paging_gprs_active.py: using CellId 26500 06:30:44.332049 tst cs_paging_gprs_active.py: using BVCI 26501 06:30:44.438308 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:30:44.448869 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:30:44.459262 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:30:44.469992 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:30:44.480363 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:30:44.490956 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:30:44.501711 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:30:44.512594 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:30:44.523445 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 06:30:44.640519 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 06:30:44.754632 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 06:30:44.950969 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:30:45.244552 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5379): Launched 06:30:45.500879 run iperf3-srv_10.42.42.10(pid=5380): Launched 06:30:45.611157 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 06:30:45.806414 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:30:46.137702 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5381): Launched 06:30:46.417713 run iperf3-srv_10.42.42.10(pid=5382): Launched 06:30:46.531733 tst cs_paging_gprs_active.py:38: start network... 06:30:46.731566 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:30:47.199865 run create_hlr_db(pid=5383): Launched 06:30:47.342737 bus /sierra_2: Setting Powered False 06:30:48.405032 run create_hlr_db(pid=5383): Terminated: ok {rc=0} 06:30:48.842297 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5385): Launched 06:30:49.156716 run osmo-hlr_10.42.42.2(pid=5386): Launched 06:30:49.278206 run osmo-stp_10.42.42.5: Starting osmo-stp 06:30:49.820087 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5388): Launched 06:30:50.135183 run osmo-stp_10.42.42.5(pid=5389): Launched 06:30:50.256158 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:30:50.800514 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5391): Launched 06:30:50.921802 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:30:51.188705 run patchelf(pid=5392): Launched 06:30:51.365175 run osmo-stp_10.42.42.5(pid=5389): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5389)] 06:30:51.499058 run osmo-stp_10.42.42.5(pid=5389): stdout: | (launched: 2022-12-10_06:30:50.077711) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:30:51.634241 run osmo-stp_10.42.42.5(pid=5389): stderr: | 20221210063050268 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063050268 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063050268 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063050269 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063050271 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063050271 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063050271 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:30:51.769573 run osmo-stp_10.42.42.5(pid=5389): stdout: | (launched: 2022-12-10_06:30:50.077711) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:30:51.899119 run osmo-stp_10.42.42.5(pid=5389): stderr: | 20221210063050268 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063050268 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063050268 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063050269 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063050271 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063050271 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063050271 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:30:52.052482 run patchelf(pid=5392): Terminating (SIGINT) 06:30:52.229536 run patchelf(pid=5392): Terminated: ok {rc=0} 06:30:52.356900 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=5389): Process ended prematurely: osmo-stp_10.42.42.5(pid=5389) [trial-2370↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5389)] [trial-2370↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38] 06:30:52.367151 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 06:30:52.395363 run osmo-hlr_10.42.42.2(pid=5386): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5386)] 06:30:52.444363 run osmo-hlr_10.42.42.2(pid=5386): stdout: | (launched: 2022-12-10_06:30:49.099309) 06:30:52.495106 run osmo-hlr_10.42.42.2(pid=5386): stderr: | 20221210063049298 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210063049298 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210063049298 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210063049298 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210063049298 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210063049298 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210063049312 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:nanobts+band-1900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210063049320 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210063049320 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210063049321 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:30:52.546363 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5379): Terminating (SIGTERM) 06:30:52.587547 run iperf3-srv_10.42.42.10(pid=5380): Terminating (SIGTERM) 06:30:52.628623 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5381): Terminating (SIGTERM) 06:30:52.669846 run iperf3-srv_10.42.42.10(pid=5382): Terminating (SIGTERM) 06:30:52.710703 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5385): Terminating (SIGTERM) 06:30:52.752075 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5388): Terminating (SIGTERM) 06:30:52.793284 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5391): Terminating (SIGTERM) 06:30:52.834568 --- ParallelTerminationStrategy: PID 5379 died... 06:30:52.854461 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5379): Terminated: ok {rc=0} 06:30:52.899856 --- ParallelTerminationStrategy: PID 5380 died... 06:30:52.919353 run iperf3-srv_10.42.42.10(pid=5380): Terminated {rc=256} 06:30:52.964482 --- ParallelTerminationStrategy: PID 5381 died... 06:30:52.983699 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5381): Terminated: ok {rc=0} 06:30:53.028744 --- ParallelTerminationStrategy: PID 5382 died... 06:30:53.047924 run iperf3-srv_10.42.42.10(pid=5382): Terminated {rc=256} 06:30:53.093181 --- ParallelTerminationStrategy: PID 5385 died... 06:30:53.112433 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5385): Terminated: ok {rc=0} 06:30:53.157730 --- ParallelTerminationStrategy: PID 5388 died... 06:30:53.176785 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5388): Terminated: ok {rc=0} 06:30:53.222280 --- ParallelTerminationStrategy: PID 5391 died... 06:30:53.241711 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5391): Terminated: ok {rc=0} 06:30:53.327601 bus /gobi_0: Setting Powered False 06:30:54.425468 bus /gobi_0: Setting Powered False 06:30:55.541417 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:nanobts+band-1900 iperf3.py ---------------------------------------------- 06:30:56.683772 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:30:56.695123 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 06:30:56.734181 tst iperf3.py: using LAC 26501 06:30:56.851776 tst iperf3.py: using RAC 236 06:30:56.967294 tst iperf3.py: using CellId 26501 06:30:57.082538 tst iperf3.py: using BVCI 26502 06:30:57.189415 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:30:57.199949 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:30:57.210480 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:30:57.221148 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:30:57.231660 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:30:57.242321 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:30:57.253028 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:30:57.263710 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:30:57.274501 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 06:30:57.388692 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 06:30:57.584215 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:30:57.877727 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5393): Launched 06:30:58.133455 run iperf3-srv_10.42.42.10(pid=5394): Launched 06:30:58.243314 tst iperf3.py:8: start network... 06:30:58.438065 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:30:58.891119 run create_hlr_db(pid=5395): Launched 06:30:59.003345 bus /gobi_6: Setting Powered False 06:31:00.061911 run create_hlr_db(pid=5395): Terminated: ok {rc=0} 06:31:00.493138 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5397): Launched 06:31:00.807389 run osmo-hlr_10.42.42.2(pid=5398): Launched 06:31:01.039820 run osmo-stp_10.42.42.5: Starting osmo-stp 06:31:01.682182 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5400): Launched 06:31:02.041741 run osmo-stp_10.42.42.5(pid=5401): Launched 06:31:02.275384 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:31:02.858714 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5403): Launched 06:31:02.980266 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:31:03.247642 run patchelf(pid=5404): Launched 06:31:03.423297 run osmo-stp_10.42.42.5(pid=5401): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5401)] 06:31:03.556588 run osmo-stp_10.42.42.5(pid=5401): stdout: | (launched: 2022-12-10_06:31:01.982565) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:31:03.691523 run osmo-stp_10.42.42.5(pid=5401): stderr: | 20221210063102278 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063102278 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063102278 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063102279 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063102279 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063102279 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063102279 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:31:03.826383 run osmo-stp_10.42.42.5(pid=5401): stdout: | (launched: 2022-12-10_06:31:01.982565) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:31:03.955545 run osmo-stp_10.42.42.5(pid=5401): stderr: | 20221210063102278 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063102278 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063102278 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063102279 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063102279 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063102279 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063102279 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:31:04.108388 run patchelf(pid=5404): Terminating (SIGINT) 06:31:04.284906 run patchelf(pid=5404): Terminated: ok {rc=0} 06:31:04.412244 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5401): Process ended prematurely: osmo-stp_10.42.42.5(pid=5401) [trial-2370↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5401)] [trial-2370↪gprs:nanobts+band-1900↪iperf3.py:8] 06:31:04.422488 tst iperf3.py:8: Test FAILED (7.8 sec) 06:31:04.450709 run osmo-hlr_10.42.42.2(pid=5398): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:nanobts+band-1900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5398)] 06:31:04.499771 run osmo-hlr_10.42.42.2(pid=5398): stdout: | (launched: 2022-12-10_06:31:00.750423) 06:31:04.550372 run osmo-hlr_10.42.42.2(pid=5398): stderr: | 20221210063101026 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210063101026 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210063101026 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210063101026 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210063101026 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210063101026 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210063101041 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:nanobts+band-1900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210063101058 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210063101058 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210063101058 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:31:04.601392 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5393): Terminating (SIGTERM) 06:31:04.642493 run iperf3-srv_10.42.42.10(pid=5394): Terminating (SIGTERM) 06:31:04.683496 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5397): Terminating (SIGTERM) 06:31:04.724592 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5400): Terminating (SIGTERM) 06:31:04.765741 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5403): Terminating (SIGTERM) 06:31:04.807002 --- ParallelTerminationStrategy: PID 5393 died... 06:31:04.826460 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5393): Terminated: ok {rc=0} 06:31:04.872026 --- ParallelTerminationStrategy: PID 5394 died... 06:31:04.891313 run iperf3-srv_10.42.42.10(pid=5394): Terminated {rc=256} 06:31:04.936350 --- ParallelTerminationStrategy: PID 5397 died... 06:31:04.955665 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5397): Terminated: ok {rc=0} 06:31:05.000909 --- ParallelTerminationStrategy: PID 5400 died... 06:31:05.020864 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5400): Terminated: ok {rc=0} 06:31:05.066470 --- ParallelTerminationStrategy: PID 5403 died... 06:31:05.085744 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5403): Terminated: ok {rc=0} 06:31:05.172826 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:nanobts+band-1900 iperf3m4.py ---------------------------------------------- 06:31:06.320595 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:31:06.332385 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 06:31:06.371801 tst iperf3m4.py: using LAC 26502 06:31:06.494647 tst iperf3m4.py: using RAC 237 06:31:06.617363 tst iperf3m4.py: using CellId 26502 06:31:06.739650 tst iperf3m4.py: using BVCI 26503 06:31:06.854541 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:31:06.865600 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:31:06.876459 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:31:06.887400 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:31:06.898173 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:31:06.908996 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:31:06.919903 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:31:06.930674 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:31:06.941624 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 06:31:07.061171 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 06:31:07.178709 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 06:31:07.293893 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 06:31:07.410007 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 06:31:07.622088 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:31:07.938418 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5405): Launched 06:31:08.213914 run iperf3-srv_10.42.42.10(pid=5406): Launched 06:31:08.332089 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 06:31:08.543382 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:31:08.859664 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5407): Launched 06:31:09.134434 run iperf3-srv_10.42.42.10(pid=5408): Launched 06:31:09.253204 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 06:31:09.464525 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:31:09.779753 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5409): Launched 06:31:10.053798 run iperf3-srv_10.42.42.10(pid=5410): Launched 06:31:10.171834 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 06:31:10.382913 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:31:10.698799 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5411): Launched 06:31:10.973383 run iperf3-srv_10.42.42.10(pid=5412): Launched 06:31:11.091510 tst iperf3m4.py:8: start network... 06:31:11.302822 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:31:11.787765 run create_hlr_db(pid=5413): Launched 06:31:11.915520 bus /gobi_6: Setting Powered False 06:31:12.977454 run create_hlr_db(pid=5413): Terminated: ok {rc=0} 06:31:13.414578 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5415): Launched 06:31:13.728827 run osmo-hlr_10.42.42.2(pid=5416): Launched 06:31:13.848895 run osmo-stp_10.42.42.5: Starting osmo-stp 06:31:14.389633 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5418): Launched 06:31:14.702498 run osmo-stp_10.42.42.5(pid=5419): Launched 06:31:14.821989 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:31:15.364874 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5421): Launched 06:31:15.485598 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:31:15.751800 run patchelf(pid=5422): Launched 06:31:15.942886 run osmo-stp_10.42.42.5(pid=5419): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5419)] 06:31:16.079099 run osmo-stp_10.42.42.5(pid=5419): stdout: | (launched: 2022-12-10_06:31:14.645368) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:31:16.217200 run osmo-stp_10.42.42.5(pid=5419): stderr: | 20221210063114837 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063114837 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063114837 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063114838 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063114838 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063114838 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063114838 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:31:16.355350 run osmo-stp_10.42.42.5(pid=5419): stdout: | (launched: 2022-12-10_06:31:14.645368) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:31:16.487249 run osmo-stp_10.42.42.5(pid=5419): stderr: | 20221210063114837 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063114837 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063114837 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063114838 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063114838 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063114838 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063114838 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:31:16.643391 run patchelf(pid=5422): Terminating (SIGINT) 06:31:16.822899 run patchelf(pid=5422): Terminated: ok {rc=0} 06:31:16.952640 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5419): Process ended prematurely: osmo-stp_10.42.42.5(pid=5419) [trial-2370↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5419)] [trial-2370↪gprs:nanobts+band-1900↪iperf3m4.py:8] 06:31:16.963468 tst iperf3m4.py:8: Test FAILED (10.7 sec) 06:31:16.993155 run osmo-hlr_10.42.42.2(pid=5416): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:nanobts+band-1900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5416)] 06:31:17.043856 run osmo-hlr_10.42.42.2(pid=5416): stdout: | (launched: 2022-12-10_06:31:13.671453) 06:31:17.095995 run osmo-hlr_10.42.42.2(pid=5416): stderr: | 20221210063113869 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210063113869 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210063113869 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210063113869 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210063113869 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210063113869 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210063113882 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:nanobts+band-1900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210063113890 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210063113890 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210063113890 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:31:17.148856 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5405): Terminating (SIGTERM) 06:31:17.191375 run iperf3-srv_10.42.42.10(pid=5406): Terminating (SIGTERM) 06:31:17.233394 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5407): Terminating (SIGTERM) 06:31:17.274699 run iperf3-srv_10.42.42.10(pid=5408): Terminating (SIGTERM) 06:31:17.316207 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5409): Terminating (SIGTERM) 06:31:17.357566 run iperf3-srv_10.42.42.10(pid=5410): Terminating (SIGTERM) 06:31:17.398731 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5411): Terminating (SIGTERM) 06:31:17.440048 run iperf3-srv_10.42.42.10(pid=5412): Terminating (SIGTERM) 06:31:17.481225 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5415): Terminating (SIGTERM) 06:31:17.522487 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5418): Terminating (SIGTERM) 06:31:17.563660 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5421): Terminating (SIGTERM) 06:31:17.605173 --- ParallelTerminationStrategy: PID 5405 died... 06:31:17.625104 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5405): Terminated: ok {rc=0} 06:31:17.670800 --- ParallelTerminationStrategy: PID 5406 died... 06:31:17.690252 run iperf3-srv_10.42.42.10(pid=5406): Terminated {rc=256} 06:31:17.735559 --- ParallelTerminationStrategy: PID 5407 died... 06:31:17.754908 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5407): Terminated: ok {rc=0} 06:31:17.799964 --- ParallelTerminationStrategy: PID 5408 died... 06:31:17.819176 run iperf3-srv_10.42.42.10(pid=5408): Terminated {rc=256} 06:31:17.864236 --- ParallelTerminationStrategy: PID 5409 died... 06:31:17.883542 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5409): Terminated: ok {rc=0} 06:31:17.928663 --- ParallelTerminationStrategy: PID 5410 died... 06:31:17.947898 run iperf3-srv_10.42.42.10(pid=5410): Terminated {rc=256} 06:31:17.992827 --- ParallelTerminationStrategy: PID 5411 died... 06:31:18.012186 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5411): Terminated: ok {rc=0} 06:31:18.057466 --- ParallelTerminationStrategy: PID 5412 died... 06:31:18.076595 run iperf3-srv_10.42.42.10(pid=5412): Terminated {rc=256} 06:31:18.121752 --- ParallelTerminationStrategy: PID 5415 died... 06:31:18.141152 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5415): Terminated: ok {rc=0} 06:31:18.186700 --- ParallelTerminationStrategy: PID 5418 died... 06:31:18.205977 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5418): Terminated: ok {rc=0} 06:31:18.251307 --- ParallelTerminationStrategy: PID 5421 died... 06:31:18.270677 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5421): Terminated: ok {rc=0} 06:31:18.356700 bus /gobi_4: Setting Powered False 06:31:19.453413 bus /gobi_4: Setting Powered False 06:31:20.565820 bus /gobi_1: Setting Powered False 06:31:21.663021 bus /gobi_1: Setting Powered False 06:31:22.775853 bus /gobi_0: Setting Powered False 06:31:23.872613 bus /gobi_0: Setting Powered False 06:31:24.987856 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:nanobts+band-1900 ping.py ---------------------------------------------- 06:31:26.088704 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:31:26.100680 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 06:31:26.141277 tst ping.py: using LAC 26503 06:31:26.261916 tst ping.py: using RAC 238 06:31:26.375838 tst ping.py: using CellId 26503 06:31:26.488778 tst ping.py: using BVCI 26504 06:31:26.593832 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:31:26.604558 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:31:26.615305 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:31:26.626784 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:31:26.638117 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:31:26.649485 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:31:26.660625 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:31:26.671891 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 06:31:26.784125 tst ping.py:19: start network... 06:31:26.975970 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:31:27.420751 run create_hlr_db(pid=5423): Launched 06:31:27.530148 bus /gobi_6: Setting Powered False 06:31:28.588751 run create_hlr_db(pid=5423): Terminated: ok {rc=0} 06:31:29.008909 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5425): Launched 06:31:29.317383 run osmo-hlr_10.42.42.2(pid=5426): Launched 06:31:29.434874 run osmo-stp_10.42.42.5: Starting osmo-stp 06:31:29.969939 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5428): Launched 06:31:30.277473 run osmo-stp_10.42.42.5(pid=5429): Launched 06:31:30.395137 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:31:30.939524 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5431): Launched 06:31:31.068208 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:31:31.329995 run patchelf(pid=5432): Launched 06:31:31.510666 run osmo-stp_10.42.42.5(pid=5429): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5429)] 06:31:31.637976 run osmo-stp_10.42.42.5(pid=5429): stdout: | (launched: 2022-12-10_06:31:30.221001) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:31:31.768499 run osmo-stp_10.42.42.5(pid=5429): stderr: | 20221210063130412 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063130412 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063130412 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063130412 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063130413 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063130413 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063130413 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:31:31.900308 run osmo-stp_10.42.42.5(pid=5429): stdout: | (launched: 2022-12-10_06:31:30.221001) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:31:32.023126 run osmo-stp_10.42.42.5(pid=5429): stderr: | 20221210063130412 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063130412 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063130412 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063130412 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063130413 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063130413 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063130413 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:31:32.169556 run patchelf(pid=5432): Terminating (SIGINT) 06:31:32.334166 run patchelf(pid=5432): Terminated: ok {rc=0} 06:31:32.450955 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=5429): Process ended prematurely: osmo-stp_10.42.42.5(pid=5429) [trial-2370↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5429)] [trial-2370↪gprs:nanobts+band-1900↪ping.py:22] 06:31:32.459842 tst ping.py:22: Test FAILED (6.4 sec) 06:31:32.486859 run osmo-hlr_10.42.42.2(pid=5426): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:nanobts+band-1900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5426)] 06:31:32.534619 run osmo-hlr_10.42.42.2(pid=5426): stdout: | (launched: 2022-12-10_06:31:29.261012) 06:31:32.583987 run osmo-hlr_10.42.42.2(pid=5426): stderr: | 20221210063129455 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210063129455 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210063129455 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210063129455 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210063129455 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210063129455 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210063129468 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:nanobts+band-1900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210063129476 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210063129476 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210063129476 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:31:32.633862 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5425): Terminating (SIGTERM) 06:31:32.673337 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5428): Terminating (SIGTERM) 06:31:32.712703 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5431): Terminating (SIGTERM) 06:31:32.752053 --- ParallelTerminationStrategy: PID 5425 died... 06:31:32.771011 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5425): Terminated: ok {rc=0} 06:31:32.815183 --- ParallelTerminationStrategy: PID 5428 died... 06:31:32.833841 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5428): Terminated: ok {rc=0} 06:31:32.877920 --- ParallelTerminationStrategy: PID 5431 died... 06:31:32.896282 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5431): Terminated: ok {rc=0} 06:31:32.980811 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:nanobts+band-1900 ping_idle_ping.py ---------------------------------------------- 06:31:34.067740 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:31:34.079606 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 06:31:34.122956 tst ping_idle_ping.py: using LAC 26504 06:31:34.236032 tst ping_idle_ping.py: using RAC 239 06:31:34.350975 tst ping_idle_ping.py: using CellId 26504 06:31:34.464563 tst ping_idle_ping.py: using BVCI 26505 06:31:34.568889 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:31:34.579760 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:31:34.590329 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:31:34.601045 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:31:34.611796 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:31:34.622412 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:31:34.633229 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:31:34.643919 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 06:31:34.759693 tst ping_idle_ping.py:24: start network... 06:31:34.967544 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:31:35.448588 run create_hlr_db(pid=5433): Launched 06:31:35.574967 bus /gobi_6: Setting Powered False 06:31:36.637051 run create_hlr_db(pid=5433): Terminated: ok {rc=0} 06:31:37.050855 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5435): Launched 06:31:37.340111 run osmo-hlr_10.42.42.2(pid=5436): Launched 06:31:37.450231 run osmo-stp_10.42.42.5: Starting osmo-stp 06:31:37.959668 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5438): Launched 06:31:38.247805 run osmo-stp_10.42.42.5(pid=5439): Launched 06:31:38.357694 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:31:38.853691 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5441): Launched 06:31:38.964420 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:31:39.207691 run patchelf(pid=5442): Launched 06:31:39.369962 run osmo-stp_10.42.42.5(pid=5439): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5439)] 06:31:39.493140 run osmo-stp_10.42.42.5(pid=5439): stdout: | (launched: 2022-12-10_06:31:38.194802) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:31:39.617930 run osmo-stp_10.42.42.5(pid=5439): stderr: | 20221210063138362 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063138363 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063138363 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063138363 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063138365 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063138366 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063138366 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:31:39.742645 run osmo-stp_10.42.42.5(pid=5439): stdout: | (launched: 2022-12-10_06:31:38.194802) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:31:39.861357 run osmo-stp_10.42.42.5(pid=5439): stderr: | 20221210063138362 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063138363 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063138363 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063138363 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063138365 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063138366 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063138366 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:31:40.001824 run patchelf(pid=5442): Terminating (SIGINT) 06:31:40.164450 run patchelf(pid=5442): Terminated: ok {rc=0} 06:31:40.281628 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=5439): Process ended prematurely: osmo-stp_10.42.42.5(pid=5439) [trial-2370↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5439)] [trial-2370↪gprs:nanobts+band-1900↪ping_idle_ping.py:27] 06:31:40.290478 tst ping_idle_ping.py:27: Test FAILED (6.2 sec) 06:31:40.317182 run osmo-hlr_10.42.42.2(pid=5436): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:nanobts+band-1900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5436)] 06:31:40.364078 run osmo-hlr_10.42.42.2(pid=5436): stdout: | (launched: 2022-12-10_06:31:37.287044) 06:31:40.412515 run osmo-hlr_10.42.42.2(pid=5436): stderr: | 20221210063137461 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210063137461 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210063137461 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210063137461 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210063137461 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210063137461 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210063137474 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:nanobts+band-1900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210063137485 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210063137485 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210063137485 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:31:40.461346 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5435): Terminating (SIGTERM) 06:31:40.500644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5438): Terminating (SIGTERM) 06:31:40.540070 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5441): Terminating (SIGTERM) 06:31:40.579677 --- ParallelTerminationStrategy: PID 5435 died... 06:31:40.598479 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5435): Terminated: ok {rc=0} 06:31:40.642059 --- ParallelTerminationStrategy: PID 5438 died... 06:31:40.660156 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5438): Terminated: ok {rc=0} 06:31:40.704374 --- ParallelTerminationStrategy: PID 5441 died... 06:31:40.723001 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5441): Terminated: ok {rc=0} 06:31:40.807335 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2370 gprs:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 gprs:nanobts+band-1900+mod-bts0-egprs --------------------------------------------------------------------- 06:31:42.099410 tst gprs:nanobts+band-1900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:31:42.105874 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 06:31:42.129960 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 06:31:42.168553 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 06:31:42.254236 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 06:31:42.277189 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 06:31:42.314906 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 06:31:42.913456 tst gprs:nanobts+band-1900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2370 gprs:nanobts+band-1900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 06:31:42.963926 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:31:42.975379 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:31:43.016788 tst cs_paging_gprs_active.py: using LAC 26505 06:31:43.141537 tst cs_paging_gprs_active.py: using RAC 240 06:31:43.258470 tst cs_paging_gprs_active.py: using CellId 26505 06:31:43.373815 tst cs_paging_gprs_active.py: using BVCI 26506 06:31:43.482373 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:31:43.493233 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:31:43.504126 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:31:43.514912 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:31:43.525704 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:31:43.536380 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:31:43.547437 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:31:43.558201 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:31:43.569122 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:31:43.686921 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:31:43.801374 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 06:31:43.997683 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:31:44.291734 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5447): Launched 06:31:44.547841 run iperf3-srv_10.42.42.10(pid=5448): Launched 06:31:44.658501 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 06:31:44.854521 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:31:45.149486 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5449): Launched 06:31:45.406325 run iperf3-srv_10.42.42.10(pid=5450): Launched 06:31:45.516621 tst cs_paging_gprs_active.py:38: start network... 06:31:45.712262 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:31:46.178947 run create_hlr_db(pid=5451): Launched 06:31:46.365195 bus /gobi_6: Setting Powered False 06:31:47.423700 run create_hlr_db(pid=5451): Terminated: ok {rc=0} 06:31:47.849429 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5453): Launched 06:31:48.142425 run osmo-hlr_10.42.42.2(pid=5454): Launched 06:31:48.254861 run osmo-stp_10.42.42.5: Starting osmo-stp 06:31:48.759416 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5456): Launched 06:31:49.053812 run osmo-stp_10.42.42.5(pid=5457): Launched 06:31:49.166275 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:31:49.672628 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5459): Launched 06:31:49.785864 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:31:50.033923 run patchelf(pid=5460): Launched 06:31:50.198570 run osmo-stp_10.42.42.5(pid=5457): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5457)] 06:31:50.323510 run osmo-stp_10.42.42.5(pid=5457): stdout: | (launched: 2022-12-10_06:31:48.999724) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:31:50.450067 run osmo-stp_10.42.42.5(pid=5457): stderr: | 20221210063149169 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063149169 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063149170 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063149170 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063149171 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063149171 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063149171 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:31:50.576623 run osmo-stp_10.42.42.5(pid=5457): stdout: | (launched: 2022-12-10_06:31:48.999724) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:31:50.697898 run osmo-stp_10.42.42.5(pid=5457): stderr: | 20221210063149169 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063149169 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063149170 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063149170 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063149171 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063149171 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063149171 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:31:50.841502 run patchelf(pid=5460): Terminating (SIGINT) 06:31:51.006589 run patchelf(pid=5460): Terminated: ok {rc=0} 06:31:51.125927 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=5457): Process ended prematurely: osmo-stp_10.42.42.5(pid=5457) [trial-2370↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5457)] [trial-2370↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 06:31:51.135364 tst cs_paging_gprs_active.py:38: Test FAILED (8.2 sec) 06:31:51.162737 run osmo-hlr_10.42.42.2(pid=5454): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5454)] 06:31:51.209937 run osmo-hlr_10.42.42.2(pid=5454): stdout: | (launched: 2022-12-10_06:31:48.088532) 06:31:51.258640 run osmo-hlr_10.42.42.2(pid=5454): stderr: | 20221210063148264 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210063148264 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210063148264 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210063148264 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210063148264 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210063148264 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210063148277 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:nanobts+band-1900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210063148287 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210063148287 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210063148287 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:31:51.307649 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5447): Terminating (SIGTERM) 06:31:51.346883 run iperf3-srv_10.42.42.10(pid=5448): Terminating (SIGTERM) 06:31:51.386469 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5449): Terminating (SIGTERM) 06:31:51.425741 run iperf3-srv_10.42.42.10(pid=5450): Terminating (SIGTERM) 06:31:51.464733 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5453): Terminating (SIGTERM) 06:31:51.503793 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5456): Terminating (SIGTERM) 06:31:51.542617 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5459): Terminating (SIGTERM) 06:31:51.581849 --- ParallelTerminationStrategy: PID 5447 died... 06:31:51.600572 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5447): Terminated: ok {rc=0} 06:31:51.644031 --- ParallelTerminationStrategy: PID 5448 died... 06:31:51.662268 run iperf3-srv_10.42.42.10(pid=5448): Terminated {rc=256} 06:31:51.705407 --- ParallelTerminationStrategy: PID 5449 died... 06:31:51.723652 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5449): Terminated: ok {rc=0} 06:31:51.767071 --- ParallelTerminationStrategy: PID 5450 died... 06:31:51.785199 run iperf3-srv_10.42.42.10(pid=5450): Terminated {rc=256} 06:31:51.828339 --- ParallelTerminationStrategy: PID 5453 died... 06:31:51.846550 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5453): Terminated: ok {rc=0} 06:31:51.889855 --- ParallelTerminationStrategy: PID 5456 died... 06:31:51.908100 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5456): Terminated: ok {rc=0} 06:31:51.951210 --- ParallelTerminationStrategy: PID 5459 died... 06:31:51.969413 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5459): Terminated: ok {rc=0} 06:31:52.051181 bus /gobi_0: Setting Powered False 06:31:53.148780 bus /gobi_0: Setting Powered False 06:31:54.265212 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:nanobts+band-1900+mod-bts0-egprs iperf3.py ---------------------------------------------- 06:31:55.410903 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:31:55.423007 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:31:55.466831 tst iperf3.py: using LAC 26506 06:31:55.591732 tst iperf3.py: using RAC 241 06:31:55.719563 tst iperf3.py: using CellId 26506 06:31:55.842428 tst iperf3.py: using BVCI 26507 06:31:55.957401 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:31:55.968687 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:31:55.979854 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:31:55.990965 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:31:56.002046 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:31:56.013064 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:31:56.024276 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:31:56.035311 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:31:56.046553 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:31:56.164054 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 06:31:56.376092 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:31:56.690625 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5461): Launched 06:31:56.964651 run iperf3-srv_10.42.42.10(pid=5462): Launched 06:31:57.082674 tst iperf3.py:8: start network... 06:31:57.294575 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:31:57.781965 run create_hlr_db(pid=5463): Launched 06:31:57.909701 bus /gobi_6: Setting Powered False 06:31:58.972275 run create_hlr_db(pid=5463): Terminated: ok {rc=0} 06:31:59.392730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5465): Launched 06:31:59.688229 run osmo-hlr_10.42.42.2(pid=5466): Launched 06:31:59.801085 run osmo-stp_10.42.42.5: Starting osmo-stp 06:32:00.312022 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5468): Launched 06:32:00.606986 run osmo-stp_10.42.42.5(pid=5469): Launched 06:32:00.719405 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:32:01.260500 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5471): Launched 06:32:01.378679 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:32:01.645831 run patchelf(pid=5472): Launched 06:32:01.813616 run osmo-stp_10.42.42.5(pid=5469): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5469)] 06:32:01.942105 run osmo-stp_10.42.42.5(pid=5469): stdout: | (launched: 2022-12-10_06:32:00.552524) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:32:02.071194 run osmo-stp_10.42.42.5(pid=5469): stderr: | 20221210063200723 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063200723 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063200723 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063200724 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063200724 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063200724 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063200724 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:32:02.200595 run osmo-stp_10.42.42.5(pid=5469): stdout: | (launched: 2022-12-10_06:32:00.552524) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:32:02.322997 run osmo-stp_10.42.42.5(pid=5469): stderr: | 20221210063200723 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063200723 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063200723 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063200724 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063200724 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063200724 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063200724 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:32:02.466018 run patchelf(pid=5472): Terminating (SIGINT) 06:32:02.632434 run patchelf(pid=5472): Terminated: ok {rc=0} 06:32:02.751859 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5469): Process ended prematurely: osmo-stp_10.42.42.5(pid=5469) [trial-2370↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5469)] [trial-2370↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8] 06:32:02.761517 tst iperf3.py:8: Test FAILED (7.4 sec) 06:32:02.788884 run osmo-hlr_10.42.42.2(pid=5466): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5466)] 06:32:02.836499 run osmo-hlr_10.42.42.2(pid=5466): stdout: | (launched: 2022-12-10_06:31:59.634137) 06:32:02.885495 run osmo-hlr_10.42.42.2(pid=5466): stderr: | 20221210063159807 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210063159807 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210063159807 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210063159807 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210063159807 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210063159807 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210063159820 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210063159830 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210063159830 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210063159830 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:32:02.934783 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5461): Terminating (SIGTERM) 06:32:02.973839 run iperf3-srv_10.42.42.10(pid=5462): Terminating (SIGTERM) 06:32:03.012588 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5465): Terminating (SIGTERM) 06:32:03.053659 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5468): Terminating (SIGTERM) 06:32:03.092846 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5471): Terminating (SIGTERM) 06:32:03.132618 --- ParallelTerminationStrategy: PID 5461 died... 06:32:03.151479 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5461): Terminated: ok {rc=0} 06:32:03.195279 --- ParallelTerminationStrategy: PID 5462 died... 06:32:03.213813 run iperf3-srv_10.42.42.10(pid=5462): Terminated {rc=256} 06:32:03.257736 --- ParallelTerminationStrategy: PID 5465 died... 06:32:03.276269 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5465): Terminated: ok {rc=0} 06:32:03.320582 --- ParallelTerminationStrategy: PID 5468 died... 06:32:03.339313 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5468): Terminated: ok {rc=0} 06:32:03.383169 --- ParallelTerminationStrategy: PID 5471 died... 06:32:03.401770 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5471): Terminated: ok {rc=0} 06:32:03.488095 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:nanobts+band-1900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 06:32:04.633453 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:32:04.644836 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:32:04.687930 tst iperf3m4.py: using LAC 26507 06:32:04.807918 tst iperf3m4.py: using RAC 242 06:32:04.931408 tst iperf3m4.py: using CellId 26507 06:32:05.055139 tst iperf3m4.py: using BVCI 26508 06:32:05.171276 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:32:05.182833 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:32:05.194493 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:32:05.205957 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:32:05.217206 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:32:05.228081 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:32:05.239344 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:32:05.250477 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:32:05.261825 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:32:05.376047 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:32:05.496861 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:32:05.616468 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:32:05.730843 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 06:32:05.928076 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:32:06.223375 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5473): Launched 06:32:06.480766 run iperf3-srv_10.42.42.10(pid=5474): Launched 06:32:06.591923 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 06:32:06.788356 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:32:07.084602 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5475): Launched 06:32:07.342290 run iperf3-srv_10.42.42.10(pid=5476): Launched 06:32:07.453090 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 06:32:07.649923 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:32:07.946660 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5477): Launched 06:32:08.204121 run iperf3-srv_10.42.42.10(pid=5478): Launched 06:32:08.315075 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 06:32:08.512568 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:32:08.808734 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5479): Launched 06:32:09.066232 run iperf3-srv_10.42.42.10(pid=5480): Launched 06:32:09.177115 tst iperf3m4.py:8: start network... 06:32:09.374042 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:32:09.829619 run create_hlr_db(pid=5481): Launched 06:32:09.947742 bus /gobi_6: Setting Powered False 06:32:11.007725 run create_hlr_db(pid=5481): Terminated: ok {rc=0} 06:32:11.419429 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5483): Launched 06:32:11.715257 run osmo-hlr_10.42.42.2(pid=5484): Launched 06:32:11.828047 run osmo-stp_10.42.42.5: Starting osmo-stp 06:32:12.338446 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5486): Launched 06:32:12.633079 run osmo-stp_10.42.42.5(pid=5487): Launched 06:32:12.746108 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:32:13.254983 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5489): Launched 06:32:13.368357 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:32:13.620246 run patchelf(pid=5490): Launched 06:32:13.784786 run osmo-stp_10.42.42.5(pid=5487): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5487)] 06:32:13.909813 run osmo-stp_10.42.42.5(pid=5487): stdout: | (launched: 2022-12-10_06:32:12.578683) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:32:14.036225 run osmo-stp_10.42.42.5(pid=5487): stderr: | 20221210063212751 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063212751 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063212751 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063212751 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063212752 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063212752 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063212752 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:32:14.162648 run osmo-stp_10.42.42.5(pid=5487): stdout: | (launched: 2022-12-10_06:32:12.578683) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:32:14.283824 run osmo-stp_10.42.42.5(pid=5487): stderr: | 20221210063212751 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063212751 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063212751 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063212751 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063212752 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063212752 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063212752 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:32:14.426990 run patchelf(pid=5490): Terminating (SIGINT) 06:32:14.592539 run patchelf(pid=5490): Terminated: ok {rc=0} 06:32:14.711631 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5487): Process ended prematurely: osmo-stp_10.42.42.5(pid=5487) [trial-2370↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5487)] [trial-2370↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8] 06:32:14.721178 tst iperf3m4.py:8: Test FAILED (10.1 sec) 06:32:14.749077 run osmo-hlr_10.42.42.2(pid=5484): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5484)] 06:32:14.796343 run osmo-hlr_10.42.42.2(pid=5484): stdout: | (launched: 2022-12-10_06:32:11.660204) 06:32:14.845362 run osmo-hlr_10.42.42.2(pid=5484): stderr: | 20221210063211834 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210063211834 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210063211834 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210063211834 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210063211834 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210063211834 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210063211846 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210063211854 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210063211854 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210063211854 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:32:14.895159 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5473): Terminating (SIGTERM) 06:32:14.934656 run iperf3-srv_10.42.42.10(pid=5474): Terminating (SIGTERM) 06:32:14.973744 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5475): Terminating (SIGTERM) 06:32:15.012290 run iperf3-srv_10.42.42.10(pid=5476): Terminating (SIGTERM) 06:32:15.051065 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5477): Terminating (SIGTERM) 06:32:15.089888 run iperf3-srv_10.42.42.10(pid=5478): Terminating (SIGTERM) 06:32:15.128364 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5479): Terminating (SIGTERM) 06:32:15.167063 run iperf3-srv_10.42.42.10(pid=5480): Terminating (SIGTERM) 06:32:15.205630 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5483): Terminating (SIGTERM) 06:32:15.244431 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5486): Terminating (SIGTERM) 06:32:15.283530 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5489): Terminating (SIGTERM) 06:32:15.323203 --- ParallelTerminationStrategy: PID 5473 died... 06:32:15.342055 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5473): Terminated: ok {rc=0} 06:32:15.386155 --- ParallelTerminationStrategy: PID 5474 died... 06:32:15.404346 run iperf3-srv_10.42.42.10(pid=5474): Terminated {rc=256} 06:32:15.448016 --- ParallelTerminationStrategy: PID 5475 died... 06:32:15.466430 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5475): Terminated: ok {rc=0} 06:32:15.510070 --- ParallelTerminationStrategy: PID 5476 died... 06:32:15.528399 run iperf3-srv_10.42.42.10(pid=5476): Terminated {rc=256} 06:32:15.571942 --- ParallelTerminationStrategy: PID 5477 died... 06:32:15.590309 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5477): Terminated: ok {rc=0} 06:32:15.633794 --- ParallelTerminationStrategy: PID 5478 died... 06:32:15.651954 run iperf3-srv_10.42.42.10(pid=5478): Terminated {rc=256} 06:32:15.695204 --- ParallelTerminationStrategy: PID 5479 died... 06:32:15.713362 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5479): Terminated: ok {rc=0} 06:32:15.756782 --- ParallelTerminationStrategy: PID 5480 died... 06:32:15.775088 run iperf3-srv_10.42.42.10(pid=5480): Terminated {rc=256} 06:32:15.818460 --- ParallelTerminationStrategy: PID 5483 died... 06:32:15.837088 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5483): Terminated: ok {rc=0} 06:32:15.881958 --- ParallelTerminationStrategy: PID 5486 died... 06:32:15.903139 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5486): Terminated: ok {rc=0} 06:32:15.948745 --- ParallelTerminationStrategy: PID 5489 died... 06:32:15.967938 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5489): Terminated: ok {rc=0} 06:32:16.053517 bus /gobi_4: Setting Powered False 06:32:17.150374 bus /gobi_4: Setting Powered False 06:32:18.268311 bus /gobi_1: Setting Powered False 06:32:19.365706 bus /gobi_1: Setting Powered False 06:32:20.479807 bus /gobi_0: Setting Powered False 06:32:21.576674 bus /gobi_0: Setting Powered False 06:32:22.691844 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:nanobts+band-1900+mod-bts0-egprs ping.py ---------------------------------------------- 06:32:23.793536 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:32:23.804857 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:32:23.848754 tst ping.py: using LAC 26508 06:32:23.966747 tst ping.py: using RAC 243 06:32:24.079439 tst ping.py: using CellId 26508 06:32:24.192086 tst ping.py: using BVCI 26509 06:32:24.296347 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:32:24.307282 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:32:24.318088 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:32:24.329166 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:32:24.340095 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:32:24.350864 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:32:24.362012 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:32:24.372889 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:32:24.488089 tst ping.py:19: start network... 06:32:24.696538 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:32:25.174107 run create_hlr_db(pid=5491): Launched 06:32:25.300444 bus /gobi_6: Setting Powered False 06:32:26.362568 run create_hlr_db(pid=5491): Terminated: ok {rc=0} 06:32:26.793681 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5493): Launched 06:32:27.101352 run osmo-hlr_10.42.42.2(pid=5494): Launched 06:32:27.219198 run osmo-stp_10.42.42.5: Starting osmo-stp 06:32:27.752351 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5496): Launched 06:32:28.061262 run osmo-stp_10.42.42.5(pid=5497): Launched 06:32:28.179301 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:32:28.714629 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5499): Launched 06:32:28.833159 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:32:29.094329 run patchelf(pid=5500): Launched 06:32:29.267580 run osmo-stp_10.42.42.5(pid=5497): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5497)] 06:32:29.399403 run osmo-stp_10.42.42.5(pid=5497): stdout: | (launched: 2022-12-10_06:32:28.004640) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:32:29.533196 run osmo-stp_10.42.42.5(pid=5497): stderr: | 20221210063228196 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063228197 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063228197 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063228197 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063228198 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063228198 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063228198 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:32:29.667022 run osmo-stp_10.42.42.5(pid=5497): stdout: | (launched: 2022-12-10_06:32:28.004640) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:32:29.794799 run osmo-stp_10.42.42.5(pid=5497): stderr: | 20221210063228196 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063228197 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063228197 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063228197 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063228198 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063228198 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063228198 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:32:29.945785 run patchelf(pid=5500): Terminating (SIGINT) 06:32:30.119681 run patchelf(pid=5500): Terminated: ok {rc=0} 06:32:30.245252 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=5497): Process ended prematurely: osmo-stp_10.42.42.5(pid=5497) [trial-2370↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5497)] [trial-2370↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22] 06:32:30.254867 tst ping.py:22: Test FAILED (6.5 sec) 06:32:30.282665 run osmo-hlr_10.42.42.2(pid=5494): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5494)] 06:32:30.331812 run osmo-hlr_10.42.42.2(pid=5494): stdout: | (launched: 2022-12-10_06:32:27.045035) 06:32:30.382732 run osmo-hlr_10.42.42.2(pid=5494): stderr: | 20221210063227243 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210063227243 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210063227243 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210063227243 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210063227243 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210063227243 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210063227263 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:nanobts+band-1900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210063227274 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210063227274 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210063227274 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:32:30.434035 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5493): Terminating (SIGTERM) 06:32:30.475232 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5496): Terminating (SIGTERM) 06:32:30.516531 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5499): Terminating (SIGTERM) 06:32:30.558188 --- ParallelTerminationStrategy: PID 5493 died... 06:32:30.577996 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5493): Terminated: ok {rc=0} 06:32:30.623682 --- ParallelTerminationStrategy: PID 5496 died... 06:32:30.643042 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5496): Terminated: ok {rc=0} 06:32:30.688270 --- ParallelTerminationStrategy: PID 5499 died... 06:32:30.707574 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5499): Terminated: ok {rc=0} 06:32:30.794182 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:nanobts+band-1900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 06:32:31.876411 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:32:31.888830 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:32:31.936459 tst ping_idle_ping.py: using LAC 26509 06:32:32.091152 tst ping_idle_ping.py: using RAC 244 06:32:32.219733 tst ping_idle_ping.py: using CellId 26509 06:32:32.341838 tst ping_idle_ping.py: using BVCI 26510 06:32:32.454132 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:32:32.465594 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:32:32.476824 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:32:32.488191 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:32:32.499352 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:32:32.510549 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:32:32.522022 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:32:32.533376 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:32:32.648147 tst ping_idle_ping.py:24: start network... 06:32:32.840483 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:32:33.293167 run create_hlr_db(pid=5501): Launched 06:32:33.404790 bus /gobi_6: Setting Powered False 06:32:34.461997 run create_hlr_db(pid=5501): Terminated: ok {rc=0} 06:32:34.887870 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5503): Launched 06:32:35.198191 run osmo-hlr_10.42.42.2(pid=5504): Launched 06:32:35.317800 run osmo-stp_10.42.42.5: Starting osmo-stp 06:32:35.853875 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5506): Launched 06:32:36.164589 run osmo-stp_10.42.42.5(pid=5510): Launched 06:32:36.283507 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:32:36.817235 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5512): Launched 06:32:36.935525 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:32:37.197284 run patchelf(pid=5513): Launched 06:32:37.370967 run osmo-stp_10.42.42.5(pid=5510): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5510)] 06:32:37.502691 run osmo-stp_10.42.42.5(pid=5510): stdout: | (launched: 2022-12-10_06:32:36.108085) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:32:37.636053 run osmo-stp_10.42.42.5(pid=5510): stderr: | 20221210063236298 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063236299 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063236299 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063236299 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063236300 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063236300 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063236300 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:32:37.770358 run osmo-stp_10.42.42.5(pid=5510): stdout: | (launched: 2022-12-10_06:32:36.108085) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:32:37.897903 run osmo-stp_10.42.42.5(pid=5510): stderr: | 20221210063236298 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063236299 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063236299 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063236299 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063236300 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063236300 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063236300 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:32:38.048426 run patchelf(pid=5513): Terminating (SIGINT) 06:32:38.222283 run patchelf(pid=5513): Terminated: ok {rc=0} 06:32:38.347005 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=5510): Process ended prematurely: osmo-stp_10.42.42.5(pid=5510) [trial-2370↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5510)] [trial-2370↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27] 06:32:38.356437 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 06:32:38.384287 run osmo-hlr_10.42.42.2(pid=5504): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5504)] 06:32:38.433438 run osmo-hlr_10.42.42.2(pid=5504): stdout: | (launched: 2022-12-10_06:32:35.141637) 06:32:38.484318 run osmo-hlr_10.42.42.2(pid=5504): stderr: | 20221210063235339 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210063235339 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210063235339 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210063235339 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210063235339 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210063235339 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210063235353 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:nanobts+band-1900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210063235363 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210063235363 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210063235363 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:32:38.535678 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5503): Terminating (SIGTERM) 06:32:38.576558 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5506): Terminating (SIGTERM) 06:32:38.617614 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5512): Terminating (SIGTERM) 06:32:38.658813 --- ParallelTerminationStrategy: PID 5503 died... 06:32:38.678208 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5503): Terminated: ok {rc=0} 06:32:38.723466 --- ParallelTerminationStrategy: PID 5506 died... 06:32:38.742560 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5506): Terminated: ok {rc=0} 06:32:38.787597 --- ParallelTerminationStrategy: PID 5512 died... 06:32:38.806848 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5512): Terminated: ok {rc=0} 06:32:38.892278 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2370 gprs:nanobts+band-1900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 gprs:nanobts+band-1900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 06:32:40.185877 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:32:40.193562 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 06:32:40.217910 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 06:32:40.256796 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 06:32:40.345999 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 06:32:40.370379 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 06:32:40.408772 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 06:32:41.004143 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2370 gprs:nanobts+band-1900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 06:32:41.054422 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:32:41.065936 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:32:41.126929 tst cs_paging_gprs_active.py: using LAC 26510 06:32:41.249680 tst cs_paging_gprs_active.py: using RAC 245 06:32:41.373964 tst cs_paging_gprs_active.py: using CellId 26510 06:32:41.498500 tst cs_paging_gprs_active.py: using BVCI 26511 06:32:41.614168 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:32:41.625597 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:32:41.636632 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:32:41.647802 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:32:41.658887 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:32:41.670030 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:32:41.681336 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:32:41.692366 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:32:41.703577 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:32:41.818249 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:32:41.935787 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 06:32:42.130914 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:32:42.424402 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5517): Launched 06:32:42.681295 run iperf3-srv_10.42.42.10(pid=5518): Launched 06:32:42.791679 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 06:32:42.987216 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:32:43.281776 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5519): Launched 06:32:43.537613 run iperf3-srv_10.42.42.10(pid=5520): Launched 06:32:43.647713 tst cs_paging_gprs_active.py:38: start network... 06:32:43.843427 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:32:44.296249 run create_hlr_db(pid=5521): Launched 06:32:44.409586 bus /gobi_6: Setting Powered False 06:32:45.468396 run create_hlr_db(pid=5521): Terminated: ok {rc=0} 06:32:45.897786 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5523): Launched 06:32:46.229495 run osmo-hlr_10.42.42.2(pid=5524): Launched 06:32:46.416291 run osmo-stp_10.42.42.5: Starting osmo-stp 06:32:47.154525 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5526): Launched 06:32:47.459109 run osmo-stp_10.42.42.5(pid=5527): Launched 06:32:47.573688 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:32:48.080387 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5529): Launched 06:32:48.194666 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:32:48.443731 run patchelf(pid=5530): Launched 06:32:48.608101 run osmo-stp_10.42.42.5(pid=5527): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5527)] 06:32:48.733069 run osmo-stp_10.42.42.5(pid=5527): stdout: | (launched: 2022-12-10_06:32:47.405221) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:32:48.859677 run osmo-stp_10.42.42.5(pid=5527): stderr: | 20221210063247573 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063247573 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063247573 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063247574 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063247574 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063247574 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063247574 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:32:48.986487 run osmo-stp_10.42.42.5(pid=5527): stdout: | (launched: 2022-12-10_06:32:47.405221) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:32:49.107934 run osmo-stp_10.42.42.5(pid=5527): stderr: | 20221210063247573 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063247573 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063247573 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063247574 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063247574 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063247574 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063247574 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:32:49.251149 run patchelf(pid=5530): Terminating (SIGINT) 06:32:49.416089 run patchelf(pid=5530): Terminated: ok {rc=0} 06:32:49.535349 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=5527): Process ended prematurely: osmo-stp_10.42.42.5(pid=5527) [trial-2370↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5527)] [trial-2370↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 06:32:49.544817 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 06:32:49.571978 run osmo-hlr_10.42.42.2(pid=5524): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5524)] 06:32:49.619882 run osmo-hlr_10.42.42.2(pid=5524): stdout: | (launched: 2022-12-10_06:32:46.168802) 06:32:49.668630 run osmo-hlr_10.42.42.2(pid=5524): stderr: | 20221210063246565 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210063246565 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210063246566 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210063246566 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210063246567 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210063246567 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210063246598 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210063246619 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210063246619 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210063246619 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:32:49.718183 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5517): Terminating (SIGTERM) 06:32:49.757321 run iperf3-srv_10.42.42.10(pid=5518): Terminating (SIGTERM) 06:32:49.796442 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5519): Terminating (SIGTERM) 06:32:49.835694 run iperf3-srv_10.42.42.10(pid=5520): Terminating (SIGTERM) 06:32:49.874989 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5523): Terminating (SIGTERM) 06:32:49.914127 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5526): Terminating (SIGTERM) 06:32:49.953379 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5529): Terminating (SIGTERM) 06:32:49.992561 --- ParallelTerminationStrategy: PID 5517 died... 06:32:50.011404 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5517): Terminated: ok {rc=0} 06:32:50.055666 --- ParallelTerminationStrategy: PID 5518 died... 06:32:50.073997 run iperf3-srv_10.42.42.10(pid=5518): Terminated {rc=256} 06:32:50.117237 --- ParallelTerminationStrategy: PID 5519 died... 06:32:50.135260 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5519): Terminated: ok {rc=0} 06:32:50.178753 --- ParallelTerminationStrategy: PID 5520 died... 06:32:50.197068 run iperf3-srv_10.42.42.10(pid=5520): Terminated {rc=256} 06:32:50.240386 --- ParallelTerminationStrategy: PID 5523 died... 06:32:50.258758 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5523): Terminated: ok {rc=0} 06:32:50.301970 --- ParallelTerminationStrategy: PID 5526 died... 06:32:50.320361 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5526): Terminated: ok {rc=0} 06:32:50.363716 --- ParallelTerminationStrategy: PID 5529 died... 06:32:50.382268 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5529): Terminated: ok {rc=0} 06:32:50.467525 bus /gobi_0: Setting Powered False 06:32:51.566529 bus /gobi_0: Setting Powered False 06:32:52.681197 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 06:32:53.823921 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:32:53.835469 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:32:53.897277 tst iperf3.py: using LAC 26511 06:32:54.014692 tst iperf3.py: using RAC 246 06:32:54.130648 tst iperf3.py: using CellId 26511 06:32:54.249215 tst iperf3.py: using BVCI 26512 06:32:54.364787 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:32:54.376367 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:32:54.387699 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:32:54.399153 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:32:54.410545 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:32:54.421958 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:32:54.433633 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:32:54.444757 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:32:54.456246 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:32:54.571462 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 06:32:54.768138 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:32:55.061950 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5531): Launched 06:32:55.318625 run iperf3-srv_10.42.42.10(pid=5532): Launched 06:32:55.429227 tst iperf3.py:8: start network... 06:32:55.624766 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:32:56.077904 run create_hlr_db(pid=5533): Launched 06:32:56.190667 bus /gobi_6: Setting Powered False 06:32:57.249730 run create_hlr_db(pid=5533): Terminated: ok {rc=0} 06:32:57.678550 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5535): Launched 06:32:57.994851 run osmo-hlr_10.42.42.2(pid=5536): Launched 06:32:58.115720 run osmo-stp_10.42.42.5: Starting osmo-stp 06:32:58.660164 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5538): Launched 06:32:58.974744 run osmo-stp_10.42.42.5(pid=5539): Launched 06:32:59.094811 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:32:59.636692 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5541): Launched 06:32:59.758053 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:33:00.024204 run patchelf(pid=5542): Launched 06:33:00.200374 run osmo-stp_10.42.42.5(pid=5539): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5539)] 06:33:00.335596 run osmo-stp_10.42.42.5(pid=5539): stdout: | (launched: 2022-12-10_06:32:58.917374) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:33:00.471168 run osmo-stp_10.42.42.5(pid=5539): stderr: | 20221210063259110 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063259110 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063259110 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063259111 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063259111 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063259111 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063259111 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:33:00.606952 run osmo-stp_10.42.42.5(pid=5539): stdout: | (launched: 2022-12-10_06:32:58.917374) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:33:00.736554 run osmo-stp_10.42.42.5(pid=5539): stderr: | 20221210063259110 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063259110 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063259110 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063259111 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063259111 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063259111 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063259111 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:33:00.916406 run patchelf(pid=5542): Terminating (SIGINT) 06:33:01.098808 run patchelf(pid=5542): Terminated: ok {rc=0} 06:33:01.243897 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5539): Process ended prematurely: osmo-stp_10.42.42.5(pid=5539) [trial-2370↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5539)] [trial-2370↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8] 06:33:01.255080 tst iperf3.py:8: Test FAILED (7.5 sec) 06:33:01.286229 run osmo-hlr_10.42.42.2(pid=5536): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5536)] 06:33:01.337984 run osmo-hlr_10.42.42.2(pid=5536): stdout: | (launched: 2022-12-10_06:32:57.937389) 06:33:01.390814 run osmo-hlr_10.42.42.2(pid=5536): stderr: | 20221210063258135 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210063258135 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210063258135 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210063258136 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210063258136 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210063258136 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210063258148 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210063258157 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210063258157 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210063258157 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:33:01.443889 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5531): Terminating (SIGTERM) 06:33:01.486869 run iperf3-srv_10.42.42.10(pid=5532): Terminating (SIGTERM) 06:33:01.532381 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5535): Terminating (SIGTERM) 06:33:01.575753 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5538): Terminating (SIGTERM) 06:33:01.620382 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5541): Terminating (SIGTERM) 06:33:01.665285 --- ParallelTerminationStrategy: PID 5531 died... 06:33:01.685194 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5531): Terminated: ok {rc=0} 06:33:01.734038 --- ParallelTerminationStrategy: PID 5532 died... 06:33:01.754069 run iperf3-srv_10.42.42.10(pid=5532): Terminated {rc=256} 06:33:01.801268 --- ParallelTerminationStrategy: PID 5535 died... 06:33:01.820777 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5535): Terminated: ok {rc=0} 06:33:01.868682 --- ParallelTerminationStrategy: PID 5538 died... 06:33:01.888471 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5538): Terminated: ok {rc=0} 06:33:01.937296 --- ParallelTerminationStrategy: PID 5541 died... 06:33:01.956913 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5541): Terminated: ok {rc=0} 06:33:02.046932 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 06:33:03.196451 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:33:03.208057 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:33:03.267078 tst iperf3m4.py: using LAC 26512 06:33:03.383946 tst iperf3m4.py: using RAC 247 06:33:03.498539 tst iperf3m4.py: using CellId 26512 06:33:03.615856 tst iperf3m4.py: using BVCI 26513 06:33:03.723622 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:33:03.734561 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:33:03.745326 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:33:03.756290 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:33:03.767143 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:33:03.778058 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:33:03.789061 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:33:03.799860 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:33:03.810995 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:33:03.929753 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:33:04.048104 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:33:04.165319 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:33:04.284504 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 06:33:04.496283 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:33:04.811302 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5544): Launched 06:33:05.085445 run iperf3-srv_10.42.42.10(pid=5545): Launched 06:33:05.203895 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 06:33:05.415980 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:33:05.731231 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5546): Launched 06:33:06.005694 run iperf3-srv_10.42.42.10(pid=5547): Launched 06:33:06.124111 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 06:33:06.336607 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:33:06.651966 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5548): Launched 06:33:06.925512 run iperf3-srv_10.42.42.10(pid=5549): Launched 06:33:07.043096 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 06:33:07.254669 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:33:07.569717 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5550): Launched 06:33:07.843426 run iperf3-srv_10.42.42.10(pid=5551): Launched 06:33:07.961190 tst iperf3m4.py:8: start network... 06:33:08.172743 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:33:08.658979 run create_hlr_db(pid=5552): Launched 06:33:08.787864 bus /gobi_6: Setting Powered False 06:33:09.849510 run create_hlr_db(pid=5552): Terminated: ok {rc=0} 06:33:10.286994 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5554): Launched 06:33:10.601402 run osmo-hlr_10.42.42.2(pid=5555): Launched 06:33:10.721129 run osmo-stp_10.42.42.5: Starting osmo-stp 06:33:11.262096 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5557): Launched 06:33:11.576008 run osmo-stp_10.42.42.5(pid=5558): Launched 06:33:11.695744 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:33:12.238459 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5560): Launched 06:33:12.359980 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:33:12.626185 run patchelf(pid=5561): Launched 06:33:12.801781 run osmo-stp_10.42.42.5(pid=5558): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5558)] 06:33:12.935201 run osmo-stp_10.42.42.5(pid=5558): stdout: | (launched: 2022-12-10_06:33:11.518439) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:33:13.070006 run osmo-stp_10.42.42.5(pid=5558): stderr: | 20221210063311711 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063311711 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063311711 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063311712 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063311712 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063311712 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063311712 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:33:13.204703 run osmo-stp_10.42.42.5(pid=5558): stdout: | (launched: 2022-12-10_06:33:11.518439) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:33:13.334419 run osmo-stp_10.42.42.5(pid=5558): stderr: | 20221210063311711 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063311711 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063311711 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063311712 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063311712 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063311712 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063311712 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:33:13.487388 run patchelf(pid=5561): Terminating (SIGINT) 06:33:13.663189 run patchelf(pid=5561): Terminated: ok {rc=0} 06:33:13.790058 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5558): Process ended prematurely: osmo-stp_10.42.42.5(pid=5558) [trial-2370↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5558)] [trial-2370↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 06:33:13.800171 tst iperf3m4.py:8: Test FAILED (10.6 sec) 06:33:13.828593 run osmo-hlr_10.42.42.2(pid=5555): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5555)] 06:33:13.877657 run osmo-hlr_10.42.42.2(pid=5555): stdout: | (launched: 2022-12-10_06:33:10.543811) 06:33:13.928346 run osmo-hlr_10.42.42.2(pid=5555): stderr: | 20221210063310744 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210063310744 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210063310744 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210063310744 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210063310744 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210063310744 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210063310756 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210063310766 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210063310766 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210063310766 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:33:13.979345 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5544): Terminating (SIGTERM) 06:33:14.020409 run iperf3-srv_10.42.42.10(pid=5545): Terminating (SIGTERM) 06:33:14.062229 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5546): Terminating (SIGTERM) 06:33:14.103443 run iperf3-srv_10.42.42.10(pid=5547): Terminating (SIGTERM) 06:33:14.144429 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5548): Terminating (SIGTERM) 06:33:14.185729 run iperf3-srv_10.42.42.10(pid=5549): Terminating (SIGTERM) 06:33:14.226845 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5550): Terminating (SIGTERM) 06:33:14.267814 run iperf3-srv_10.42.42.10(pid=5551): Terminating (SIGTERM) 06:33:14.308675 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5554): Terminating (SIGTERM) 06:33:14.349678 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5557): Terminating (SIGTERM) 06:33:14.390597 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5560): Terminating (SIGTERM) 06:33:14.432149 --- ParallelTerminationStrategy: PID 5544 died... 06:33:14.452090 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5544): Terminated: ok {rc=0} 06:33:14.498122 --- ParallelTerminationStrategy: PID 5545 died... 06:33:14.517587 run iperf3-srv_10.42.42.10(pid=5545): Terminated {rc=256} 06:33:14.562699 --- ParallelTerminationStrategy: PID 5546 died... 06:33:14.582090 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5546): Terminated: ok {rc=0} 06:33:14.627278 --- ParallelTerminationStrategy: PID 5547 died... 06:33:14.646519 run iperf3-srv_10.42.42.10(pid=5547): Terminated {rc=256} 06:33:14.691521 --- ParallelTerminationStrategy: PID 5548 died... 06:33:14.710768 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5548): Terminated: ok {rc=0} 06:33:14.755848 --- ParallelTerminationStrategy: PID 5549 died... 06:33:14.775045 run iperf3-srv_10.42.42.10(pid=5549): Terminated {rc=256} 06:33:14.819883 --- ParallelTerminationStrategy: PID 5550 died... 06:33:14.839233 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5550): Terminated: ok {rc=0} 06:33:14.884211 --- ParallelTerminationStrategy: PID 5551 died... 06:33:14.903611 run iperf3-srv_10.42.42.10(pid=5551): Terminated {rc=256} 06:33:14.948570 --- ParallelTerminationStrategy: PID 5554 died... 06:33:14.967911 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5554): Terminated: ok {rc=0} 06:33:15.013027 --- ParallelTerminationStrategy: PID 5557 died... 06:33:15.032338 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5557): Terminated: ok {rc=0} 06:33:15.077948 --- ParallelTerminationStrategy: PID 5560 died... 06:33:15.097521 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5560): Terminated: ok {rc=0} 06:33:15.184906 bus /gobi_4: Setting Powered False 06:33:16.281678 bus /gobi_4: Setting Powered False 06:33:17.399587 bus /gobi_1: Setting Powered False 06:33:18.497421 bus /gobi_1: Setting Powered False 06:33:19.611278 bus /gobi_0: Setting Powered False 06:33:20.708002 bus /gobi_0: Setting Powered False 06:33:21.824073 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 06:33:22.928787 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:33:22.942582 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:33:23.003431 tst ping.py: using LAC 26513 06:33:23.124356 tst ping.py: using RAC 248 06:33:23.245684 tst ping.py: using CellId 26513 06:33:23.366574 tst ping.py: using BVCI 26514 06:33:23.478388 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:33:23.490204 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:33:23.501721 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:33:23.513133 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:33:23.524373 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:33:23.535806 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:33:23.547308 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:33:23.558744 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:33:23.671584 tst ping.py:19: start network... 06:33:23.864113 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:33:24.311473 run create_hlr_db(pid=5562): Launched 06:33:24.422450 bus /gobi_6: Setting Powered False 06:33:25.480409 run create_hlr_db(pid=5562): Terminated: ok {rc=0} 06:33:25.906226 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5564): Launched 06:33:26.218690 run osmo-hlr_10.42.42.2(pid=5565): Launched 06:33:26.337850 run osmo-stp_10.42.42.5: Starting osmo-stp 06:33:26.857305 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5567): Launched 06:33:27.146072 run osmo-stp_10.42.42.5(pid=5568): Launched 06:33:27.255788 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:33:27.753286 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5570): Launched 06:33:27.864605 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:33:28.107893 run patchelf(pid=5571): Launched 06:33:28.269291 run osmo-stp_10.42.42.5(pid=5568): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5568)] 06:33:28.391730 run osmo-stp_10.42.42.5(pid=5568): stdout: | (launched: 2022-12-10_06:33:27.092865) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:33:28.515896 run osmo-stp_10.42.42.5(pid=5568): stderr: | 20221210063327262 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063327262 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063327262 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063327263 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063327263 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063327263 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063327263 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:33:28.640095 run osmo-stp_10.42.42.5(pid=5568): stdout: | (launched: 2022-12-10_06:33:27.092865) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:33:28.758407 run osmo-stp_10.42.42.5(pid=5568): stderr: | 20221210063327262 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063327262 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063327262 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063327263 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063327263 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063327263 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063327263 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:33:28.898476 run patchelf(pid=5571): Terminating (SIGINT) 06:33:29.060216 run patchelf(pid=5571): Terminated: ok {rc=0} 06:33:29.176752 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=5568): Process ended prematurely: osmo-stp_10.42.42.5(pid=5568) [trial-2370↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5568)] [trial-2370↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22] 06:33:29.185700 tst ping.py:22: Test FAILED (6.3 sec) 06:33:29.212545 run osmo-hlr_10.42.42.2(pid=5565): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5565)] 06:33:29.259463 run osmo-hlr_10.42.42.2(pid=5565): stdout: | (launched: 2022-12-10_06:33:26.161931) 06:33:29.307971 run osmo-hlr_10.42.42.2(pid=5565): stderr: | 20221210063326359 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210063326360 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210063326360 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210063326360 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210063326360 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210063326360 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210063326371 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210063326379 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210063326380 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210063326380 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:33:29.357119 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5564): Terminating (SIGTERM) 06:33:29.395962 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5567): Terminating (SIGTERM) 06:33:29.434971 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5570): Terminating (SIGTERM) 06:33:29.474507 --- ParallelTerminationStrategy: PID 5564 died... 06:33:29.493203 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5564): Terminated: ok {rc=0} 06:33:29.537162 --- ParallelTerminationStrategy: PID 5567 died... 06:33:29.555514 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5567): Terminated: ok {rc=0} 06:33:29.599082 --- ParallelTerminationStrategy: PID 5570 died... 06:33:29.617481 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5570): Terminated: ok {rc=0} 06:33:29.702493 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 06:33:30.788120 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:33:30.800228 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:33:30.863614 tst ping_idle_ping.py: using LAC 26514 06:33:30.994927 tst ping_idle_ping.py: using RAC 249 06:33:31.110977 tst ping_idle_ping.py: using CellId 26514 06:33:31.246758 tst ping_idle_ping.py: using BVCI 26515 06:33:31.370028 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:33:31.382129 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:33:31.394078 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:33:31.407677 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:33:31.419466 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:33:31.432219 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:33:31.446396 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:33:31.458123 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:33:31.579706 tst ping_idle_ping.py:24: start network... 06:33:31.825637 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:33:32.319613 run create_hlr_db(pid=5572): Launched 06:33:32.445957 bus /gobi_6: Setting Powered False 06:33:33.508396 run create_hlr_db(pid=5572): Terminated: ok {rc=0} 06:33:33.941188 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5574): Launched 06:33:34.251514 run osmo-hlr_10.42.42.2(pid=5575): Launched 06:33:34.369322 run osmo-stp_10.42.42.5: Starting osmo-stp 06:33:34.905700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5577): Launched 06:33:35.214394 run osmo-stp_10.42.42.5(pid=5578): Launched 06:33:35.332213 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:33:35.865669 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5580): Launched 06:33:35.984390 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:33:36.246134 run patchelf(pid=5581): Launched 06:33:36.418629 run osmo-stp_10.42.42.5(pid=5578): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5578)] 06:33:36.549536 run osmo-stp_10.42.42.5(pid=5578): stdout: | (launched: 2022-12-10_06:33:35.157694) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:33:36.682606 run osmo-stp_10.42.42.5(pid=5578): stderr: | 20221210063335348 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063335349 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063335349 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063335349 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063335350 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063335350 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063335350 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:33:36.815453 run osmo-stp_10.42.42.5(pid=5578): stdout: | (launched: 2022-12-10_06:33:35.157694) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:33:36.942057 run osmo-stp_10.42.42.5(pid=5578): stderr: | 20221210063335348 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063335349 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063335349 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063335349 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063335350 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063335350 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063335350 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:33:37.091999 run patchelf(pid=5581): Terminating (SIGINT) 06:33:37.265443 run patchelf(pid=5581): Terminated: ok {rc=0} 06:33:37.390243 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=5578): Process ended prematurely: osmo-stp_10.42.42.5(pid=5578) [trial-2370↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5578)] [trial-2370↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 06:33:37.399866 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 06:33:37.427584 run osmo-hlr_10.42.42.2(pid=5575): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5575)] 06:33:37.476337 run osmo-hlr_10.42.42.2(pid=5575): stdout: | (launched: 2022-12-10_06:33:34.194232) 06:33:37.526859 run osmo-hlr_10.42.42.2(pid=5575): stderr: | 20221210063334394 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210063334394 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210063334394 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210063334394 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210063334394 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210063334394 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210063334407 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210063334416 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210063334416 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210063334416 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:33:37.577810 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5574): Terminating (SIGTERM) 06:33:37.618686 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5577): Terminating (SIGTERM) 06:33:37.659712 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5580): Terminating (SIGTERM) 06:33:37.700820 --- ParallelTerminationStrategy: PID 5574 died... 06:33:37.720451 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5574): Terminated: ok {rc=0} 06:33:37.766078 --- ParallelTerminationStrategy: PID 5577 died... 06:33:37.785149 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5577): Terminated: ok {rc=0} 06:33:37.830331 --- ParallelTerminationStrategy: PID 5580 died... 06:33:37.849542 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5580): Terminated: ok {rc=0} 06:33:37.934636 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2370 gprs:nanobts+band-1900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 06:33:39.225049 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:33:39.232599 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 06:33:39.258586 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 06:33:39.293457 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 06:33:39.345782 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 06:33:39.369085 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 06:33:39.404030 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 06:33:39.964334 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2370 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 06:33:39.969800 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:33:39.981314 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 06:33:40.043579 tst switch_tch_pdch.py: using LAC 26515 06:33:40.158323 tst switch_tch_pdch.py: using RAC 250 06:33:40.272704 tst switch_tch_pdch.py: using CellId 26515 06:33:40.385592 tst switch_tch_pdch.py: using BVCI 26516 06:33:40.490374 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:33:40.501859 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:33:40.513243 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:33:40.524587 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:33:40.536210 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:33:40.547810 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:33:40.559587 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:33:40.571257 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:33:40.688558 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:33:40.806906 tst switch_tch_pdch.py:51: start network... 06:33:41.014343 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:33:41.491784 run create_hlr_db(pid=5585): Launched 06:33:41.617905 bus /gobi_6: Setting Powered False 06:33:42.679187 run create_hlr_db(pid=5585): Terminated: ok {rc=0} 06:33:43.093069 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5587): Launched 06:33:43.382411 run osmo-hlr_10.42.42.2(pid=5588): Launched 06:33:43.492904 run osmo-stp_10.42.42.5: Starting osmo-stp 06:33:43.997684 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5590): Launched 06:33:44.286762 run osmo-stp_10.42.42.5(pid=5591): Launched 06:33:44.397009 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:33:44.894475 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5593): Launched 06:33:45.005590 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:33:45.249496 run patchelf(pid=5594): Launched 06:33:45.410531 run osmo-stp_10.42.42.5(pid=5591): ERR: Terminated: ERROR {rc=1} [trial-2370↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5591)] 06:33:45.533497 run osmo-stp_10.42.42.5(pid=5591): stdout: | (launched: 2022-12-10_06:33:44.233427) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:33:45.657825 run osmo-stp_10.42.42.5(pid=5591): stderr: | 20221210063344403 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063344403 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063344403 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063344404 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063344404 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063344404 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063344405 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:33:45.782361 run osmo-stp_10.42.42.5(pid=5591): stdout: | (launched: 2022-12-10_06:33:44.233427) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:33:45.925878 run osmo-stp_10.42.42.5(pid=5591): stderr: | 20221210063344403 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063344403 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063344403 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063344404 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063344404 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063344404 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063344405 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:33:46.068864 run patchelf(pid=5594): Terminating (SIGINT) 06:33:46.234264 run patchelf(pid=5594): Terminated: ok {rc=0} 06:33:46.354210 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=5591): Process ended prematurely: osmo-stp_10.42.42.5(pid=5591) [trial-2370↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5591)] [trial-2370↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 06:33:46.363763 tst switch_tch_pdch.py:54: Test FAILED (6.4 sec) 06:33:46.391812 run osmo-hlr_10.42.42.2(pid=5588): ERR: Terminated: ERROR {rc=237} [trial-2370↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5588)] 06:33:46.439880 run osmo-hlr_10.42.42.2(pid=5588): stdout: | (launched: 2022-12-10_06:33:43.329757) 06:33:46.489706 run osmo-hlr_10.42.42.2(pid=5588): stderr: | 20221210063343504 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210063343504 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210063343504 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210063343504 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210063343504 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210063343504 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210063343517 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210063343525 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210063343525 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210063343525 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:33:46.539846 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5587): Terminating (SIGTERM) 06:33:46.580595 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5590): Terminating (SIGTERM) 06:33:46.622561 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5593): Terminating (SIGTERM) 06:33:46.663088 --- ParallelTerminationStrategy: PID 5587 died... 06:33:46.682081 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5587): Terminated: ok {rc=0} 06:33:46.726920 --- ParallelTerminationStrategy: PID 5590 died... 06:33:46.745952 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5590): Terminated: ok {rc=0} 06:33:46.790623 --- ParallelTerminationStrategy: PID 5593 died... 06:33:46.809422 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5593): Terminated: ok {rc=0} 06:33:46.893887 bus /gobi_0: Setting Powered False 06:33:47.988424 bus /gobi_0: Setting Powered False 06:33:49.102148 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2370 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 sms:nanobts+band-900 --------------------------------------------------------------------- 06:33:50.348698 tst sms:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:33:50.354128 tst sms:nanobts+band-900: Verifying 1 x bts (candidates: 11) 06:33:50.386831 tst sms:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 06:33:50.413838 tst sms:nanobts+band-900: Verifying 2 x modem (candidates: 12) 06:33:50.466677 tst sms:nanobts+band-900: Reserving 1 x bts (candidates: 11) 06:33:50.499464 tst sms:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 06:33:50.526279 tst sms:nanobts+band-900: Reserving 2 x modem (candidates: 12) 06:33:51.071925 tst sms:nanobts+band-900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 sms:nanobts+band-900 mo_mt_sms.py ---------------------------------------------- 06:33:51.078817 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 06:33:51.090226 tst sms:nanobts+band-900: Using 1 x bts (candidates: 1) 06:33:51.141897 tst mo_mt_sms.py: using LAC 26516 06:33:51.256053 tst mo_mt_sms.py: using RAC 251 06:33:51.367946 tst mo_mt_sms.py: using CellId 26516 06:33:51.479362 tst mo_mt_sms.py: using BVCI 26517 06:33:51.583544 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 06:33:51.594149 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 06:33:51.604417 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 06:33:51.614947 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 06:33:51.625541 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 06:33:51.635995 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 06:33:51.752520 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 06:33:51.865639 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:33:52.311707 run create_hlr_db(pid=5598): Launched 06:33:52.421534 bus /gobi_6: Setting Powered False 06:33:53.479986 run create_hlr_db(pid=5598): Terminated: ok {rc=0} 06:33:53.903800 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5600): Launched 06:33:54.213281 run osmo-hlr_10.42.42.2(pid=5601): Launched 06:33:54.331998 run osmo-stp_10.42.42.5: Starting osmo-stp 06:33:54.865639 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5603): Launched 06:33:55.174048 run osmo-stp_10.42.42.5(pid=5604): Launched 06:33:55.291874 run osmo-msc_10.42.42.6: Starting osmo-msc 06:33:55.851211 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5606): Launched 06:33:56.161387 run osmo-msc_10.42.42.6(pid=5607): Launched 06:33:56.335085 run osmo-stp_10.42.42.5(pid=5604): ERR: Terminated: ERROR {rc=1} [trial-2370↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5604)] 06:33:56.467882 run osmo-stp_10.42.42.5(pid=5604): stdout: | (launched: 2022-12-10_06:33:55.117672) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:33:56.600026 run osmo-stp_10.42.42.5(pid=5604): stderr: | 20221210063355306 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063355306 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063355307 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063355307 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063355310 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063355310 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063355310 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:33:56.729384 run osmo-stp_10.42.42.5(pid=5604): stdout: | (launched: 2022-12-10_06:33:55.117672) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:33:56.852573 run osmo-stp_10.42.42.5(pid=5604): stderr: | 20221210063355306 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063355306 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063355307 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063355307 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063355310 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063355310 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063355310 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:33:57.000276 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=5604): Process ended prematurely: osmo-stp_10.42.42.5(pid=5604) [trial-2370↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5604)] [trial-2370↪sms:nanobts+band-900↪mo_mt_sms.py:16] 06:33:57.009285 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 06:33:57.036536 run osmo-hlr_10.42.42.2(pid=5601): ERR: Terminated: ERROR {rc=237} [trial-2370↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5601)] 06:33:57.086170 run osmo-hlr_10.42.42.2(pid=5601): stdout: | (launched: 2022-12-10_06:33:54.157102) 06:33:57.137212 run osmo-hlr_10.42.42.2(pid=5601): stderr: | 20221210063354354 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210063354354 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210063354354 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210063354354 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210063354354 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210063354354 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210063354367 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/sms:nanobts+band-900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210063354376 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210063354377 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210063354377 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:33:57.208182 run osmo-msc_10.42.42.6(pid=5607): ERR: Terminated: ERROR {rc=2} [trial-2370↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5607)] 06:33:57.257826 run osmo-msc_10.42.42.6(pid=5607): stdout: | (launched: 2022-12-10_06:33:56.104402) 06:33:57.308723 run osmo-msc_10.42.42.6(pid=5607): stderr: | 20221210063356424 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210063356424 DLGLOBAL DEBUG validating counter group 0x7fe7ac39fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210063356425 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210063356425 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210063356425 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210063356425 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210063356427 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210063356427 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210063356427 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210063356427 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:33:57.360015 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5600): Terminating (SIGTERM) 06:33:57.400872 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5603): Terminating (SIGTERM) 06:33:57.442029 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5606): Terminating (SIGTERM) 06:33:57.483526 --- ParallelTerminationStrategy: PID 5600 died... 06:33:57.503294 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5600): Terminated: ok {rc=0} 06:33:57.549109 --- ParallelTerminationStrategy: PID 5603 died... 06:33:57.568380 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5603): Terminated: ok {rc=0} 06:33:57.613985 --- ParallelTerminationStrategy: PID 5606 died... 06:33:57.633432 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5606): Terminated: ok {rc=0} 06:33:57.719030 bus /sierra_3: Setting Powered False 06:33:58.814975 bus /sierra_3: Setting Powered False 06:33:59.928066 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 sms:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 nitb_ussd:nanobts+band-900 --------------------------------------------------------------------- 06:34:01.201733 tst nitb_ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:34:01.209406 tst nitb_ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 06:34:01.251836 tst nitb_ussd:nanobts+band-900: Verifying 1 x ip_address (candidates: 9) 06:34:01.261418 tst nitb_ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 06:34:01.307016 tst nitb_ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 06:34:01.353015 tst nitb_ussd:nanobts+band-900: Reserving 1 x ip_address (candidates: 9) 06:34:01.362474 tst nitb_ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 06:34:01.878303 tst nitb_ussd:nanobts+band-900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2370 nitb_ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 06:34:01.886384 tst nitb_ussd:nanobts+band-900: Using 1 x ip_address (candidates: 1) 06:34:01.901729 tst nitb_ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 06:34:01.957265 tst assert_extension.py: using LAC 26517 06:34:02.112393 tst assert_extension.py: using RAC 252 06:34:02.261020 tst assert_extension.py: using CellId 26517 06:34:02.376713 tst assert_extension.py: using BVCI 26518 06:34:02.481626 tst nitb_ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 06:34:02.595956 tst assert_extension.py:10: start nitb and bts... 06:34:02.804240 run osmo-nitb_10.42.42.2: Starting osmo-nitb 06:34:03.435658 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=5614): Launched 06:34:03.745368 run osmo-nitb_10.42.42.2(pid=5615): Launched 06:34:03.916708 run osmo-nitb_10.42.42.2(pid=5615): ERR: Terminated: ERROR {rc=2} [trial-2370↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5615)] 06:34:04.055537 run osmo-nitb_10.42.42.2(pid=5615): stdout: | (launched: 2022-12-10_06:34:03.689028) 06:34:04.196055 run osmo-nitb_10.42.42.2(pid=5615): stderr: | (launched: 2022-12-10_06:34:03.734921) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:34:04.336817 run osmo-nitb_10.42.42.2(pid=5615): stdout: | (launched: 2022-12-10_06:34:03.689028) 06:34:04.471815 run osmo-nitb_10.42.42.2(pid=5615): stderr: | (launched: 2022-12-10_06:34:03.734921) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=5615): Process ended prematurely: osmo-nitb_10.42.42.2(pid=5615) [trial-2370↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5615)] 06:34:04.861879 tst osmo-nitb_10.42.42.2(pid=5615): stdout: | (launched: 2022-12-10_06:34:03.689028) 06:34:04.988018 tst osmo-nitb_10.42.42.2(pid=5615): stderr: | (launched: 2022-12-10_06:34:03.734921) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:34:05.136304 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=5615): Process ended prematurely: osmo-nitb_10.42.42.2(pid=5615) [trial-2370↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5615)] [trial-2370↪nitb_ussd:nanobts+band-900↪assert_extension.py:12] 06:34:05.145103 tst assert_extension.py:12: Test FAILED (3.3 sec) 06:34:05.152114 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=5614): Terminating (SIGTERM) 06:34:05.363300 --- ParallelTerminationStrategy: PID 5614 died... 06:34:05.383814 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=5614): Terminated: ok {rc=0} 06:34:05.471049 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 nitb_ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 ussd:nanobts+band-900 --------------------------------------------------------------------- 06:34:06.647691 tst ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:34:06.653525 tst ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 06:34:06.687042 tst ussd:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 06:34:06.713775 tst ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 06:34:06.748522 tst ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 06:34:06.780361 tst ussd:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 06:34:06.806591 tst ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 06:34:07.334902 tst ussd:nanobts+band-900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2370 ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 06:34:07.340132 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 06:34:07.350957 tst ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 06:34:07.398311 tst assert_extension.py: using LAC 26518 06:34:07.517297 tst assert_extension.py: using RAC 253 06:34:07.629334 tst assert_extension.py: using CellId 26518 06:34:07.740415 tst assert_extension.py: using BVCI 26519 06:34:07.844938 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 06:34:07.855787 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 06:34:07.866444 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 06:34:07.877309 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 06:34:07.888063 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 06:34:07.898864 tst ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 06:34:08.008754 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:34:08.453176 run create_hlr_db(pid=5619): Launched 06:34:08.563904 bus /sierra_2: Setting Powered False 06:34:09.623014 run create_hlr_db(pid=5619): Terminated: ok {rc=0} 06:34:10.045450 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5621): Launched 06:34:10.355943 run osmo-hlr_10.42.42.2(pid=5622): Launched 06:34:10.475350 run osmo-stp_10.42.42.5: Starting osmo-stp 06:34:11.011319 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5624): Launched 06:34:11.321352 run osmo-stp_10.42.42.5(pid=5625): Launched 06:34:11.440387 run osmo-msc_10.42.42.6: Starting osmo-msc 06:34:11.998327 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5627): Launched 06:34:12.306672 run osmo-msc_10.42.42.6(pid=5628): Launched 06:34:12.479403 run osmo-stp_10.42.42.5(pid=5625): ERR: Terminated: ERROR {rc=1} [trial-2370↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5625)] 06:34:12.611608 run osmo-stp_10.42.42.5(pid=5625): stdout: | (launched: 2022-12-10_06:34:11.264291) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:34:12.743591 run osmo-stp_10.42.42.5(pid=5625): stderr: | 20221210063411454 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063411455 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063411455 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063411455 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063411456 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063411456 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063411456 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:34:12.874513 run osmo-stp_10.42.42.5(pid=5625): stdout: | (launched: 2022-12-10_06:34:11.264291) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:34:12.997435 run osmo-stp_10.42.42.5(pid=5625): stderr: | 20221210063411454 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063411455 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063411455 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063411455 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063411456 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063411456 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063411456 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:34:13.144581 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=5625): Process ended prematurely: osmo-stp_10.42.42.5(pid=5625) [trial-2370↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5625)] [trial-2370↪ussd:nanobts+band-900↪assert_extension.py:17] 06:34:13.153629 tst assert_extension.py:17: Test FAILED (5.8 sec) 06:34:13.181190 run osmo-hlr_10.42.42.2(pid=5622): ERR: Terminated: ERROR {rc=237} [trial-2370↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5622)] 06:34:13.230733 run osmo-hlr_10.42.42.2(pid=5622): stdout: | (launched: 2022-12-10_06:34:10.299266) 06:34:13.282622 run osmo-hlr_10.42.42.2(pid=5622): stderr: | 20221210063410496 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210063410496 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210063410496 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210063410497 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210063410497 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210063410497 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210063410511 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/ussd:nanobts+band-900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210063410519 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210063410519 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210063410519 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:34:13.354084 run osmo-msc_10.42.42.6(pid=5628): ERR: Terminated: ERROR {rc=2} [trial-2370↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5628)] 06:34:13.403539 run osmo-msc_10.42.42.6(pid=5628): stdout: | (launched: 2022-12-10_06:34:12.249956) 06:34:13.454774 run osmo-msc_10.42.42.6(pid=5628): stderr: | 20221210063412571 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210063412571 DLGLOBAL DEBUG validating counter group 0x7fcd1c1b4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210063412571 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210063412571 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210063412571 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210063412571 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210063412573 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210063412574 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210063412574 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210063412574 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:34:13.506041 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5621): Terminating (SIGTERM) 06:34:13.547006 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5624): Terminating (SIGTERM) 06:34:13.588243 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5627): Terminating (SIGTERM) 06:34:13.629639 --- ParallelTerminationStrategy: PID 5621 died... 06:34:13.649392 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5621): Terminated: ok {rc=0} 06:34:13.694825 --- ParallelTerminationStrategy: PID 5624 died... 06:34:13.714165 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5624): Terminated: ok {rc=0} 06:34:13.759333 --- ParallelTerminationStrategy: PID 5627 died... 06:34:13.778454 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5627): Terminated: ok {rc=0} 06:34:13.863914 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 06:34:15.073913 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:34:15.081935 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 06:34:15.114702 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 06:34:15.141960 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 06:34:15.195474 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 06:34:15.228430 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 06:34:15.255495 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 06:34:15.805911 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 06:34:15.868603 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:34:15.888189 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 06:34:15.966885 tst mo_mt_call.py: using LAC 26519 06:34:16.089871 tst mo_mt_call.py: using RAC 254 06:34:16.208316 tst mo_mt_call.py: using CellId 26519 06:34:16.326517 tst mo_mt_call.py: using BVCI 26520 06:34:16.446075 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:34:16.458285 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:34:16.470442 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:34:16.482425 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:34:16.494832 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:34:16.506844 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 06:34:16.628256 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 06:34:16.750207 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:34:17.226668 run create_hlr_db(pid=5633): Launched 06:34:17.377500 bus /sierra_2: Setting Powered False 06:34:18.436678 run create_hlr_db(pid=5633): Terminated: ok {rc=0} 06:34:18.847169 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5635): Launched 06:34:19.140380 run osmo-hlr_10.42.42.2(pid=5636): Launched 06:34:19.252372 run osmo-stp_10.42.42.5: Starting osmo-stp 06:34:19.756818 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5638): Launched 06:34:20.050904 run osmo-stp_10.42.42.5(pid=5639): Launched 06:34:20.163618 run osmo-msc_10.42.42.6: Starting osmo-msc 06:34:20.694638 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5641): Launched 06:34:20.987746 run osmo-msc_10.42.42.6(pid=5642): Launched 06:34:21.152237 run osmo-stp_10.42.42.5(pid=5639): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5639)] 06:34:21.277559 run osmo-stp_10.42.42.5(pid=5639): stdout: | (launched: 2022-12-10_06:34:19.997081) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:34:21.402945 run osmo-stp_10.42.42.5(pid=5639): stderr: | 20221210063420165 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063420165 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063420165 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063420166 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063420166 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063420166 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063420166 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:34:21.525674 run osmo-stp_10.42.42.5(pid=5639): stdout: | (launched: 2022-12-10_06:34:19.997081) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:34:21.642184 run osmo-stp_10.42.42.5(pid=5639): stderr: | 20221210063420165 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063420165 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063420165 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063420166 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063420166 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063420166 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063420166 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:34:21.781632 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5639): Process ended prematurely: osmo-stp_10.42.42.5(pid=5639) [trial-2370↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5639)] [trial-2370↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 06:34:21.790531 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 06:34:21.816935 run osmo-hlr_10.42.42.2(pid=5636): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5636)] 06:34:21.863906 run osmo-hlr_10.42.42.2(pid=5636): stdout: | (launched: 2022-12-10_06:34:19.086403) 06:34:21.912727 run osmo-hlr_10.42.42.2(pid=5636): stderr: | 20221210063419263 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210063419263 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210063419263 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210063419263 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210063419263 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210063419263 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210063419276 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210063419286 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210063419286 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210063419286 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:34:21.980524 run osmo-msc_10.42.42.6(pid=5642): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5642)] 06:34:22.027447 run osmo-msc_10.42.42.6(pid=5642): stdout: | (launched: 2022-12-10_06:34:20.933736) 06:34:22.075895 run osmo-msc_10.42.42.6(pid=5642): stderr: | 20221210063421206 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210063421206 DLGLOBAL DEBUG validating counter group 0x7f611e287c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210063421206 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210063421206 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210063421206 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210063421207 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210063421208 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210063421209 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210063421209 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210063421209 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:34:22.124887 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5635): Terminating (SIGTERM) 06:34:22.163893 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5638): Terminating (SIGTERM) 06:34:22.202875 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5641): Terminating (SIGTERM) 06:34:22.242415 --- ParallelTerminationStrategy: PID 5635 died... 06:34:22.261283 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5635): Terminated: ok {rc=0} 06:34:22.305496 --- ParallelTerminationStrategy: PID 5638 died... 06:34:22.323708 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5638): Terminated: ok {rc=0} 06:34:22.367432 --- ParallelTerminationStrategy: PID 5641 died... 06:34:22.385863 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5641): Terminated: ok {rc=0} 06:34:22.471352 bus /sierra_3: Setting Powered False 06:34:23.567979 bus /sierra_3: Setting Powered False 06:34:24.682181 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2370 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 06:34:25.825371 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:34:25.837332 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 06:34:25.903853 tst mo_mt_call_osmux.py: using LAC 26520 06:34:26.019629 tst mo_mt_call_osmux.py: using RAC 255 06:34:26.137135 tst mo_mt_call_osmux.py: using CellId 26520 06:34:26.253933 tst mo_mt_call_osmux.py: using BVCI 26521 06:34:26.360330 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:34:26.371536 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:34:26.382527 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:34:26.393654 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:34:26.404786 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:34:26.415947 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 06:34:26.534501 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 06:34:26.650424 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:34:27.105492 run create_hlr_db(pid=5644): Launched 06:34:27.217527 bus /sierra_2: Setting Powered False 06:34:28.277207 run create_hlr_db(pid=5644): Terminated: ok {rc=0} 06:34:28.709441 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5646): Launched 06:34:29.024880 run osmo-hlr_10.42.42.2(pid=5647): Launched 06:34:29.145509 run osmo-stp_10.42.42.5: Starting osmo-stp 06:34:29.686744 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5649): Launched 06:34:30.001377 run osmo-stp_10.42.42.5(pid=5650): Launched 06:34:30.121439 run osmo-msc_10.42.42.6: Starting osmo-msc 06:34:30.690987 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5652): Launched 06:34:31.023193 run osmo-msc_10.42.42.6(pid=5653): Launched 06:34:31.303191 run osmo-stp_10.42.42.5(pid=5650): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5650)] 06:34:31.550912 run osmo-stp_10.42.42.5(pid=5650): stdout: | (launched: 2022-12-10_06:34:29.943808) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:34:31.780826 run osmo-stp_10.42.42.5(pid=5650): stderr: | 20221210063430134 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063430134 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063430135 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063430135 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063430136 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063430136 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063430136 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:34:31.930504 run osmo-stp_10.42.42.5(pid=5650): stdout: | (launched: 2022-12-10_06:34:29.943808) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:34:32.058164 run osmo-stp_10.42.42.5(pid=5650): stderr: | 20221210063430134 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063430134 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063430135 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063430135 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063430136 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063430136 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063430136 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:34:32.211225 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5650): Process ended prematurely: osmo-stp_10.42.42.5(pid=5650) [trial-2370↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5650)] [trial-2370↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 06:34:32.221488 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 06:34:32.251065 run osmo-hlr_10.42.42.2(pid=5647): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5647)] 06:34:32.302130 run osmo-hlr_10.42.42.2(pid=5647): stdout: | (launched: 2022-12-10_06:34:28.967508) 06:34:32.354685 run osmo-hlr_10.42.42.2(pid=5647): stderr: | 20221210063429164 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210063429164 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210063429164 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210063429164 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210063429164 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210063429164 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210063429176 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210063429184 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210063429185 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210063429185 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:34:32.426887 run osmo-msc_10.42.42.6(pid=5653): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5653)] 06:34:32.476908 run osmo-msc_10.42.42.6(pid=5653): stdout: | (launched: 2022-12-10_06:34:30.951964) 06:34:32.528851 run osmo-msc_10.42.42.6(pid=5653): stderr: | 20221210063431466 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210063431466 DLGLOBAL DEBUG validating counter group 0x7fa49e383c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210063431466 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210063431466 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210063431466 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210063431467 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210063431468 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210063431469 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210063431469 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210063431469 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:34:32.581007 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5646): Terminating (SIGTERM) 06:34:32.622803 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5649): Terminating (SIGTERM) 06:34:32.665001 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5652): Terminating (SIGTERM) 06:34:32.707082 --- ParallelTerminationStrategy: PID 5646 died... 06:34:32.727096 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5646): Terminated: ok {rc=0} 06:34:32.774224 --- ParallelTerminationStrategy: PID 5649 died... 06:34:32.793657 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5649): Terminated: ok {rc=0} 06:34:32.840037 --- ParallelTerminationStrategy: PID 5652 died... 06:34:32.859473 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5652): Terminated: ok {rc=0} 06:34:32.946069 bus /sierra_3: Setting Powered False 06:34:34.043749 bus /sierra_3: Setting Powered False 06:34:35.157691 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 06:34:36.411133 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:34:36.419109 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 06:34:36.451880 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 06:34:36.478803 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 06:34:36.531377 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 06:34:36.563649 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 06:34:36.590235 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 06:34:37.139640 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 06:34:37.187678 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:34:37.198949 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 06:34:37.264173 tst mo_mt_call.py: using LAC 26521 06:34:37.379610 tst mo_mt_call.py: using RAC 1 06:34:37.501543 tst mo_mt_call.py: using CellId 26521 06:34:37.625015 tst mo_mt_call.py: using BVCI 26522 06:34:37.738329 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:34:37.749878 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:34:37.761259 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:34:37.772539 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:34:37.783943 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:34:37.795228 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 06:34:37.910250 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 06:34:38.028286 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:34:38.514709 run create_hlr_db(pid=5658): Launched 06:34:38.642957 bus /sierra_2: Setting Powered False 06:34:39.705813 run create_hlr_db(pid=5658): Terminated: ok {rc=0} 06:34:40.143597 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5660): Launched 06:34:40.459448 run osmo-hlr_10.42.42.2(pid=5661): Launched 06:34:40.579352 run osmo-stp_10.42.42.5: Starting osmo-stp 06:34:41.122981 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5663): Launched 06:34:41.439090 run osmo-stp_10.42.42.5(pid=5664): Launched 06:34:41.559835 run osmo-msc_10.42.42.6: Starting osmo-msc 06:34:42.128265 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5666): Launched 06:34:42.443075 run osmo-msc_10.42.42.6(pid=5667): Launched 06:34:42.619380 run osmo-stp_10.42.42.5(pid=5664): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5664)] 06:34:42.753141 run osmo-stp_10.42.42.5(pid=5664): stdout: | (launched: 2022-12-10_06:34:41.381774) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:34:42.886797 run osmo-stp_10.42.42.5(pid=5664): stderr: | 20221210063441572 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063441572 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063441573 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063441573 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063441574 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063441574 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063441574 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:34:43.019848 run osmo-stp_10.42.42.5(pid=5664): stdout: | (launched: 2022-12-10_06:34:41.381774) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:34:43.144646 run osmo-stp_10.42.42.5(pid=5664): stderr: | 20221210063441572 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063441572 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063441573 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063441573 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063441574 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063441574 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063441574 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:34:43.294444 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5664): Process ended prematurely: osmo-stp_10.42.42.5(pid=5664) [trial-2370↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5664)] [trial-2370↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 06:34:43.303991 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 06:34:43.331710 run osmo-hlr_10.42.42.2(pid=5661): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5661)] 06:34:43.380483 run osmo-hlr_10.42.42.2(pid=5661): stdout: | (launched: 2022-12-10_06:34:40.401945) 06:34:43.431337 run osmo-hlr_10.42.42.2(pid=5661): stderr: | 20221210063440602 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210063440602 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210063440602 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210063440602 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210063440602 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210063440602 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210063440651 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210063440661 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210063440661 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210063440661 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:34:43.502289 run osmo-msc_10.42.42.6(pid=5667): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5667)] 06:34:43.551163 run osmo-msc_10.42.42.6(pid=5667): stdout: | (launched: 2022-12-10_06:34:42.385832) 06:34:43.601739 run osmo-msc_10.42.42.6(pid=5667): stderr: | 20221210063442706 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210063442706 DLGLOBAL DEBUG validating counter group 0x7f37a3eefc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210063442706 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210063442707 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210063442707 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210063442707 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210063442709 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210063442709 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210063442709 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210063442709 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:34:43.652722 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5660): Terminating (SIGTERM) 06:34:43.693461 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5663): Terminating (SIGTERM) 06:34:43.734236 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5666): Terminating (SIGTERM) 06:34:43.775328 --- ParallelTerminationStrategy: PID 5660 died... 06:34:43.795015 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5660): Terminated: ok {rc=0} 06:34:43.840352 --- ParallelTerminationStrategy: PID 5663 died... 06:34:43.859525 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5663): Terminated: ok {rc=0} 06:34:43.904631 --- ParallelTerminationStrategy: PID 5666 died... 06:34:43.923874 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5666): Terminated: ok {rc=0} 06:34:44.009856 bus /sierra_3: Setting Powered False 06:34:45.106742 bus /sierra_3: Setting Powered False 06:34:46.226445 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2370 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 06:34:47.396835 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:34:47.409235 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 06:34:47.477409 tst mo_mt_call_osmux.py: using LAC 26522 06:34:47.600453 tst mo_mt_call_osmux.py: using RAC 2 06:34:47.724682 tst mo_mt_call_osmux.py: using CellId 26522 06:34:47.852516 tst mo_mt_call_osmux.py: using BVCI 26523 06:34:47.966986 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:34:47.978577 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:34:47.990405 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:34:48.001971 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:34:48.013574 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:34:48.025108 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 06:34:48.138579 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 06:34:48.257786 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:34:48.746595 run create_hlr_db(pid=5669): Launched 06:34:48.874890 bus /sierra_2: Setting Powered False 06:34:49.937346 run create_hlr_db(pid=5669): Terminated: ok {rc=0} 06:34:50.356885 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5671): Launched 06:34:50.651878 run osmo-hlr_10.42.42.2(pid=5672): Launched 06:34:50.765271 run osmo-stp_10.42.42.5: Starting osmo-stp 06:34:51.272004 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5674): Launched 06:34:51.566264 run osmo-stp_10.42.42.5(pid=5675): Launched 06:34:51.679217 run osmo-msc_10.42.42.6: Starting osmo-msc 06:34:52.210576 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5677): Launched 06:34:52.505279 run osmo-msc_10.42.42.6(pid=5678): Launched 06:34:52.671330 run osmo-stp_10.42.42.5(pid=5675): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5675)] 06:34:52.797920 run osmo-stp_10.42.42.5(pid=5675): stdout: | (launched: 2022-12-10_06:34:51.512484) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:34:52.923969 run osmo-stp_10.42.42.5(pid=5675): stderr: | 20221210063451680 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063451680 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063451680 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063451681 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063451681 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063451681 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063451681 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:34:53.046978 run osmo-stp_10.42.42.5(pid=5675): stdout: | (launched: 2022-12-10_06:34:51.512484) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:34:53.163859 run osmo-stp_10.42.42.5(pid=5675): stderr: | 20221210063451680 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063451680 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063451680 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063451681 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063451681 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063451681 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063451681 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:34:53.303844 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5675): Process ended prematurely: osmo-stp_10.42.42.5(pid=5675) [trial-2370↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5675)] [trial-2370↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 06:34:53.312920 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 06:34:53.339473 run osmo-hlr_10.42.42.2(pid=5672): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5672)] 06:34:53.386673 run osmo-hlr_10.42.42.2(pid=5672): stdout: | (launched: 2022-12-10_06:34:50.597869) 06:34:53.435376 run osmo-hlr_10.42.42.2(pid=5672): stderr: | 20221210063450775 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210063450775 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210063450775 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210063450775 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210063450775 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210063450775 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210063450788 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210063450798 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210063450798 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210063450798 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:34:53.503441 run osmo-msc_10.42.42.6(pid=5678): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5678)] 06:34:53.550677 run osmo-msc_10.42.42.6(pid=5678): stdout: | (launched: 2022-12-10_06:34:52.451095) 06:34:53.599126 run osmo-msc_10.42.42.6(pid=5678): stderr: | 20221210063452722 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210063452722 DLGLOBAL DEBUG validating counter group 0x7f2db6b0bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210063452722 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210063452722 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210063452722 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210063452723 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210063452724 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210063452725 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210063452725 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210063452725 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:34:53.648205 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5671): Terminating (SIGTERM) 06:34:53.687394 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5674): Terminating (SIGTERM) 06:34:53.726554 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5677): Terminating (SIGTERM) 06:34:53.765866 --- ParallelTerminationStrategy: PID 5671 died... 06:34:53.784657 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5671): Terminated: ok {rc=0} 06:34:53.828511 --- ParallelTerminationStrategy: PID 5674 died... 06:34:53.846890 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5674): Terminated: ok {rc=0} 06:34:53.890100 --- ParallelTerminationStrategy: PID 5677 died... 06:34:53.908220 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5677): Terminated: ok {rc=0} 06:34:53.993728 bus /sierra_3: Setting Powered False 06:34:55.091332 bus /sierra_3: Setting Powered False 06:34:56.205610 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 06:34:57.455793 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:34:57.464522 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 06:34:57.500007 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 06:34:57.527610 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 06:34:57.581077 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 06:34:57.614175 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 06:34:57.641650 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 06:34:58.192609 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 06:34:58.244116 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:34:58.255901 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 06:34:58.325184 tst mo_mt_call.py: using LAC 26523 06:34:58.448457 tst mo_mt_call.py: using RAC 3 06:34:58.571968 tst mo_mt_call.py: using CellId 26523 06:34:58.695353 tst mo_mt_call.py: using BVCI 26524 06:34:58.809411 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:34:58.820843 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:34:58.832208 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:34:58.843506 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:34:58.854861 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:34:58.866479 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 06:34:58.981183 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 06:34:59.094582 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:34:59.549827 run create_hlr_db(pid=5683): Launched 06:34:59.679447 bus /sierra_2: Setting Powered False 06:35:00.741329 run create_hlr_db(pid=5683): Terminated: ok {rc=0} 06:35:01.216061 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5685): Launched 06:35:01.551218 run osmo-hlr_10.42.42.2(pid=5686): Launched 06:35:01.748635 run osmo-stp_10.42.42.5: Starting osmo-stp 06:35:02.364256 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5691): Launched 06:35:02.680283 run osmo-stp_10.42.42.5(pid=5692): Launched 06:35:02.800037 run osmo-msc_10.42.42.6: Starting osmo-msc 06:35:03.370297 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5694): Launched 06:35:03.685127 run osmo-msc_10.42.42.6(pid=5695): Launched 06:35:03.860447 run osmo-stp_10.42.42.5(pid=5692): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5692)] 06:35:03.993483 run osmo-stp_10.42.42.5(pid=5692): stdout: | (launched: 2022-12-10_06:35:02.622686) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:35:04.127229 run osmo-stp_10.42.42.5(pid=5692): stderr: | 20221210063502816 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063502816 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063502817 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063502817 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063502818 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063502818 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063502818 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:35:04.260464 run osmo-stp_10.42.42.5(pid=5692): stdout: | (launched: 2022-12-10_06:35:02.622686) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:35:04.386522 run osmo-stp_10.42.42.5(pid=5692): stderr: | 20221210063502816 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063502816 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063502817 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063502817 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063502818 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063502818 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063502818 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:35:04.536711 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5692): Process ended prematurely: osmo-stp_10.42.42.5(pid=5692) [trial-2370↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5692)] [trial-2370↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 06:35:04.546366 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 06:35:04.574051 run osmo-hlr_10.42.42.2(pid=5686): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5686)] 06:35:04.623517 run osmo-hlr_10.42.42.2(pid=5686): stdout: | (launched: 2022-12-10_06:35:01.488085) 06:35:04.674487 run osmo-hlr_10.42.42.2(pid=5686): stderr: | 20221210063501859 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210063501859 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210063501859 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210063501859 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210063501859 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210063501860 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210063501917 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210063501943 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210063501944 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210063501944 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:35:04.745871 run osmo-msc_10.42.42.6(pid=5695): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5695)] 06:35:04.795370 run osmo-msc_10.42.42.6(pid=5695): stdout: | (launched: 2022-12-10_06:35:03.627636) 06:35:04.846303 run osmo-msc_10.42.42.6(pid=5695): stderr: | 20221210063503949 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210063503949 DLGLOBAL DEBUG validating counter group 0x7ff48545cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210063503949 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210063503949 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210063503949 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210063503950 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210063503951 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210063503952 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210063503952 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210063503952 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:35:04.897353 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5685): Terminating (SIGTERM) 06:35:04.938643 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5691): Terminating (SIGTERM) 06:35:04.979741 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5694): Terminating (SIGTERM) 06:35:05.021115 --- ParallelTerminationStrategy: PID 5685 died... 06:35:05.040865 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5685): Terminated: ok {rc=0} 06:35:05.086617 --- ParallelTerminationStrategy: PID 5691 died... 06:35:05.105956 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5691): Terminated: ok {rc=0} 06:35:05.151395 --- ParallelTerminationStrategy: PID 5694 died... 06:35:05.170751 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5694): Terminated: ok {rc=0} 06:35:05.257313 bus /sierra_3: Setting Powered False 06:35:06.356051 bus /sierra_3: Setting Powered False 06:35:07.472129 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2370 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 06:35:08.613810 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:35:08.625497 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 06:35:08.692378 tst mo_mt_call_osmux.py: using LAC 26524 06:35:08.808628 tst mo_mt_call_osmux.py: using RAC 4 06:35:08.925640 tst mo_mt_call_osmux.py: using CellId 26524 06:35:09.045052 tst mo_mt_call_osmux.py: using BVCI 26525 06:35:09.153706 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:35:09.164736 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:35:09.175649 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:35:09.187224 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:35:09.199000 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:35:09.211483 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 06:35:09.330169 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 06:35:09.450079 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:35:09.906501 run create_hlr_db(pid=5697): Launched 06:35:10.018880 bus /sierra_2: Setting Powered False 06:35:11.077992 run create_hlr_db(pid=5697): Terminated: ok {rc=0} 06:35:11.509394 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5699): Launched 06:35:11.825886 run osmo-hlr_10.42.42.2(pid=5700): Launched 06:35:11.946612 run osmo-stp_10.42.42.5: Starting osmo-stp 06:35:12.489471 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5702): Launched 06:35:12.802757 run osmo-stp_10.42.42.5(pid=5703): Launched 06:35:12.923225 run osmo-msc_10.42.42.6: Starting osmo-msc 06:35:13.492671 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5705): Launched 06:35:13.807607 run osmo-msc_10.42.42.6(pid=5706): Launched 06:35:13.983461 run osmo-stp_10.42.42.5(pid=5703): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5703)] 06:35:14.121290 run osmo-stp_10.42.42.5(pid=5703): stdout: | (launched: 2022-12-10_06:35:12.745601) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:35:14.253894 run osmo-stp_10.42.42.5(pid=5703): stderr: | 20221210063512937 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063512938 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063512938 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063512938 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063512940 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063512941 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063512941 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:35:14.385815 run osmo-stp_10.42.42.5(pid=5703): stdout: | (launched: 2022-12-10_06:35:12.745601) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:35:14.510817 run osmo-stp_10.42.42.5(pid=5703): stderr: | 20221210063512937 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063512938 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063512938 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063512938 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063512940 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063512941 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063512941 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:35:14.660699 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5703): Process ended prematurely: osmo-stp_10.42.42.5(pid=5703) [trial-2370↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5703)] [trial-2370↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 06:35:14.670508 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 06:35:14.698359 run osmo-hlr_10.42.42.2(pid=5700): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5700)] 06:35:14.747815 run osmo-hlr_10.42.42.2(pid=5700): stdout: | (launched: 2022-12-10_06:35:11.768548) 06:35:14.799144 run osmo-hlr_10.42.42.2(pid=5700): stderr: | 20221210063511967 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210063511967 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210063511967 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210063511967 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210063511967 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210063511967 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210063511979 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210063511989 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210063511989 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210063511989 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:35:14.870268 run osmo-msc_10.42.42.6(pid=5706): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5706)] 06:35:14.919452 run osmo-msc_10.42.42.6(pid=5706): stdout: | (launched: 2022-12-10_06:35:13.750090) 06:35:14.970392 run osmo-msc_10.42.42.6(pid=5706): stderr: | 20221210063514071 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210063514072 DLGLOBAL DEBUG validating counter group 0x7f716521ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210063514072 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210063514072 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210063514072 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210063514072 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210063514074 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210063514074 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210063514074 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210063514075 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:35:15.022205 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5699): Terminating (SIGTERM) 06:35:15.063176 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5702): Terminating (SIGTERM) 06:35:15.104296 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5705): Terminating (SIGTERM) 06:35:15.145816 --- ParallelTerminationStrategy: PID 5699 died... 06:35:15.165324 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5699): Terminated: ok {rc=0} 06:35:15.211117 --- ParallelTerminationStrategy: PID 5702 died... 06:35:15.230350 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5702): Terminated: ok {rc=0} 06:35:15.275779 --- ParallelTerminationStrategy: PID 5705 died... 06:35:15.295400 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5705): Terminated: ok {rc=0} 06:35:15.382190 bus /sierra_3: Setting Powered False 06:35:16.477401 bus /sierra_3: Setting Powered False 06:35:17.591049 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 06:35:18.851082 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:35:18.860695 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 06:35:18.893632 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 06:35:18.920664 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 06:35:18.980911 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 06:35:19.014524 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 06:35:19.041822 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 06:35:19.585428 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 06:35:19.636038 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:35:19.647742 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 06:35:19.716193 tst mo_mt_call.py: using LAC 26525 06:35:19.839317 tst mo_mt_call.py: using RAC 5 06:35:19.964779 tst mo_mt_call.py: using CellId 26525 06:35:20.088926 tst mo_mt_call.py: using BVCI 26526 06:35:20.202826 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:35:20.214419 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:35:20.225883 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:35:20.237491 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:35:20.249197 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:35:20.260704 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 06:35:20.374875 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 06:35:20.491118 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:35:20.978217 run create_hlr_db(pid=5711): Launched 06:35:21.106923 bus /sierra_2: Setting Powered False 06:35:22.169386 run create_hlr_db(pid=5711): Terminated: ok {rc=0} 06:35:22.607333 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5713): Launched 06:35:22.922574 run osmo-hlr_10.42.42.2(pid=5714): Launched 06:35:23.042108 run osmo-stp_10.42.42.5: Starting osmo-stp 06:35:23.586278 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5716): Launched 06:35:23.901528 run osmo-stp_10.42.42.5(pid=5717): Launched 06:35:24.021854 run osmo-msc_10.42.42.6: Starting osmo-msc 06:35:24.590758 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5719): Launched 06:35:24.905546 run osmo-msc_10.42.42.6(pid=5720): Launched 06:35:25.081255 run osmo-stp_10.42.42.5(pid=5717): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5717)] 06:35:25.214392 run osmo-stp_10.42.42.5(pid=5717): stdout: | (launched: 2022-12-10_06:35:23.843917) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:35:25.348415 run osmo-stp_10.42.42.5(pid=5717): stderr: | 20221210063524037 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063524037 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063524037 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063524038 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063524038 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063524038 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063524038 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:35:25.481318 run osmo-stp_10.42.42.5(pid=5717): stdout: | (launched: 2022-12-10_06:35:23.843917) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:35:25.606670 run osmo-stp_10.42.42.5(pid=5717): stderr: | 20221210063524037 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063524037 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063524037 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063524038 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063524038 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063524038 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063524038 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:35:25.756575 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5717): Process ended prematurely: osmo-stp_10.42.42.5(pid=5717) [trial-2370↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5717)] [trial-2370↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 06:35:25.766241 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 06:35:25.794019 run osmo-hlr_10.42.42.2(pid=5714): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5714)] 06:35:25.843603 run osmo-hlr_10.42.42.2(pid=5714): stdout: | (launched: 2022-12-10_06:35:22.865225) 06:35:25.894879 run osmo-hlr_10.42.42.2(pid=5714): stderr: | 20221210063523064 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210063523064 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210063523064 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210063523064 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210063523064 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210063523064 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210063523075 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210063523084 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210063523084 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210063523084 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:35:25.966199 run osmo-msc_10.42.42.6(pid=5720): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5720)] 06:35:26.015322 run osmo-msc_10.42.42.6(pid=5720): stdout: | (launched: 2022-12-10_06:35:24.847925) 06:35:26.066170 run osmo-msc_10.42.42.6(pid=5720): stderr: | 20221210063525172 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210063525173 DLGLOBAL DEBUG validating counter group 0x7f5a8edabc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210063525173 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210063525173 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210063525173 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210063525173 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210063525175 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210063525175 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210063525175 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210063525175 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:35:26.117321 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5713): Terminating (SIGTERM) 06:35:26.157804 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5716): Terminating (SIGTERM) 06:35:26.198649 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5719): Terminating (SIGTERM) 06:35:26.240046 --- ParallelTerminationStrategy: PID 5713 died... 06:35:26.259853 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5713): Terminated: ok {rc=0} 06:35:26.305490 --- ParallelTerminationStrategy: PID 5716 died... 06:35:26.324511 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5716): Terminated: ok {rc=0} 06:35:26.370058 --- ParallelTerminationStrategy: PID 5719 died... 06:35:26.389418 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5719): Terminated: ok {rc=0} 06:35:26.475515 bus /sierra_3: Setting Powered False 06:35:27.574088 bus /sierra_3: Setting Powered False 06:35:28.691262 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2370 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 06:35:29.838106 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:35:29.850460 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 06:35:29.919172 tst mo_mt_call_osmux.py: using LAC 26526 06:35:30.046382 tst mo_mt_call_osmux.py: using RAC 6 06:35:30.172119 tst mo_mt_call_osmux.py: using CellId 26526 06:35:30.295511 tst mo_mt_call_osmux.py: using BVCI 26527 06:35:30.410326 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:35:30.421986 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:35:30.433437 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:35:30.444894 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:35:30.456405 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:35:30.467849 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 06:35:30.583686 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 06:35:30.700058 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:35:31.176140 run create_hlr_db(pid=5722): Launched 06:35:31.303537 bus /sierra_2: Setting Powered False 06:35:32.364004 run create_hlr_db(pid=5722): Terminated: ok {rc=0} 06:35:32.774953 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5724): Launched 06:35:33.069744 run osmo-hlr_10.42.42.2(pid=5725): Launched 06:35:33.181698 run osmo-stp_10.42.42.5: Starting osmo-stp 06:35:33.687182 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5727): Launched 06:35:33.982141 run osmo-stp_10.42.42.5(pid=5728): Launched 06:35:34.094228 run osmo-msc_10.42.42.6: Starting osmo-msc 06:35:34.625200 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5730): Launched 06:35:34.918880 run osmo-msc_10.42.42.6(pid=5731): Launched 06:35:35.083790 run osmo-stp_10.42.42.5(pid=5728): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5728)] 06:35:35.209631 run osmo-stp_10.42.42.5(pid=5728): stdout: | (launched: 2022-12-10_06:35:33.927558) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:35:35.335528 run osmo-stp_10.42.42.5(pid=5728): stderr: | 20221210063534097 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063534098 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063534098 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063534098 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063534099 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063534099 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063534099 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:35:35.458556 run osmo-stp_10.42.42.5(pid=5728): stdout: | (launched: 2022-12-10_06:35:33.927558) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:35:35.575151 run osmo-stp_10.42.42.5(pid=5728): stderr: | 20221210063534097 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063534098 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063534098 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063534098 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063534099 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063534099 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063534099 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:35:35.715384 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5728): Process ended prematurely: osmo-stp_10.42.42.5(pid=5728) [trial-2370↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5728)] [trial-2370↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 06:35:35.724221 tst mo_mt_call_osmux.py:8: Test FAILED (5.9 sec) 06:35:35.750886 run osmo-hlr_10.42.42.2(pid=5725): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5725)] 06:35:35.798021 run osmo-hlr_10.42.42.2(pid=5725): stdout: | (launched: 2022-12-10_06:35:33.015663) 06:35:35.846532 run osmo-hlr_10.42.42.2(pid=5725): stderr: | 20221210063533190 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210063533190 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210063533190 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210063533190 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210063533190 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210063533191 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210063533203 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210063533213 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210063533214 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210063533214 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:35:35.914124 run osmo-msc_10.42.42.6(pid=5731): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5731)] 06:35:35.960928 run osmo-msc_10.42.42.6(pid=5731): stdout: | (launched: 2022-12-10_06:35:34.864632) 06:35:36.009226 run osmo-msc_10.42.42.6(pid=5731): stderr: | 20221210063535138 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210063535138 DLGLOBAL DEBUG validating counter group 0x7f33e020ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210063535138 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210063535138 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210063535138 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210063535138 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210063535140 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210063535140 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210063535140 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210063535141 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:35:36.058049 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5724): Terminating (SIGTERM) 06:35:36.096922 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5727): Terminating (SIGTERM) 06:35:36.136134 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5730): Terminating (SIGTERM) 06:35:36.175472 --- ParallelTerminationStrategy: PID 5724 died... 06:35:36.194196 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5724): Terminated: ok {rc=0} 06:35:36.237798 --- ParallelTerminationStrategy: PID 5727 died... 06:35:36.256212 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5727): Terminated: ok {rc=0} 06:35:36.300131 --- ParallelTerminationStrategy: PID 5730 died... 06:35:36.318571 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5730): Terminated: ok {rc=0} 06:35:36.403070 bus /sierra_3: Setting Powered False 06:35:37.499881 bus /sierra_3: Setting Powered False 06:35:38.613562 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 06:35:39.863654 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:35:39.871738 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 06:35:39.904600 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 06:35:39.932044 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 06:35:39.987813 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 06:35:40.019648 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 06:35:40.046222 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 06:35:40.597946 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 06:35:40.646043 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:35:40.657209 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 06:35:40.727882 tst mo_mt_call.py: using LAC 26527 06:35:40.843721 tst mo_mt_call.py: using RAC 7 06:35:40.958439 tst mo_mt_call.py: using CellId 26527 06:35:41.077024 tst mo_mt_call.py: using BVCI 26528 06:35:41.193881 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:35:41.205941 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:35:41.218017 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:35:41.230740 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:35:41.242472 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:35:41.254024 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:35:41.370078 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:35:41.487281 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:35:41.974701 run create_hlr_db(pid=5737): Launched 06:35:42.102463 bus /sierra_2: Setting Powered False 06:35:43.164413 run create_hlr_db(pid=5737): Terminated: ok {rc=0} 06:35:43.604178 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5739): Launched 06:35:43.919367 run osmo-hlr_10.42.42.2(pid=5740): Launched 06:35:44.039415 run osmo-stp_10.42.42.5: Starting osmo-stp 06:35:44.580520 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5742): Launched 06:35:44.875513 run osmo-stp_10.42.42.5(pid=5743): Launched 06:35:44.987869 run osmo-msc_10.42.42.6: Starting osmo-msc 06:35:45.518348 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5745): Launched 06:35:45.813201 run osmo-msc_10.42.42.6(pid=5746): Launched 06:35:46.107549 run osmo-stp_10.42.42.5(pid=5743): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5743)] 06:35:46.430337 run osmo-stp_10.42.42.5(pid=5743): stdout: | (launched: 2022-12-10_06:35:44.821587) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:35:46.606660 run osmo-stp_10.42.42.5(pid=5743): stderr: | 20221210063544990 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063544990 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063544991 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063544991 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063544991 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063544991 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063544991 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:35:46.795048 run osmo-stp_10.42.42.5(pid=5743): stdout: | (launched: 2022-12-10_06:35:44.821587) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:35:46.924333 run osmo-stp_10.42.42.5(pid=5743): stderr: | 20221210063544990 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063544990 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063544991 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063544991 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063544991 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063544991 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063544991 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:35:47.079208 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5743): Process ended prematurely: osmo-stp_10.42.42.5(pid=5743) [trial-2370↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5743)] [trial-2370↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 06:35:47.089387 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 06:35:47.119197 run osmo-hlr_10.42.42.2(pid=5740): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5740)] 06:35:47.171596 run osmo-hlr_10.42.42.2(pid=5740): stdout: | (launched: 2022-12-10_06:35:43.861974) 06:35:47.224418 run osmo-hlr_10.42.42.2(pid=5740): stderr: | 20221210063544060 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210063544060 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210063544060 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210063544060 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210063544060 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210063544060 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210063544078 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210063544088 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210063544089 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210063544089 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:35:47.298999 run osmo-msc_10.42.42.6(pid=5746): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5746)] 06:35:47.351550 run osmo-msc_10.42.42.6(pid=5746): stdout: | (launched: 2022-12-10_06:35:45.758799) 06:35:47.403546 run osmo-msc_10.42.42.6(pid=5746): stderr: | 20221210063546429 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210063546429 DLGLOBAL DEBUG validating counter group 0x7f1105e73c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210063546430 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210063546430 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210063546430 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210063546430 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210063546432 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210063546432 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210063546432 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210063546432 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:35:47.455291 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5739): Terminating (SIGTERM) 06:35:47.496328 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5742): Terminating (SIGTERM) 06:35:47.538632 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5745): Terminating (SIGTERM) 06:35:47.580465 --- ParallelTerminationStrategy: PID 5739 died... 06:35:47.600301 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5739): Terminated: ok {rc=0} 06:35:47.646650 --- ParallelTerminationStrategy: PID 5742 died... 06:35:47.665936 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5742): Terminated: ok {rc=0} 06:35:47.712322 --- ParallelTerminationStrategy: PID 5745 died... 06:35:47.731739 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5745): Terminated: ok {rc=0} 06:35:47.818975 bus /sierra_3: Setting Powered False 06:35:48.916696 bus /sierra_3: Setting Powered False 06:35:50.031485 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2370 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 06:35:51.177482 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:35:51.189750 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 06:35:51.257925 tst mo_mt_call_osmux.py: using LAC 26528 06:35:51.384847 tst mo_mt_call_osmux.py: using RAC 8 06:35:51.509828 tst mo_mt_call_osmux.py: using CellId 26528 06:35:51.633379 tst mo_mt_call_osmux.py: using BVCI 26529 06:35:51.747816 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:35:51.759442 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:35:51.770950 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:35:51.782429 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:35:51.793964 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:35:51.805477 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:35:51.923252 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:35:52.039771 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:35:52.529514 run create_hlr_db(pid=5748): Launched 06:35:52.658281 bus /sierra_2: Setting Powered False 06:35:53.720662 run create_hlr_db(pid=5748): Terminated: ok {rc=0} 06:35:54.141580 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5750): Launched 06:35:54.436541 run osmo-hlr_10.42.42.2(pid=5751): Launched 06:35:54.548772 run osmo-stp_10.42.42.5: Starting osmo-stp 06:35:55.068402 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5753): Launched 06:35:55.362609 run osmo-stp_10.42.42.5(pid=5754): Launched 06:35:55.474601 run osmo-msc_10.42.42.6: Starting osmo-msc 06:35:56.006066 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5756): Launched 06:35:56.300818 run osmo-msc_10.42.42.6(pid=5757): Launched 06:35:56.466108 run osmo-stp_10.42.42.5(pid=5754): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5754)] 06:35:56.592019 run osmo-stp_10.42.42.5(pid=5754): stdout: | (launched: 2022-12-10_06:35:55.308405) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:35:56.717337 run osmo-stp_10.42.42.5(pid=5754): stderr: | 20221210063555476 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063555476 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063555477 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063555477 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063555478 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063555478 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063555478 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:35:56.839974 run osmo-stp_10.42.42.5(pid=5754): stdout: | (launched: 2022-12-10_06:35:55.308405) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:35:56.956909 run osmo-stp_10.42.42.5(pid=5754): stderr: | 20221210063555476 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063555476 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063555477 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063555477 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063555478 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063555478 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063555478 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:35:57.096833 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5754): Process ended prematurely: osmo-stp_10.42.42.5(pid=5754) [trial-2370↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5754)] [trial-2370↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 06:35:57.105909 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 06:35:57.132315 run osmo-hlr_10.42.42.2(pid=5751): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5751)] 06:35:57.179566 run osmo-hlr_10.42.42.2(pid=5751): stdout: | (launched: 2022-12-10_06:35:54.382292) 06:35:57.228203 run osmo-hlr_10.42.42.2(pid=5751): stderr: | 20221210063554557 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210063554557 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210063554557 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210063554557 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210063554557 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210063554557 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210063554569 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210063554580 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210063554580 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210063554580 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:35:57.296010 run osmo-msc_10.42.42.6(pid=5757): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5757)] 06:35:57.343079 run osmo-msc_10.42.42.6(pid=5757): stdout: | (launched: 2022-12-10_06:35:56.246669) 06:35:57.391445 run osmo-msc_10.42.42.6(pid=5757): stderr: | 20221210063556517 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210063556517 DLGLOBAL DEBUG validating counter group 0x7f2d016fdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210063556517 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210063556517 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210063556517 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210063556517 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210063556519 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210063556519 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210063556520 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210063556520 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:35:57.440491 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5750): Terminating (SIGTERM) 06:35:57.479339 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5753): Terminating (SIGTERM) 06:35:57.518184 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5756): Terminating (SIGTERM) 06:35:57.557610 --- ParallelTerminationStrategy: PID 5750 died... 06:35:57.576346 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5750): Terminated: ok {rc=0} 06:35:57.620123 --- ParallelTerminationStrategy: PID 5753 died... 06:35:57.638320 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5753): Terminated: ok {rc=0} 06:35:57.682676 --- ParallelTerminationStrategy: PID 5756 died... 06:35:57.701049 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5756): Terminated: ok {rc=0} 06:35:57.784818 bus /sierra_3: Setting Powered False 06:35:58.882256 bus /sierra_3: Setting Powered False 06:35:59.996229 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 06:36:01.250033 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:36:01.261339 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 06:36:01.304116 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 06:36:01.341674 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 06:36:01.409424 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 06:36:01.453567 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 06:36:01.496589 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 06:36:02.041823 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 06:36:02.107781 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 06:36:02.125090 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 06:36:02.185155 tst mo_mt_call.py: using LAC 26529 06:36:02.310404 tst mo_mt_call.py: using RAC 9 06:36:02.434367 tst mo_mt_call.py: using CellId 26529 06:36:02.559278 tst mo_mt_call.py: using BVCI 26530 06:36:02.673465 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 06:36:02.685260 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 06:36:02.696765 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 06:36:02.708444 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 06:36:02.720165 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 06:36:02.731764 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 06:36:02.845788 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 06:36:02.959127 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:36:03.414932 run create_hlr_db(pid=5762): Launched 06:36:03.528422 bus /sierra_2: Setting Powered False 06:36:04.587305 run create_hlr_db(pid=5762): Terminated: ok {rc=0} 06:36:05.018662 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5764): Launched 06:36:05.336177 run osmo-hlr_10.42.42.2(pid=5765): Launched 06:36:05.458092 run osmo-stp_10.42.42.5: Starting osmo-stp 06:36:06.000930 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5767): Launched 06:36:06.316730 run osmo-stp_10.42.42.5(pid=5768): Launched 06:36:06.438167 run osmo-msc_10.42.42.6: Starting osmo-msc 06:36:07.010227 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5770): Launched 06:36:07.325288 run osmo-msc_10.42.42.6(pid=5771): Launched 06:36:07.503526 run osmo-stp_10.42.42.5(pid=5768): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5768)] 06:36:07.638922 run osmo-stp_10.42.42.5(pid=5768): stdout: | (launched: 2022-12-10_06:36:06.259169) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:36:07.773615 run osmo-stp_10.42.42.5(pid=5768): stderr: | 20221210063606451 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063606451 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063606451 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063606452 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063606454 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063606454 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063606454 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:36:07.906729 run osmo-stp_10.42.42.5(pid=5768): stdout: | (launched: 2022-12-10_06:36:06.259169) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:36:08.031835 run osmo-stp_10.42.42.5(pid=5768): stderr: | 20221210063606451 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063606451 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063606451 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063606452 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063606454 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063606454 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063606454 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:36:08.182260 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5768): Process ended prematurely: osmo-stp_10.42.42.5(pid=5768) [trial-2370↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5768)] [trial-2370↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 06:36:08.191729 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 06:36:08.219317 run osmo-hlr_10.42.42.2(pid=5765): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5765)] 06:36:08.268265 run osmo-hlr_10.42.42.2(pid=5765): stdout: | (launched: 2022-12-10_06:36:05.278065) 06:36:08.319680 run osmo-hlr_10.42.42.2(pid=5765): stderr: | 20221210063605475 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210063605475 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210063605475 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210063605475 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210063605475 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210063605475 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210063605487 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210063605495 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210063605496 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210063605496 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:36:08.390819 run osmo-msc_10.42.42.6(pid=5771): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5771)] 06:36:08.439698 run osmo-msc_10.42.42.6(pid=5771): stdout: | (launched: 2022-12-10_06:36:07.267252) 06:36:08.490504 run osmo-msc_10.42.42.6(pid=5771): stderr: | 20221210063607585 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210063607585 DLGLOBAL DEBUG validating counter group 0x7f5adea39c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210063607585 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210063607585 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210063607585 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210063607586 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210063607587 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210063607588 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210063607588 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210063607588 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:36:08.541849 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5764): Terminating (SIGTERM) 06:36:08.582906 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5767): Terminating (SIGTERM) 06:36:08.623985 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5770): Terminating (SIGTERM) 06:36:08.665356 --- ParallelTerminationStrategy: PID 5764 died... 06:36:08.685144 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5764): Terminated: ok {rc=0} 06:36:08.730649 --- ParallelTerminationStrategy: PID 5767 died... 06:36:08.750020 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5767): Terminated: ok {rc=0} 06:36:08.795483 --- ParallelTerminationStrategy: PID 5770 died... 06:36:08.815026 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5770): Terminated: ok {rc=0} 06:36:08.901909 bus /sierra_3: Setting Powered False 06:36:10.000392 bus /sierra_3: Setting Powered False 06:36:11.115218 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2370 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 06:36:12.261487 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 06:36:12.274095 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 06:36:12.325461 tst mo_mt_call_osmux.py: using LAC 26530 06:36:12.449481 tst mo_mt_call_osmux.py: using RAC 10 06:36:12.567203 tst mo_mt_call_osmux.py: using CellId 26530 06:36:12.684506 tst mo_mt_call_osmux.py: using BVCI 26531 06:36:12.791553 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 06:36:12.803105 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 06:36:12.814462 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 06:36:12.826577 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 06:36:12.838683 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 06:36:12.850525 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 06:36:12.968421 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 06:36:13.083307 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:36:13.538517 run create_hlr_db(pid=5773): Launched 06:36:13.650983 bus /sierra_2: Setting Powered False 06:36:14.709999 run create_hlr_db(pid=5773): Terminated: ok {rc=0} 06:36:15.140383 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5775): Launched 06:36:15.456275 run osmo-hlr_10.42.42.2(pid=5776): Launched 06:36:15.578569 run osmo-stp_10.42.42.5: Starting osmo-stp 06:36:16.145475 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5778): Launched 06:36:16.484330 run osmo-stp_10.42.42.5(pid=5779): Launched 06:36:16.633657 run osmo-msc_10.42.42.6: Starting osmo-msc 06:36:17.524284 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5781): Launched 06:36:17.819900 run osmo-msc_10.42.42.6(pid=5782): Launched 06:36:17.985358 run osmo-stp_10.42.42.5(pid=5779): ERR: Terminated: ERROR {rc=1} [trial-2370↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5779)] 06:36:18.110718 run osmo-stp_10.42.42.5(pid=5779): stdout: | (launched: 2022-12-10_06:36:16.418410) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:36:18.236326 run osmo-stp_10.42.42.5(pid=5779): stderr: | 20221210063616858 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063616859 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063616862 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063616864 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063616866 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063616866 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063616866 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:36:18.359398 run osmo-stp_10.42.42.5(pid=5779): stdout: | (launched: 2022-12-10_06:36:16.418410) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:36:18.476626 run osmo-stp_10.42.42.5(pid=5779): stderr: | 20221210063616858 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063616859 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063616862 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063616864 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063616866 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063616866 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063616866 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:36:18.617662 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5779): Process ended prematurely: osmo-stp_10.42.42.5(pid=5779) [trial-2370↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5779)] [trial-2370↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 06:36:18.626653 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 06:36:18.653462 run osmo-hlr_10.42.42.2(pid=5776): ERR: Terminated: ERROR {rc=237} [trial-2370↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5776)] 06:36:18.701169 run osmo-hlr_10.42.42.2(pid=5776): stdout: | (launched: 2022-12-10_06:36:15.398806) 06:36:18.750036 run osmo-hlr_10.42.42.2(pid=5776): stderr: | 20221210063615595 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210063615595 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210063615595 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210063615595 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210063615595 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210063615595 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210063615610 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210063615620 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210063615620 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210063615620 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:36:18.818167 run osmo-msc_10.42.42.6(pid=5782): ERR: Terminated: ERROR {rc=2} [trial-2370↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5782)] 06:36:18.865254 run osmo-msc_10.42.42.6(pid=5782): stdout: | (launched: 2022-12-10_06:36:17.765613) 06:36:18.913938 run osmo-msc_10.42.42.6(pid=5782): stderr: | 20221210063618037 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210063618038 DLGLOBAL DEBUG validating counter group 0x7f2d629a2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210063618038 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210063618038 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210063618038 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210063618038 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210063618040 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210063618040 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210063618040 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210063618040 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:36:18.963079 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5775): Terminating (SIGTERM) 06:36:19.002047 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5778): Terminating (SIGTERM) 06:36:19.041109 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5781): Terminating (SIGTERM) 06:36:19.080618 --- ParallelTerminationStrategy: PID 5775 died... 06:36:19.099443 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5775): Terminated: ok {rc=0} 06:36:19.143258 --- ParallelTerminationStrategy: PID 5778 died... 06:36:19.161523 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5778): Terminated: ok {rc=0} 06:36:19.205105 --- ParallelTerminationStrategy: PID 5781 died... 06:36:19.223475 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5781): Terminated: ok {rc=0} 06:36:19.307863 bus /sierra_3: Setting Powered False 06:36:20.406358 bus /sierra_3: Setting Powered False 06:36:21.519701 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 emergency:nanobts+band-900 --------------------------------------------------------------------- 06:36:22.775121 tst emergency:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:36:22.780697 tst emergency:nanobts+band-900: Verifying 1 x bts (candidates: 11) 06:36:22.813033 tst emergency:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 06:36:22.840034 tst emergency:nanobts+band-900: Verifying 4 x modem (candidates: 12) 06:36:22.926774 tst emergency:nanobts+band-900: Reserving 1 x bts (candidates: 11) 06:36:22.958499 tst emergency:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 06:36:22.984214 tst emergency:nanobts+band-900: Reserving 4 x modem (candidates: 12) 06:36:23.574339 tst emergency:nanobts+band-900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2370 emergency:nanobts+band-900 emergency_mo_mt_call.py ---------------------------------------------- 06:36:23.579830 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 06:36:23.591161 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 06:36:23.639527 tst emergency_mo_mt_call.py: using LAC 26531 06:36:23.760219 tst emergency_mo_mt_call.py: using RAC 11 06:36:23.874478 tst emergency_mo_mt_call.py: using CellId 26531 06:36:23.988147 tst emergency_mo_mt_call.py: using BVCI 26532 06:36:24.092587 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 06:36:24.103455 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 06:36:24.114186 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 06:36:24.124938 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 06:36:24.135559 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 06:36:24.146275 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 06:36:24.263853 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 06:36:24.377241 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:36:24.823397 run create_hlr_db(pid=5788): Launched 06:36:24.934262 bus /sierra_2: Setting Powered False 06:36:25.992451 run create_hlr_db(pid=5788): Terminated: ok {rc=0} 06:36:26.397072 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5790): Launched 06:36:26.686144 run osmo-hlr_10.42.42.2(pid=5791): Launched 06:36:26.796884 run osmo-stp_10.42.42.5: Starting osmo-stp 06:36:27.307412 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5793): Launched 06:36:27.595434 run osmo-stp_10.42.42.5(pid=5794): Launched 06:36:27.716331 tst emergency_mo_mt_call.py: using MSISDN 7588 06:36:27.871760 run osmo-msc_10.42.42.6: Starting osmo-msc 06:36:28.390256 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5796): Launched 06:36:28.677924 run osmo-msc_10.42.42.6(pid=5797): Launched 06:36:28.839558 run osmo-stp_10.42.42.5(pid=5794): ERR: Terminated: ERROR {rc=1} [trial-2370↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5794)] 06:36:28.962027 run osmo-stp_10.42.42.5(pid=5794): stdout: | (launched: 2022-12-10_06:36:27.541742) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:36:29.085061 run osmo-stp_10.42.42.5(pid=5794): stderr: | 20221210063627710 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063627711 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063627711 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063627711 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063627712 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063627712 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063627712 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:36:29.205424 run osmo-stp_10.42.42.5(pid=5794): stdout: | (launched: 2022-12-10_06:36:27.541742) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:36:29.320014 run osmo-stp_10.42.42.5(pid=5794): stderr: | 20221210063627710 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063627711 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063627711 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063627711 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063627712 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063627712 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063627712 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:36:29.457723 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=5794): Process ended prematurely: osmo-stp_10.42.42.5(pid=5794) [trial-2370↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5794)] [trial-2370↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19] 06:36:29.465936 tst emergency_mo_mt_call.py:19: Test FAILED (5.9 sec) 06:36:29.492121 run osmo-hlr_10.42.42.2(pid=5791): ERR: Terminated: ERROR {rc=237} [trial-2370↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5791)] 06:36:29.538950 run osmo-hlr_10.42.42.2(pid=5791): stdout: | (launched: 2022-12-10_06:36:26.633044) 06:36:29.587655 run osmo-hlr_10.42.42.2(pid=5791): stderr: | 20221210063626809 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210063626809 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210063626809 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210063626809 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210063626809 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210063626809 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210063626821 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/emergency:nanobts+band-900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210063626829 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210063626830 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210063626830 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:36:29.655629 run osmo-msc_10.42.42.6(pid=5797): ERR: Terminated: ERROR {rc=2} [trial-2370↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5797)] 06:36:29.702479 run osmo-msc_10.42.42.6(pid=5797): stdout: | (launched: 2022-12-10_06:36:28.624623) 06:36:29.750735 run osmo-msc_10.42.42.6(pid=5797): stderr: | 20221210063628892 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210063628892 DLGLOBAL DEBUG validating counter group 0x7f120af70c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210063628892 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210063628892 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210063628893 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210063628893 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210063628895 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210063628895 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210063628895 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210063628895 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:36:29.799520 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5790): Terminating (SIGTERM) 06:36:29.838411 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5793): Terminating (SIGTERM) 06:36:29.877343 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5796): Terminating (SIGTERM) 06:36:29.916417 --- ParallelTerminationStrategy: PID 5790 died... 06:36:29.935055 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5790): Terminated: ok {rc=0} 06:36:29.978418 --- ParallelTerminationStrategy: PID 5793 died... 06:36:29.996504 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5793): Terminated: ok {rc=0} 06:36:30.040281 --- ParallelTerminationStrategy: PID 5796 died... 06:36:30.058702 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5796): Terminated: ok {rc=0} 06:36:30.142527 bus /sierra_3: Setting Powered False 06:36:31.261472 bus /sierra_3: Setting Powered False 06:36:32.385315 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2370 emergency:nanobts+band-900 emergency_preemptive_call.py ---------------------------------------------- 06:36:33.472228 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 06:36:33.483541 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 06:36:33.533966 tst emergency_preemptive_call.py: using LAC 26532 06:36:33.648908 tst emergency_preemptive_call.py: using RAC 12 06:36:33.766946 tst emergency_preemptive_call.py: using CellId 26532 06:36:33.880472 tst emergency_preemptive_call.py: using BVCI 26533 06:36:33.985329 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 06:36:33.996034 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 06:36:34.006551 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 06:36:34.017293 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 06:36:34.028009 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 06:36:34.038772 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 06:36:34.154276 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 06:36:34.268764 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 06:36:34.384636 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 06:36:34.499079 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:36:34.949459 run create_hlr_db(pid=5799): Launched 06:36:35.059688 bus /sierra_2: Setting Powered False 06:36:36.118207 run create_hlr_db(pid=5799): Terminated: ok {rc=0} 06:36:36.524286 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5801): Launched 06:36:36.813762 run osmo-hlr_10.42.42.2(pid=5802): Launched 06:36:36.924655 run osmo-stp_10.42.42.5: Starting osmo-stp 06:36:37.419472 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5804): Launched 06:36:37.709786 run osmo-stp_10.42.42.5(pid=5805): Launched 06:36:37.829967 tst emergency_preemptive_call.py: using MSISDN 7589 06:36:37.976282 run osmo-msc_10.42.42.6: Starting osmo-msc 06:36:38.495506 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5807): Launched 06:36:38.784378 run osmo-msc_10.42.42.6(pid=5808): Launched 06:36:38.947989 run osmo-stp_10.42.42.5(pid=5805): ERR: Terminated: ERROR {rc=1} [trial-2370↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5805)] 06:36:39.071029 run osmo-stp_10.42.42.5(pid=5805): stdout: | (launched: 2022-12-10_06:36:37.656320) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:36:39.195759 run osmo-stp_10.42.42.5(pid=5805): stderr: | 20221210063637825 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063637825 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063637826 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063637826 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063637826 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063637827 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063637827 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:36:39.317108 run osmo-stp_10.42.42.5(pid=5805): stdout: | (launched: 2022-12-10_06:36:37.656320) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:36:39.432731 run osmo-stp_10.42.42.5(pid=5805): stderr: | 20221210063637825 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063637825 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063637826 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063637826 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063637826 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063637827 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063637827 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:36:39.570944 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=5805): Process ended prematurely: osmo-stp_10.42.42.5(pid=5805) [trial-2370↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5805)] [trial-2370↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32] 06:36:39.579220 tst emergency_preemptive_call.py:32: Test FAILED (6.1 sec) 06:36:39.605560 run osmo-hlr_10.42.42.2(pid=5802): ERR: Terminated: ERROR {rc=237} [trial-2370↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5802)] 06:36:39.653311 run osmo-hlr_10.42.42.2(pid=5802): stdout: | (launched: 2022-12-10_06:36:36.760454) 06:36:39.703113 run osmo-hlr_10.42.42.2(pid=5802): stderr: | 20221210063636936 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210063636936 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210063636936 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210063636936 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210063636936 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210063636936 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210063636948 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/emergency:nanobts+band-900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210063636956 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210063636956 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210063636956 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:36:39.771852 run osmo-msc_10.42.42.6(pid=5808): ERR: Terminated: ERROR {rc=2} [trial-2370↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5808)] 06:36:39.819541 run osmo-msc_10.42.42.6(pid=5808): stdout: | (launched: 2022-12-10_06:36:38.730917) 06:36:39.868707 run osmo-msc_10.42.42.6(pid=5808): stderr: | 20221210063639002 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210063639002 DLGLOBAL DEBUG validating counter group 0x7f9bd4856c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210063639002 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210063639002 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210063639002 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210063639002 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210063639004 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210063639005 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210063639005 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210063639005 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:36:39.918285 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5801): Terminating (SIGTERM) 06:36:39.957963 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5804): Terminating (SIGTERM) 06:36:39.997731 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5807): Terminating (SIGTERM) 06:36:40.037685 --- ParallelTerminationStrategy: PID 5801 died... 06:36:40.056348 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5801): Terminated: ok {rc=0} 06:36:40.100212 --- ParallelTerminationStrategy: PID 5804 died... 06:36:40.118663 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5804): Terminated: ok {rc=0} 06:36:40.162072 --- ParallelTerminationStrategy: PID 5807 died... 06:36:40.180423 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5807): Terminated: ok {rc=0} 06:36:40.264853 bus /sierra_9: Setting Powered False 06:36:41.363896 bus /sierra_9: Setting Powered False 06:36:42.478525 bus /sierra_8: Setting Powered False 06:36:43.574897 bus /sierra_8: Setting Powered False 06:36:44.687931 bus /sierra_3: Setting Powered False 06:36:45.783945 bus /sierra_3: Setting Powered False 06:36:46.909319 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 emergency:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 gprs:nanobts+band-900 --------------------------------------------------------------------- 06:36:48.192412 tst gprs:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:36:48.198468 tst gprs:nanobts+band-900: Verifying 1 x bts (candidates: 11) 06:36:48.230850 tst gprs:nanobts+band-900: Verifying 9 x ip_address (candidates: 9) 06:36:48.269876 tst gprs:nanobts+band-900: Verifying 4 x modem (candidates: 12) 06:36:48.356301 tst gprs:nanobts+band-900: Reserving 1 x bts (candidates: 11) 06:36:48.388927 tst gprs:nanobts+band-900: Reserving 9 x ip_address (candidates: 9) 06:36:48.427826 tst gprs:nanobts+band-900: Reserving 4 x modem (candidates: 12) 06:36:49.021298 tst gprs:nanobts+band-900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2370 gprs:nanobts+band-900 cs_paging_gprs_active.py ---------------------------------------------- 06:36:49.072477 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:36:49.083594 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 06:36:49.133117 tst cs_paging_gprs_active.py: using LAC 26533 06:36:49.250334 tst cs_paging_gprs_active.py: using RAC 13 06:36:49.366844 tst cs_paging_gprs_active.py: using CellId 26533 06:36:49.481221 tst cs_paging_gprs_active.py: using BVCI 26534 06:36:49.588065 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:36:49.598943 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:36:49.609555 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:36:49.620418 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:36:49.631146 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:36:49.641846 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:36:49.652553 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:36:49.663283 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:36:49.674088 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 06:36:49.791582 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 06:36:49.912875 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 06:36:50.127761 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:36:50.446380 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5813): Launched 06:36:50.722166 run iperf3-srv_10.42.42.10(pid=5814): Launched 06:36:50.840578 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 06:36:51.053207 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:36:51.371477 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5815): Launched 06:36:51.647708 run iperf3-srv_10.42.42.10(pid=5816): Launched 06:36:51.766651 tst cs_paging_gprs_active.py:38: start network... 06:36:51.979538 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:36:52.469717 run create_hlr_db(pid=5817): Launched 06:36:52.599024 bus /sierra_2: Setting Powered False 06:36:53.661999 run create_hlr_db(pid=5817): Terminated: ok {rc=0} 06:36:54.084889 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5819): Launched 06:36:54.380695 run osmo-hlr_10.42.42.2(pid=5820): Launched 06:36:54.494774 run osmo-stp_10.42.42.5: Starting osmo-stp 06:36:55.019458 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5822): Launched 06:36:55.315099 run osmo-stp_10.42.42.5(pid=5823): Launched 06:36:55.427886 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:36:55.941741 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5825): Launched 06:36:56.063171 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:36:56.330361 run patchelf(pid=5826): Launched 06:36:56.507270 run osmo-stp_10.42.42.5(pid=5823): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5823)] 06:36:56.641269 run osmo-stp_10.42.42.5(pid=5823): stdout: | (launched: 2022-12-10_06:36:55.260744) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:36:56.776364 run osmo-stp_10.42.42.5(pid=5823): stderr: | 20221210063655430 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063655430 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063655431 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063655431 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063655433 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063655434 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063655434 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:36:56.911629 run osmo-stp_10.42.42.5(pid=5823): stdout: | (launched: 2022-12-10_06:36:55.260744) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:36:57.040917 run osmo-stp_10.42.42.5(pid=5823): stderr: | 20221210063655430 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063655430 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063655431 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063655431 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063655433 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063655434 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063655434 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:36:57.194468 run patchelf(pid=5826): Terminating (SIGINT) 06:36:57.371404 run patchelf(pid=5826): Terminated: ok {rc=0} 06:36:57.499088 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=5823): Process ended prematurely: osmo-stp_10.42.42.5(pid=5823) [trial-2370↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5823)] [trial-2370↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38] 06:36:57.509248 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 06:36:57.537485 run osmo-hlr_10.42.42.2(pid=5820): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:nanobts+band-900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5820)] 06:36:57.586626 run osmo-hlr_10.42.42.2(pid=5820): stdout: | (launched: 2022-12-10_06:36:54.325923) 06:36:57.637460 run osmo-hlr_10.42.42.2(pid=5820): stderr: | 20221210063654500 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210063654500 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210063654500 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210063654500 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210063654500 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210063654500 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210063654512 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:nanobts+band-900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210063654521 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210063654521 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210063654521 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:36:57.688701 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5813): Terminating (SIGTERM) 06:36:57.729757 run iperf3-srv_10.42.42.10(pid=5814): Terminating (SIGTERM) 06:36:57.770679 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5815): Terminating (SIGTERM) 06:36:57.811836 run iperf3-srv_10.42.42.10(pid=5816): Terminating (SIGTERM) 06:36:57.852828 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5819): Terminating (SIGTERM) 06:36:57.894385 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5822): Terminating (SIGTERM) 06:36:57.935171 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5825): Terminating (SIGTERM) 06:36:57.976190 --- ParallelTerminationStrategy: PID 5813 died... 06:36:57.995897 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5813): Terminated: ok {rc=0} 06:36:58.041707 --- ParallelTerminationStrategy: PID 5814 died... 06:36:58.060661 run iperf3-srv_10.42.42.10(pid=5814): Terminated {rc=256} 06:36:58.105750 --- ParallelTerminationStrategy: PID 5815 died... 06:36:58.124905 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5815): Terminated: ok {rc=0} 06:36:58.169905 --- ParallelTerminationStrategy: PID 5816 died... 06:36:58.188918 run iperf3-srv_10.42.42.10(pid=5816): Terminated {rc=256} 06:36:58.234370 --- ParallelTerminationStrategy: PID 5819 died... 06:36:58.253694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5819): Terminated: ok {rc=0} 06:36:58.298857 --- ParallelTerminationStrategy: PID 5822 died... 06:36:58.318144 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5822): Terminated: ok {rc=0} 06:36:58.363675 --- ParallelTerminationStrategy: PID 5825 died... 06:36:58.382968 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5825): Terminated: ok {rc=0} 06:36:58.468754 bus /gobi_0: Setting Powered False 06:36:59.567765 bus /gobi_0: Setting Powered False 06:37:00.680822 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:nanobts+band-900 iperf3.py ---------------------------------------------- 06:37:01.841404 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:37:01.857489 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 06:37:01.917274 tst iperf3.py: using LAC 26534 06:37:02.042345 tst iperf3.py: using RAC 14 06:37:02.164187 tst iperf3.py: using CellId 26534 06:37:02.282730 tst iperf3.py: using BVCI 26535 06:37:02.390023 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:37:02.400663 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:37:02.411068 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:37:02.421830 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:37:02.432337 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:37:02.442879 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:37:02.453731 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:37:02.464143 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:37:02.474934 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 06:37:02.591214 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 06:37:02.804833 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:37:03.122094 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5827): Launched 06:37:03.398085 run iperf3-srv_10.42.42.10(pid=5828): Launched 06:37:03.517513 tst iperf3.py:8: start network... 06:37:03.730711 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:37:04.221693 run create_hlr_db(pid=5829): Launched 06:37:04.351625 bus /gobi_6: Setting Powered False 06:37:05.415215 run create_hlr_db(pid=5829): Terminated: ok {rc=0} 06:37:05.838475 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5831): Launched 06:37:06.133718 run osmo-hlr_10.42.42.2(pid=5832): Launched 06:37:06.246467 run osmo-stp_10.42.42.5: Starting osmo-stp 06:37:06.756562 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5834): Launched 06:37:07.051556 run osmo-stp_10.42.42.5(pid=5835): Launched 06:37:07.164035 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:37:07.687171 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5837): Launched 06:37:07.801145 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:37:08.050699 run patchelf(pid=5838): Launched 06:37:08.215215 run osmo-stp_10.42.42.5(pid=5835): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5835)] 06:37:08.340539 run osmo-stp_10.42.42.5(pid=5835): stdout: | (launched: 2022-12-10_06:37:06.997202) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:37:08.467171 run osmo-stp_10.42.42.5(pid=5835): stderr: | 20221210063707167 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063707167 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063707167 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063707168 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063707170 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063707170 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063707170 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:37:08.593643 run osmo-stp_10.42.42.5(pid=5835): stdout: | (launched: 2022-12-10_06:37:06.997202) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:37:08.714577 run osmo-stp_10.42.42.5(pid=5835): stderr: | 20221210063707167 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063707167 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063707167 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063707168 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063707170 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063707170 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063707170 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:37:08.857999 run patchelf(pid=5838): Terminating (SIGINT) 06:37:09.022961 run patchelf(pid=5838): Terminated: ok {rc=0} 06:37:09.142469 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5835): Process ended prematurely: osmo-stp_10.42.42.5(pid=5835) [trial-2370↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5835)] [trial-2370↪gprs:nanobts+band-900↪iperf3.py:8] 06:37:09.151862 tst iperf3.py:8: Test FAILED (7.4 sec) 06:37:09.179192 run osmo-hlr_10.42.42.2(pid=5832): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:nanobts+band-900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5832)] 06:37:09.226077 run osmo-hlr_10.42.42.2(pid=5832): stdout: | (launched: 2022-12-10_06:37:06.079730) 06:37:09.274557 run osmo-hlr_10.42.42.2(pid=5832): stderr: | 20221210063706254 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210063706254 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210063706254 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210063706254 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210063706254 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210063706254 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210063706266 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:nanobts+band-900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210063706275 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210063706275 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210063706275 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:37:09.323860 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5827): Terminating (SIGTERM) 06:37:09.363155 run iperf3-srv_10.42.42.10(pid=5828): Terminating (SIGTERM) 06:37:09.402307 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5831): Terminating (SIGTERM) 06:37:09.441320 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5834): Terminating (SIGTERM) 06:37:09.480324 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5837): Terminating (SIGTERM) 06:37:09.519664 --- ParallelTerminationStrategy: PID 5827 died... 06:37:09.538397 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5827): Terminated: ok {rc=0} 06:37:09.581930 --- ParallelTerminationStrategy: PID 5828 died... 06:37:09.600193 run iperf3-srv_10.42.42.10(pid=5828): Terminated {rc=256} 06:37:09.643577 --- ParallelTerminationStrategy: PID 5831 died... 06:37:09.661944 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5831): Terminated: ok {rc=0} 06:37:09.705190 --- ParallelTerminationStrategy: PID 5834 died... 06:37:09.723467 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5834): Terminated: ok {rc=0} 06:37:09.767035 --- ParallelTerminationStrategy: PID 5837 died... 06:37:09.785353 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5837): Terminated: ok {rc=0} 06:37:09.869273 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:nanobts+band-900 iperf3m4.py ---------------------------------------------- 06:37:11.019776 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:37:11.031407 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 06:37:11.082145 tst iperf3m4.py: using LAC 26535 06:37:11.215888 tst iperf3m4.py: using RAC 15 06:37:11.350479 tst iperf3m4.py: using CellId 26535 06:37:11.476865 tst iperf3m4.py: using BVCI 26536 06:37:11.592050 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:37:11.603283 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:37:11.614252 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:37:11.625800 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:37:11.637241 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:37:11.648474 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:37:11.660118 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:37:11.671522 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:37:11.683123 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 06:37:11.801996 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 06:37:11.920513 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 06:37:12.038663 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 06:37:12.156288 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 06:37:12.369690 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:37:12.687643 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5839): Launched 06:37:12.963494 run iperf3-srv_10.42.42.10(pid=5840): Launched 06:37:13.082433 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 06:37:13.294928 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:37:13.613393 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5841): Launched 06:37:13.889554 run iperf3-srv_10.42.42.10(pid=5842): Launched 06:37:14.008909 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 06:37:14.221419 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:37:14.540222 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5843): Launched 06:37:14.816364 run iperf3-srv_10.42.42.10(pid=5844): Launched 06:37:14.935823 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 06:37:15.149298 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:37:15.468253 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5845): Launched 06:37:15.744790 run iperf3-srv_10.42.42.10(pid=5846): Launched 06:37:15.873687 tst iperf3m4.py:8: start network... 06:37:16.119883 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:37:16.622276 run create_hlr_db(pid=5847): Launched 06:37:16.790303 bus /gobi_6: Setting Powered False 06:37:17.850141 run create_hlr_db(pid=5847): Terminated: ok {rc=0} 06:37:18.263681 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5849): Launched 06:37:18.560732 run osmo-hlr_10.42.42.2(pid=5850): Launched 06:37:18.674692 run osmo-stp_10.42.42.5: Starting osmo-stp 06:37:19.196799 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5852): Launched 06:37:19.493642 run osmo-stp_10.42.42.5(pid=5853): Launched 06:37:19.606719 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:37:20.115812 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5855): Launched 06:37:20.230298 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:37:20.480337 run patchelf(pid=5856): Launched 06:37:20.645841 run osmo-stp_10.42.42.5(pid=5853): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5853)] 06:37:20.771234 run osmo-stp_10.42.42.5(pid=5853): stdout: | (launched: 2022-12-10_06:37:19.438898) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:37:20.897907 run osmo-stp_10.42.42.5(pid=5853): stderr: | 20221210063719608 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063719609 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063719609 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063719609 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063719610 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063719610 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063719610 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:37:21.024790 run osmo-stp_10.42.42.5(pid=5853): stdout: | (launched: 2022-12-10_06:37:19.438898) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:37:21.146369 run osmo-stp_10.42.42.5(pid=5853): stderr: | 20221210063719608 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063719609 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063719609 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063719609 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063719610 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063719610 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063719610 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:37:21.290246 run patchelf(pid=5856): Terminating (SIGINT) 06:37:21.456451 run patchelf(pid=5856): Terminated: ok {rc=0} 06:37:21.576316 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5853): Process ended prematurely: osmo-stp_10.42.42.5(pid=5853) [trial-2370↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5853)] [trial-2370↪gprs:nanobts+band-900↪iperf3m4.py:8] 06:37:21.586050 tst iperf3m4.py:8: Test FAILED (10.6 sec) 06:37:21.614047 run osmo-hlr_10.42.42.2(pid=5850): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:nanobts+band-900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5850)] 06:37:21.661518 run osmo-hlr_10.42.42.2(pid=5850): stdout: | (launched: 2022-12-10_06:37:18.506093) 06:37:21.710628 run osmo-hlr_10.42.42.2(pid=5850): stderr: | 20221210063718679 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210063718679 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210063718679 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210063718679 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210063718679 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210063718680 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210063718692 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:nanobts+band-900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210063718703 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210063718703 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210063718703 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:37:21.760041 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5839): Terminating (SIGTERM) 06:37:21.799482 run iperf3-srv_10.42.42.10(pid=5840): Terminating (SIGTERM) 06:37:21.838974 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5841): Terminating (SIGTERM) 06:37:21.878398 run iperf3-srv_10.42.42.10(pid=5842): Terminating (SIGTERM) 06:37:21.917873 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5843): Terminating (SIGTERM) 06:37:21.957541 run iperf3-srv_10.42.42.10(pid=5844): Terminating (SIGTERM) 06:37:21.997089 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5845): Terminating (SIGTERM) 06:37:22.036625 run iperf3-srv_10.42.42.10(pid=5846): Terminating (SIGTERM) 06:37:22.075930 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5849): Terminating (SIGTERM) 06:37:22.115820 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5852): Terminating (SIGTERM) 06:37:22.155550 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5855): Terminating (SIGTERM) 06:37:22.195398 --- ParallelTerminationStrategy: PID 5839 died... 06:37:22.214400 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5839): Terminated: ok {rc=0} 06:37:22.258708 --- ParallelTerminationStrategy: PID 5840 died... 06:37:22.276858 run iperf3-srv_10.42.42.10(pid=5840): Terminated {rc=256} 06:37:22.320580 --- ParallelTerminationStrategy: PID 5841 died... 06:37:22.339058 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5841): Terminated: ok {rc=0} 06:37:22.382733 --- ParallelTerminationStrategy: PID 5842 died... 06:37:22.401223 run iperf3-srv_10.42.42.10(pid=5842): Terminated {rc=256} 06:37:22.444769 --- ParallelTerminationStrategy: PID 5843 died... 06:37:22.463182 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5843): Terminated: ok {rc=0} 06:37:22.506886 --- ParallelTerminationStrategy: PID 5844 died... 06:37:22.525244 run iperf3-srv_10.42.42.10(pid=5844): Terminated {rc=256} 06:37:22.568886 --- ParallelTerminationStrategy: PID 5845 died... 06:37:22.587392 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5845): Terminated: ok {rc=0} 06:37:22.631161 --- ParallelTerminationStrategy: PID 5846 died... 06:37:22.649526 run iperf3-srv_10.42.42.10(pid=5846): Terminated {rc=256} 06:37:22.693221 --- ParallelTerminationStrategy: PID 5849 died... 06:37:22.711653 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5849): Terminated: ok {rc=0} 06:37:22.755548 --- ParallelTerminationStrategy: PID 5852 died... 06:37:22.774118 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5852): Terminated: ok {rc=0} 06:37:22.817914 --- ParallelTerminationStrategy: PID 5855 died... 06:37:22.836492 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5855): Terminated: ok {rc=0} 06:37:22.919358 bus /gobi_4: Setting Powered False 06:37:24.017790 bus /gobi_4: Setting Powered False 06:37:25.133262 bus /gobi_1: Setting Powered False 06:37:26.231131 bus /gobi_1: Setting Powered False 06:37:27.344325 bus /gobi_0: Setting Powered False 06:37:28.442214 bus /gobi_0: Setting Powered False 06:37:29.557623 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:nanobts+band-900 ping.py ---------------------------------------------- 06:37:30.660081 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:37:30.671601 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 06:37:30.720260 tst ping.py: using LAC 26536 06:37:30.845414 tst ping.py: using RAC 16 06:37:30.983403 tst ping.py: using CellId 26536 06:37:31.113915 tst ping.py: using BVCI 26537 06:37:31.261515 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:37:31.276771 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:37:31.293275 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:37:31.309749 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:37:31.325846 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:37:31.339571 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:37:31.355758 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:37:31.371336 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 06:37:31.515190 tst ping.py:19: start network... 06:37:31.765659 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:37:32.261775 run create_hlr_db(pid=5857): Launched 06:37:32.390366 bus /gobi_6: Setting Powered False 06:37:33.452253 run create_hlr_db(pid=5857): Terminated: ok {rc=0} 06:37:33.884850 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5859): Launched 06:37:34.195651 run osmo-hlr_10.42.42.2(pid=5860): Launched 06:37:34.314323 run osmo-stp_10.42.42.5: Starting osmo-stp 06:37:34.852488 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5862): Launched 06:37:35.162061 run osmo-stp_10.42.42.5(pid=5863): Launched 06:37:35.280040 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:37:35.816293 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5865): Launched 06:37:35.936079 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:37:36.200674 run patchelf(pid=5869): Launched 06:37:36.374248 run osmo-stp_10.42.42.5(pid=5863): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5863)] 06:37:36.506370 run osmo-stp_10.42.42.5(pid=5863): stdout: | (launched: 2022-12-10_06:37:35.105272) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:37:36.639690 run osmo-stp_10.42.42.5(pid=5863): stderr: | 20221210063735296 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063735296 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063735297 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063735297 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063735297 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063735298 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063735298 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:37:36.773179 run osmo-stp_10.42.42.5(pid=5863): stdout: | (launched: 2022-12-10_06:37:35.105272) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:37:36.900071 run osmo-stp_10.42.42.5(pid=5863): stderr: | 20221210063735296 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063735296 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063735297 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063735297 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063735297 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063735298 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063735298 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:37:37.050902 run patchelf(pid=5869): Terminating (SIGINT) 06:37:37.224684 run patchelf(pid=5869): Terminated: ok {rc=0} 06:37:37.349791 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=5863): Process ended prematurely: osmo-stp_10.42.42.5(pid=5863) [trial-2370↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5863)] [trial-2370↪gprs:nanobts+band-900↪ping.py:22] 06:37:37.359520 tst ping.py:22: Test FAILED (6.7 sec) 06:37:37.387569 run osmo-hlr_10.42.42.2(pid=5860): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:nanobts+band-900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5860)] 06:37:37.436695 run osmo-hlr_10.42.42.2(pid=5860): stdout: | (launched: 2022-12-10_06:37:34.138549) 06:37:37.487679 run osmo-hlr_10.42.42.2(pid=5860): stderr: | 20221210063734338 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210063734338 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210063734338 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210063734338 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210063734338 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210063734338 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210063734351 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:nanobts+band-900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210063734362 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210063734362 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210063734362 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:37:37.539066 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5859): Terminating (SIGTERM) 06:37:37.579863 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5862): Terminating (SIGTERM) 06:37:37.620643 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5865): Terminating (SIGTERM) 06:37:37.661979 --- ParallelTerminationStrategy: PID 5859 died... 06:37:37.681701 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5859): Terminated: ok {rc=0} 06:37:37.727382 --- ParallelTerminationStrategy: PID 5862 died... 06:37:37.746821 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5862): Terminated: ok {rc=0} 06:37:37.792202 --- ParallelTerminationStrategy: PID 5865 died... 06:37:37.811988 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5865): Terminated: ok {rc=0} 06:37:37.897794 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:nanobts+band-900 ping_idle_ping.py ---------------------------------------------- 06:37:38.983850 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:37:38.995349 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 06:37:39.048379 tst ping_idle_ping.py: using LAC 26537 06:37:39.168134 tst ping_idle_ping.py: using RAC 17 06:37:39.288822 tst ping_idle_ping.py: using CellId 26537 06:37:39.411146 tst ping_idle_ping.py: using BVCI 26538 06:37:39.523926 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:37:39.535506 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:37:39.546757 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:37:39.558036 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:37:39.569076 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:37:39.580118 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:37:39.591366 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:37:39.602606 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 06:37:39.719593 tst ping_idle_ping.py:24: start network... 06:37:39.928135 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:37:40.411563 run create_hlr_db(pid=5870): Launched 06:37:40.537618 bus /gobi_6: Setting Powered False 06:37:41.599390 run create_hlr_db(pid=5870): Terminated: ok {rc=0} 06:37:42.015926 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5872): Launched 06:37:42.307266 run osmo-hlr_10.42.42.2(pid=5873): Launched 06:37:42.419185 run osmo-stp_10.42.42.5: Starting osmo-stp 06:37:42.920024 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5875): Launched 06:37:43.210807 run osmo-stp_10.42.42.5(pid=5876): Launched 06:37:43.321882 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:37:43.822300 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5878): Launched 06:37:43.933981 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:37:44.179224 run patchelf(pid=5879): Launched 06:37:44.342098 run osmo-stp_10.42.42.5(pid=5876): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5876)] 06:37:44.465371 run osmo-stp_10.42.42.5(pid=5876): stdout: | (launched: 2022-12-10_06:37:43.157168) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:37:44.590354 run osmo-stp_10.42.42.5(pid=5876): stderr: | 20221210063743327 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063743327 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063743327 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063743327 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063743328 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063743328 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063743328 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:37:44.715638 run osmo-stp_10.42.42.5(pid=5876): stdout: | (launched: 2022-12-10_06:37:43.157168) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:37:44.835183 run osmo-stp_10.42.42.5(pid=5876): stderr: | 20221210063743327 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063743327 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063743327 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063743327 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063743328 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063743328 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063743328 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:37:44.976195 run patchelf(pid=5879): Terminating (SIGINT) 06:37:45.140240 run patchelf(pid=5879): Terminated: ok {rc=0} 06:37:45.258027 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=5876): Process ended prematurely: osmo-stp_10.42.42.5(pid=5876) [trial-2370↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5876)] [trial-2370↪gprs:nanobts+band-900↪ping_idle_ping.py:27] 06:37:45.266781 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 06:37:45.293746 run osmo-hlr_10.42.42.2(pid=5873): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:nanobts+band-900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5873)] 06:37:45.340697 run osmo-hlr_10.42.42.2(pid=5873): stdout: | (launched: 2022-12-10_06:37:42.253838) 06:37:45.389309 run osmo-hlr_10.42.42.2(pid=5873): stderr: | 20221210063742429 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210063742429 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210063742429 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210063742429 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210063742429 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210063742429 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210063742442 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:nanobts+band-900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210063742452 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210063742452 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210063742452 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:37:45.438320 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5872): Terminating (SIGTERM) 06:37:45.477251 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5875): Terminating (SIGTERM) 06:37:45.516182 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5878): Terminating (SIGTERM) 06:37:45.556054 --- ParallelTerminationStrategy: PID 5872 died... 06:37:45.574939 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5872): Terminated: ok {rc=0} 06:37:45.618761 --- ParallelTerminationStrategy: PID 5875 died... 06:37:45.637251 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5875): Terminated: ok {rc=0} 06:37:45.680868 --- ParallelTerminationStrategy: PID 5878 died... 06:37:45.699570 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5878): Terminated: ok {rc=0} 06:37:45.783873 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2370 gprs:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 gprs:nanobts+band-900+mod-bts0-egprs --------------------------------------------------------------------- 06:37:47.094700 tst gprs:nanobts+band-900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:37:47.102452 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 06:37:47.139410 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 06:37:47.179899 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 06:37:47.266627 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 06:37:47.301102 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 06:37:47.340885 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 06:37:47.950851 tst gprs:nanobts+band-900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2370 gprs:nanobts+band-900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 06:37:48.002424 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:37:48.013829 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:37:48.063754 tst cs_paging_gprs_active.py: using LAC 26538 06:37:48.187846 tst cs_paging_gprs_active.py: using RAC 18 06:37:48.311655 tst cs_paging_gprs_active.py: using CellId 26538 06:37:48.438103 tst cs_paging_gprs_active.py: using BVCI 26539 06:37:48.554063 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:37:48.565553 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:37:48.576566 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:37:48.588215 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:37:48.599680 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:37:48.611385 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:37:48.623126 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:37:48.634449 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:37:48.646818 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:37:48.764119 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:37:48.878794 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 06:37:49.076565 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:37:49.372487 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5884): Launched 06:37:49.630401 run iperf3-srv_10.42.42.10(pid=5885): Launched 06:37:49.741667 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 06:37:49.938896 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:37:50.235812 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5886): Launched 06:37:50.494339 run iperf3-srv_10.42.42.10(pid=5887): Launched 06:37:50.605545 tst cs_paging_gprs_active.py:38: start network... 06:37:50.802788 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:37:51.259916 run create_hlr_db(pid=5888): Launched 06:37:51.374292 bus /gobi_6: Setting Powered False 06:37:52.434591 run create_hlr_db(pid=5888): Terminated: ok {rc=0} 06:37:52.847294 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5890): Launched 06:37:53.143896 run osmo-hlr_10.42.42.2(pid=5891): Launched 06:37:53.257840 run osmo-stp_10.42.42.5: Starting osmo-stp 06:37:53.782162 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5893): Launched 06:37:54.077760 run osmo-stp_10.42.42.5(pid=5894): Launched 06:37:54.191728 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:37:54.701187 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5896): Launched 06:37:54.815200 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:37:55.065422 run patchelf(pid=5897): Launched 06:37:55.230416 run osmo-stp_10.42.42.5(pid=5894): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5894)] 06:37:55.355589 run osmo-stp_10.42.42.5(pid=5894): stdout: | (launched: 2022-12-10_06:37:54.023068) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:37:55.482723 run osmo-stp_10.42.42.5(pid=5894): stderr: | 20221210063754191 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063754192 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063754192 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063754192 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063754194 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063754195 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063754195 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:37:55.609642 run osmo-stp_10.42.42.5(pid=5894): stdout: | (launched: 2022-12-10_06:37:54.023068) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:37:55.731195 run osmo-stp_10.42.42.5(pid=5894): stderr: | 20221210063754191 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063754192 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063754192 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063754192 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063754194 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063754195 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063754195 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:37:55.874851 run patchelf(pid=5897): Terminating (SIGINT) 06:37:56.040795 run patchelf(pid=5897): Terminated: ok {rc=0} 06:37:56.160530 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=5894): Process ended prematurely: osmo-stp_10.42.42.5(pid=5894) [trial-2370↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5894)] [trial-2370↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 06:37:56.170245 tst cs_paging_gprs_active.py:38: Test FAILED (8.2 sec) 06:37:56.197519 run osmo-hlr_10.42.42.2(pid=5891): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5891)] 06:37:56.244813 run osmo-hlr_10.42.42.2(pid=5891): stdout: | (launched: 2022-12-10_06:37:53.088387) 06:37:56.293733 run osmo-hlr_10.42.42.2(pid=5891): stderr: | 20221210063753264 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210063753264 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210063753264 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210063753264 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210063753264 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210063753264 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210063753276 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:nanobts+band-900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210063753284 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210063753284 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210063753284 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:37:56.343019 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5884): Terminating (SIGTERM) 06:37:56.382041 run iperf3-srv_10.42.42.10(pid=5885): Terminating (SIGTERM) 06:37:56.420843 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5886): Terminating (SIGTERM) 06:37:56.459853 run iperf3-srv_10.42.42.10(pid=5887): Terminating (SIGTERM) 06:37:56.498731 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5890): Terminating (SIGTERM) 06:37:56.537655 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5893): Terminating (SIGTERM) 06:37:56.576577 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5896): Terminating (SIGTERM) 06:37:56.615733 --- ParallelTerminationStrategy: PID 5884 died... 06:37:56.634517 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5884): Terminated: ok {rc=0} 06:37:56.678059 --- ParallelTerminationStrategy: PID 5885 died... 06:37:56.696234 run iperf3-srv_10.42.42.10(pid=5885): Terminated {rc=256} 06:37:56.740250 --- ParallelTerminationStrategy: PID 5886 died... 06:37:56.758671 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5886): Terminated: ok {rc=0} 06:37:56.802044 --- ParallelTerminationStrategy: PID 5887 died... 06:37:56.820265 run iperf3-srv_10.42.42.10(pid=5887): Terminated {rc=256} 06:37:56.863519 --- ParallelTerminationStrategy: PID 5890 died... 06:37:56.881813 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5890): Terminated: ok {rc=0} 06:37:56.925513 --- ParallelTerminationStrategy: PID 5893 died... 06:37:56.943799 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5893): Terminated: ok {rc=0} 06:37:56.987205 --- ParallelTerminationStrategy: PID 5896 died... 06:37:57.005575 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5896): Terminated: ok {rc=0} 06:37:57.087863 bus /gobi_0: Setting Powered False 06:37:58.182744 bus /gobi_0: Setting Powered False 06:37:59.295769 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:nanobts+band-900+mod-bts0-egprs iperf3.py ---------------------------------------------- 06:38:00.444189 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:38:00.456327 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:38:00.508924 tst iperf3.py: using LAC 26539 06:38:00.633621 tst iperf3.py: using RAC 19 06:38:00.757929 tst iperf3.py: using CellId 26539 06:38:00.895615 tst iperf3.py: using BVCI 26540 06:38:01.018713 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:38:01.030819 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:38:01.042648 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:38:01.057043 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:38:01.068687 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:38:01.081645 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:38:01.095327 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:38:01.107242 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:38:01.119978 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:38:01.237222 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 06:38:01.443468 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:38:01.753663 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5898): Launched 06:38:02.050006 run iperf3-srv_10.42.42.10(pid=5899): Launched 06:38:02.176527 tst iperf3.py:8: start network... 06:38:02.379781 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:38:02.840852 run create_hlr_db(pid=5900): Launched 06:38:02.955318 bus /gobi_6: Setting Powered False 06:38:04.014688 run create_hlr_db(pid=5900): Terminated: ok {rc=0} 06:38:04.427377 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5902): Launched 06:38:04.723446 run osmo-hlr_10.42.42.2(pid=5903): Launched 06:38:04.836136 run osmo-stp_10.42.42.5: Starting osmo-stp 06:38:05.344386 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5905): Launched 06:38:05.640530 run osmo-stp_10.42.42.5(pid=5906): Launched 06:38:05.753598 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:38:06.263271 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5908): Launched 06:38:06.377133 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:38:06.626640 run patchelf(pid=5909): Launched 06:38:06.791621 run osmo-stp_10.42.42.5(pid=5906): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5906)] 06:38:06.916929 run osmo-stp_10.42.42.5(pid=5906): stdout: | (launched: 2022-12-10_06:38:05.585917) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:38:07.043709 run osmo-stp_10.42.42.5(pid=5906): stderr: | 20221210063805756 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063805756 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063805757 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063805757 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063805758 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063805758 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063805758 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:38:07.170556 run osmo-stp_10.42.42.5(pid=5906): stdout: | (launched: 2022-12-10_06:38:05.585917) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:38:07.292004 run osmo-stp_10.42.42.5(pid=5906): stderr: | 20221210063805756 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063805756 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063805757 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063805757 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063805758 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063805758 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063805758 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:38:07.436023 run patchelf(pid=5909): Terminating (SIGINT) 06:38:07.602396 run patchelf(pid=5909): Terminated: ok {rc=0} 06:38:07.721939 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5906): Process ended prematurely: osmo-stp_10.42.42.5(pid=5906) [trial-2370↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5906)] [trial-2370↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8] 06:38:07.731371 tst iperf3.py:8: Test FAILED (7.3 sec) 06:38:07.758870 run osmo-hlr_10.42.42.2(pid=5903): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5903)] 06:38:07.805843 run osmo-hlr_10.42.42.2(pid=5903): stdout: | (launched: 2022-12-10_06:38:04.669147) 06:38:07.854409 run osmo-hlr_10.42.42.2(pid=5903): stderr: | 20221210063804844 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210063804844 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210063804844 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210063804844 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210063804844 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210063804844 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210063804856 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:nanobts+band-900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210063804865 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210063804865 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210063804865 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:38:07.903321 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5898): Terminating (SIGTERM) 06:38:07.942411 run iperf3-srv_10.42.42.10(pid=5899): Terminating (SIGTERM) 06:38:07.981416 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5902): Terminating (SIGTERM) 06:38:08.020758 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5905): Terminating (SIGTERM) 06:38:08.059802 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5908): Terminating (SIGTERM) 06:38:08.099402 --- ParallelTerminationStrategy: PID 5898 died... 06:38:08.118269 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5898): Terminated: ok {rc=0} 06:38:08.162226 --- ParallelTerminationStrategy: PID 5899 died... 06:38:08.180566 run iperf3-srv_10.42.42.10(pid=5899): Terminated {rc=256} 06:38:08.224427 --- ParallelTerminationStrategy: PID 5902 died... 06:38:08.242868 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5902): Terminated: ok {rc=0} 06:38:08.286510 --- ParallelTerminationStrategy: PID 5905 died... 06:38:08.305311 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5905): Terminated: ok {rc=0} 06:38:08.349133 --- ParallelTerminationStrategy: PID 5908 died... 06:38:08.367717 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5908): Terminated: ok {rc=0} 06:38:08.451307 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:nanobts+band-900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 06:38:09.599769 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:38:09.611937 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:38:09.665537 tst iperf3m4.py: using LAC 26540 06:38:09.791768 tst iperf3m4.py: using RAC 20 06:38:09.916703 tst iperf3m4.py: using CellId 26540 06:38:10.041599 tst iperf3m4.py: using BVCI 26541 06:38:10.158182 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:38:10.169916 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:38:10.181528 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:38:10.193580 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:38:10.205530 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:38:10.217515 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:38:10.229741 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:38:10.241668 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:38:10.253674 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:38:10.375013 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:38:10.497272 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:38:10.611403 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:38:10.731287 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 06:38:10.944562 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:38:11.261985 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5910): Launched 06:38:11.539099 run iperf3-srv_10.42.42.10(pid=5911): Launched 06:38:11.658112 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 06:38:11.870955 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:38:12.188764 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5912): Launched 06:38:12.465695 run iperf3-srv_10.42.42.10(pid=5913): Launched 06:38:12.584366 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 06:38:12.796922 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:38:13.114481 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5914): Launched 06:38:13.390579 run iperf3-srv_10.42.42.10(pid=5915): Launched 06:38:13.509405 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 06:38:13.721764 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:38:14.039346 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5916): Launched 06:38:14.315567 run iperf3-srv_10.42.42.10(pid=5917): Launched 06:38:14.435138 tst iperf3m4.py:8: start network... 06:38:14.647675 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:38:15.138208 run create_hlr_db(pid=5918): Launched 06:38:15.266775 bus /gobi_6: Setting Powered False 06:38:16.370248 run create_hlr_db(pid=5918): Terminated: ok {rc=0} 06:38:16.916082 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5956): Launched 06:38:17.300585 run osmo-hlr_10.42.42.2(pid=5970): Launched 06:38:17.587218 run osmo-stp_10.42.42.5: Starting osmo-stp 06:38:18.511987 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6047): Launched 06:38:18.901737 run osmo-stp_10.42.42.5(pid=6084): Launched 06:38:19.172885 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:38:19.919716 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6197): Launched 06:38:20.057594 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:38:20.322537 run patchelf(pid=6199): Launched 06:38:20.510016 run osmo-stp_10.42.42.5(pid=6084): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6084)] 06:38:20.642099 run osmo-stp_10.42.42.5(pid=6084): stdout: | (launched: 2022-12-10_06:38:18.833349) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:38:20.775379 run osmo-stp_10.42.42.5(pid=6084): stderr: | 20221210063819149 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063819149 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063819149 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063819149 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063819152 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063819152 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063819152 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:38:20.907036 run osmo-stp_10.42.42.5(pid=6084): stdout: | (launched: 2022-12-10_06:38:18.833349) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:38:21.032768 run osmo-stp_10.42.42.5(pid=6084): stderr: | 20221210063819149 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063819149 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063819149 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063819149 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063819152 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063819152 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063819152 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:38:21.182763 run patchelf(pid=6199): Terminating (SIGINT) 06:38:21.356105 run patchelf(pid=6199): Terminated: ok {rc=0} 06:38:21.480216 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6084): Process ended prematurely: osmo-stp_10.42.42.5(pid=6084) [trial-2370↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6084)] [trial-2370↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8] 06:38:21.491102 tst iperf3m4.py:8: Test FAILED (11.9 sec) 06:38:21.522793 run osmo-hlr_10.42.42.2(pid=5970): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5970)] 06:38:21.573951 run osmo-hlr_10.42.42.2(pid=5970): stdout: | (launched: 2022-12-10_06:38:17.232697) 06:38:21.626180 run osmo-hlr_10.42.42.2(pid=5970): stderr: | 20221210063817646 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210063817646 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210063817646 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210063817646 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210063817646 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210063817646 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210063817676 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:nanobts+band-900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210063817697 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210063817698 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210063817698 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:38:21.678585 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5910): Terminating (SIGTERM) 06:38:21.719840 run iperf3-srv_10.42.42.10(pid=5911): Terminating (SIGTERM) 06:38:21.767367 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5912): Terminating (SIGTERM) 06:38:21.810445 run iperf3-srv_10.42.42.10(pid=5913): Terminating (SIGTERM) 06:38:21.854917 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5914): Terminating (SIGTERM) 06:38:21.898619 run iperf3-srv_10.42.42.10(pid=5915): Terminating (SIGTERM) 06:38:21.947347 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5916): Terminating (SIGTERM) 06:38:21.989123 run iperf3-srv_10.42.42.10(pid=5917): Terminating (SIGTERM) 06:38:22.033095 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5956): Terminating (SIGTERM) 06:38:22.073929 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6047): Terminating (SIGTERM) 06:38:22.115508 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6197): Terminating (SIGTERM) 06:38:22.162024 --- ParallelTerminationStrategy: PID 5910 died... 06:38:22.181789 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5910): Terminated: ok {rc=0} 06:38:22.229847 --- ParallelTerminationStrategy: PID 5911 died... 06:38:22.250380 run iperf3-srv_10.42.42.10(pid=5911): Terminated {rc=256} 06:38:22.297161 --- ParallelTerminationStrategy: PID 5912 died... 06:38:22.316772 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5912): Terminated: ok {rc=0} 06:38:22.364557 --- ParallelTerminationStrategy: PID 5913 died... 06:38:22.384991 run iperf3-srv_10.42.42.10(pid=5913): Terminated {rc=256} 06:38:22.432735 --- ParallelTerminationStrategy: PID 5914 died... 06:38:22.452420 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5914): Terminated: ok {rc=0} 06:38:22.500584 --- ParallelTerminationStrategy: PID 5915 died... 06:38:22.520377 run iperf3-srv_10.42.42.10(pid=5915): Terminated {rc=256} 06:38:22.568393 --- ParallelTerminationStrategy: PID 5916 died... 06:38:22.588272 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5916): Terminated: ok {rc=0} 06:38:22.634960 --- ParallelTerminationStrategy: PID 5917 died... 06:38:22.654692 run iperf3-srv_10.42.42.10(pid=5917): Terminated {rc=256} 06:38:22.705150 --- ParallelTerminationStrategy: PID 5956 died... 06:38:22.724247 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5956): Terminated: ok {rc=0} 06:38:22.771852 --- ParallelTerminationStrategy: PID 6047 died... 06:38:22.791195 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6047): Terminated: ok {rc=0} 06:38:22.837672 --- ParallelTerminationStrategy: PID 6197 died... 06:38:22.856995 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6197): Terminated: ok {rc=0} 06:38:22.944459 bus /gobi_4: Setting Powered False 06:38:24.041357 bus /gobi_4: Setting Powered False 06:38:25.156465 bus /gobi_1: Setting Powered False 06:38:26.256585 bus /gobi_1: Setting Powered False 06:38:27.372879 bus /gobi_0: Setting Powered False 06:38:28.473300 bus /gobi_0: Setting Powered False 06:38:29.590159 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:nanobts+band-900+mod-bts0-egprs ping.py ---------------------------------------------- 06:38:30.694843 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:38:30.707807 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:38:30.762373 tst ping.py: using LAC 26541 06:38:30.906032 tst ping.py: using RAC 21 06:38:31.054044 tst ping.py: using CellId 26541 06:38:31.209087 tst ping.py: using BVCI 26542 06:38:31.352048 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:38:31.365799 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:38:31.380689 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:38:31.396538 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:38:31.411158 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:38:31.426687 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:38:31.442405 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:38:31.456311 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:38:31.595279 tst ping.py:19: start network... 06:38:31.796701 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:38:32.293705 run create_hlr_db(pid=6202): Launched 06:38:32.472828 bus /gobi_6: Setting Powered False 06:38:33.537431 run create_hlr_db(pid=6202): Terminated: ok {rc=0} 06:38:33.997844 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6204): Launched 06:38:34.332411 run osmo-hlr_10.42.42.2(pid=6205): Launched 06:38:34.572362 run osmo-stp_10.42.42.5: Starting osmo-stp 06:38:35.235852 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6207): Launched 06:38:35.572710 run osmo-stp_10.42.42.5(pid=6208): Launched 06:38:35.808861 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:38:36.456494 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6210): Launched 06:38:36.591309 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:38:36.868455 run patchelf(pid=6211): Launched 06:38:37.061388 run osmo-stp_10.42.42.5(pid=6208): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6208)] 06:38:37.198647 run osmo-stp_10.42.42.5(pid=6208): stdout: | (launched: 2022-12-10_06:38:35.509067) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:38:37.336817 run osmo-stp_10.42.42.5(pid=6208): stderr: | 20221210063835810 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063835810 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063835811 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063835811 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063835812 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063835812 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063835812 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:38:37.475931 run osmo-stp_10.42.42.5(pid=6208): stdout: | (launched: 2022-12-10_06:38:35.509067) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:38:37.609184 run osmo-stp_10.42.42.5(pid=6208): stderr: | 20221210063835810 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063835810 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063835811 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063835811 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063835812 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063835812 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063835812 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:38:37.767103 run patchelf(pid=6211): Terminating (SIGINT) 06:38:37.948001 run patchelf(pid=6211): Terminated: ok {rc=0} 06:38:38.076543 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=6208): Process ended prematurely: osmo-stp_10.42.42.5(pid=6208) [trial-2370↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6208)] [trial-2370↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22] 06:38:38.087022 tst ping.py:22: Test FAILED (7.4 sec) 06:38:38.116874 run osmo-hlr_10.42.42.2(pid=6205): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6205)] 06:38:38.169262 run osmo-hlr_10.42.42.2(pid=6205): stdout: | (launched: 2022-12-10_06:38:34.269232) 06:38:38.221951 run osmo-hlr_10.42.42.2(pid=6205): stderr: | 20221210063834582 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210063834582 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210063834582 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210063834582 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210063834582 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210063834582 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210063834595 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:nanobts+band-900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210063834607 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210063834608 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210063834608 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:38:38.275272 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6204): Terminating (SIGTERM) 06:38:38.317986 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6207): Terminating (SIGTERM) 06:38:38.364567 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6210): Terminating (SIGTERM) 06:38:38.410392 --- ParallelTerminationStrategy: PID 6204 died... 06:38:38.430881 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6204): Terminated: ok {rc=0} 06:38:38.479894 --- ParallelTerminationStrategy: PID 6207 died... 06:38:38.499943 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6207): Terminated: ok {rc=0} 06:38:38.548160 --- ParallelTerminationStrategy: PID 6210 died... 06:38:38.568242 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6210): Terminated: ok {rc=0} 06:38:38.659378 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:nanobts+band-900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 06:38:39.752694 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:38:39.765483 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:38:39.817687 tst ping_idle_ping.py: using LAC 26542 06:38:39.944759 tst ping_idle_ping.py: using RAC 22 06:38:40.070691 tst ping_idle_ping.py: using CellId 26542 06:38:40.199972 tst ping_idle_ping.py: using BVCI 26543 06:38:40.313407 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:38:40.324774 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:38:40.335998 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:38:40.347230 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:38:40.358325 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:38:40.369513 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:38:40.380797 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:38:40.392792 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:38:40.508064 tst ping_idle_ping.py:24: start network... 06:38:40.702194 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:38:41.153178 run create_hlr_db(pid=6212): Launched 06:38:41.281400 bus /gobi_6: Setting Powered False 06:38:42.344060 run create_hlr_db(pid=6212): Terminated: ok {rc=0} 06:38:42.779525 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6214): Launched 06:38:43.090153 run osmo-hlr_10.42.42.2(pid=6215): Launched 06:38:43.208015 run osmo-stp_10.42.42.5: Starting osmo-stp 06:38:43.752047 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6217): Launched 06:38:44.064798 run osmo-stp_10.42.42.5(pid=6218): Launched 06:38:44.184584 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:38:44.724179 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6220): Launched 06:38:44.843528 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:38:45.107097 run patchelf(pid=6221): Launched 06:38:45.281189 run osmo-stp_10.42.42.5(pid=6218): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6218)] 06:38:45.414237 run osmo-stp_10.42.42.5(pid=6218): stdout: | (launched: 2022-12-10_06:38:44.007540) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:38:45.548933 run osmo-stp_10.42.42.5(pid=6218): stderr: | 20221210063844198 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063844198 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063844198 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063844199 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063844199 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063844199 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063844199 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:38:45.683495 run osmo-stp_10.42.42.5(pid=6218): stdout: | (launched: 2022-12-10_06:38:44.007540) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:38:45.811315 run osmo-stp_10.42.42.5(pid=6218): stderr: | 20221210063844198 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063844198 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063844198 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063844199 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063844199 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063844199 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063844199 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:38:45.981450 run patchelf(pid=6221): Terminating (SIGINT) 06:38:46.186217 run patchelf(pid=6221): Terminated: ok {rc=0} 06:38:46.314962 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=6218): Process ended prematurely: osmo-stp_10.42.42.5(pid=6218) [trial-2370↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6218)] [trial-2370↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27] 06:38:46.324805 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 06:38:46.354724 run osmo-hlr_10.42.42.2(pid=6215): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6215)] 06:38:46.405475 run osmo-hlr_10.42.42.2(pid=6215): stdout: | (launched: 2022-12-10_06:38:43.033165) 06:38:46.457860 run osmo-hlr_10.42.42.2(pid=6215): stderr: | 20221210063843233 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210063843233 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210063843233 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210063843234 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210063843234 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210063843234 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210063843246 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:nanobts+band-900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210063843255 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210063843256 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210063843256 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:38:46.510378 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6214): Terminating (SIGTERM) 06:38:46.554223 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6217): Terminating (SIGTERM) 06:38:46.597956 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6220): Terminating (SIGTERM) 06:38:46.640911 --- ParallelTerminationStrategy: PID 6214 died... 06:38:46.660755 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6214): Terminated: ok {rc=0} 06:38:46.709478 --- ParallelTerminationStrategy: PID 6217 died... 06:38:46.729488 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6217): Terminated: ok {rc=0} 06:38:46.778855 --- ParallelTerminationStrategy: PID 6220 died... 06:38:46.798690 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6220): Terminated: ok {rc=0} 06:38:46.890992 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2370 gprs:nanobts+band-900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 gprs:nanobts+band-900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 06:38:48.195950 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:38:48.203724 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 06:38:48.236785 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 06:38:48.275793 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 06:38:48.363959 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 06:38:48.397048 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 06:38:48.435891 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 06:38:49.030981 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2370 gprs:nanobts+band-900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 06:38:49.081649 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:38:49.093074 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:38:49.161078 tst cs_paging_gprs_active.py: using LAC 26543 06:38:49.286213 tst cs_paging_gprs_active.py: using RAC 23 06:38:49.410061 tst cs_paging_gprs_active.py: using CellId 26543 06:38:49.535389 tst cs_paging_gprs_active.py: using BVCI 26544 06:38:49.649940 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:38:49.661341 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:38:49.672493 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:38:49.683783 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:38:49.694952 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:38:49.706156 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:38:49.717404 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:38:49.728489 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:38:49.739915 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:38:49.857723 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:38:49.975936 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 06:38:50.189031 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:38:50.506655 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6226): Launched 06:38:50.783429 run iperf3-srv_10.42.42.10(pid=6227): Launched 06:38:50.902574 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 06:38:51.115891 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:38:51.434406 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6228): Launched 06:38:51.711379 run iperf3-srv_10.42.42.10(pid=6229): Launched 06:38:51.830237 tst cs_paging_gprs_active.py:38: start network... 06:38:52.043394 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:38:52.535116 run create_hlr_db(pid=6230): Launched 06:38:52.664284 bus /gobi_6: Setting Powered False 06:38:53.727636 run create_hlr_db(pid=6230): Terminated: ok {rc=0} 06:38:54.150057 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6232): Launched 06:38:54.447138 run osmo-hlr_10.42.42.2(pid=6233): Launched 06:38:54.561620 run osmo-stp_10.42.42.5: Starting osmo-stp 06:38:55.086356 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6235): Launched 06:38:55.382890 run osmo-stp_10.42.42.5(pid=6236): Launched 06:38:55.497109 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:38:56.010078 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6238): Launched 06:38:56.123735 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:38:56.374058 run patchelf(pid=6239): Launched 06:38:56.539734 run osmo-stp_10.42.42.5(pid=6236): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6236)] 06:38:56.665743 run osmo-stp_10.42.42.5(pid=6236): stdout: | (launched: 2022-12-10_06:38:55.328228) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:38:56.793714 run osmo-stp_10.42.42.5(pid=6236): stderr: | 20221210063855497 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063855497 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063855498 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063855498 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063855499 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063855499 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063855499 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:38:56.921648 run osmo-stp_10.42.42.5(pid=6236): stdout: | (launched: 2022-12-10_06:38:55.328228) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:38:57.043592 run osmo-stp_10.42.42.5(pid=6236): stderr: | 20221210063855497 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063855497 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063855498 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063855498 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063855499 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063855499 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063855499 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:38:57.187816 run patchelf(pid=6239): Terminating (SIGINT) 06:38:57.354671 run patchelf(pid=6239): Terminated: ok {rc=0} 06:38:57.474850 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=6236): Process ended prematurely: osmo-stp_10.42.42.5(pid=6236) [trial-2370↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6236)] [trial-2370↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 06:38:57.484361 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 06:38:57.511654 run osmo-hlr_10.42.42.2(pid=6233): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6233)] 06:38:57.559144 run osmo-hlr_10.42.42.2(pid=6233): stdout: | (launched: 2022-12-10_06:38:54.392521) 06:38:57.607950 run osmo-hlr_10.42.42.2(pid=6233): stderr: | 20221210063854568 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210063854568 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210063854568 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210063854568 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210063854568 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210063854568 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210063854580 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:nanobts+band-900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210063854589 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210063854589 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210063854590 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:38:57.657408 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6226): Terminating (SIGTERM) 06:38:57.696609 run iperf3-srv_10.42.42.10(pid=6227): Terminating (SIGTERM) 06:38:57.735736 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6228): Terminating (SIGTERM) 06:38:57.774865 run iperf3-srv_10.42.42.10(pid=6229): Terminating (SIGTERM) 06:38:57.813980 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6232): Terminating (SIGTERM) 06:38:57.853250 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6235): Terminating (SIGTERM) 06:38:57.892555 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6238): Terminating (SIGTERM) 06:38:57.931887 --- ParallelTerminationStrategy: PID 6226 died... 06:38:57.950647 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6226): Terminated: ok {rc=0} 06:38:57.994869 --- ParallelTerminationStrategy: PID 6227 died... 06:38:58.012910 run iperf3-srv_10.42.42.10(pid=6227): Terminated {rc=256} 06:38:58.056915 --- ParallelTerminationStrategy: PID 6228 died... 06:38:58.075523 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6228): Terminated: ok {rc=0} 06:38:58.119131 --- ParallelTerminationStrategy: PID 6229 died... 06:38:58.137448 run iperf3-srv_10.42.42.10(pid=6229): Terminated {rc=256} 06:38:58.180891 --- ParallelTerminationStrategy: PID 6232 died... 06:38:58.199616 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6232): Terminated: ok {rc=0} 06:38:58.243224 --- ParallelTerminationStrategy: PID 6235 died... 06:38:58.261693 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6235): Terminated: ok {rc=0} 06:38:58.305033 --- ParallelTerminationStrategy: PID 6238 died... 06:38:58.323361 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6238): Terminated: ok {rc=0} 06:38:58.405329 bus /gobi_0: Setting Powered False 06:38:59.499027 bus /gobi_0: Setting Powered False 06:39:00.612103 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 06:39:01.764034 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:39:01.777429 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:39:01.848817 tst iperf3.py: using LAC 26544 06:39:01.967783 tst iperf3.py: using RAC 24 06:39:02.089142 tst iperf3.py: using CellId 26544 06:39:02.207467 tst iperf3.py: using BVCI 26545 06:39:02.326321 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:39:02.337792 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:39:02.349039 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:39:02.360800 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:39:02.372555 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:39:02.384302 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:39:02.396536 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:39:02.408217 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:39:02.420010 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:39:02.536008 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 06:39:02.750766 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:39:03.069586 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6240): Launched 06:39:03.346576 run iperf3-srv_10.42.42.10(pid=6241): Launched 06:39:03.466331 tst iperf3.py:8: start network... 06:39:03.680008 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:39:04.171624 run create_hlr_db(pid=6242): Launched 06:39:04.300063 bus /gobi_6: Setting Powered False 06:39:05.363581 run create_hlr_db(pid=6242): Terminated: ok {rc=0} 06:39:05.785726 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6245): Launched 06:39:06.081300 run osmo-hlr_10.42.42.2(pid=6246): Launched 06:39:06.194266 run osmo-stp_10.42.42.5: Starting osmo-stp 06:39:06.707669 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6248): Launched 06:39:07.003942 run osmo-stp_10.42.42.5(pid=6249): Launched 06:39:07.117675 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:39:07.626826 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6251): Launched 06:39:07.740497 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:39:07.989776 run patchelf(pid=6252): Launched 06:39:08.154435 run osmo-stp_10.42.42.5(pid=6249): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6249)] 06:39:08.279483 run osmo-stp_10.42.42.5(pid=6249): stdout: | (launched: 2022-12-10_06:39:06.949725) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:39:08.406031 run osmo-stp_10.42.42.5(pid=6249): stderr: | 20221210063907119 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063907120 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063907120 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063907120 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063907121 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063907121 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063907121 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:39:08.532552 run osmo-stp_10.42.42.5(pid=6249): stdout: | (launched: 2022-12-10_06:39:06.949725) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:39:08.653829 run osmo-stp_10.42.42.5(pid=6249): stderr: | 20221210063907119 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063907120 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063907120 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063907120 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063907121 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063907121 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063907121 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:39:08.797457 run patchelf(pid=6252): Terminating (SIGINT) 06:39:08.963915 run patchelf(pid=6252): Terminated: ok {rc=0} 06:39:09.083593 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6249): Process ended prematurely: osmo-stp_10.42.42.5(pid=6249) [trial-2370↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6249)] [trial-2370↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8] 06:39:09.093177 tst iperf3.py:8: Test FAILED (7.4 sec) 06:39:09.120543 run osmo-hlr_10.42.42.2(pid=6246): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6246)] 06:39:09.167314 run osmo-hlr_10.42.42.2(pid=6246): stdout: | (launched: 2022-12-10_06:39:06.026953) 06:39:09.215617 run osmo-hlr_10.42.42.2(pid=6246): stderr: | 20221210063906202 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210063906202 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210063906202 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210063906202 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210063906202 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210063906202 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210063906215 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210063906224 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210063906225 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210063906225 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:39:09.264623 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6240): Terminating (SIGTERM) 06:39:09.303689 run iperf3-srv_10.42.42.10(pid=6241): Terminating (SIGTERM) 06:39:09.342681 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6245): Terminating (SIGTERM) 06:39:09.381541 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6248): Terminating (SIGTERM) 06:39:09.420519 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6251): Terminating (SIGTERM) 06:39:09.459701 --- ParallelTerminationStrategy: PID 6240 died... 06:39:09.478414 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6240): Terminated: ok {rc=0} 06:39:09.521762 --- ParallelTerminationStrategy: PID 6241 died... 06:39:09.540279 run iperf3-srv_10.42.42.10(pid=6241): Terminated {rc=256} 06:39:09.583589 --- ParallelTerminationStrategy: PID 6245 died... 06:39:09.601834 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6245): Terminated: ok {rc=0} 06:39:09.645329 --- ParallelTerminationStrategy: PID 6248 died... 06:39:09.663730 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6248): Terminated: ok {rc=0} 06:39:09.707016 --- ParallelTerminationStrategy: PID 6251 died... 06:39:09.725288 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6251): Terminated: ok {rc=0} 06:39:09.810988 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 06:39:10.959648 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:39:10.971807 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:39:11.041194 tst iperf3m4.py: using LAC 26545 06:39:11.164903 tst iperf3m4.py: using RAC 25 06:39:11.290612 tst iperf3m4.py: using CellId 26545 06:39:11.415431 tst iperf3m4.py: using BVCI 26546 06:39:11.530683 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:39:11.542094 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:39:11.553428 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:39:11.564942 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:39:11.576160 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:39:11.587665 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:39:11.599157 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:39:11.610389 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:39:11.621802 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:39:11.740476 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:39:11.858692 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:39:11.978393 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:39:12.093170 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 06:39:12.292254 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:39:12.590410 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6253): Launched 06:39:12.849911 run iperf3-srv_10.42.42.10(pid=6254): Launched 06:39:12.961245 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 06:39:13.158041 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:39:13.457096 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6255): Launched 06:39:13.715612 run iperf3-srv_10.42.42.10(pid=6256): Launched 06:39:13.827251 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 06:39:14.024635 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:39:14.321855 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6257): Launched 06:39:14.580394 run iperf3-srv_10.42.42.10(pid=6258): Launched 06:39:14.691570 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 06:39:14.889171 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:39:15.186830 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6259): Launched 06:39:15.445794 run iperf3-srv_10.42.42.10(pid=6260): Launched 06:39:15.557122 tst iperf3m4.py:8: start network... 06:39:15.754339 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:39:16.263778 run create_hlr_db(pid=6261): Launched 06:39:16.424064 bus /gobi_6: Setting Powered False 06:39:17.483872 run create_hlr_db(pid=6261): Terminated: ok {rc=0} 06:39:17.934673 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6263): Launched 06:39:18.252881 run osmo-hlr_10.42.42.2(pid=6264): Launched 06:39:18.374709 run osmo-stp_10.42.42.5: Starting osmo-stp 06:39:18.924132 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6266): Launched 06:39:19.242359 run osmo-stp_10.42.42.5(pid=6267): Launched 06:39:19.363766 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:39:19.911277 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6269): Launched 06:39:20.033170 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:39:20.300737 run patchelf(pid=6270): Launched 06:39:20.478516 run osmo-stp_10.42.42.5(pid=6267): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6267)] 06:39:20.612506 run osmo-stp_10.42.42.5(pid=6267): stdout: | (launched: 2022-12-10_06:39:19.184257) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:39:20.747830 run osmo-stp_10.42.42.5(pid=6267): stderr: | 20221210063919377 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063919377 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063919377 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063919378 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063919378 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063919378 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063919378 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:39:20.883088 run osmo-stp_10.42.42.5(pid=6267): stdout: | (launched: 2022-12-10_06:39:19.184257) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:39:21.013202 run osmo-stp_10.42.42.5(pid=6267): stderr: | 20221210063919377 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063919377 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063919377 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063919378 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063919378 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063919378 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063919378 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:39:21.167076 run patchelf(pid=6270): Terminating (SIGINT) 06:39:21.344340 run patchelf(pid=6270): Terminated: ok {rc=0} 06:39:21.472657 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6267): Process ended prematurely: osmo-stp_10.42.42.5(pid=6267) [trial-2370↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6267)] [trial-2370↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 06:39:21.482889 tst iperf3m4.py:8: Test FAILED (10.6 sec) 06:39:21.511324 run osmo-hlr_10.42.42.2(pid=6264): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6264)] 06:39:21.561197 run osmo-hlr_10.42.42.2(pid=6264): stdout: | (launched: 2022-12-10_06:39:18.194948) 06:39:21.612026 run osmo-hlr_10.42.42.2(pid=6264): stderr: | 20221210063918393 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210063918393 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210063918393 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210063918393 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210063918393 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210063918393 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210063918408 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210063918416 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210063918416 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210063918416 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:39:21.663401 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6253): Terminating (SIGTERM) 06:39:21.704302 run iperf3-srv_10.42.42.10(pid=6254): Terminating (SIGTERM) 06:39:21.745342 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6255): Terminating (SIGTERM) 06:39:21.786441 run iperf3-srv_10.42.42.10(pid=6256): Terminating (SIGTERM) 06:39:21.827250 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6257): Terminating (SIGTERM) 06:39:21.868263 run iperf3-srv_10.42.42.10(pid=6258): Terminating (SIGTERM) 06:39:21.909515 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6259): Terminating (SIGTERM) 06:39:21.950620 run iperf3-srv_10.42.42.10(pid=6260): Terminating (SIGTERM) 06:39:21.991412 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6263): Terminating (SIGTERM) 06:39:22.032407 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6266): Terminating (SIGTERM) 06:39:22.073460 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6269): Terminating (SIGTERM) 06:39:22.114964 --- ParallelTerminationStrategy: PID 6253 died... 06:39:22.134792 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6253): Terminated: ok {rc=0} 06:39:22.180497 --- ParallelTerminationStrategy: PID 6254 died... 06:39:22.199934 run iperf3-srv_10.42.42.10(pid=6254): Terminated {rc=256} 06:39:22.245937 --- ParallelTerminationStrategy: PID 6255 died... 06:39:22.265397 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6255): Terminated: ok {rc=0} 06:39:22.310945 --- ParallelTerminationStrategy: PID 6256 died... 06:39:22.330425 run iperf3-srv_10.42.42.10(pid=6256): Terminated {rc=256} 06:39:22.375904 --- ParallelTerminationStrategy: PID 6257 died... 06:39:22.395376 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6257): Terminated: ok {rc=0} 06:39:22.441792 --- ParallelTerminationStrategy: PID 6258 died... 06:39:22.461396 run iperf3-srv_10.42.42.10(pid=6258): Terminated {rc=256} 06:39:22.506944 --- ParallelTerminationStrategy: PID 6259 died... 06:39:22.526500 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6259): Terminated: ok {rc=0} 06:39:22.571986 --- ParallelTerminationStrategy: PID 6260 died... 06:39:22.591184 run iperf3-srv_10.42.42.10(pid=6260): Terminated {rc=256} 06:39:22.636867 --- ParallelTerminationStrategy: PID 6263 died... 06:39:22.656685 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6263): Terminated: ok {rc=0} 06:39:22.702043 --- ParallelTerminationStrategy: PID 6266 died... 06:39:22.721483 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6266): Terminated: ok {rc=0} 06:39:22.766901 --- ParallelTerminationStrategy: PID 6269 died... 06:39:22.786285 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6269): Terminated: ok {rc=0} 06:39:22.873052 bus /gobi_4: Setting Powered False 06:39:23.972488 bus /gobi_4: Setting Powered False 06:39:25.086806 bus /gobi_1: Setting Powered False 06:39:26.181969 bus /gobi_1: Setting Powered False 06:39:27.295854 bus /gobi_0: Setting Powered False 06:39:28.392713 bus /gobi_0: Setting Powered False 06:39:29.507333 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 06:39:30.607949 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:39:30.619672 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:39:30.700776 tst ping.py: using LAC 26546 06:39:30.819880 tst ping.py: using RAC 26 06:39:30.952910 tst ping.py: using CellId 26546 06:39:31.086251 tst ping.py: using BVCI 26547 06:39:31.231224 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:39:31.245760 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:39:31.259961 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:39:31.275265 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:39:31.290844 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:39:31.307343 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:39:31.323681 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:39:31.339941 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:39:31.462202 tst ping.py:19: start network... 06:39:31.694593 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:39:32.159318 run create_hlr_db(pid=6272): Launched 06:39:32.304157 bus /gobi_6: Setting Powered False 06:39:33.363631 run create_hlr_db(pid=6272): Terminated: ok {rc=0} 06:39:33.770455 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6274): Launched 06:39:34.061157 run osmo-hlr_10.42.42.2(pid=6275): Launched 06:39:34.172372 run osmo-stp_10.42.42.5: Starting osmo-stp 06:39:34.690750 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6277): Launched 06:39:34.981167 run osmo-stp_10.42.42.5(pid=6278): Launched 06:39:35.091148 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:39:35.592636 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6280): Launched 06:39:35.704655 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:39:35.950305 run patchelf(pid=6281): Launched 06:39:36.113184 run osmo-stp_10.42.42.5(pid=6278): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6278)] 06:39:36.236804 run osmo-stp_10.42.42.5(pid=6278): stdout: | (launched: 2022-12-10_06:39:34.927481) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:39:36.362250 run osmo-stp_10.42.42.5(pid=6278): stderr: | 20221210063935095 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063935095 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063935095 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063935095 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063935096 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063935096 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063935096 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:39:36.487933 run osmo-stp_10.42.42.5(pid=6278): stdout: | (launched: 2022-12-10_06:39:34.927481) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:39:36.607214 run osmo-stp_10.42.42.5(pid=6278): stderr: | 20221210063935095 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063935095 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063935095 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063935095 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063935096 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063935096 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063935096 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:39:36.748840 run patchelf(pid=6281): Terminating (SIGINT) 06:39:36.913159 run patchelf(pid=6281): Terminated: ok {rc=0} 06:39:37.030611 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=6278): Process ended prematurely: osmo-stp_10.42.42.5(pid=6278) [trial-2370↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6278)] [trial-2370↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22] 06:39:37.039408 tst ping.py:22: Test FAILED (6.4 sec) 06:39:37.066606 run osmo-hlr_10.42.42.2(pid=6275): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6275)] 06:39:37.114556 run osmo-hlr_10.42.42.2(pid=6275): stdout: | (launched: 2022-12-10_06:39:34.007801) 06:39:37.163708 run osmo-hlr_10.42.42.2(pid=6275): stderr: | 20221210063934183 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210063934183 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210063934183 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210063934183 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210063934183 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210063934183 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210063934195 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210063934204 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210063934204 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210063934204 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:39:37.212906 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6274): Terminating (SIGTERM) 06:39:37.252170 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6277): Terminating (SIGTERM) 06:39:37.291387 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6280): Terminating (SIGTERM) 06:39:37.330853 --- ParallelTerminationStrategy: PID 6274 died... 06:39:37.349769 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6274): Terminated: ok {rc=0} 06:39:37.393960 --- ParallelTerminationStrategy: PID 6277 died... 06:39:37.412267 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6277): Terminated: ok {rc=0} 06:39:37.456504 --- ParallelTerminationStrategy: PID 6280 died... 06:39:37.475044 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6280): Terminated: ok {rc=0} 06:39:37.558156 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 06:39:38.641696 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:39:38.653242 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:39:38.720713 tst ping_idle_ping.py: using LAC 26547 06:39:38.837089 tst ping_idle_ping.py: using RAC 27 06:39:38.952373 tst ping_idle_ping.py: using CellId 26547 06:39:39.076698 tst ping_idle_ping.py: using BVCI 26548 06:39:39.190858 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:39:39.202543 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:39:39.213832 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:39:39.225836 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:39:39.237698 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:39:39.249603 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:39:39.261470 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:39:39.273267 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:39:39.390345 tst ping_idle_ping.py:24: start network... 06:39:39.601472 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:39:40.088379 run create_hlr_db(pid=6282): Launched 06:39:40.215870 bus /gobi_6: Setting Powered False 06:39:41.278045 run create_hlr_db(pid=6282): Terminated: ok {rc=0} 06:39:41.697404 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6284): Launched 06:39:41.990252 run osmo-hlr_10.42.42.2(pid=6285): Launched 06:39:42.101573 run osmo-stp_10.42.42.5: Starting osmo-stp 06:39:42.605493 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6287): Launched 06:39:42.896652 run osmo-stp_10.42.42.5(pid=6288): Launched 06:39:43.008142 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:39:43.511753 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6290): Launched 06:39:43.623346 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:39:43.869943 run patchelf(pid=6291): Launched 06:39:44.032878 run osmo-stp_10.42.42.5(pid=6288): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6288)] 06:39:44.156818 run osmo-stp_10.42.42.5(pid=6288): stdout: | (launched: 2022-12-10_06:39:42.842564) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:39:44.281940 run osmo-stp_10.42.42.5(pid=6288): stderr: | 20221210063943011 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063943011 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063943012 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063943012 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063943013 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063943013 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063943013 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:39:44.407653 run osmo-stp_10.42.42.5(pid=6288): stdout: | (launched: 2022-12-10_06:39:42.842564) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:39:44.527869 run osmo-stp_10.42.42.5(pid=6288): stderr: | 20221210063943011 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063943011 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063943012 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063943012 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063943013 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063943013 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063943013 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:39:44.669687 run patchelf(pid=6291): Terminating (SIGINT) 06:39:44.834117 run patchelf(pid=6291): Terminated: ok {rc=0} 06:39:44.952601 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=6288): Process ended prematurely: osmo-stp_10.42.42.5(pid=6288) [trial-2370↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6288)] [trial-2370↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 06:39:44.961602 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 06:39:44.988475 run osmo-hlr_10.42.42.2(pid=6285): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6285)] 06:39:45.035556 run osmo-hlr_10.42.42.2(pid=6285): stdout: | (launched: 2022-12-10_06:39:41.936446) 06:39:45.083953 run osmo-hlr_10.42.42.2(pid=6285): stderr: | 20221210063942109 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210063942110 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210063942110 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210063942110 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210063942110 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210063942110 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210063942122 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210063942130 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210063942130 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210063942130 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:39:45.133286 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6284): Terminating (SIGTERM) 06:39:45.172733 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6287): Terminating (SIGTERM) 06:39:45.211969 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6290): Terminating (SIGTERM) 06:39:45.251660 --- ParallelTerminationStrategy: PID 6284 died... 06:39:45.270448 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6284): Terminated: ok {rc=0} 06:39:45.314475 --- ParallelTerminationStrategy: PID 6287 died... 06:39:45.332574 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6287): Terminated: ok {rc=0} 06:39:45.377337 --- ParallelTerminationStrategy: PID 6290 died... 06:39:45.395824 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6290): Terminated: ok {rc=0} 06:39:45.480209 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2370 gprs:nanobts+band-900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 06:39:46.856172 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:39:46.867977 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 06:39:46.927935 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 06:39:46.977225 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 06:39:47.087653 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 06:39:47.150619 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 06:39:47.197580 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 06:39:47.752037 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2370 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 06:39:47.801344 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:39:47.812535 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 06:39:47.862794 tst cs_paging_gprs_active.py: using LAC 26548 06:39:47.983195 tst cs_paging_gprs_active.py: using RAC 28 06:39:48.099708 tst cs_paging_gprs_active.py: using CellId 26548 06:39:48.214858 tst cs_paging_gprs_active.py: using BVCI 26549 06:39:48.329275 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:39:48.340925 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:39:48.353352 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:39:48.365125 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:39:48.376559 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:39:48.388156 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:39:48.399841 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:39:48.411490 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:39:48.423722 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 06:39:48.543033 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 06:39:48.660463 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 06:39:48.872101 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:39:49.186298 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6295): Launched 06:39:49.461433 run iperf3-srv_10.42.42.10(pid=6296): Launched 06:39:49.579306 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 06:39:49.789269 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:39:50.103022 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6297): Launched 06:39:50.377135 run iperf3-srv_10.42.42.10(pid=6298): Launched 06:39:50.495832 tst cs_paging_gprs_active.py:38: start network... 06:39:50.706479 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:39:51.194319 run create_hlr_db(pid=6299): Launched 06:39:51.323714 bus /gobi_6: Setting Powered False 06:39:52.385726 run create_hlr_db(pid=6299): Terminated: ok {rc=0} 06:39:52.824233 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6301): Launched 06:39:53.139114 run osmo-hlr_10.42.42.2(pid=6302): Launched 06:39:53.259421 run osmo-stp_10.42.42.5: Starting osmo-stp 06:39:53.799788 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6304): Launched 06:39:54.114330 run osmo-stp_10.42.42.5(pid=6305): Launched 06:39:54.235041 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:39:54.777702 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6307): Launched 06:39:54.898189 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:39:55.163445 run patchelf(pid=6308): Launched 06:39:55.339265 run osmo-stp_10.42.42.5(pid=6305): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6305)] 06:39:55.473284 run osmo-stp_10.42.42.5(pid=6305): stdout: | (launched: 2022-12-10_06:39:54.057226) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:39:55.608082 run osmo-stp_10.42.42.5(pid=6305): stderr: | 20221210063954249 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063954249 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063954249 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063954250 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063954250 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063954250 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063954250 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:39:55.743362 run osmo-stp_10.42.42.5(pid=6305): stdout: | (launched: 2022-12-10_06:39:54.057226) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:39:55.872426 run osmo-stp_10.42.42.5(pid=6305): stderr: | 20221210063954249 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210063954249 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210063954249 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210063954250 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210063954250 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210063954250 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210063954250 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:39:56.025647 run patchelf(pid=6308): Terminating (SIGINT) 06:39:56.201752 run patchelf(pid=6308): Terminated: ok {rc=0} 06:39:56.329484 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=6305): Process ended prematurely: osmo-stp_10.42.42.5(pid=6305) [trial-2370↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6305)] [trial-2370↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 06:39:56.339686 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 06:39:56.367823 run osmo-hlr_10.42.42.2(pid=6302): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6302)] 06:39:56.416897 run osmo-hlr_10.42.42.2(pid=6302): stdout: | (launched: 2022-12-10_06:39:53.081152) 06:39:56.468222 run osmo-hlr_10.42.42.2(pid=6302): stderr: | 20221210063953280 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210063953280 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210063953280 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210063953280 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210063953280 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210063953280 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210063953293 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210063953301 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210063953302 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210063953302 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:39:56.519618 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6295): Terminating (SIGTERM) 06:39:56.561089 run iperf3-srv_10.42.42.10(pid=6296): Terminating (SIGTERM) 06:39:56.602476 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6297): Terminating (SIGTERM) 06:39:56.643870 run iperf3-srv_10.42.42.10(pid=6298): Terminating (SIGTERM) 06:39:56.685027 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6301): Terminating (SIGTERM) 06:39:56.726535 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6304): Terminating (SIGTERM) 06:39:56.767822 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6307): Terminating (SIGTERM) 06:39:56.809296 --- ParallelTerminationStrategy: PID 6295 died... 06:39:56.829063 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6295): Terminated: ok {rc=0} 06:39:56.874569 --- ParallelTerminationStrategy: PID 6296 died... 06:39:56.893794 run iperf3-srv_10.42.42.10(pid=6296): Terminated {rc=256} 06:39:56.939197 --- ParallelTerminationStrategy: PID 6297 died... 06:39:56.958349 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6297): Terminated: ok {rc=0} 06:39:57.003773 --- ParallelTerminationStrategy: PID 6298 died... 06:39:57.023131 run iperf3-srv_10.42.42.10(pid=6298): Terminated {rc=256} 06:39:57.068441 --- ParallelTerminationStrategy: PID 6301 died... 06:39:57.087689 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6301): Terminated: ok {rc=0} 06:39:57.132942 --- ParallelTerminationStrategy: PID 6304 died... 06:39:57.152272 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6304): Terminated: ok {rc=0} 06:39:57.198195 --- ParallelTerminationStrategy: PID 6307 died... 06:39:57.217637 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6307): Terminated: ok {rc=0} 06:39:57.306065 bus /gobi_0: Setting Powered False 06:39:58.405379 bus /gobi_0: Setting Powered False 06:39:59.521426 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 06:40:00.668123 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:40:00.680663 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 06:40:00.732329 tst iperf3.py: using LAC 26549 06:40:00.861505 tst iperf3.py: using RAC 29 06:40:01.003670 tst iperf3.py: using CellId 26549 06:40:01.127639 tst iperf3.py: using BVCI 26550 06:40:01.240298 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:40:01.253097 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:40:01.266586 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:40:01.281529 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:40:01.293936 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:40:01.308156 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:40:01.322818 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:40:01.336235 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:40:01.349820 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 06:40:01.474444 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 06:40:01.682515 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:40:02.000765 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6312): Launched 06:40:02.271146 run iperf3-srv_10.42.42.10(pid=6313): Launched 06:40:02.382303 tst iperf3.py:8: start network... 06:40:02.577528 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:40:03.029532 run create_hlr_db(pid=6314): Launched 06:40:03.141660 bus /gobi_6: Setting Powered False 06:40:04.200165 run create_hlr_db(pid=6314): Terminated: ok {rc=0} 06:40:04.630753 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6316): Launched 06:40:04.945311 run osmo-hlr_10.42.42.2(pid=6317): Launched 06:40:05.064933 run osmo-stp_10.42.42.5: Starting osmo-stp 06:40:05.607901 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6319): Launched 06:40:05.921019 run osmo-stp_10.42.42.5(pid=6320): Launched 06:40:06.040886 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:40:06.584313 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6322): Launched 06:40:06.705710 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:40:06.972359 run patchelf(pid=6323): Launched 06:40:07.148034 run osmo-stp_10.42.42.5(pid=6320): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6320)] 06:40:07.281995 run osmo-stp_10.42.42.5(pid=6320): stdout: | (launched: 2022-12-10_06:40:05.864040) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:40:07.417908 run osmo-stp_10.42.42.5(pid=6320): stderr: | 20221210064006054 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210064006055 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210064006055 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210064006055 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210064006056 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210064006056 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210064006056 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:40:07.553968 run osmo-stp_10.42.42.5(pid=6320): stdout: | (launched: 2022-12-10_06:40:05.864040) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:40:07.683467 run osmo-stp_10.42.42.5(pid=6320): stderr: | 20221210064006054 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210064006055 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210064006055 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210064006055 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210064006056 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210064006056 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210064006056 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:40:07.836716 run patchelf(pid=6323): Terminating (SIGINT) 06:40:08.012691 run patchelf(pid=6323): Terminated: ok {rc=0} 06:40:08.139693 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6320): Process ended prematurely: osmo-stp_10.42.42.5(pid=6320) [trial-2370↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6320)] [trial-2370↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 06:40:08.150131 tst iperf3.py:8: Test FAILED (7.5 sec) 06:40:08.178218 run osmo-hlr_10.42.42.2(pid=6317): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6317)] 06:40:08.227436 run osmo-hlr_10.42.42.2(pid=6317): stdout: | (launched: 2022-12-10_06:40:04.888477) 06:40:08.278224 run osmo-hlr_10.42.42.2(pid=6317): stderr: | 20221210064005085 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210064005085 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210064005085 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210064005085 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210064005085 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210064005085 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210064005098 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210064005108 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210064005108 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210064005109 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:40:08.329535 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6312): Terminating (SIGTERM) 06:40:08.370531 run iperf3-srv_10.42.42.10(pid=6313): Terminating (SIGTERM) 06:40:08.411554 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6316): Terminating (SIGTERM) 06:40:08.453073 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6319): Terminating (SIGTERM) 06:40:08.494233 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6322): Terminating (SIGTERM) 06:40:08.535373 --- ParallelTerminationStrategy: PID 6312 died... 06:40:08.554978 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6312): Terminated: ok {rc=0} 06:40:08.600390 --- ParallelTerminationStrategy: PID 6313 died... 06:40:08.619636 run iperf3-srv_10.42.42.10(pid=6313): Terminated {rc=256} 06:40:08.664722 --- ParallelTerminationStrategy: PID 6316 died... 06:40:08.683864 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6316): Terminated: ok {rc=0} 06:40:08.729227 --- ParallelTerminationStrategy: PID 6319 died... 06:40:08.748388 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6319): Terminated: ok {rc=0} 06:40:08.793846 --- ParallelTerminationStrategy: PID 6322 died... 06:40:08.813175 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6322): Terminated: ok {rc=0} 06:40:08.899621 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 06:40:10.046591 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:40:10.059045 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 06:40:10.112723 tst iperf3m4.py: using LAC 26550 06:40:10.235566 tst iperf3m4.py: using RAC 30 06:40:10.362802 tst iperf3m4.py: using CellId 26550 06:40:10.485197 tst iperf3m4.py: using BVCI 26551 06:40:10.598619 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:40:10.610397 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:40:10.622061 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:40:10.633638 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:40:10.645181 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:40:10.656596 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:40:10.668281 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:40:10.679696 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:40:10.691451 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 06:40:10.809763 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 06:40:10.925356 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 06:40:11.044502 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 06:40:11.161528 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 06:40:11.374697 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:40:11.691113 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6324): Launched 06:40:11.965110 run iperf3-srv_10.42.42.10(pid=6325): Launched 06:40:12.083346 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 06:40:12.294200 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:40:12.609738 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6326): Launched 06:40:12.882114 run iperf3-srv_10.42.42.10(pid=6327): Launched 06:40:12.999672 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 06:40:13.210146 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:40:13.526281 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6328): Launched 06:40:13.799608 run iperf3-srv_10.42.42.10(pid=6329): Launched 06:40:13.917146 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 06:40:14.127323 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:40:14.443203 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6330): Launched 06:40:14.717191 run iperf3-srv_10.42.42.10(pid=6331): Launched 06:40:14.834570 tst iperf3m4.py:8: start network... 06:40:15.045016 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:40:15.531846 run create_hlr_db(pid=6332): Launched 06:40:15.659942 bus /gobi_6: Setting Powered False 06:40:16.754858 run create_hlr_db(pid=6332): Terminated: ok {rc=0} 06:40:17.288868 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6353): Launched 06:40:17.639729 run osmo-hlr_10.42.42.2(pid=6354): Launched 06:40:17.769173 run osmo-stp_10.42.42.5: Starting osmo-stp 06:40:18.430297 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6364): Launched 06:40:18.761738 run osmo-stp_10.42.42.5(pid=6385): Launched 06:40:18.896316 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:40:19.438962 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6388): Launched 06:40:19.559398 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:40:19.824767 run patchelf(pid=6389): Launched 06:40:19.999807 run osmo-stp_10.42.42.5(pid=6385): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6385)] 06:40:20.132844 run osmo-stp_10.42.42.5(pid=6385): stdout: | (launched: 2022-12-10_06:40:18.692148) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:40:20.267235 run osmo-stp_10.42.42.5(pid=6385): stderr: | 20221210064018900 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210064018900 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210064018900 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210064018901 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210064018901 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210064018901 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210064018902 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:40:20.401806 run osmo-stp_10.42.42.5(pid=6385): stdout: | (launched: 2022-12-10_06:40:18.692148) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:40:20.530971 run osmo-stp_10.42.42.5(pid=6385): stderr: | 20221210064018900 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210064018900 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210064018900 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210064018901 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210064018901 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210064018901 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210064018902 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:40:20.683672 run patchelf(pid=6389): Terminating (SIGINT) 06:40:20.859022 run patchelf(pid=6389): Terminated: ok {rc=0} 06:40:20.985362 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6385): Process ended prematurely: osmo-stp_10.42.42.5(pid=6385) [trial-2370↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6385)] [trial-2370↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 06:40:20.995590 tst iperf3m4.py:8: Test FAILED (11.0 sec) 06:40:21.023746 run osmo-hlr_10.42.42.2(pid=6354): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6354)] 06:40:21.072270 run osmo-hlr_10.42.42.2(pid=6354): stdout: | (launched: 2022-12-10_06:40:17.571120) 06:40:21.122489 run osmo-hlr_10.42.42.2(pid=6354): stderr: | 20221210064017906 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210064017906 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210064017906 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210064017906 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210064017906 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210064017906 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210064017928 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210064017939 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210064017939 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210064017940 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:40:21.173246 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6324): Terminating (SIGTERM) 06:40:21.213802 run iperf3-srv_10.42.42.10(pid=6325): Terminating (SIGTERM) 06:40:21.254397 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6326): Terminating (SIGTERM) 06:40:21.295016 run iperf3-srv_10.42.42.10(pid=6327): Terminating (SIGTERM) 06:40:21.335451 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6328): Terminating (SIGTERM) 06:40:21.376017 run iperf3-srv_10.42.42.10(pid=6329): Terminating (SIGTERM) 06:40:21.416527 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6330): Terminating (SIGTERM) 06:40:21.457842 run iperf3-srv_10.42.42.10(pid=6331): Terminating (SIGTERM) 06:40:21.498349 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6353): Terminating (SIGTERM) 06:40:21.538867 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6364): Terminating (SIGTERM) 06:40:21.579400 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6388): Terminating (SIGTERM) 06:40:21.620127 --- ParallelTerminationStrategy: PID 6324 died... 06:40:21.639673 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6324): Terminated: ok {rc=0} 06:40:21.684645 --- ParallelTerminationStrategy: PID 6325 died... 06:40:21.703828 run iperf3-srv_10.42.42.10(pid=6325): Terminated {rc=256} 06:40:21.748563 --- ParallelTerminationStrategy: PID 6326 died... 06:40:21.767685 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6326): Terminated: ok {rc=0} 06:40:21.812562 --- ParallelTerminationStrategy: PID 6327 died... 06:40:21.831782 run iperf3-srv_10.42.42.10(pid=6327): Terminated {rc=256} 06:40:21.876390 --- ParallelTerminationStrategy: PID 6328 died... 06:40:21.895658 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6328): Terminated: ok {rc=0} 06:40:21.940889 --- ParallelTerminationStrategy: PID 6329 died... 06:40:21.960100 run iperf3-srv_10.42.42.10(pid=6329): Terminated {rc=256} 06:40:22.004780 --- ParallelTerminationStrategy: PID 6330 died... 06:40:22.023889 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6330): Terminated: ok {rc=0} 06:40:22.068782 --- ParallelTerminationStrategy: PID 6331 died... 06:40:22.087979 run iperf3-srv_10.42.42.10(pid=6331): Terminated {rc=256} 06:40:22.132725 --- ParallelTerminationStrategy: PID 6353 died... 06:40:22.152054 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6353): Terminated: ok {rc=0} 06:40:22.196887 --- ParallelTerminationStrategy: PID 6364 died... 06:40:22.216395 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6364): Terminated: ok {rc=0} 06:40:22.261394 --- ParallelTerminationStrategy: PID 6388 died... 06:40:22.280529 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6388): Terminated: ok {rc=0} 06:40:22.366426 bus /gobi_4: Setting Powered False 06:40:23.464570 bus /gobi_4: Setting Powered False 06:40:24.577413 bus /gobi_1: Setting Powered False 06:40:25.673750 bus /gobi_1: Setting Powered False 06:40:26.787519 bus /gobi_0: Setting Powered False 06:40:27.884748 bus /gobi_0: Setting Powered False 06:40:28.999377 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 06:40:30.100358 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:40:30.113099 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 06:40:30.164610 tst ping.py: using LAC 26551 06:40:30.286398 tst ping.py: using RAC 31 06:40:30.406247 tst ping.py: using CellId 26551 06:40:30.527795 tst ping.py: using BVCI 26552 06:40:30.641134 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:40:30.652921 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:40:30.664624 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:40:30.676253 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:40:30.687757 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:40:30.699595 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:40:30.711232 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:40:30.722831 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 06:40:30.844312 tst ping.py:19: start network... 06:40:31.066856 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:40:31.557052 run create_hlr_db(pid=6390): Launched 06:40:31.710354 bus /gobi_6: Setting Powered False 06:40:32.767632 run create_hlr_db(pid=6390): Terminated: ok {rc=0} 06:40:33.188810 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6392): Launched 06:40:33.496920 run osmo-hlr_10.42.42.2(pid=6393): Launched 06:40:33.615028 run osmo-stp_10.42.42.5: Starting osmo-stp 06:40:34.149038 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6395): Launched 06:40:34.456024 run osmo-stp_10.42.42.5(pid=6396): Launched 06:40:34.572764 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:40:35.102098 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6398): Launched 06:40:35.219653 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:40:35.479804 run patchelf(pid=6399): Launched 06:40:35.652533 run osmo-stp_10.42.42.5(pid=6396): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6396)] 06:40:35.783055 run osmo-stp_10.42.42.5(pid=6396): stdout: | (launched: 2022-12-10_06:40:34.399344) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:40:35.915083 run osmo-stp_10.42.42.5(pid=6396): stderr: | 20221210064034591 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210064034592 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210064034592 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210064034592 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210064034593 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210064034593 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210064034593 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:40:36.047304 run osmo-stp_10.42.42.5(pid=6396): stdout: | (launched: 2022-12-10_06:40:34.399344) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:40:36.173521 run osmo-stp_10.42.42.5(pid=6396): stderr: | 20221210064034591 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210064034592 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210064034592 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210064034592 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210064034593 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210064034593 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210064034593 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:40:36.322569 run patchelf(pid=6399): Terminating (SIGINT) 06:40:36.495421 run patchelf(pid=6399): Terminated: ok {rc=0} 06:40:36.619708 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=6396): Process ended prematurely: osmo-stp_10.42.42.5(pid=6396) [trial-2370↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6396)] [trial-2370↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 06:40:36.629292 tst ping.py:22: Test FAILED (6.5 sec) 06:40:36.656769 run osmo-hlr_10.42.42.2(pid=6393): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6393)] 06:40:36.705614 run osmo-hlr_10.42.42.2(pid=6393): stdout: | (launched: 2022-12-10_06:40:33.440564) 06:40:36.756205 run osmo-hlr_10.42.42.2(pid=6393): stderr: | 20221210064033637 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210064033637 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210064033637 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210064033637 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210064033637 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210064033637 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210064033650 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210064033658 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210064033658 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210064033658 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:40:36.807221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6392): Terminating (SIGTERM) 06:40:36.847927 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6395): Terminating (SIGTERM) 06:40:36.888527 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6398): Terminating (SIGTERM) 06:40:36.929641 --- ParallelTerminationStrategy: PID 6392 died... 06:40:36.949059 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6392): Terminated: ok {rc=0} 06:40:36.994242 --- ParallelTerminationStrategy: PID 6395 died... 06:40:37.013274 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6395): Terminated: ok {rc=0} 06:40:37.058293 --- ParallelTerminationStrategy: PID 6398 died... 06:40:37.077370 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6398): Terminated: ok {rc=0} 06:40:37.162080 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2370 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 06:40:38.248212 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:40:38.260942 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 06:40:38.312927 tst ping_idle_ping.py: using LAC 26552 06:40:38.436024 tst ping_idle_ping.py: using RAC 32 06:40:38.557096 tst ping_idle_ping.py: using CellId 26552 06:40:38.677414 tst ping_idle_ping.py: using BVCI 26553 06:40:38.791181 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:40:38.803081 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:40:38.814972 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:40:38.826613 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:40:38.838730 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:40:38.850383 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:40:38.862182 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:40:38.873931 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 06:40:38.987014 tst ping_idle_ping.py:24: start network... 06:40:39.181259 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:40:39.633092 run create_hlr_db(pid=6400): Launched 06:40:39.744631 bus /gobi_6: Setting Powered False 06:40:40.802567 run create_hlr_db(pid=6400): Terminated: ok {rc=0} 06:40:41.229434 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6402): Launched 06:40:41.539752 run osmo-hlr_10.42.42.2(pid=6403): Launched 06:40:41.659094 run osmo-stp_10.42.42.5: Starting osmo-stp 06:40:42.195144 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6405): Launched 06:40:42.505108 run osmo-stp_10.42.42.5(pid=6406): Launched 06:40:42.624280 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:40:43.159492 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6408): Launched 06:40:43.277607 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:40:43.539275 run patchelf(pid=6409): Launched 06:40:43.712240 run osmo-stp_10.42.42.5(pid=6406): ERR: Terminated: ERROR {rc=1} [trial-2370↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6406)] 06:40:43.843631 run osmo-stp_10.42.42.5(pid=6406): stdout: | (launched: 2022-12-10_06:40:42.448404) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:40:43.977050 run osmo-stp_10.42.42.5(pid=6406): stderr: | 20221210064042639 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210064042639 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210064042639 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210064042640 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210064042640 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210064042640 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210064042640 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:40:44.110631 run osmo-stp_10.42.42.5(pid=6406): stdout: | (launched: 2022-12-10_06:40:42.448404) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:40:44.237432 run osmo-stp_10.42.42.5(pid=6406): stderr: | 20221210064042639 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210064042639 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210064042639 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210064042640 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210064042640 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210064042640 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210064042640 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:40:44.388077 run patchelf(pid=6409): Terminating (SIGINT) 06:40:44.562066 run patchelf(pid=6409): Terminated: ok {rc=0} 06:40:44.686896 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=6406): Process ended prematurely: osmo-stp_10.42.42.5(pid=6406) [trial-2370↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6406)] [trial-2370↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 06:40:44.696352 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 06:40:44.724170 run osmo-hlr_10.42.42.2(pid=6403): ERR: Terminated: ERROR {rc=237} [trial-2370↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6403)] 06:40:44.773525 run osmo-hlr_10.42.42.2(pid=6403): stdout: | (launched: 2022-12-10_06:40:41.482981) 06:40:44.824452 run osmo-hlr_10.42.42.2(pid=6403): stderr: | 20221210064041681 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210064041681 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210064041681 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210064041681 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210064041681 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210064041681 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210064041694 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210064041702 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210064041702 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210064041702 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:40:44.875913 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6402): Terminating (SIGTERM) 06:40:44.917300 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6405): Terminating (SIGTERM) 06:40:44.958724 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6408): Terminating (SIGTERM) 06:40:45.000208 --- ParallelTerminationStrategy: PID 6402 died... 06:40:45.019988 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6402): Terminated: ok {rc=0} 06:40:45.066090 --- ParallelTerminationStrategy: PID 6405 died... 06:40:45.085580 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6405): Terminated: ok {rc=0} 06:40:45.131096 --- ParallelTerminationStrategy: PID 6408 died... 06:40:45.150447 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6408): Terminated: ok {rc=0} 06:40:45.237696 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2370 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 06:40:46.554286 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:40:46.565183 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 06:40:46.604920 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 06:40:46.648077 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 06:40:46.712740 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 06:40:46.754246 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 06:40:46.795944 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 06:40:47.341467 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2370 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 06:40:47.346800 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:40:47.358432 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 06:40:47.425963 tst switch_tch_pdch.py: using LAC 26553 06:40:47.540438 tst switch_tch_pdch.py: using RAC 33 06:40:47.654591 tst switch_tch_pdch.py: using CellId 26553 06:40:47.769393 tst switch_tch_pdch.py: using BVCI 26554 06:40:47.873779 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:40:47.885416 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:40:47.896804 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:40:47.909093 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:40:47.921200 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:40:47.933353 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:40:47.945538 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:40:47.957813 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:40:48.077166 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:40:48.194805 tst switch_tch_pdch.py:51: start network... 06:40:48.402950 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:40:48.880911 run create_hlr_db(pid=6413): Launched 06:40:49.007705 bus /gobi_6: Setting Powered False 06:40:50.068850 run create_hlr_db(pid=6413): Terminated: ok {rc=0} 06:40:50.482411 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6415): Launched 06:40:50.769737 run osmo-hlr_10.42.42.2(pid=6416): Launched 06:40:50.878921 run osmo-stp_10.42.42.5: Starting osmo-stp 06:40:51.376419 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6418): Launched 06:40:51.665273 run osmo-stp_10.42.42.5(pid=6419): Launched 06:40:51.774773 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:40:52.270857 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6421): Launched 06:40:52.381811 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:40:52.626129 run patchelf(pid=6422): Launched 06:40:52.787732 run osmo-stp_10.42.42.5(pid=6419): ERR: Terminated: ERROR {rc=1} [trial-2370↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6419)] 06:40:52.910849 run osmo-stp_10.42.42.5(pid=6419): stdout: | (launched: 2022-12-10_06:40:51.611924) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:40:53.035845 run osmo-stp_10.42.42.5(pid=6419): stderr: | 20221210064051779 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210064051779 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210064051780 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210064051780 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210064051782 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210064051782 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210064051782 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:40:53.160748 run osmo-stp_10.42.42.5(pid=6419): stdout: | (launched: 2022-12-10_06:40:51.611924) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:40:53.279697 run osmo-stp_10.42.42.5(pid=6419): stderr: | 20221210064051779 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210064051779 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210064051780 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210064051780 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210064051782 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210064051782 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210064051782 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:40:53.420418 run patchelf(pid=6422): Terminating (SIGINT) 06:40:53.582537 run patchelf(pid=6422): Terminated: ok {rc=0} 06:40:53.699663 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=6419): Process ended prematurely: osmo-stp_10.42.42.5(pid=6419) [trial-2370↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6419)] [trial-2370↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 06:40:53.708416 tst switch_tch_pdch.py:54: Test FAILED (6.4 sec) 06:40:53.735072 run osmo-hlr_10.42.42.2(pid=6416): ERR: Terminated: ERROR {rc=237} [trial-2370↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6416)] 06:40:53.782245 run osmo-hlr_10.42.42.2(pid=6416): stdout: | (launched: 2022-12-10_06:40:50.717204) 06:40:53.831224 run osmo-hlr_10.42.42.2(pid=6416): stderr: | 20221210064050889 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210064050889 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210064050889 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210064050889 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210064050889 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210064050889 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210064050901 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210064050910 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210064050910 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210064050910 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:40:53.880444 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6415): Terminating (SIGTERM) 06:40:53.920066 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6418): Terminating (SIGTERM) 06:40:53.959368 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6421): Terminating (SIGTERM) 06:40:53.999159 --- ParallelTerminationStrategy: PID 6415 died... 06:40:54.018063 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6415): Terminated: ok {rc=0} 06:40:54.065362 --- ParallelTerminationStrategy: PID 6418 died... 06:40:54.085077 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6418): Terminated: ok {rc=0} 06:40:54.131947 --- ParallelTerminationStrategy: PID 6421 died... 06:40:54.151421 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6421): Terminated: ok {rc=0} 06:40:54.239630 bus /gobi_0: Setting Powered False 06:40:55.337440 bus /gobi_0: Setting Powered False 06:40:56.452589 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2370 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 nitb_smpp --------------------------------------------------------------------- 06:40:57.702960 tst nitb_smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:40:57.705579 tst nitb_smpp: Verifying 1 x bts (candidates: 11) 06:40:57.725749 tst nitb_smpp: Verifying 1 x ip_address (candidates: 9) 06:40:57.733149 tst nitb_smpp: Verifying 1 x modem (candidates: 12) 06:40:57.766227 tst nitb_smpp: Reserving 1 x bts (candidates: 11) 06:40:57.786218 tst nitb_smpp: Reserving 1 x ip_address (candidates: 9) 06:40:57.792676 tst nitb_smpp: Reserving 1 x modem (candidates: 12) 06:40:58.313738 tst nitb_smpp: RESERVED RESOURCES for nitb_smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2370 nitb_smpp esme_connect_policy_acceptall.py ---------------------------------------------- 06:40:58.318843 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 06:40:58.337203 tst esme_connect_policy_acceptall.py: using MSISDN 7590 06:40:58.466326 run osmo-nitb_10.42.42.2: Starting osmo-nitb 06:40:59.017940 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6427): Launched 06:40:59.313577 run osmo-nitb_10.42.42.2(pid=6428): Launched 06:40:59.477516 run osmo-nitb_10.42.42.2(pid=6428): ERR: Terminated: ERROR {rc=2} [trial-2370↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6428)] 06:40:59.610859 run osmo-nitb_10.42.42.2(pid=6428): stdout: | (launched: 2022-12-10_06:40:59.259011) 06:40:59.745487 run osmo-nitb_10.42.42.2(pid=6428): stderr: | (launched: 2022-12-10_06:40:59.302813) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:40:59.880051 run osmo-nitb_10.42.42.2(pid=6428): stdout: | (launched: 2022-12-10_06:40:59.259011) 06:41:00.008255 run osmo-nitb_10.42.42.2(pid=6428): stderr: | (launched: 2022-12-10_06:40:59.302813) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=6428): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6428) [trial-2370↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6428)] 06:41:00.425217 tst osmo-nitb_10.42.42.2(pid=6428): stdout: | (launched: 2022-12-10_06:40:59.259011) 06:41:00.544898 tst osmo-nitb_10.42.42.2(pid=6428): stderr: | (launched: 2022-12-10_06:40:59.302813) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:41:00.686506 tst esme_connect_policy_acceptall.py:18: ERR: Error: osmo-nitb_10.42.42.2(pid=6428): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6428) [trial-2370↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6428)] [trial-2370↪nitb_smpp↪esme_connect_policy_acceptall.py:18] 06:41:00.694865 tst esme_connect_policy_acceptall.py:18: Test FAILED (2.4 sec) 06:41:00.701570 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6427): Terminating (SIGTERM) 06:41:00.910305 --- ParallelTerminationStrategy: PID 6427 died... 06:41:00.933414 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6427): Terminated: ok {rc=0} ---------------------------------------------- trial-2370 nitb_smpp esme_connect_policy_closed.py ---------------------------------------------- 06:41:01.004429 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 06:41:01.027635 tst esme_connect_policy_closed.py: using MSISDN 7591 06:41:01.180363 tst esme_connect_policy_closed.py: using MSISDN 7592 06:41:01.322026 run osmo-nitb_10.42.42.2: Starting osmo-nitb 06:41:01.903407 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6429): Launched 06:41:02.216140 run osmo-nitb_10.42.42.2(pid=6430): Launched 06:41:02.395309 run osmo-nitb_10.42.42.2(pid=6430): ERR: Terminated: ERROR {rc=2} [trial-2370↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6430)] 06:41:02.525816 run osmo-nitb_10.42.42.2(pid=6430): stdout: | (launched: 2022-12-10_06:41:02.154288) 06:41:02.657403 run osmo-nitb_10.42.42.2(pid=6430): stderr: | (launched: 2022-12-10_06:41:02.198765) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:41:02.789167 run osmo-nitb_10.42.42.2(pid=6430): stdout: | (launched: 2022-12-10_06:41:02.154288) 06:41:02.914452 run osmo-nitb_10.42.42.2(pid=6430): stderr: | (launched: 2022-12-10_06:41:02.198765) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:41:03.064616 tst esme_connect_policy_closed.py:24: ERR: Error: osmo-nitb_10.42.42.2(pid=6430): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6430) [trial-2370↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6430)] [trial-2370↪nitb_smpp↪esme_connect_policy_closed.py:24] 06:41:03.073612 tst esme_connect_policy_closed.py:24: Test FAILED (2.1 sec) 06:41:03.080522 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6429): Terminating (SIGTERM) 06:41:03.290642 --- ParallelTerminationStrategy: PID 6429 died... 06:41:03.311928 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6429): Terminated: ok {rc=0} ---------------------------------------------- trial-2370 nitb_smpp esme_ms_sms_storeforward.py ---------------------------------------------- 06:41:03.362080 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 06:41:03.373574 tst nitb_smpp: Using 1 x bts (candidates: 1) 06:41:03.410570 tst esme_ms_sms_storeforward.py: using LAC 26554 06:41:03.529752 tst esme_ms_sms_storeforward.py: using RAC 34 06:41:03.654461 tst esme_ms_sms_storeforward.py: using CellId 26554 06:41:03.771301 tst esme_ms_sms_storeforward.py: using BVCI 26555 06:41:03.879826 tst nitb_smpp: Using 1 x modem (candidates: 1) 06:41:04.007230 tst esme_ms_sms_storeforward.py: using MSISDN 7593 06:41:04.122377 tst esme_ms_sms_storeforward.py:20: start nitb and bts... 06:41:04.337687 run osmo-nitb_10.42.42.2: Starting osmo-nitb 06:41:04.987269 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6431): Launched 06:41:05.305797 run osmo-nitb_10.42.42.2(pid=6432): Launched 06:41:05.478258 run osmo-nitb_10.42.42.2(pid=6432): ERR: Terminated: ERROR {rc=2} [trial-2370↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6432)] 06:41:05.609508 run osmo-nitb_10.42.42.2(pid=6432): stdout: | (launched: 2022-12-10_06:41:05.248284) 06:41:05.741579 run osmo-nitb_10.42.42.2(pid=6432): stderr: | (launched: 2022-12-10_06:41:05.295655) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:41:05.874809 run osmo-nitb_10.42.42.2(pid=6432): stdout: | (launched: 2022-12-10_06:41:05.248284) 06:41:06.000720 run osmo-nitb_10.42.42.2(pid=6432): stderr: | (launched: 2022-12-10_06:41:05.295655) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:41:06.152070 tst esme_ms_sms_storeforward.py:23: ERR: Error: osmo-nitb_10.42.42.2(pid=6432): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6432) [trial-2370↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6432)] [trial-2370↪nitb_smpp↪esme_ms_sms_storeforward.py:23] 06:41:06.161089 tst esme_ms_sms_storeforward.py:23: Test FAILED (2.8 sec) 06:41:06.167999 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6431): Terminating (SIGTERM) 06:41:06.377667 --- ParallelTerminationStrategy: PID 6431 died... 06:41:06.399149 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6431): Terminated: ok {rc=0} 06:41:06.486392 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2370 nitb_smpp esme_ms_sms_transaction.py ---------------------------------------------- 06:41:07.572798 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 06:41:07.584136 tst nitb_smpp: Using 1 x bts (candidates: 1) 06:41:07.620748 tst esme_ms_sms_transaction.py: using LAC 26555 06:41:07.748487 tst esme_ms_sms_transaction.py: using RAC 35 06:41:07.875603 tst esme_ms_sms_transaction.py: using CellId 26555 06:41:07.999808 tst esme_ms_sms_transaction.py: using BVCI 26556 06:41:08.115477 tst nitb_smpp: Using 1 x modem (candidates: 1) 06:41:08.239507 tst esme_ms_sms_transaction.py: using MSISDN 7594 06:41:08.349452 tst esme_ms_sms_transaction.py:18: start nitb and bts... 06:41:08.549048 run osmo-nitb_10.42.42.2: Starting osmo-nitb 06:41:09.196281 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6435): Launched 06:41:09.514185 run osmo-nitb_10.42.42.2(pid=6436): Launched 06:41:09.690009 run osmo-nitb_10.42.42.2(pid=6436): ERR: Terminated: ERROR {rc=2} [trial-2370↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6436)] 06:41:09.833215 run osmo-nitb_10.42.42.2(pid=6436): stdout: | (launched: 2022-12-10_06:41:09.456219) 06:41:09.977258 run osmo-nitb_10.42.42.2(pid=6436): stderr: | (launched: 2022-12-10_06:41:09.503763) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:41:10.121434 run osmo-nitb_10.42.42.2(pid=6436): stdout: | (launched: 2022-12-10_06:41:09.456219) 06:41:10.259281 run osmo-nitb_10.42.42.2(pid=6436): stderr: | (launched: 2022-12-10_06:41:09.503763) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=6436): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6436) [trial-2370↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6436)] 06:41:10.633566 tst osmo-nitb_10.42.42.2(pid=6436): stdout: | (launched: 2022-12-10_06:41:09.456219) 06:41:10.762414 tst osmo-nitb_10.42.42.2(pid=6436): stderr: | (launched: 2022-12-10_06:41:09.503763) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:41:10.914161 tst esme_ms_sms_transaction.py:21: ERR: Error: osmo-nitb_10.42.42.2(pid=6436): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6436) [trial-2370↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6436)] [trial-2370↪nitb_smpp↪esme_ms_sms_transaction.py:21] 06:41:10.923143 tst esme_ms_sms_transaction.py:21: Test FAILED (3.3 sec) 06:41:10.930131 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6435): Terminating (SIGTERM) 06:41:11.141733 --- ParallelTerminationStrategy: PID 6435 died... 06:41:11.163426 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6435): Terminated: ok {rc=0} 06:41:11.252699 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 nitb_smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 smpp --------------------------------------------------------------------- 06:41:12.417146 tst smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:41:12.419913 tst smpp: Verifying 1 x bts (candidates: 11) 06:41:12.440290 tst smpp: Verifying 6 x ip_address (candidates: 9) 06:41:12.467495 tst smpp: Verifying 1 x modem (candidates: 12) 06:41:12.503077 tst smpp: Reserving 1 x bts (candidates: 11) 06:41:12.524427 tst smpp: Reserving 6 x ip_address (candidates: 9) 06:41:12.552609 tst smpp: Reserving 1 x modem (candidates: 12) 06:41:13.078753 tst smpp: RESERVED RESOURCES for smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2370 smpp esme_connect_policy_acceptall.py ---------------------------------------------- 06:41:13.083807 tst smpp: Using 1 x ip_address (candidates: 6) 06:41:13.094635 tst smpp: Using 1 x ip_address (candidates: 6) 06:41:13.105855 tst smpp: Using 1 x ip_address (candidates: 6) 06:41:13.117438 tst smpp: Using 1 x ip_address (candidates: 6) 06:41:13.136805 tst esme_connect_policy_acceptall.py: using MSISDN 7595 06:41:13.252430 run osmo-stp_10.42.42.4: Starting osmo-stp 06:41:13.793030 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=6440): Launched 06:41:14.110014 run osmo-stp_10.42.42.4(pid=6441): Launched 06:41:14.231055 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:41:14.722747 run create_hlr_db(pid=6442): Launched 06:41:14.854017 bus /sierra_2: Setting Powered False 06:41:15.932862 run create_hlr_db(pid=6442): Terminated: ok {rc=0} 06:41:16.415269 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6444): Launched 06:41:16.746968 run osmo-hlr_10.42.42.2(pid=6445): Launched 06:41:17.034393 run osmo-msc_10.42.42.5: Starting osmo-msc 06:41:17.686905 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6447): Launched 06:41:18.007340 run osmo-msc_10.42.42.5(pid=6448): Launched 06:41:18.185214 run osmo-hlr_10.42.42.2(pid=6445): ERR: Terminated: ERROR {rc=237} [trial-2370↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6445)] 06:41:18.321017 run osmo-hlr_10.42.42.2(pid=6445): stdout: | (launched: 2022-12-10_06:41:16.686095) 06:41:18.456013 run osmo-hlr_10.42.42.2(pid=6445): stderr: | 20221210064117029 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210064117029 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210064117029 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210064117029 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210064117029 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210064117030 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210064117050 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210064117068 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210064117068 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210064117068 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:41:18.590817 run osmo-hlr_10.42.42.2(pid=6445): stdout: | (launched: 2022-12-10_06:41:16.686095) 06:41:18.718309 run osmo-hlr_10.42.42.2(pid=6445): stderr: | 20221210064117029 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210064117029 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210064117029 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210064117029 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210064117029 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210064117030 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210064117050 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210064117068 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210064117068 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210064117068 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:41:18.870873 tst esme_connect_policy_acceptall.py:23: ERR: Error: osmo-hlr_10.42.42.2(pid=6445): Process ended prematurely: osmo-hlr_10.42.42.2(pid=6445) [trial-2370↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6445)] [trial-2370↪smpp↪esme_connect_policy_acceptall.py:23] 06:41:18.879669 tst esme_connect_policy_acceptall.py:23: Test FAILED (5.8 sec) 06:41:18.906851 run osmo-msc_10.42.42.5(pid=6448): ERR: Terminated: ERROR {rc=9} [trial-2370↪smpp↪esme_connect_policy_acceptall.py↪esme_connect_policy_acceptall.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=6448)] 06:41:18.956622 run osmo-msc_10.42.42.5(pid=6448): stdout: | (launched: 2022-12-10_06:41:17.949102) 06:41:19.008356 run osmo-msc_10.42.42.5(pid=6448): stderr: | 20221210064118309 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | 20221210064118309 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | 20221210064118309 DLSS7 DEBUG XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210064118309 DLSCCP NOTICE OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | 20221210064118309 DLSS7 NOTICE 0: Creating SCCP instance (osmo_ss7.c:458) | 20221210064118309 DLSCCP INFO Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | 20221210064118309 DLSS7 DEBUG registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | 20221210064118310 DLGLOBAL NOTICE unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221210064118310 DSGS ERROR SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 06:41:19.060253 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=6440): Terminating (SIGTERM) 06:41:19.101948 run osmo-stp_10.42.42.4(pid=6441): Terminating (SIGTERM) 06:41:19.143593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6444): Terminating (SIGTERM) 06:41:19.186611 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6447): Terminating (SIGTERM) 06:41:19.230624 --- ParallelTerminationStrategy: PID 6440 died... 06:41:19.250955 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=6440): Terminated: ok {rc=0} 06:41:19.298049 --- ParallelTerminationStrategy: PID 6441 died... 06:41:19.317520 run osmo-stp_10.42.42.4(pid=6441): Terminated: ok {rc=0} 06:41:19.363521 --- ParallelTerminationStrategy: PID 6444 died... 06:41:19.382881 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6444): Terminated: ok {rc=0} 06:41:19.428706 --- ParallelTerminationStrategy: PID 6447 died... 06:41:19.448081 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6447): Terminated: ok {rc=0} ---------------------------------------------- trial-2370 smpp esme_connect_policy_closed.py ---------------------------------------------- 06:41:19.498968 tst smpp: Using 1 x ip_address (candidates: 6) 06:41:19.510469 tst smpp: Using 1 x bts (candidates: 1) 06:41:19.551535 tst esme_connect_policy_closed.py: using LAC 26556 06:41:19.679818 tst esme_connect_policy_closed.py: using RAC 36 06:41:19.803731 tst esme_connect_policy_closed.py: using CellId 26556 06:41:19.928646 tst esme_connect_policy_closed.py: using BVCI 26557 06:41:20.046957 tst smpp: Using 1 x ip_address (candidates: 6) 06:41:20.057838 tst smpp: Using 1 x ip_address (candidates: 6) 06:41:20.068429 tst smpp: Using 1 x ip_address (candidates: 6) 06:41:20.087772 tst esme_connect_policy_closed.py: using MSISDN 7596 06:41:20.213976 tst esme_connect_policy_closed.py: using MSISDN 7597 06:41:20.330043 run osmo-stp_10.42.42.4: Starting osmo-stp 06:41:20.876522 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=6451): Launched 06:41:21.197695 run osmo-stp_10.42.42.4(pid=6452): Launched 06:41:21.320765 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:41:21.818262 run create_hlr_db(pid=6453): Launched 06:41:23.006567 run create_hlr_db(pid=6453): Terminated: ok {rc=0} 06:41:23.346005 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6455): Launched 06:41:23.667603 run osmo-hlr_10.42.42.2(pid=6456): Launched 06:41:23.789631 run osmo-msc_10.42.42.5: Starting osmo-msc 06:41:24.371582 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6458): Launched 06:41:24.693714 run osmo-msc_10.42.42.5(pid=6459): Launched 06:41:24.872045 run osmo-hlr_10.42.42.2(pid=6456): ERR: Terminated: ERROR {rc=237} [trial-2370↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6456)] 06:41:25.009302 run osmo-hlr_10.42.42.2(pid=6456): stdout: | (launched: 2022-12-10_06:41:23.608631) 06:41:25.145123 run osmo-hlr_10.42.42.2(pid=6456): stderr: | 20221210064123802 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210064123802 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210064123802 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210064123802 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210064123802 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210064123802 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210064123814 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210064123823 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210064123823 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210064123823 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:41:25.280753 run osmo-hlr_10.42.42.2(pid=6456): stdout: | (launched: 2022-12-10_06:41:23.608631) 06:41:25.408733 run osmo-hlr_10.42.42.2(pid=6456): stderr: | 20221210064123802 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210064123802 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210064123802 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210064123802 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210064123802 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210064123802 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210064123814 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210064123823 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210064123823 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210064123823 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:41:25.562022 tst esme_connect_policy_closed.py:31: ERR: Error: osmo-hlr_10.42.42.2(pid=6456): Process ended prematurely: osmo-hlr_10.42.42.2(pid=6456) [trial-2370↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6456)] [trial-2370↪smpp↪esme_connect_policy_closed.py:31] 06:41:25.570995 tst esme_connect_policy_closed.py:31: Test FAILED (6.1 sec) 06:41:25.598144 run osmo-msc_10.42.42.5(pid=6459): ERR: Terminated: ERROR {rc=9} [trial-2370↪smpp↪esme_connect_policy_closed.py↪esme_connect_policy_closed.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=6459)] 06:41:25.648337 run osmo-msc_10.42.42.5(pid=6459): stdout: | (launched: 2022-12-10_06:41:24.635264) 06:41:25.700363 run osmo-msc_10.42.42.5(pid=6459): stderr: | 20221210064125018 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | 20221210064125018 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | 20221210064125018 DLSS7 DEBUG XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210064125018 DLSCCP NOTICE OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | 20221210064125018 DLSS7 NOTICE 0: Creating SCCP instance (osmo_ss7.c:458) | 20221210064125019 DLSCCP INFO Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | 20221210064125019 DLSS7 DEBUG registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | 20221210064125019 DLGLOBAL NOTICE unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221210064125019 DSGS ERROR SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 06:41:25.752507 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=6451): Terminating (SIGTERM) 06:41:25.794336 run osmo-stp_10.42.42.4(pid=6452): Terminating (SIGTERM) 06:41:25.835867 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6455): Terminating (SIGTERM) 06:41:25.878776 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6458): Terminating (SIGTERM) 06:41:25.923380 --- ParallelTerminationStrategy: PID 6451 died... 06:41:25.944103 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=6451): Terminated: ok {rc=0} 06:41:25.992145 --- ParallelTerminationStrategy: PID 6452 died... 06:41:26.011526 run osmo-stp_10.42.42.4(pid=6452): Terminated: ok {rc=0} 06:41:26.057175 --- ParallelTerminationStrategy: PID 6455 died... 06:41:26.076560 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6455): Terminated: ok {rc=0} 06:41:26.122432 --- ParallelTerminationStrategy: PID 6458 died... 06:41:26.141895 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6458): Terminated: ok {rc=0} ---------------------------------------------- trial-2370 smpp esme_ms_sms_storeforward.py ---------------------------------------------- 06:41:26.192546 tst smpp: Using 1 x ip_address (candidates: 6) 06:41:26.204065 tst smpp: Using 1 x bts (candidates: 1) 06:41:26.240500 tst esme_ms_sms_storeforward.py: using LAC 26557 06:41:26.369719 tst esme_ms_sms_storeforward.py: using RAC 37 06:41:26.496743 tst esme_ms_sms_storeforward.py: using CellId 26557 06:41:26.622657 tst esme_ms_sms_storeforward.py: using BVCI 26558 06:41:26.741207 tst smpp: Using 1 x ip_address (candidates: 6) 06:41:26.751998 tst smpp: Using 1 x ip_address (candidates: 6) 06:41:26.762810 tst smpp: Using 1 x ip_address (candidates: 6) 06:41:26.773504 tst smpp: Using 1 x ip_address (candidates: 6) 06:41:26.784126 tst smpp: Using 1 x ip_address (candidates: 6) 06:41:26.794851 tst smpp: Using 1 x modem (candidates: 1) 06:41:26.922933 tst esme_ms_sms_storeforward.py: using MSISDN 7598 06:41:27.040509 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:41:27.538237 run create_hlr_db(pid=6462): Launched 06:41:28.726228 run create_hlr_db(pid=6462): Terminated: ok {rc=0} 06:41:29.065497 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6464): Launched 06:41:29.386557 run osmo-hlr_10.42.42.2(pid=6465): Launched 06:41:29.510688 run osmo-stp_10.42.42.5: Starting osmo-stp 06:41:30.067668 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6467): Launched 06:41:30.389190 run osmo-stp_10.42.42.5(pid=6468): Launched 06:41:30.512475 run osmo-msc_10.42.42.6: Starting osmo-msc 06:41:31.107643 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6470): Launched 06:41:31.481749 run osmo-msc_10.42.42.6(pid=6471): Launched 06:41:31.691803 run osmo-stp_10.42.42.5(pid=6468): ERR: Terminated: ERROR {rc=1} [trial-2370↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6468)] 06:41:32.013951 run osmo-stp_10.42.42.5(pid=6468): stdout: | (launched: 2022-12-10_06:41:30.330552) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:41:32.285240 run osmo-stp_10.42.42.5(pid=6468): stderr: | 20221210064130520 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210064130520 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210064130520 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210064130521 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210064130521 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210064130521 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210064130521 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:41:32.428593 run osmo-stp_10.42.42.5(pid=6468): stdout: | (launched: 2022-12-10_06:41:30.330552) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:41:32.556398 run osmo-stp_10.42.42.5(pid=6468): stderr: | 20221210064130520 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210064130520 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210064130520 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210064130521 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210064130521 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210064130521 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210064130521 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:41:32.708879 tst esme_ms_sms_storeforward.py:30: ERR: Error: osmo-stp_10.42.42.5(pid=6468): Process ended prematurely: osmo-stp_10.42.42.5(pid=6468) [trial-2370↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6468)] [trial-2370↪smpp↪esme_ms_sms_storeforward.py:30] 06:41:32.717925 tst esme_ms_sms_storeforward.py:30: Test FAILED (6.5 sec) 06:41:32.745093 run osmo-hlr_10.42.42.2(pid=6465): ERR: Terminated: ERROR {rc=237} [trial-2370↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6465)] 06:41:32.794707 run osmo-hlr_10.42.42.2(pid=6465): stdout: | (launched: 2022-12-10_06:41:29.328065) 06:41:32.846215 run osmo-hlr_10.42.42.2(pid=6465): stderr: | 20221210064129526 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210064129526 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210064129526 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210064129526 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210064129526 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210064129526 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210064129538 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/smpp/esme_ms_sms_storeforward.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210064129546 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210064129547 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210064129547 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:41:32.918021 run osmo-msc_10.42.42.6(pid=6471): ERR: Terminated: ERROR {rc=2} [trial-2370↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6471)] 06:41:32.967741 run osmo-msc_10.42.42.6(pid=6471): stdout: | (launched: 2022-12-10_06:41:31.419642) 06:41:33.018867 run osmo-msc_10.42.42.6(pid=6471): stderr: | 20221210064131922 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210064131922 DLGLOBAL DEBUG validating counter group 0x7f9098a16c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210064131922 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210064131922 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210064131922 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210064131922 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210064131924 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210064131925 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210064131925 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210064131925 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:41:33.070626 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6464): Terminating (SIGTERM) 06:41:33.112160 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6467): Terminating (SIGTERM) 06:41:33.153526 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6470): Terminating (SIGTERM) 06:41:33.195123 --- ParallelTerminationStrategy: PID 6464 died... 06:41:33.215003 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6464): Terminated: ok {rc=0} 06:41:33.261328 --- ParallelTerminationStrategy: PID 6467 died... 06:41:33.280749 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6467): Terminated: ok {rc=0} 06:41:33.326606 --- ParallelTerminationStrategy: PID 6470 died... 06:41:33.346151 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6470): Terminated: ok {rc=0} 06:41:33.433223 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2370 smpp esme_ms_sms_transaction.py ---------------------------------------------- 06:41:34.518913 tst smpp: Using 1 x ip_address (candidates: 6) 06:41:34.530213 tst smpp: Using 1 x bts (candidates: 1) 06:41:34.567417 tst esme_ms_sms_transaction.py: using LAC 26558 06:41:34.686833 tst esme_ms_sms_transaction.py: using RAC 38 06:41:34.806802 tst esme_ms_sms_transaction.py: using CellId 26558 06:41:34.925547 tst esme_ms_sms_transaction.py: using BVCI 26559 06:41:35.034574 tst smpp: Using 1 x ip_address (candidates: 6) 06:41:35.045050 tst smpp: Using 1 x ip_address (candidates: 6) 06:41:35.055422 tst smpp: Using 1 x ip_address (candidates: 6) 06:41:35.066091 tst smpp: Using 1 x ip_address (candidates: 6) 06:41:35.076546 tst smpp: Using 1 x ip_address (candidates: 6) 06:41:35.086935 tst smpp: Using 1 x modem (candidates: 1) 06:41:35.211975 tst esme_ms_sms_transaction.py: using MSISDN 7599 06:41:35.322761 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:41:35.788705 run create_hlr_db(pid=6473): Launched 06:41:35.903573 bus /sierra_2: Setting Powered False 06:41:36.963150 run create_hlr_db(pid=6473): Terminated: ok {rc=0} 06:41:37.404215 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6475): Launched 06:41:37.726920 run osmo-hlr_10.42.42.2(pid=6476): Launched 06:41:37.849795 run osmo-stp_10.42.42.5: Starting osmo-stp 06:41:38.400929 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6478): Launched 06:41:38.720730 run osmo-stp_10.42.42.5(pid=6479): Launched 06:41:38.843232 run osmo-msc_10.42.42.6: Starting osmo-msc 06:41:39.421207 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6481): Launched 06:41:39.741285 run osmo-msc_10.42.42.6(pid=6482): Launched 06:41:39.920663 run osmo-stp_10.42.42.5(pid=6479): ERR: Terminated: ERROR {rc=1} [trial-2370↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6479)] 06:41:40.058043 run osmo-stp_10.42.42.5(pid=6479): stdout: | (launched: 2022-12-10_06:41:38.662373) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:41:40.196300 run osmo-stp_10.42.42.5(pid=6479): stderr: | 20221210064138854 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210064138854 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210064138855 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210064138855 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210064138855 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210064138856 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210064138856 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:41:40.331170 run osmo-stp_10.42.42.5(pid=6479): stdout: | (launched: 2022-12-10_06:41:38.662373) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:41:40.458753 run osmo-stp_10.42.42.5(pid=6479): stderr: | 20221210064138854 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210064138854 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210064138855 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210064138855 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210064138855 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210064138856 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210064138856 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:41:40.611872 tst esme_ms_sms_transaction.py:28: ERR: Error: osmo-stp_10.42.42.5(pid=6479): Process ended prematurely: osmo-stp_10.42.42.5(pid=6479) [trial-2370↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6479)] [trial-2370↪smpp↪esme_ms_sms_transaction.py:28] 06:41:40.620855 tst esme_ms_sms_transaction.py:28: Test FAILED (6.1 sec) 06:41:40.648301 run osmo-hlr_10.42.42.2(pid=6476): ERR: Terminated: ERROR {rc=237} [trial-2370↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6476)] 06:41:40.698346 run osmo-hlr_10.42.42.2(pid=6476): stdout: | (launched: 2022-12-10_06:41:37.668462) 06:41:40.749984 run osmo-hlr_10.42.42.2(pid=6476): stderr: | 20221210064137867 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210064137867 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210064137867 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210064137867 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210064137867 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210064137867 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210064137883 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/smpp/esme_ms_sms_transaction.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210064137891 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210064137891 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210064137891 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:41:40.822232 run osmo-msc_10.42.42.6(pid=6482): ERR: Terminated: ERROR {rc=2} [trial-2370↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6482)] 06:41:40.872259 run osmo-msc_10.42.42.6(pid=6482): stdout: | (launched: 2022-12-10_06:41:39.682920) 06:41:40.923967 run osmo-msc_10.42.42.6(pid=6482): stderr: | 20221210064140003 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210064140003 DLGLOBAL DEBUG validating counter group 0x7ffbd3a58c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210064140003 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210064140003 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210064140003 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210064140003 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210064140005 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210064140006 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210064140006 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210064140006 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:41:40.975950 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6475): Terminating (SIGTERM) 06:41:41.017251 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6478): Terminating (SIGTERM) 06:41:41.058634 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6481): Terminating (SIGTERM) 06:41:41.100499 --- ParallelTerminationStrategy: PID 6475 died... 06:41:41.120323 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6475): Terminated: ok {rc=0} 06:41:41.166177 --- ParallelTerminationStrategy: PID 6478 died... 06:41:41.185626 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6478): Terminated: ok {rc=0} 06:41:41.231481 --- ParallelTerminationStrategy: PID 6481 died... 06:41:41.251122 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6481): Terminated: ok {rc=0} 06:41:41.339052 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 encryption --------------------------------------------------------------------- 06:41:42.527369 tst encryption: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:41:42.530461 tst encryption: Verifying 1 x bts (candidates: 11) 06:41:42.551068 tst encryption: Verifying 6 x ip_address (candidates: 9) 06:41:42.580007 tst encryption: Verifying 1 x modem (candidates: 12) 06:41:42.614658 tst encryption: Reserving 1 x bts (candidates: 11) 06:41:42.635403 tst encryption: Reserving 6 x ip_address (candidates: 9) 06:41:42.662493 tst encryption: Reserving 1 x modem (candidates: 12) 06:41:43.189354 tst encryption: RESERVED RESOURCES for encryption: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2370 encryption register_a5_0_authopt.py ---------------------------------------------- 06:41:43.244563 tst encryption: Using 1 x ip_address (candidates: 6) 06:41:43.255634 tst encryption: Using 1 x bts (candidates: 1) 06:41:43.292053 tst register_a5_0_authopt.py: using LAC 26559 06:41:43.420687 tst register_a5_0_authopt.py: using RAC 39 06:41:43.541485 tst register_a5_0_authopt.py: using CellId 26559 06:41:43.668418 tst register_a5_0_authopt.py: using BVCI 26560 06:41:43.787915 tst encryption: Using 1 x ip_address (candidates: 6) 06:41:43.798994 tst encryption: Using 1 x ip_address (candidates: 6) 06:41:43.809905 tst encryption: Using 1 x ip_address (candidates: 6) 06:41:43.821286 tst encryption: Using 1 x ip_address (candidates: 6) 06:41:43.832481 tst encryption: Using 1 x ip_address (candidates: 6) 06:41:43.843645 tst encryption: Using 1 x modem (candidates: 1) 06:41:43.956467 tst register_a5_0_authopt.py:8: start network... 06:41:44.162659 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:41:44.633316 run create_hlr_db(pid=6487): Launched 06:41:44.750150 bus /sierra_2: Setting Powered False 06:41:45.811615 run create_hlr_db(pid=6487): Terminated: ok {rc=0} 06:41:46.268442 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6489): Launched 06:41:46.581163 run osmo-hlr_10.42.42.2(pid=6490): Launched 06:41:46.813890 run osmo-stp_10.42.42.5: Starting osmo-stp 06:41:47.529115 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6492): Launched 06:41:47.831815 run osmo-stp_10.42.42.5(pid=6493): Launched 06:41:47.948225 run osmo-msc_10.42.42.6: Starting osmo-msc 06:41:48.495051 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6495): Launched 06:41:48.797447 run osmo-msc_10.42.42.6(pid=6496): Launched 06:41:48.966757 run osmo-stp_10.42.42.5(pid=6493): ERR: Terminated: ERROR {rc=1} [trial-2370↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6493)] 06:41:49.094676 run osmo-stp_10.42.42.5(pid=6493): stdout: | (launched: 2022-12-10_06:41:47.776013) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:41:49.223309 run osmo-stp_10.42.42.5(pid=6493): stderr: | 20221210064147946 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210064147946 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210064147946 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210064147947 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210064147949 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210064147949 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210064147949 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:41:49.349348 run osmo-stp_10.42.42.5(pid=6493): stdout: | (launched: 2022-12-10_06:41:47.776013) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:41:49.469239 run osmo-stp_10.42.42.5(pid=6493): stderr: | 20221210064147946 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210064147946 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210064147946 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210064147947 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210064147949 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210064147949 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210064147949 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:41:49.613271 tst register_a5_0_authopt.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6493): Process ended prematurely: osmo-stp_10.42.42.5(pid=6493) [trial-2370↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6493)] [trial-2370↪encryption↪register_a5_0_authopt.py:8] 06:41:49.622139 tst register_a5_0_authopt.py:8: Test FAILED (6.4 sec) 06:41:49.648278 run osmo-hlr_10.42.42.2(pid=6490): ERR: Terminated: ERROR {rc=237} [trial-2370↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6490)] 06:41:49.695427 run osmo-hlr_10.42.42.2(pid=6490): stdout: | (launched: 2022-12-10_06:41:46.521980) 06:41:49.744120 run osmo-hlr_10.42.42.2(pid=6490): stderr: | 20221210064146860 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210064146860 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210064146860 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210064146860 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210064146860 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210064146860 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210064146887 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/encryption/register_a5_0_authopt.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210064146904 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210064146904 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210064146904 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:41:49.812119 run osmo-msc_10.42.42.6(pid=6496): ERR: Terminated: ERROR {rc=2} [trial-2370↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6496)] 06:41:49.859076 run osmo-msc_10.42.42.6(pid=6496): stdout: | (launched: 2022-12-10_06:41:48.742005) 06:41:49.907728 run osmo-msc_10.42.42.6(pid=6496): stderr: | 20221210064149015 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210064149015 DLGLOBAL DEBUG validating counter group 0x7f3470099c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210064149016 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210064149016 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210064149016 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210064149016 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210064149018 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210064149019 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210064149019 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210064149019 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:41:49.956606 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6489): Terminating (SIGTERM) 06:41:49.995717 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6492): Terminating (SIGTERM) 06:41:50.034928 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6495): Terminating (SIGTERM) 06:41:50.074257 --- ParallelTerminationStrategy: PID 6489 died... 06:41:50.092875 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6489): Terminated: ok {rc=0} 06:41:50.136575 --- ParallelTerminationStrategy: PID 6492 died... 06:41:50.154811 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6492): Terminated: ok {rc=0} 06:41:50.199299 --- ParallelTerminationStrategy: PID 6495 died... 06:41:50.217842 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6495): Terminated: ok {rc=0} 06:41:50.303367 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2370 encryption register_a5_0_authreq.py ---------------------------------------------- 06:41:51.452483 tst encryption: Using 1 x ip_address (candidates: 6) 06:41:51.463712 tst encryption: Using 1 x bts (candidates: 1) 06:41:51.500625 tst register_a5_0_authreq.py: using LAC 26560 06:41:51.622804 tst register_a5_0_authreq.py: using RAC 40 06:41:51.747853 tst register_a5_0_authreq.py: using CellId 26560 06:41:51.875752 tst register_a5_0_authreq.py: using BVCI 26561 06:41:51.993979 tst encryption: Using 1 x ip_address (candidates: 6) 06:41:52.004786 tst encryption: Using 1 x ip_address (candidates: 6) 06:41:52.015606 tst encryption: Using 1 x ip_address (candidates: 6) 06:41:52.026427 tst encryption: Using 1 x ip_address (candidates: 6) 06:41:52.037241 tst encryption: Using 1 x ip_address (candidates: 6) 06:41:52.047855 tst encryption: Using 1 x modem (candidates: 1) 06:41:52.162907 tst register_a5_0_authreq.py:8: start network... 06:41:52.367411 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:41:52.836139 run create_hlr_db(pid=6498): Launched 06:41:52.954127 bus /sierra_2: Setting Powered False 06:41:54.018641 run create_hlr_db(pid=6498): Terminated: ok {rc=0} 06:41:54.470095 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6500): Launched 06:41:54.795981 run osmo-hlr_10.42.42.2(pid=6501): Launched 06:41:54.920152 run osmo-stp_10.42.42.5: Starting osmo-stp 06:41:55.477440 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6503): Launched 06:41:55.801998 run osmo-stp_10.42.42.5(pid=6504): Launched 06:41:55.925926 run osmo-msc_10.42.42.6: Starting osmo-msc 06:41:56.512168 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6506): Launched 06:41:56.837809 run osmo-msc_10.42.42.6(pid=6507): Launched 06:41:57.018794 run osmo-stp_10.42.42.5(pid=6504): ERR: Terminated: ERROR {rc=1} [trial-2370↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6504)] 06:41:57.154586 run osmo-stp_10.42.42.5(pid=6504): stdout: | (launched: 2022-12-10_06:41:55.743124) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:41:57.290839 run osmo-stp_10.42.42.5(pid=6504): stderr: | 20221210064155936 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210064155936 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210064155937 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210064155937 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210064155937 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210064155938 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210064155938 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:41:57.426938 run osmo-stp_10.42.42.5(pid=6504): stdout: | (launched: 2022-12-10_06:41:55.743124) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:41:57.556171 run osmo-stp_10.42.42.5(pid=6504): stderr: | 20221210064155936 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210064155936 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210064155937 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210064155937 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210064155937 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210064155938 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210064155938 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:41:57.710386 tst register_a5_0_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6504): Process ended prematurely: osmo-stp_10.42.42.5(pid=6504) [trial-2370↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6504)] [trial-2370↪encryption↪register_a5_0_authreq.py:8] 06:41:57.719893 tst register_a5_0_authreq.py:8: Test FAILED (6.3 sec) 06:41:57.747391 run osmo-hlr_10.42.42.2(pid=6501): ERR: Terminated: ERROR {rc=237} [trial-2370↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6501)] 06:41:57.796771 run osmo-hlr_10.42.42.2(pid=6501): stdout: | (launched: 2022-12-10_06:41:54.736920) 06:41:57.847620 run osmo-hlr_10.42.42.2(pid=6501): stderr: | 20221210064154937 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210064154937 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210064154937 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210064154937 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210064154937 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210064154937 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210064154950 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/encryption/register_a5_0_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210064154958 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210064154958 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210064154959 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:41:57.918673 run osmo-msc_10.42.42.6(pid=6507): ERR: Terminated: ERROR {rc=2} [trial-2370↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6507)] 06:41:57.967936 run osmo-msc_10.42.42.6(pid=6507): stdout: | (launched: 2022-12-10_06:41:56.778374) 06:41:58.018880 run osmo-msc_10.42.42.6(pid=6507): stderr: | 20221210064157100 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210064157100 DLGLOBAL DEBUG validating counter group 0x7f339f780c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210064157100 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210064157100 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210064157100 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210064157101 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210064157102 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210064157103 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210064157103 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210064157103 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:41:58.070084 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6500): Terminating (SIGTERM) 06:41:58.110734 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6503): Terminating (SIGTERM) 06:41:58.151718 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6506): Terminating (SIGTERM) 06:41:58.193123 --- ParallelTerminationStrategy: PID 6500 died... 06:41:58.212584 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6500): Terminated: ok {rc=0} 06:41:58.258380 --- ParallelTerminationStrategy: PID 6503 died... 06:41:58.277598 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6503): Terminated: ok {rc=0} 06:41:58.323078 --- ParallelTerminationStrategy: PID 6506 died... 06:41:58.342402 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6506): Terminated: ok {rc=0} 06:41:58.428198 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2370 encryption register_a5_1_authreq.py ---------------------------------------------- 06:41:59.574229 tst encryption: Using 1 x ip_address (candidates: 6) 06:41:59.585470 tst encryption: Using 1 x bts (candidates: 1) 06:41:59.621375 tst register_a5_1_authreq.py: using LAC 26561 06:41:59.740405 tst register_a5_1_authreq.py: using RAC 41 06:41:59.868116 tst register_a5_1_authreq.py: using CellId 26561 06:41:59.988601 tst register_a5_1_authreq.py: using BVCI 26562 06:42:00.098733 tst encryption: Using 1 x ip_address (candidates: 6) 06:42:00.109451 tst encryption: Using 1 x ip_address (candidates: 6) 06:42:00.119859 tst encryption: Using 1 x ip_address (candidates: 6) 06:42:00.130669 tst encryption: Using 1 x ip_address (candidates: 6) 06:42:00.141681 tst encryption: Using 1 x ip_address (candidates: 6) 06:42:00.152288 tst encryption: Using 1 x modem (candidates: 1) 06:42:00.270579 tst register_a5_1_authreq.py:8: start network... 06:42:00.491260 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:42:01.059014 run create_hlr_db(pid=6514): Launched 06:42:01.239665 bus /sierra_2: Setting Powered False 06:42:02.315102 run create_hlr_db(pid=6514): Terminated: ok {rc=0} 06:42:02.791038 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6516): Launched 06:42:03.116279 run osmo-hlr_10.42.42.2(pid=6517): Launched 06:42:03.239828 run osmo-stp_10.42.42.5: Starting osmo-stp 06:42:03.800240 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6519): Launched 06:42:04.125696 run osmo-stp_10.42.42.5(pid=6520): Launched 06:42:04.249808 run osmo-msc_10.42.42.6: Starting osmo-msc 06:42:04.836194 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6522): Launched 06:42:05.160927 run osmo-msc_10.42.42.6(pid=6523): Launched 06:42:05.342945 run osmo-stp_10.42.42.5(pid=6520): ERR: Terminated: ERROR {rc=1} [trial-2370↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6520)] 06:42:05.480212 run osmo-stp_10.42.42.5(pid=6520): stdout: | (launched: 2022-12-10_06:42:04.066491) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:42:05.618446 run osmo-stp_10.42.42.5(pid=6520): stderr: | 20221210064204262 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210064204262 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210064204263 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210064204263 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210064204263 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210064204264 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210064204264 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:42:05.756136 run osmo-stp_10.42.42.5(pid=6520): stdout: | (launched: 2022-12-10_06:42:04.066491) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:42:05.885385 run osmo-stp_10.42.42.5(pid=6520): stderr: | 20221210064204262 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210064204262 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210064204263 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210064204263 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210064204263 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210064204264 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210064204264 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:42:06.040057 tst register_a5_1_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6520): Process ended prematurely: osmo-stp_10.42.42.5(pid=6520) [trial-2370↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6520)] [trial-2370↪encryption↪register_a5_1_authreq.py:8] 06:42:06.049620 tst register_a5_1_authreq.py:8: Test FAILED (6.5 sec) 06:42:06.077249 run osmo-hlr_10.42.42.2(pid=6517): ERR: Terminated: ERROR {rc=237} [trial-2370↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6517)] 06:42:06.127048 run osmo-hlr_10.42.42.2(pid=6517): stdout: | (launched: 2022-12-10_06:42:03.057124) 06:42:06.178515 run osmo-hlr_10.42.42.2(pid=6517): stderr: | 20221210064203259 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210064203259 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210064203259 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210064203259 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210064203259 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210064203259 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210064203271 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/encryption/register_a5_1_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210064203279 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210064203279 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210064203279 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:42:06.250531 run osmo-msc_10.42.42.6(pid=6523): ERR: Terminated: ERROR {rc=2} [trial-2370↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6523)] 06:42:06.300523 run osmo-msc_10.42.42.6(pid=6523): stdout: | (launched: 2022-12-10_06:42:05.101529) 06:42:06.352193 run osmo-msc_10.42.42.6(pid=6523): stderr: | 20221210064205425 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210064205425 DLGLOBAL DEBUG validating counter group 0x7f61a9454c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210064205425 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210064205425 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210064205425 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210064205425 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210064205427 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210064205427 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210064205428 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210064205428 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:42:06.403938 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6516): Terminating (SIGTERM) 06:42:06.445471 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6519): Terminating (SIGTERM) 06:42:06.487565 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6522): Terminating (SIGTERM) 06:42:06.529655 --- ParallelTerminationStrategy: PID 6516 died... 06:42:06.549694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6516): Terminated: ok {rc=0} 06:42:06.595793 --- ParallelTerminationStrategy: PID 6519 died... 06:42:06.615294 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6519): Terminated: ok {rc=0} 06:42:06.661081 --- ParallelTerminationStrategy: PID 6522 died... 06:42:06.680475 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6522): Terminated: ok {rc=0} 06:42:06.766822 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2370 encryption register_a5_3_authreq.py ---------------------------------------------- 06:42:07.913701 tst encryption: Using 1 x ip_address (candidates: 6) 06:42:07.924784 tst encryption: Using 1 x bts (candidates: 1) 06:42:07.962423 tst register_a5_3_authreq.py: using LAC 26562 06:42:08.091740 tst register_a5_3_authreq.py: using RAC 42 06:42:08.221057 tst register_a5_3_authreq.py: using CellId 26562 06:42:08.348775 tst register_a5_3_authreq.py: using BVCI 26563 06:42:08.467186 tst encryption: Using 1 x ip_address (candidates: 6) 06:42:08.478155 tst encryption: Using 1 x ip_address (candidates: 6) 06:42:08.489500 tst encryption: Using 1 x ip_address (candidates: 6) 06:42:08.500434 tst encryption: Using 1 x ip_address (candidates: 6) 06:42:08.511194 tst encryption: Using 1 x ip_address (candidates: 6) 06:42:08.521920 tst encryption: Using 1 x modem (candidates: 1) 06:42:08.650647 tst register_a5_3_authreq.py:8: start network... 06:42:08.870283 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:42:09.372115 run create_hlr_db(pid=6525): Launched 06:42:09.504745 bus /sierra_2: Setting Powered False 06:42:10.567923 run create_hlr_db(pid=6525): Terminated: ok {rc=0} 06:42:11.001332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6527): Launched 06:42:11.305883 run osmo-hlr_10.42.42.2(pid=6528): Launched 06:42:11.424545 run osmo-stp_10.42.42.5: Starting osmo-stp 06:42:11.953963 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6530): Launched 06:42:12.258522 run osmo-stp_10.42.42.5(pid=6531): Launched 06:42:12.375683 run osmo-msc_10.42.42.6: Starting osmo-msc 06:42:12.925165 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6533): Launched 06:42:13.229934 run osmo-msc_10.42.42.6(pid=6534): Launched 06:42:13.401089 run osmo-stp_10.42.42.5(pid=6531): ERR: Terminated: ERROR {rc=1} [trial-2370↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6531)] 06:42:13.530797 run osmo-stp_10.42.42.5(pid=6531): stdout: | (launched: 2022-12-10_06:42:12.202746) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:42:13.660183 run osmo-stp_10.42.42.5(pid=6531): stderr: | 20221210064212375 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210064212376 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210064212376 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210064212376 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210064212377 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210064212377 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210064212377 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:42:13.786981 run osmo-stp_10.42.42.5(pid=6531): stdout: | (launched: 2022-12-10_06:42:12.202746) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:42:13.908167 run osmo-stp_10.42.42.5(pid=6531): stderr: | 20221210064212375 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210064212376 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210064212376 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210064212376 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210064212377 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210064212377 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210064212377 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:42:14.052713 tst register_a5_3_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6531): Process ended prematurely: osmo-stp_10.42.42.5(pid=6531) [trial-2370↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6531)] [trial-2370↪encryption↪register_a5_3_authreq.py:8] 06:42:14.061564 tst register_a5_3_authreq.py:8: Test FAILED (6.2 sec) 06:42:14.087901 run osmo-hlr_10.42.42.2(pid=6528): ERR: Terminated: ERROR {rc=237} [trial-2370↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6528)] 06:42:14.134908 run osmo-hlr_10.42.42.2(pid=6528): stdout: | (launched: 2022-12-10_06:42:11.250230) 06:42:14.183611 run osmo-hlr_10.42.42.2(pid=6528): stderr: | 20221210064211425 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210064211426 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210064211426 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210064211426 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210064211426 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210064211426 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210064211438 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/encryption/register_a5_3_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210064211448 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210064211448 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210064211448 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:42:14.251233 run osmo-msc_10.42.42.6(pid=6534): ERR: Terminated: ERROR {rc=2} [trial-2370↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6534)] 06:42:14.298190 run osmo-msc_10.42.42.6(pid=6534): stdout: | (launched: 2022-12-10_06:42:13.174152) 06:42:14.347105 run osmo-msc_10.42.42.6(pid=6534): stderr: | 20221210064213445 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210064213445 DLGLOBAL DEBUG validating counter group 0x7fef5dc21c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210064213445 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210064213446 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210064213446 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210064213446 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210064213448 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210064213448 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210064213448 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210064213448 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:42:14.396368 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6527): Terminating (SIGTERM) 06:42:14.435528 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6530): Terminating (SIGTERM) 06:42:14.474933 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6533): Terminating (SIGTERM) 06:42:14.514299 --- ParallelTerminationStrategy: PID 6527 died... 06:42:14.532817 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6527): Terminated: ok {rc=0} 06:42:14.576568 --- ParallelTerminationStrategy: PID 6530 died... 06:42:14.594778 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6530): Terminated: ok {rc=0} 06:42:14.638052 --- ParallelTerminationStrategy: PID 6533 died... 06:42:14.656456 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6533): Terminated: ok {rc=0} 06:42:14.740803 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 encryption FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 4g:srsenb-rftype@zmq+srsue-rftype@zmq --------------------------------------------------------------------- 06:42:15.969466 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:42:15.976186 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x enb (candidates: 2) 06:42:15.997814 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x modem (candidates: 12) 06:42:16.026818 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x run_node (candidates: 1) 06:42:16.056101 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x enb (candidates: 2) 06:42:16.076878 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x modem (candidates: 12) 06:42:16.105442 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x run_node (candidates: 1) 06:42:16.607759 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: RESERVED RESOURCES for 4g: enb srsENB-zmq modem srsUE-zmq_1 run_node e55cbce541824969b492cc4fa86bdef69cf65e7d ---------------------------------------------- trial-2370 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover.py ---------------------------------------------- 06:42:16.613161 tst handover.py:11: TEST_CONFIG: {} 06:42:16.821691 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 06:42:16.838607 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 06:42:16.863294 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 06:42:16.912577 tst handover.py: using MSISDN 7600 06:42:17.027844 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7600', subscriber_id=0} 06:42:17.136220 run srsepc_10.42.42.118: Starting srsepc 06:42:18.961390 run rm-remote-dir(pid=6539): Launched 06:42:19.082250 bus /sierra_2: Setting Powered False 06:42:20.146461 run rm-remote-dir(pid=6539): Terminated: ok {rc=0} 06:42:20.581734 run mk-remote-dir(pid=6540): Launched 06:42:21.758260 run mk-remote-dir(pid=6540): Terminated: ok {rc=0} 06:42:22.041572 run scp-inst-to-remote(pid=6541): Launched 06:42:24.217364 run scp-inst-to-remote(pid=6541): Terminated: ok {rc=0} 06:42:24.547779 run rm-remote-dir(pid=6543): Launched 06:42:25.724726 run rm-remote-dir(pid=6543): Terminated: ok {rc=0} 06:42:26.056787 run mk-remote-dir(pid=6544): Launched 06:42:27.234077 run mk-remote-dir(pid=6544): Terminated: ok {rc=0} 06:42:27.517221 run scp-cfg-to-remote(pid=6545): Launched 06:42:28.691150 run scp-cfg-to-remote(pid=6545): Terminated: ok {rc=0} 06:42:28.972677 run scp-db-to-remote(pid=6547): Launched 06:42:30.147593 run scp-db-to-remote(pid=6547): Terminated: ok {rc=0} 06:42:30.277413 run srsepc_10.42.42.118: Setting RPATH for srsepc 06:42:30.582935 run patchelf(pid=6549): Launched 06:42:31.773891 run patchelf(pid=6549): Terminated: ok {rc=0} 06:42:31.930546 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 06:42:32.241205 run setcap-netadm(pid=6550): Launched 06:42:33.418427 run setcap-netadm(pid=6550): Terminated: ok {rc=0} 06:42:33.737399 run srsepc(pid=6551): Launched 06:42:33.849538 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 06:42:34.941430 run rm-remote-dir(pid=6552): Launched 06:42:35.114829 run srsepc(pid=6551): ERR: Terminated: ERROR {rc=127} [trial-2370↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=6551)] 06:42:35.248146 run srsepc(pid=6551): stdout: | (launched: 2022-12-10_06:42:33.681621) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 06:42:35.381294 run srsepc(pid=6551): stderr: | (launched: 2022-12-10_06:42:33.726324) | Connection to 10.42.42.116 closed. 06:42:35.514231 run srsepc(pid=6551): stdout: | (launched: 2022-12-10_06:42:33.681621) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 06:42:35.642244 run srsepc(pid=6551): stderr: | (launched: 2022-12-10_06:42:33.726324) | Connection to 10.42.42.116 closed. 06:42:35.793498 run rm-remote-dir(pid=6552): Terminating (SIGINT) 06:42:35.969716 run rm-remote-dir(pid=6552): Terminated: ok {rc=0} 06:42:36.096018 tst handover.py:37: ERR: Error: srsepc(pid=6551): Process ended prematurely: srsepc(pid=6551) [trial-2370↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=6551)] [trial-2370↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37] 06:42:36.106071 tst handover.py:37: Test FAILED (19.5 sec) 06:42:36.182567 run scp-back-log(pid=6553): Launched 06:42:37.259840 run scp-back-log(pid=6553): ERR: Terminated: ERROR {rc=1} [trial-2370↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=6553)] 06:42:37.319979 run scp-back-log(pid=6553): stdout: | (launched: 2022-12-10_06:42:36.152216) 06:42:37.381754 run scp-back-log(pid=6553): stderr: | (launched: 2022-12-10_06:42:36.171627) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 06:42:37.450987 tst srsepc_10.42.42.118: Error('scp-back-log(pid=6553): launch_sync(): local process exited with status 1 [trial-2370↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=6553)]') ---------------------------------------------- trial-2370 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_bidir.py ---------------------------------------------- 06:42:37.495577 tst iperf3_bidir.py:13: Number of physical ue: 1 06:42:37.700475 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 06:42:37.743235 tst iperf3_bidir.py:20: ue index0: srsue_10.42.42.116 06:42:37.944347 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 06:42:37.960093 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 06:42:37.992332 tst iperf3_bidir.py: using MSISDN 7601 06:42:38.102359 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7601', subscriber_id=0} 06:42:38.207967 run srsepc_10.42.42.118: Starting srsepc 06:42:38.828117 run rm-remote-dir(pid=6555): Launched 06:42:40.008700 run rm-remote-dir(pid=6555): Terminated: ok {rc=0} 06:42:40.362983 run mk-remote-dir(pid=6556): Launched 06:42:41.552515 run mk-remote-dir(pid=6556): Terminated: ok {rc=0} 06:42:41.855449 run scp-inst-to-remote(pid=6557): Launched 06:42:44.044397 run scp-inst-to-remote(pid=6557): Terminated: ok {rc=0} 06:42:44.396864 run rm-remote-dir(pid=6559): Launched 06:42:45.587806 run rm-remote-dir(pid=6559): Terminated: ok {rc=0} 06:42:45.969831 run mk-remote-dir(pid=6560): Launched 06:42:47.205895 run mk-remote-dir(pid=6560): Terminated: ok {rc=0} 06:42:47.509177 run scp-cfg-to-remote(pid=6561): Launched 06:42:48.697350 run scp-cfg-to-remote(pid=6561): Terminated: ok {rc=0} 06:42:48.997215 run scp-db-to-remote(pid=6563): Launched 06:42:50.185459 run scp-db-to-remote(pid=6563): Terminated: ok {rc=0} 06:42:50.323847 run srsepc_10.42.42.118: Setting RPATH for srsepc 06:42:50.649639 run patchelf(pid=6565): Launched 06:42:51.837513 run patchelf(pid=6565): Terminated: ok {rc=0} 06:42:51.977747 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 06:42:52.302818 run setcap-netadm(pid=6566): Launched 06:42:53.490690 run setcap-netadm(pid=6566): Terminated: ok {rc=0} 06:42:53.832245 run srsepc(pid=6567): Launched 06:42:53.954277 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 06:42:55.133102 run rm-remote-dir(pid=6568): Launched 06:42:55.320227 run srsepc(pid=6567): ERR: Terminated: ERROR {rc=127} [trial-2370↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=6567)] 06:42:55.462909 run srsepc(pid=6567): stdout: | (launched: 2022-12-10_06:42:53.773455) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 06:42:55.605355 run srsepc(pid=6567): stderr: | (launched: 2022-12-10_06:42:53.821381) | Connection to 10.42.42.116 closed. 06:42:55.747078 run srsepc(pid=6567): stdout: | (launched: 2022-12-10_06:42:53.773455) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 06:42:55.883581 run srsepc(pid=6567): stderr: | (launched: 2022-12-10_06:42:53.821381) | Connection to 10.42.42.116 closed. 06:42:56.045459 run rm-remote-dir(pid=6568): Terminating (SIGINT) 06:42:56.231521 run rm-remote-dir(pid=6568): Terminated: ok {rc=0} 06:42:56.366434 tst iperf3_bidir.py:42: ERR: Error: srsepc(pid=6567): Process ended prematurely: srsepc(pid=6567) [trial-2370↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=6567)] [trial-2370↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42] 06:42:56.377091 tst iperf3_bidir.py:42: Test FAILED (18.9 sec) 06:42:56.457113 run scp-back-log(pid=6569): Launched 06:42:57.536204 run scp-back-log(pid=6569): ERR: Terminated: ERROR {rc=1} [trial-2370↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=6569)] 06:42:57.599505 run scp-back-log(pid=6569): stdout: | (launched: 2022-12-10_06:42:56.425558) 06:42:57.664232 run scp-back-log(pid=6569): stderr: | (launched: 2022-12-10_06:42:56.446129) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 06:42:57.736936 tst srsepc_10.42.42.118: Error('scp-back-log(pid=6569): launch_sync(): local process exited with status 1 [trial-2370↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=6569)]') ---------------------------------------------- trial-2370 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_dl.py ---------------------------------------------- 06:42:57.784344 tst iperf3_dl.py:13: Number of physical ue: 1 06:42:58.002959 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 06:42:58.047312 tst iperf3_dl.py:20: ue index0: srsue_10.42.42.116 06:42:58.262308 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 06:42:58.278475 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 06:42:58.315288 tst iperf3_dl.py: using MSISDN 7602 06:42:58.434142 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7602', subscriber_id=0} 06:42:58.547718 run srsepc_10.42.42.118: Starting srsepc 06:42:59.210715 run rm-remote-dir(pid=6571): Launched 06:43:00.401191 run rm-remote-dir(pid=6571): Terminated: ok {rc=0} 06:43:00.755712 run mk-remote-dir(pid=6572): Launched 06:43:01.976002 run mk-remote-dir(pid=6572): Terminated: ok {rc=0} 06:43:02.273106 run scp-inst-to-remote(pid=6573): Launched 06:43:04.458389 run scp-inst-to-remote(pid=6573): Terminated: ok {rc=0} 06:43:04.787688 run rm-remote-dir(pid=6575): Launched 06:43:05.963117 run rm-remote-dir(pid=6575): Terminated: ok {rc=0} 06:43:06.293399 run mk-remote-dir(pid=6576): Launched 06:43:07.469843 run mk-remote-dir(pid=6576): Terminated: ok {rc=0} 06:43:07.751704 run scp-cfg-to-remote(pid=6577): Launched 06:43:08.926634 run scp-cfg-to-remote(pid=6577): Terminated: ok {rc=0} 06:43:09.207166 run scp-db-to-remote(pid=6579): Launched 06:43:10.381469 run scp-db-to-remote(pid=6579): Terminated: ok {rc=0} 06:43:10.511950 run srsepc_10.42.42.118: Setting RPATH for srsepc 06:43:10.815841 run patchelf(pid=6581): Launched 06:43:11.990577 run patchelf(pid=6581): Terminated: ok {rc=0} 06:43:12.120319 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 06:43:12.424280 run setcap-netadm(pid=6582): Launched 06:43:13.598653 run setcap-netadm(pid=6582): Terminated: ok {rc=0} 06:43:13.917249 run srsepc(pid=6583): Launched 06:43:14.030368 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 06:43:15.129684 run rm-remote-dir(pid=6584): Launched 06:43:15.303985 run srsepc(pid=6583): ERR: Terminated: ERROR {rc=127} [trial-2370↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=6583)] 06:43:15.436682 run srsepc(pid=6583): stdout: | (launched: 2022-12-10_06:43:13.861954) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 06:43:15.570235 run srsepc(pid=6583): stderr: | (launched: 2022-12-10_06:43:13.906576) | Connection to 10.42.42.116 closed. 06:43:15.703048 run srsepc(pid=6583): stdout: | (launched: 2022-12-10_06:43:13.861954) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 06:43:15.831339 run srsepc(pid=6583): stderr: | (launched: 2022-12-10_06:43:13.906576) | Connection to 10.42.42.116 closed. 06:43:15.985781 run rm-remote-dir(pid=6584): Terminating (SIGINT) 06:43:16.202819 run rm-remote-dir(pid=6584): Terminated: ok {rc=0} 06:43:16.332021 tst iperf3_dl.py:42: ERR: Error: srsepc(pid=6583): Process ended prematurely: srsepc(pid=6583) [trial-2370↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=6583)] [trial-2370↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42] 06:43:16.342687 tst iperf3_dl.py:42: Test FAILED (18.5 sec) 06:43:16.426376 run scp-back-log(pid=6585): Launched 06:43:17.544557 run scp-back-log(pid=6585): ERR: Terminated: ERROR {rc=1} [trial-2370↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=6585)] 06:43:17.605288 run scp-back-log(pid=6585): stdout: | (launched: 2022-12-10_06:43:16.392977) 06:43:17.667258 run scp-back-log(pid=6585): stderr: | (launched: 2022-12-10_06:43:16.412868) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 06:43:17.736881 tst srsepc_10.42.42.118: Error('scp-back-log(pid=6585): launch_sync(): local process exited with status 1 [trial-2370↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=6585)]') ---------------------------------------------- trial-2370 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_ul.py ---------------------------------------------- 06:43:17.782407 tst iperf3_ul.py:13: Number of physical ue: 1 06:43:17.987085 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 06:43:18.029598 tst iperf3_ul.py:20: ue index0: srsue_10.42.42.116 06:43:18.232803 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 06:43:18.248504 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 06:43:18.281225 tst iperf3_ul.py: using MSISDN 7603 06:43:18.391120 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7603', subscriber_id=0} 06:43:18.496740 run srsepc_10.42.42.118: Starting srsepc 06:43:19.117965 run rm-remote-dir(pid=6587): Launched 06:43:20.295927 run rm-remote-dir(pid=6587): Terminated: ok {rc=0} 06:43:20.627768 run mk-remote-dir(pid=6588): Launched 06:43:21.805068 run mk-remote-dir(pid=6588): Terminated: ok {rc=0} 06:43:22.087926 run scp-inst-to-remote(pid=6589): Launched 06:43:24.264839 run scp-inst-to-remote(pid=6589): Terminated: ok {rc=0} 06:43:24.593564 run rm-remote-dir(pid=6591): Launched 06:43:25.769853 run rm-remote-dir(pid=6591): Terminated: ok {rc=0} 06:43:26.099710 run mk-remote-dir(pid=6592): Launched 06:43:27.276666 run mk-remote-dir(pid=6592): Terminated: ok {rc=0} 06:43:27.558814 run scp-cfg-to-remote(pid=6593): Launched 06:43:28.733968 run scp-cfg-to-remote(pid=6593): Terminated: ok {rc=0} 06:43:29.014828 run scp-db-to-remote(pid=6595): Launched 06:43:30.189422 run scp-db-to-remote(pid=6595): Terminated: ok {rc=0} 06:43:30.318933 run srsepc_10.42.42.118: Setting RPATH for srsepc 06:43:30.621875 run patchelf(pid=6597): Launched 06:43:31.798490 run patchelf(pid=6597): Terminated: ok {rc=0} 06:43:31.931037 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 06:43:32.245940 run setcap-netadm(pid=6598): Launched 06:43:33.430489 run setcap-netadm(pid=6598): Terminated: ok {rc=0} 06:43:33.749385 run srsepc(pid=6599): Launched 06:43:33.861338 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 06:43:34.953564 run rm-remote-dir(pid=6600): Launched 06:43:35.128315 run srsepc(pid=6599): ERR: Terminated: ERROR {rc=127} [trial-2370↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=6599)] 06:43:35.261343 run srsepc(pid=6599): stdout: | (launched: 2022-12-10_06:43:33.693828) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 06:43:35.394957 run srsepc(pid=6599): stderr: | (launched: 2022-12-10_06:43:33.738660) | Connection to 10.42.42.116 closed. 06:43:35.528427 run srsepc(pid=6599): stdout: | (launched: 2022-12-10_06:43:33.693828) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 06:43:35.656900 run srsepc(pid=6599): stderr: | (launched: 2022-12-10_06:43:33.738660) | Connection to 10.42.42.116 closed. 06:43:35.809285 run rm-remote-dir(pid=6600): Terminating (SIGINT) 06:43:35.985211 run rm-remote-dir(pid=6600): Terminated: ok {rc=0} 06:43:36.112293 tst iperf3_ul.py:42: ERR: Error: srsepc(pid=6599): Process ended prematurely: srsepc(pid=6599) [trial-2370↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=6599)] [trial-2370↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42] 06:43:36.122484 tst iperf3_ul.py:42: Test FAILED (18.3 sec) 06:43:36.199380 run scp-back-log(pid=6601): Launched 06:43:37.275352 run scp-back-log(pid=6601): ERR: Terminated: ERROR {rc=1} [trial-2370↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=6601)] 06:43:37.336432 run scp-back-log(pid=6601): stdout: | (launched: 2022-12-10_06:43:36.169113) 06:43:37.398715 run scp-back-log(pid=6601): stderr: | (launched: 2022-12-10_06:43:36.188688) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 06:43:37.469049 tst srsepc_10.42.42.118: Error('scp-back-log(pid=6601): launch_sync(): local process exited with status 1 [trial-2370↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=6601)]') ---------------------------------------------- trial-2370 4g:srsenb-rftype@zmq+srsue-rftype@zmq ping.py ---------------------------------------------- 06:43:37.515500 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 06:43:37.532038 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 06:43:37.555213 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 06:43:37.604372 tst ping.py: using MSISDN 7604 06:43:37.718070 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7604', subscriber_id=0} 06:43:37.823862 run srsepc_10.42.42.118: Starting srsepc 06:43:38.446036 run rm-remote-dir(pid=6603): Launched 06:43:39.623254 run rm-remote-dir(pid=6603): Terminated: ok {rc=0} 06:43:39.954684 run mk-remote-dir(pid=6604): Launched 06:43:41.131064 run mk-remote-dir(pid=6604): Terminated: ok {rc=0} 06:43:41.413745 run scp-inst-to-remote(pid=6605): Launched 06:43:43.594518 run scp-inst-to-remote(pid=6605): Terminated: ok {rc=0} 06:43:43.948058 run rm-remote-dir(pid=6607): Launched 06:43:45.138539 run rm-remote-dir(pid=6607): Terminated: ok {rc=0} 06:43:45.493711 run mk-remote-dir(pid=6608): Launched 06:43:46.688814 run mk-remote-dir(pid=6608): Terminated: ok {rc=0} 06:43:47.018729 run scp-cfg-to-remote(pid=6609): Launched 06:43:48.258957 run scp-cfg-to-remote(pid=6609): Terminated: ok {rc=0} 06:43:48.559684 run scp-db-to-remote(pid=6611): Launched 06:43:49.747872 run scp-db-to-remote(pid=6611): Terminated: ok {rc=0} 06:43:49.886512 run srsepc_10.42.42.118: Setting RPATH for srsepc 06:43:50.211772 run patchelf(pid=6613): Launched 06:43:51.395353 run patchelf(pid=6613): Terminated: ok {rc=0} 06:43:51.526239 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 06:43:51.831219 run setcap-netadm(pid=6614): Launched 06:43:53.004763 run setcap-netadm(pid=6614): Terminated: ok {rc=0} 06:43:53.325274 run srsepc(pid=6615): Launched 06:43:53.437903 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 06:43:54.601384 run rm-remote-dir(pid=6616): Launched 06:43:54.788516 run srsepc(pid=6615): ERR: Terminated: ERROR {rc=127} [trial-2370↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=6615)] 06:43:54.931189 run srsepc(pid=6615): stdout: | (launched: 2022-12-10_06:43:53.269459) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 06:43:55.072841 run srsepc(pid=6615): stderr: | (launched: 2022-12-10_06:43:53.314323) | Connection to 10.42.42.116 closed. 06:43:55.214864 run srsepc(pid=6615): stdout: | (launched: 2022-12-10_06:43:53.269459) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 06:43:55.351485 run srsepc(pid=6615): stderr: | (launched: 2022-12-10_06:43:53.314323) | Connection to 10.42.42.116 closed. 06:43:55.513227 run rm-remote-dir(pid=6616): Terminating (SIGINT) 06:43:55.699929 run rm-remote-dir(pid=6616): Terminated: ok {rc=0} 06:43:55.834514 tst ping.py:16: ERR: Error: srsepc(pid=6615): Process ended prematurely: srsepc(pid=6615) [trial-2370↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=6615)] [trial-2370↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16] 06:43:55.844920 tst ping.py:16: Test FAILED (18.3 sec) 06:43:55.924609 run scp-back-log(pid=6617): Launched 06:43:57.004592 run scp-back-log(pid=6617): ERR: Terminated: ERROR {rc=1} [trial-2370↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=6617)] 06:43:57.067773 run scp-back-log(pid=6617): stdout: | (launched: 2022-12-10_06:43:55.893250) 06:43:57.132831 run scp-back-log(pid=6617): stderr: | (launched: 2022-12-10_06:43:55.913679) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 06:43:57.205682 tst srsepc_10.42.42.118: Error('scp-back-log(pid=6617): launch_sync(): local process exited with status 1 [trial-2370↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=6617)]') ---------------------------------------------- trial-2370 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mo_ping.py ---------------------------------------------- 06:43:57.253237 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 06:43:57.270492 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 06:43:57.294002 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 06:43:57.343714 tst rrc_idle_mo_ping.py: using MSISDN 7605 06:43:57.463747 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7605', subscriber_id=0} 06:43:57.577012 run srsepc_10.42.42.118: Starting srsepc 06:43:58.239349 run rm-remote-dir(pid=6619): Launched 06:43:59.429517 run rm-remote-dir(pid=6619): Terminated: ok {rc=0} 06:43:59.783640 run mk-remote-dir(pid=6620): Launched 06:44:00.972253 run mk-remote-dir(pid=6620): Terminated: ok {rc=0} 06:44:01.317880 run scp-inst-to-remote(pid=6621): Launched 06:44:03.542762 run scp-inst-to-remote(pid=6621): Terminated: ok {rc=0} 06:44:03.894951 run rm-remote-dir(pid=6623): Launched 06:44:05.085275 run rm-remote-dir(pid=6623): Terminated: ok {rc=0} 06:44:05.440668 run mk-remote-dir(pid=6624): Launched 06:44:06.631653 run mk-remote-dir(pid=6624): Terminated: ok {rc=0} 06:44:06.933410 run scp-cfg-to-remote(pid=6625): Launched 06:44:08.119812 run scp-cfg-to-remote(pid=6625): Terminated: ok {rc=0} 06:44:08.419680 run scp-db-to-remote(pid=6627): Launched 06:44:09.607060 run scp-db-to-remote(pid=6627): Terminated: ok {rc=0} 06:44:09.745301 run srsepc_10.42.42.118: Setting RPATH for srsepc 06:44:10.070963 run patchelf(pid=6629): Launched 06:44:11.258982 run patchelf(pid=6629): Terminated: ok {rc=0} 06:44:11.398166 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 06:44:11.724536 run setcap-netadm(pid=6630): Launched 06:44:12.912780 run setcap-netadm(pid=6630): Terminated: ok {rc=0} 06:44:13.254181 run srsepc(pid=6631): Launched 06:44:13.376285 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 06:44:14.549341 run rm-remote-dir(pid=6632): Launched 06:44:14.724893 run srsepc(pid=6631): ERR: Terminated: ERROR {rc=127} [trial-2370↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=6631)] 06:44:14.858728 run srsepc(pid=6631): stdout: | (launched: 2022-12-10_06:44:13.195021) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 06:44:14.991955 run srsepc(pid=6631): stderr: | (launched: 2022-12-10_06:44:13.242873) | Connection to 10.42.42.116 closed. 06:44:15.125499 run srsepc(pid=6631): stdout: | (launched: 2022-12-10_06:44:13.195021) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 06:44:15.253893 run srsepc(pid=6631): stderr: | (launched: 2022-12-10_06:44:13.242873) | Connection to 10.42.42.116 closed. 06:44:15.406217 run rm-remote-dir(pid=6632): Terminating (SIGINT) 06:44:15.580915 run rm-remote-dir(pid=6632): Terminated: ok {rc=0} 06:44:15.707125 tst rrc_idle_mo_ping.py:16: ERR: Error: srsepc(pid=6631): Process ended prematurely: srsepc(pid=6631) [trial-2370↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=6631)] [trial-2370↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16] 06:44:15.717212 tst rrc_idle_mo_ping.py:16: Test FAILED (18.5 sec) 06:44:15.793894 run scp-back-log(pid=6633): Launched 06:44:16.870402 run scp-back-log(pid=6633): ERR: Terminated: ERROR {rc=1} [trial-2370↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=6633)] 06:44:16.935673 run scp-back-log(pid=6633): stdout: | (launched: 2022-12-10_06:44:15.763858) 06:44:17.002346 run scp-back-log(pid=6633): stderr: | (launched: 2022-12-10_06:44:15.783376) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 06:44:17.076923 tst srsepc_10.42.42.118: Error('scp-back-log(pid=6633): launch_sync(): local process exited with status 1 [trial-2370↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=6633)]') ---------------------------------------------- trial-2370 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mt_ping.py ---------------------------------------------- 06:44:17.126698 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 06:44:17.144259 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 06:44:17.169918 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 06:44:17.220428 tst rrc_idle_mt_ping.py: using MSISDN 7606 06:44:17.342467 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7606', subscriber_id=0} 06:44:17.455785 run srsepc_10.42.42.118: Starting srsepc 06:44:18.117939 run rm-remote-dir(pid=6636): Launched 06:44:19.309778 run rm-remote-dir(pid=6636): Terminated: ok {rc=0} 06:44:19.664412 run mk-remote-dir(pid=6637): Launched 06:44:20.854091 run mk-remote-dir(pid=6637): Terminated: ok {rc=0} 06:44:21.155591 run scp-inst-to-remote(pid=6638): Launched 06:44:23.345345 run scp-inst-to-remote(pid=6638): Terminated: ok {rc=0} 06:44:23.698252 run rm-remote-dir(pid=6640): Launched 06:44:24.889099 run rm-remote-dir(pid=6640): Terminated: ok {rc=0} 06:44:25.242937 run mk-remote-dir(pid=6641): Launched 06:44:26.434152 run mk-remote-dir(pid=6641): Terminated: ok {rc=0} 06:44:26.736742 run scp-cfg-to-remote(pid=6642): Launched 06:44:27.923798 run scp-cfg-to-remote(pid=6642): Terminated: ok {rc=0} 06:44:28.223833 run scp-db-to-remote(pid=6644): Launched 06:44:29.414737 run scp-db-to-remote(pid=6644): Terminated: ok {rc=0} 06:44:29.553424 run srsepc_10.42.42.118: Setting RPATH for srsepc 06:44:29.878277 run patchelf(pid=6646): Launched 06:44:31.065758 run patchelf(pid=6646): Terminated: ok {rc=0} 06:44:31.208426 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 06:44:31.546212 run setcap-netadm(pid=6647): Launched 06:44:32.785426 run setcap-netadm(pid=6647): Terminated: ok {rc=0} 06:44:33.126299 run srsepc(pid=6648): Launched 06:44:33.248431 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 06:44:34.416490 run rm-remote-dir(pid=6649): Launched 06:44:34.604337 run srsepc(pid=6648): ERR: Terminated: ERROR {rc=127} [trial-2370↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=6648)] 06:44:34.747271 run srsepc(pid=6648): stdout: | (launched: 2022-12-10_06:44:33.067183) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 06:44:34.889120 run srsepc(pid=6648): stderr: | (launched: 2022-12-10_06:44:33.115214) | Connection to 10.42.42.116 closed. 06:44:35.030813 run srsepc(pid=6648): stdout: | (launched: 2022-12-10_06:44:33.067183) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 06:44:35.167876 run srsepc(pid=6648): stderr: | (launched: 2022-12-10_06:44:33.115214) | Connection to 10.42.42.116 closed. 06:44:35.329665 run rm-remote-dir(pid=6649): Terminating (SIGINT) 06:44:35.516419 run rm-remote-dir(pid=6649): Terminated: ok {rc=0} 06:44:35.651829 tst rrc_idle_mt_ping.py:16: ERR: Error: srsepc(pid=6648): Process ended prematurely: srsepc(pid=6648) [trial-2370↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=6648)] [trial-2370↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16] 06:44:35.662484 tst rrc_idle_mt_ping.py:16: Test FAILED (18.5 sec) 06:44:35.742267 run scp-back-log(pid=6650): Launched 06:44:36.822221 run scp-back-log(pid=6650): ERR: Terminated: ERROR {rc=1} [trial-2370↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=6650)] 06:44:36.885246 run scp-back-log(pid=6650): stdout: | (launched: 2022-12-10_06:44:35.710666) 06:44:36.949941 run scp-back-log(pid=6650): stderr: | (launched: 2022-12-10_06:44:35.731058) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 06:44:37.022859 tst srsepc_10.42.42.118: Error('scp-back-log(pid=6650): launch_sync(): local process exited with status 1 [trial-2370↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=6650)]') --------------------------------------------------------------------- trial-2370 4g:srsenb-rftype@zmq+srsue-rftype@zmq FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 handover_2G:nanobts+bts1-oc2g --------------------------------------------------------------------- 06:44:37.155643 tst handover_2G:nanobts+bts1-oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:44:37.161360 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x bts (candidates: 11) 06:44:37.203714 tst handover_2G:nanobts+bts1-oc2g: Verifying 6 x ip_address (candidates: 9) 06:44:37.231161 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x modem (candidates: 12) 06:44:37.283677 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x bts (candidates: 11) 06:44:37.326664 tst handover_2G:nanobts+bts1-oc2g: Reserving 6 x ip_address (candidates: 9) 06:44:37.353595 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x modem (candidates: 12) 06:44:37.903721 tst handover_2G:nanobts+bts1-oc2g: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 handover_2G:nanobts+bts1-oc2g handover.py ---------------------------------------------- 06:44:37.910429 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 06:44:37.922199 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 06:44:37.961130 tst handover.py: using LAC 26563 06:44:38.082538 tst handover.py: using RAC 43 06:44:38.201605 tst handover.py: using CellId 26563 06:44:38.320678 tst handover.py: using BVCI 26564 06:44:38.430568 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 06:44:38.463629 tst handover.py: using LAC 26564 06:44:38.579101 tst handover.py: using RAC 44 06:44:38.694569 tst handover.py: using CellId 26564 06:44:38.809642 tst handover.py: using BVCI 26565 06:44:38.917734 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 06:44:38.928694 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 06:44:38.939566 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 06:44:38.950805 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 06:44:38.962082 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 06:44:38.973326 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 06:44:39.091715 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 06:44:39.210074 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:44:39.702010 run create_hlr_db(pid=6655): Launched 06:44:40.880109 run create_hlr_db(pid=6655): Terminated: ok {rc=0} 06:44:41.214715 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6657): Launched 06:44:41.532104 run osmo-hlr_10.42.42.2(pid=6658): Launched 06:44:41.654363 run osmo-stp_10.42.42.5: Starting osmo-stp 06:44:42.200797 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6660): Launched 06:44:42.518084 run osmo-stp_10.42.42.5(pid=6661): Launched 06:44:42.639571 run osmo-msc_10.42.42.6: Starting osmo-msc 06:44:43.215027 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6663): Launched 06:44:43.532327 run osmo-msc_10.42.42.6(pid=6664): Launched 06:44:43.711153 run osmo-stp_10.42.42.5(pid=6661): ERR: Terminated: ERROR {rc=1} [trial-2370↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6661)] 06:44:43.845350 run osmo-stp_10.42.42.5(pid=6661): stdout: | (launched: 2022-12-10_06:44:42.460125) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:44:43.979776 run osmo-stp_10.42.42.5(pid=6661): stderr: | 20221210064442652 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210064442652 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210064442652 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210064442653 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210064442653 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210064442653 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210064442653 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:44:44.113611 run osmo-stp_10.42.42.5(pid=6661): stdout: | (launched: 2022-12-10_06:44:42.460125) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:44:44.239471 run osmo-stp_10.42.42.5(pid=6661): stderr: | 20221210064442652 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210064442652 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210064442652 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210064442653 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210064442653 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210064442653 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210064442653 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:44:44.390379 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=6661): Process ended prematurely: osmo-stp_10.42.42.5(pid=6661) [trial-2370↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6661)] [trial-2370↪handover_2G:nanobts+bts1-oc2g↪handover.py:18] 06:44:44.399166 tst handover.py:18: Test FAILED (6.5 sec) 06:44:44.426345 run osmo-hlr_10.42.42.2(pid=6658): ERR: Terminated: ERROR {rc=237} [trial-2370↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6658)] 06:44:44.475822 run osmo-hlr_10.42.42.2(pid=6658): stdout: | (launched: 2022-12-10_06:44:41.474121) 06:44:44.527168 run osmo-hlr_10.42.42.2(pid=6658): stderr: | 20221210064441670 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210064441670 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210064441670 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210064441670 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210064441670 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210064441670 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210064441682 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/handover_2G:nanobts+bts1-oc2g/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210064441692 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210064441692 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210064441692 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:44:44.598926 run osmo-msc_10.42.42.6(pid=6664): ERR: Terminated: ERROR {rc=2} [trial-2370↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6664)] 06:44:44.648434 run osmo-msc_10.42.42.6(pid=6664): stdout: | (launched: 2022-12-10_06:44:43.474260) 06:44:44.699459 run osmo-msc_10.42.42.6(pid=6664): stderr: | 20221210064443793 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210064443794 DLGLOBAL DEBUG validating counter group 0x7f54a9ddac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210064443794 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210064443794 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210064443794 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210064443794 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210064443796 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210064443796 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210064443796 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210064443796 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:44:44.751261 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6657): Terminating (SIGTERM) 06:44:44.792636 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6660): Terminating (SIGTERM) 06:44:44.833891 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6663): Terminating (SIGTERM) 06:44:44.875275 --- ParallelTerminationStrategy: PID 6657 died... 06:44:44.894956 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6657): Terminated: ok {rc=0} 06:44:44.940443 --- ParallelTerminationStrategy: PID 6660 died... 06:44:44.959825 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6660): Terminated: ok {rc=0} 06:44:45.005385 --- ParallelTerminationStrategy: PID 6663 died... 06:44:45.024555 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6663): Terminated: ok {rc=0} 06:44:45.111929 bus /sierra_3: Setting Powered False 06:44:46.206124 bus /sierra_3: Setting Powered False 06:44:47.320560 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 handover_2G:nanobts+bts1-oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 handover_2G:nanobts+bts1-octphy --------------------------------------------------------------------- 06:44:48.566554 tst handover_2G:nanobts+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:44:48.572044 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x bts (candidates: 11) 06:44:48.612451 tst handover_2G:nanobts+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 06:44:48.639519 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x modem (candidates: 12) 06:44:48.691556 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x bts (candidates: 11) 06:44:48.731611 tst handover_2G:nanobts+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 06:44:48.758562 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x modem (candidates: 12) 06:44:49.310634 tst handover_2G:nanobts+bts1-octphy: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 handover_2G:nanobts+bts1-octphy handover.py ---------------------------------------------- 06:44:49.316821 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 06:44:49.328491 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 06:44:49.368926 tst handover.py: using LAC 26565 06:44:49.487156 tst handover.py: using RAC 45 06:44:49.606395 tst handover.py: using CellId 26565 06:44:49.724055 tst handover.py: using BVCI 26566 06:44:49.833008 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 06:44:49.866930 tst handover.py: using LAC 26566 06:44:49.986309 tst handover.py: using RAC 46 06:44:50.108501 tst handover.py: using CellId 26566 06:44:50.236046 tst handover.py: using BVCI 26567 06:44:50.347777 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 06:44:50.358676 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 06:44:50.369537 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 06:44:50.381050 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 06:44:50.392384 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 06:44:50.403813 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 06:44:50.523657 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 06:44:50.638287 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:44:51.074247 run create_hlr_db(pid=6670): Launched 06:44:51.196379 bus /sierra_2: Setting Powered False 06:44:52.256006 run create_hlr_db(pid=6670): Terminated: ok {rc=0} 06:44:52.664867 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6672): Launched 06:44:52.983240 run osmo-hlr_10.42.42.2(pid=6673): Launched 06:44:53.104447 run osmo-stp_10.42.42.5: Starting osmo-stp 06:44:53.625568 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6675): Launched 06:44:53.944015 run osmo-stp_10.42.42.5(pid=6676): Launched 06:44:54.066049 run osmo-msc_10.42.42.6: Starting osmo-msc 06:44:54.616390 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6678): Launched 06:44:54.935123 run osmo-msc_10.42.42.6(pid=6679): Launched 06:44:55.113565 run osmo-stp_10.42.42.5(pid=6676): ERR: Terminated: ERROR {rc=1} [trial-2370↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6676)] 06:44:55.247603 run osmo-stp_10.42.42.5(pid=6676): stdout: | (launched: 2022-12-10_06:44:53.885804) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:44:55.383112 run osmo-stp_10.42.42.5(pid=6676): stderr: | 20221210064454076 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210064454076 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210064454077 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210064454077 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210064454078 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210064454078 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210064454078 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:44:55.517168 run osmo-stp_10.42.42.5(pid=6676): stdout: | (launched: 2022-12-10_06:44:53.885804) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:44:55.645110 run osmo-stp_10.42.42.5(pid=6676): stderr: | 20221210064454076 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210064454076 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210064454077 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210064454077 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210064454078 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210064454078 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210064454078 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:44:55.797182 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=6676): Process ended prematurely: osmo-stp_10.42.42.5(pid=6676) [trial-2370↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6676)] [trial-2370↪handover_2G:nanobts+bts1-octphy↪handover.py:18] 06:44:55.806160 tst handover.py:18: Test FAILED (6.5 sec) 06:44:55.833346 run osmo-hlr_10.42.42.2(pid=6673): ERR: Terminated: ERROR {rc=237} [trial-2370↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6673)] 06:44:55.882878 run osmo-hlr_10.42.42.2(pid=6673): stdout: | (launched: 2022-12-10_06:44:52.925406) 06:44:55.934308 run osmo-hlr_10.42.42.2(pid=6673): stderr: | 20221210064453123 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210064453123 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210064453123 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210064453123 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210064453123 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210064453123 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210064453135 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/handover_2G:nanobts+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210064453143 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210064453144 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210064453144 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:44:56.005759 run osmo-msc_10.42.42.6(pid=6679): ERR: Terminated: ERROR {rc=2} [trial-2370↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6679)] 06:44:56.055395 run osmo-msc_10.42.42.6(pid=6679): stdout: | (launched: 2022-12-10_06:44:54.877029) 06:44:56.106590 run osmo-msc_10.42.42.6(pid=6679): stderr: | 20221210064455197 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210064455197 DLGLOBAL DEBUG validating counter group 0x7fe1b261cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210064455197 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210064455198 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210064455198 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210064455198 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210064455200 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210064455200 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210064455200 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210064455200 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:44:56.158244 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6672): Terminating (SIGTERM) 06:44:56.199156 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6675): Terminating (SIGTERM) 06:44:56.240078 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6678): Terminating (SIGTERM) 06:44:56.281502 --- ParallelTerminationStrategy: PID 6672 died... 06:44:56.301155 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6672): Terminated: ok {rc=0} 06:44:56.346797 --- ParallelTerminationStrategy: PID 6675 died... 06:44:56.366146 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6675): Terminated: ok {rc=0} 06:44:56.412125 --- ParallelTerminationStrategy: PID 6678 died... 06:44:56.431508 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6678): Terminated: ok {rc=0} 06:44:56.518596 bus /sierra_3: Setting Powered False 06:44:57.615867 bus /sierra_3: Setting Powered False 06:44:58.733199 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 handover_2G:nanobts+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 handover_2G:nanobts+bts1-trx-lms --------------------------------------------------------------------- 06:44:59.972781 tst handover_2G:nanobts+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:44:59.978194 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 06:45:00.031218 tst handover_2G:nanobts+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 06:45:00.057647 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 06:45:00.109820 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 06:45:00.162949 tst handover_2G:nanobts+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 06:45:00.188907 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 06:45:00.737540 tst handover_2G:nanobts+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 handover_2G:nanobts+bts1-trx-lms handover.py ---------------------------------------------- 06:45:00.742940 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 06:45:00.753900 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 06:45:00.792283 tst handover.py: using LAC 26567 06:45:00.925341 tst handover.py: using RAC 47 06:45:01.060607 tst handover.py: using CellId 26567 06:45:01.215223 tst handover.py: using BVCI 26568 06:45:01.335016 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 06:45:01.387336 tst handover.py: using LAC 26568 06:45:01.562041 tst handover.py: using RAC 48 06:45:01.720075 tst handover.py: using CellId 26568 06:45:01.841177 tst handover.py: using BVCI 26569 06:45:01.972454 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 06:45:01.985458 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 06:45:01.999976 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 06:45:02.014298 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 06:45:02.027183 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 06:45:02.040478 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 06:45:02.182926 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 06:45:02.303012 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:45:02.779931 run create_hlr_db(pid=6687): Launched 06:45:02.911251 bus /sierra_2: Setting Powered False 06:45:03.974035 run create_hlr_db(pid=6687): Terminated: ok {rc=0} 06:45:04.374811 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6689): Launched 06:45:04.673701 run osmo-hlr_10.42.42.2(pid=6690): Launched 06:45:04.786822 run osmo-stp_10.42.42.5: Starting osmo-stp 06:45:05.271999 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6692): Launched 06:45:05.569955 run osmo-stp_10.42.42.5(pid=6693): Launched 06:45:05.683769 run osmo-msc_10.42.42.6: Starting osmo-msc 06:45:06.197390 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6695): Launched 06:45:06.494668 run osmo-msc_10.42.42.6(pid=6696): Launched 06:45:06.661588 run osmo-stp_10.42.42.5(pid=6693): ERR: Terminated: ERROR {rc=1} [trial-2370↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6693)] 06:45:06.787757 run osmo-stp_10.42.42.5(pid=6693): stdout: | (launched: 2022-12-10_06:45:05.514730) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:45:06.913980 run osmo-stp_10.42.42.5(pid=6693): stderr: | 20221210064505685 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210064505686 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210064505686 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210064505686 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210064505687 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210064505687 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210064505687 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:45:07.038425 run osmo-stp_10.42.42.5(pid=6693): stdout: | (launched: 2022-12-10_06:45:05.514730) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:45:07.156545 run osmo-stp_10.42.42.5(pid=6693): stderr: | 20221210064505685 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210064505686 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210064505686 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210064505686 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210064505687 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210064505687 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210064505687 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:45:07.298258 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=6693): Process ended prematurely: osmo-stp_10.42.42.5(pid=6693) [trial-2370↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6693)] [trial-2370↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18] 06:45:07.306611 tst handover.py:18: Test FAILED (6.6 sec) 06:45:07.332688 run osmo-hlr_10.42.42.2(pid=6690): ERR: Terminated: ERROR {rc=237} [trial-2370↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6690)] 06:45:07.380105 run osmo-hlr_10.42.42.2(pid=6690): stdout: | (launched: 2022-12-10_06:45:04.619063) 06:45:07.429084 run osmo-hlr_10.42.42.2(pid=6690): stderr: | 20221210064504794 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210064504794 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210064504794 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210064504794 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210064504794 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210064504795 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210064504807 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/handover_2G:nanobts+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210064504818 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210064504818 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210064504818 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:45:07.497208 run osmo-msc_10.42.42.6(pid=6696): ERR: Terminated: ERROR {rc=2} [trial-2370↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6696)] 06:45:07.544621 run osmo-msc_10.42.42.6(pid=6696): stdout: | (launched: 2022-12-10_06:45:06.439698) 06:45:07.593673 run osmo-msc_10.42.42.6(pid=6696): stderr: | 20221210064506708 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210064506709 DLGLOBAL DEBUG validating counter group 0x7f58d4f8fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210064506709 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210064506709 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210064506709 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210064506709 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210064506711 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210064506712 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210064506712 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210064506712 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:45:07.642999 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6689): Terminating (SIGTERM) 06:45:07.682619 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6692): Terminating (SIGTERM) 06:45:07.722504 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6695): Terminating (SIGTERM) 06:45:07.762093 --- ParallelTerminationStrategy: PID 6689 died... 06:45:07.780988 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6689): Terminated: ok {rc=0} 06:45:07.825073 --- ParallelTerminationStrategy: PID 6692 died... 06:45:07.843490 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6692): Terminated: ok {rc=0} 06:45:07.887274 --- ParallelTerminationStrategy: PID 6695 died... 06:45:07.905806 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6695): Terminated: ok {rc=0} 06:45:07.988918 bus /sierra_3: Setting Powered False 06:45:09.085137 bus /sierra_3: Setting Powered False 06:45:10.199743 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 handover_2G:nanobts+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 handover_2G:nanobts+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 06:45:11.453568 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:45:11.458741 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 06:45:11.507887 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 06:45:11.534496 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 06:45:11.585852 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 06:45:11.636582 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 06:45:11.664394 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 06:45:12.212813 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 handover_2G:nanobts+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 06:45:12.219411 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:45:12.231182 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 06:45:12.269637 tst handover.py: using LAC 26569 06:45:12.394676 tst handover.py: using RAC 49 06:45:12.520816 tst handover.py: using CellId 26569 06:45:12.638997 tst handover.py: using BVCI 26570 06:45:12.749771 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 06:45:12.794549 tst handover.py: using LAC 26570 06:45:12.917043 tst handover.py: using RAC 50 06:45:13.034462 tst handover.py: using CellId 26570 06:45:13.150903 tst handover.py: using BVCI 26571 06:45:13.260939 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:45:13.272085 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:45:13.283124 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:45:13.294712 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:45:13.306098 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:45:13.317283 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 06:45:13.436822 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 06:45:13.554795 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:45:14.022283 run create_hlr_db(pid=6701): Launched 06:45:14.152246 bus /sierra_2: Setting Powered False 06:45:15.216140 run create_hlr_db(pid=6701): Terminated: ok {rc=0} 06:45:15.632528 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6703): Launched 06:45:15.969747 run osmo-hlr_10.42.42.2(pid=6704): Launched 06:45:16.237193 run osmo-stp_10.42.42.5: Starting osmo-stp 06:45:16.823910 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6706): Launched 06:45:17.158333 run osmo-stp_10.42.42.5(pid=6707): Launched 06:45:17.314057 run osmo-msc_10.42.42.6: Starting osmo-msc 06:45:17.834344 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6709): Launched 06:45:18.132669 run osmo-msc_10.42.42.6(pid=6710): Launched 06:45:18.300421 run osmo-stp_10.42.42.5(pid=6707): ERR: Terminated: ERROR {rc=1} [trial-2370↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6707)] 06:45:18.427055 run osmo-stp_10.42.42.5(pid=6707): stdout: | (launched: 2022-12-10_06:45:17.099233) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:45:18.553648 run osmo-stp_10.42.42.5(pid=6707): stderr: | 20221210064517307 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210064517308 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210064517308 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210064517308 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210064517309 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210064517309 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210064517309 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:45:18.678201 run osmo-stp_10.42.42.5(pid=6707): stdout: | (launched: 2022-12-10_06:45:17.099233) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:45:18.796433 run osmo-stp_10.42.42.5(pid=6707): stderr: | 20221210064517307 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210064517308 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210064517308 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210064517308 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210064517309 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210064517309 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210064517309 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:45:18.938326 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=6707): Process ended prematurely: osmo-stp_10.42.42.5(pid=6707) [trial-2370↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6707)] [trial-2370↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18] 06:45:18.946579 tst handover.py:18: Test FAILED (6.7 sec) 06:45:18.972586 run osmo-hlr_10.42.42.2(pid=6704): ERR: Terminated: ERROR {rc=237} [trial-2370↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6704)] 06:45:19.019766 run osmo-hlr_10.42.42.2(pid=6704): stdout: | (launched: 2022-12-10_06:45:15.899507) 06:45:19.068480 run osmo-hlr_10.42.42.2(pid=6704): stderr: | 20221210064516138 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210064516138 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210064516138 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210064516138 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210064516138 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210064516138 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210064516151 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/handover_2G:nanobts+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210064516164 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210064516164 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210064516164 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:45:19.135889 run osmo-msc_10.42.42.6(pid=6710): ERR: Terminated: ERROR {rc=2} [trial-2370↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6710)] 06:45:19.183151 run osmo-msc_10.42.42.6(pid=6710): stdout: | (launched: 2022-12-10_06:45:18.077544) 06:45:19.231847 run osmo-msc_10.42.42.6(pid=6710): stderr: | 20221210064518348 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210064518348 DLGLOBAL DEBUG validating counter group 0x7fdd33865c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210064518348 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210064518348 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210064518349 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210064518349 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210064518350 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210064518351 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210064518351 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210064518351 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:45:19.280775 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6703): Terminating (SIGTERM) 06:45:19.319949 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6706): Terminating (SIGTERM) 06:45:19.359271 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6709): Terminating (SIGTERM) 06:45:19.398759 --- ParallelTerminationStrategy: PID 6703 died... 06:45:19.417741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6703): Terminated: ok {rc=0} 06:45:19.461780 --- ParallelTerminationStrategy: PID 6706 died... 06:45:19.479891 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6706): Terminated: ok {rc=0} 06:45:19.523242 --- ParallelTerminationStrategy: PID 6709 died... 06:45:19.541456 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6709): Terminated: ok {rc=0} 06:45:19.626379 bus /sierra_3: Setting Powered False 06:45:20.723886 bus /sierra_3: Setting Powered False 06:45:21.837794 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 handover_2G:nanobts+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 handover_2G:nanobts+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 06:45:23.090484 tst handover_2G:nanobts+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:45:23.095426 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 06:45:23.148892 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 06:45:23.175360 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 06:45:23.228049 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 06:45:23.281763 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 06:45:23.308073 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 06:45:23.858267 tst handover_2G:nanobts+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 handover_2G:nanobts+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 06:45:23.865129 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:45:23.876646 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 06:45:23.918984 tst handover.py: using LAC 26571 06:45:24.047756 tst handover.py: using RAC 51 06:45:24.173364 tst handover.py: using CellId 26571 06:45:24.297293 tst handover.py: using BVCI 26572 06:45:24.413266 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 06:45:24.462175 tst handover.py: using LAC 26572 06:45:24.590475 tst handover.py: using RAC 52 06:45:24.715664 tst handover.py: using CellId 26572 06:45:24.845201 tst handover.py: using BVCI 26573 06:45:24.962416 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:45:24.973897 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:45:24.985169 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:45:24.996729 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:45:25.008373 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:45:25.019971 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 06:45:25.138478 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 06:45:25.254465 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:45:25.691449 run create_hlr_db(pid=6716): Launched 06:45:25.805549 bus /sierra_2: Setting Powered False 06:45:26.865521 run create_hlr_db(pid=6716): Terminated: ok {rc=0} 06:45:27.273274 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6718): Launched 06:45:27.592441 run osmo-hlr_10.42.42.2(pid=6719): Launched 06:45:27.714688 run osmo-stp_10.42.42.5: Starting osmo-stp 06:45:28.235878 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6721): Launched 06:45:28.555147 run osmo-stp_10.42.42.5(pid=6722): Launched 06:45:28.677606 run osmo-msc_10.42.42.6: Starting osmo-msc 06:45:29.225685 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6724): Launched 06:45:29.544127 run osmo-msc_10.42.42.6(pid=6725): Launched 06:45:29.722451 run osmo-stp_10.42.42.5(pid=6722): ERR: Terminated: ERROR {rc=1} [trial-2370↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6722)] 06:45:29.855854 run osmo-stp_10.42.42.5(pid=6722): stdout: | (launched: 2022-12-10_06:45:28.496880) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:45:29.990861 run osmo-stp_10.42.42.5(pid=6722): stderr: | 20221210064528689 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210064528689 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210064528689 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210064528690 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210064528690 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210064528690 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210064528690 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:45:30.124737 run osmo-stp_10.42.42.5(pid=6722): stdout: | (launched: 2022-12-10_06:45:28.496880) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:45:30.251627 run osmo-stp_10.42.42.5(pid=6722): stderr: | 20221210064528689 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210064528689 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210064528689 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210064528690 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210064528690 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210064528690 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210064528690 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:45:30.403537 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=6722): Process ended prematurely: osmo-stp_10.42.42.5(pid=6722) [trial-2370↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6722)] [trial-2370↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18] 06:45:30.412599 tst handover.py:18: Test FAILED (6.5 sec) 06:45:30.440196 run osmo-hlr_10.42.42.2(pid=6719): ERR: Terminated: ERROR {rc=237} [trial-2370↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6719)] 06:45:30.489773 run osmo-hlr_10.42.42.2(pid=6719): stdout: | (launched: 2022-12-10_06:45:27.534520) 06:45:30.542500 run osmo-hlr_10.42.42.2(pid=6719): stderr: | 20221210064527729 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210064527730 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210064527730 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210064527730 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210064527730 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210064527730 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210064527742 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/handover_2G:nanobts+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210064527751 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210064527752 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210064527752 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:45:30.613904 run osmo-msc_10.42.42.6(pid=6725): ERR: Terminated: ERROR {rc=2} [trial-2370↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6725)] 06:45:30.663379 run osmo-msc_10.42.42.6(pid=6725): stdout: | (launched: 2022-12-10_06:45:29.485928) 06:45:30.714061 run osmo-msc_10.42.42.6(pid=6725): stderr: | 20221210064529807 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210064529807 DLGLOBAL DEBUG validating counter group 0x7f330cf93c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210064529807 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210064529807 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210064529807 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210064529807 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210064529809 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210064529810 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210064529810 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210064529810 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:45:30.765220 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6718): Terminating (SIGTERM) 06:45:30.806409 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6721): Terminating (SIGTERM) 06:45:30.854059 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6724): Terminating (SIGTERM) 06:45:30.906338 --- ParallelTerminationStrategy: PID 6718 died... 06:45:30.936135 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6718): Terminated: ok {rc=0} 06:45:30.982727 --- ParallelTerminationStrategy: PID 6721 died... 06:45:31.002748 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6721): Terminated: ok {rc=0} 06:45:31.072192 --- ParallelTerminationStrategy: PID 6724 died... 06:45:31.094232 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6724): Terminated: ok {rc=0} 06:45:31.182573 bus /sierra_3: Setting Powered False 06:45:32.281633 bus /sierra_3: Setting Powered False 06:45:33.398428 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 handover_2G:nanobts+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 handover_2G:nanobts+bts1-sysmo --------------------------------------------------------------------- 06:45:34.656811 tst handover_2G:nanobts+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:45:34.662316 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x bts (candidates: 11) 06:45:34.703755 tst handover_2G:nanobts+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 06:45:34.729941 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x modem (candidates: 12) 06:45:34.782806 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x bts (candidates: 11) 06:45:34.825787 tst handover_2G:nanobts+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 06:45:34.852714 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x modem (candidates: 12) 06:45:35.401922 tst handover_2G:nanobts+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 handover_2G:nanobts+bts1-sysmo handover.py ---------------------------------------------- 06:45:35.408305 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:45:35.420179 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 06:45:35.459818 tst handover.py: using LAC 26573 06:45:35.580523 tst handover.py: using RAC 53 06:45:35.706601 tst handover.py: using CellId 26573 06:45:35.831824 tst handover.py: using BVCI 26574 06:45:35.948079 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 06:45:35.983966 tst handover.py: using LAC 26574 06:45:36.108850 tst handover.py: using RAC 54 06:45:36.226628 tst handover.py: using CellId 26574 06:45:36.346347 tst handover.py: using BVCI 26575 06:45:36.455497 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:45:36.466559 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:45:36.477386 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:45:36.488675 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:45:36.499660 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:45:36.510621 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 06:45:36.629868 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 06:45:36.749443 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:45:37.215447 run create_hlr_db(pid=6731): Launched 06:45:37.344725 bus /sierra_2: Setting Powered False 06:45:38.407770 run create_hlr_db(pid=6731): Terminated: ok {rc=0} 06:45:38.824302 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6733): Launched 06:45:39.142531 run osmo-hlr_10.42.42.2(pid=6734): Launched 06:45:39.264080 run osmo-stp_10.42.42.5: Starting osmo-stp 06:45:39.789118 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6736): Launched 06:45:40.108510 run osmo-stp_10.42.42.5(pid=6737): Launched 06:45:40.230503 run osmo-msc_10.42.42.6: Starting osmo-msc 06:45:40.780496 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6739): Launched 06:45:41.099570 run osmo-msc_10.42.42.6(pid=6740): Launched 06:45:41.277870 run osmo-stp_10.42.42.5(pid=6737): ERR: Terminated: ERROR {rc=1} [trial-2370↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6737)] 06:45:41.411750 run osmo-stp_10.42.42.5(pid=6737): stdout: | (launched: 2022-12-10_06:45:40.050319) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:45:41.546583 run osmo-stp_10.42.42.5(pid=6737): stderr: | 20221210064540242 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210064540242 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210064540243 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210064540243 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210064540244 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210064540244 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210064540244 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:45:41.681187 run osmo-stp_10.42.42.5(pid=6737): stdout: | (launched: 2022-12-10_06:45:40.050319) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:45:41.808059 run osmo-stp_10.42.42.5(pid=6737): stderr: | 20221210064540242 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210064540242 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210064540243 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210064540243 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210064540244 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210064540244 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210064540244 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:45:41.960164 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=6737): Process ended prematurely: osmo-stp_10.42.42.5(pid=6737) [trial-2370↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6737)] [trial-2370↪handover_2G:nanobts+bts1-sysmo↪handover.py:18] 06:45:41.969369 tst handover.py:18: Test FAILED (6.6 sec) 06:45:41.996837 run osmo-hlr_10.42.42.2(pid=6734): ERR: Terminated: ERROR {rc=237} [trial-2370↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6734)] 06:45:42.046356 run osmo-hlr_10.42.42.2(pid=6734): stdout: | (launched: 2022-12-10_06:45:39.084416) 06:45:42.097919 run osmo-hlr_10.42.42.2(pid=6734): stderr: | 20221210064539281 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210064539281 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210064539281 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210064539281 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210064539281 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210064539281 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210064539294 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/handover_2G:nanobts+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210064539303 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210064539303 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210064539303 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:45:42.169681 run osmo-msc_10.42.42.6(pid=6740): ERR: Terminated: ERROR {rc=2} [trial-2370↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6740)] 06:45:42.218926 run osmo-msc_10.42.42.6(pid=6740): stdout: | (launched: 2022-12-10_06:45:41.041062) 06:45:42.269570 run osmo-msc_10.42.42.6(pid=6740): stderr: | 20221210064541365 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210064541365 DLGLOBAL DEBUG validating counter group 0x7f46c9550c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210064541365 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210064541365 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210064541366 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210064541366 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210064541367 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210064541368 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210064541368 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210064541368 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:45:42.320615 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6733): Terminating (SIGTERM) 06:45:42.361449 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6736): Terminating (SIGTERM) 06:45:42.402334 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6739): Terminating (SIGTERM) 06:45:42.443685 --- ParallelTerminationStrategy: PID 6733 died... 06:45:42.463295 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6733): Terminated: ok {rc=0} 06:45:42.508695 --- ParallelTerminationStrategy: PID 6736 died... 06:45:42.528064 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6736): Terminated: ok {rc=0} 06:45:42.573146 --- ParallelTerminationStrategy: PID 6739 died... 06:45:42.592510 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6739): Terminated: ok {rc=0} 06:45:42.678641 bus /sierra_3: Setting Powered False 06:45:43.776907 bus /sierra_3: Setting Powered False 06:45:44.893536 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 handover_2G:nanobts+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 handover_2G:nanobts+bts1-trx-b200 --------------------------------------------------------------------- 06:45:46.148012 tst handover_2G:nanobts+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:45:46.157082 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 06:45:46.231222 tst handover_2G:nanobts+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 06:45:46.270542 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 06:45:46.336287 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 06:45:46.423411 tst handover_2G:nanobts+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 06:45:46.454052 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 06:45:46.987809 tst handover_2G:nanobts+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 handover_2G:nanobts+bts1-trx-b200 handover.py ---------------------------------------------- 06:45:46.996910 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:45:47.008825 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 06:45:47.051024 tst handover.py: using LAC 26575 06:45:47.209152 tst handover.py: using RAC 55 06:45:47.329102 tst handover.py: using CellId 26575 06:45:47.449398 tst handover.py: using BVCI 26576 06:45:47.557931 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 06:45:47.606077 tst handover.py: using LAC 26576 06:45:47.725615 tst handover.py: using RAC 56 06:45:47.843378 tst handover.py: using CellId 26576 06:45:47.961329 tst handover.py: using BVCI 26577 06:45:48.071198 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:45:48.082304 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:45:48.093193 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:45:48.104449 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:45:48.115913 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:45:48.127165 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 06:45:48.242880 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 06:45:48.360936 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:45:48.829890 run create_hlr_db(pid=6745): Launched 06:45:48.959249 bus /sierra_2: Setting Powered False 06:45:50.022488 run create_hlr_db(pid=6745): Terminated: ok {rc=0} 06:45:50.440915 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6747): Launched 06:45:50.761940 run osmo-hlr_10.42.42.2(pid=6748): Launched 06:45:50.883845 run osmo-stp_10.42.42.5: Starting osmo-stp 06:45:51.408018 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6750): Launched 06:45:51.728639 run osmo-stp_10.42.42.5(pid=6751): Launched 06:45:51.851361 run osmo-msc_10.42.42.6: Starting osmo-msc 06:45:52.403841 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6753): Launched 06:45:52.724438 run osmo-msc_10.42.42.6(pid=6754): Launched 06:45:52.903854 run osmo-stp_10.42.42.5(pid=6751): ERR: Terminated: ERROR {rc=1} [trial-2370↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6751)] 06:45:53.038191 run osmo-stp_10.42.42.5(pid=6751): stdout: | (launched: 2022-12-10_06:45:51.669707) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:45:53.173196 run osmo-stp_10.42.42.5(pid=6751): stderr: | 20221210064551861 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210064551861 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210064551862 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210064551862 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210064551862 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210064551863 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210064551863 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:45:53.307515 run osmo-stp_10.42.42.5(pid=6751): stdout: | (launched: 2022-12-10_06:45:51.669707) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:45:53.434631 run osmo-stp_10.42.42.5(pid=6751): stderr: | 20221210064551861 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210064551861 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210064551862 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210064551862 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210064551862 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210064551863 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210064551863 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:45:53.586875 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=6751): Process ended prematurely: osmo-stp_10.42.42.5(pid=6751) [trial-2370↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6751)] [trial-2370↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18] 06:45:53.595555 tst handover.py:18: Test FAILED (6.6 sec) 06:45:53.623226 run osmo-hlr_10.42.42.2(pid=6748): ERR: Terminated: ERROR {rc=237} [trial-2370↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6748)] 06:45:53.672825 run osmo-hlr_10.42.42.2(pid=6748): stdout: | (launched: 2022-12-10_06:45:50.703630) 06:45:53.724244 run osmo-hlr_10.42.42.2(pid=6748): stderr: | 20221210064550901 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210064550901 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210064550901 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210064550901 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210064550901 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210064550901 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210064550914 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/handover_2G:nanobts+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210064550922 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210064550923 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210064550923 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:45:53.796042 run osmo-msc_10.42.42.6(pid=6754): ERR: Terminated: ERROR {rc=2} [trial-2370↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6754)] 06:45:53.845712 run osmo-msc_10.42.42.6(pid=6754): stdout: | (launched: 2022-12-10_06:45:52.665801) 06:45:53.897093 run osmo-msc_10.42.42.6(pid=6754): stderr: | 20221210064552990 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210064552990 DLGLOBAL DEBUG validating counter group 0x7fbea95c0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210064552991 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210064552991 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210064552991 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210064552991 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210064552993 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210064552993 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210064552993 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210064552993 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:45:53.948558 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6747): Terminating (SIGTERM) 06:45:53.990059 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6750): Terminating (SIGTERM) 06:45:54.031566 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6753): Terminating (SIGTERM) 06:45:54.073605 --- ParallelTerminationStrategy: PID 6747 died... 06:45:54.093456 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6747): Terminated: ok {rc=0} 06:45:54.139263 --- ParallelTerminationStrategy: PID 6750 died... 06:45:54.158556 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6750): Terminated: ok {rc=0} 06:45:54.204369 --- ParallelTerminationStrategy: PID 6753 died... 06:45:54.223735 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6753): Terminated: ok {rc=0} 06:45:54.310417 bus /sierra_3: Setting Powered False 06:45:55.409086 bus /sierra_3: Setting Powered False 06:45:56.525931 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 handover_2G:nanobts+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 handover_2G:nanobts+bts1-trx-umtrx --------------------------------------------------------------------- 06:45:57.787211 tst handover_2G:nanobts+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:45:57.793181 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 06:45:57.847288 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 06:45:57.874396 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 06:45:57.927000 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 06:45:57.980059 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 06:45:58.006880 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 06:45:58.558921 tst handover_2G:nanobts+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 handover_2G:nanobts+bts1-trx-umtrx handover.py ---------------------------------------------- 06:45:58.564288 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:45:58.575482 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 06:45:58.614020 tst handover.py: using LAC 26577 06:45:58.743896 tst handover.py: using RAC 57 06:45:58.868479 tst handover.py: using CellId 26577 06:45:58.991543 tst handover.py: using BVCI 26578 06:45:59.107044 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 06:45:59.154027 tst handover.py: using LAC 26578 06:45:59.277229 tst handover.py: using RAC 58 06:45:59.400335 tst handover.py: using CellId 26578 06:45:59.522400 tst handover.py: using BVCI 26579 06:45:59.637913 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:45:59.649230 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:45:59.660424 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:45:59.671625 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:45:59.682818 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:45:59.693999 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 06:45:59.808222 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 06:45:59.926949 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:46:00.394861 run create_hlr_db(pid=6759): Launched 06:46:00.524788 bus /sierra_2: Setting Powered False 06:46:01.605503 run create_hlr_db(pid=6759): Terminated: ok {rc=0} 06:46:02.110511 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6761): Launched 06:46:02.422309 run osmo-hlr_10.42.42.2(pid=6762): Launched 06:46:02.538485 run osmo-stp_10.42.42.5: Starting osmo-stp 06:46:03.040607 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6764): Launched 06:46:03.339058 run osmo-stp_10.42.42.5(pid=6765): Launched 06:46:03.453183 run osmo-msc_10.42.42.6: Starting osmo-msc 06:46:03.970361 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6767): Launched 06:46:04.270214 run osmo-msc_10.42.42.6(pid=6768): Launched 06:46:04.437909 run osmo-stp_10.42.42.5(pid=6765): ERR: Terminated: ERROR {rc=1} [trial-2370↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6765)] 06:46:04.564828 run osmo-stp_10.42.42.5(pid=6765): stdout: | (launched: 2022-12-10_06:46:03.283961) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:46:04.691898 run osmo-stp_10.42.42.5(pid=6765): stderr: | 20221210064603455 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210064603455 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210064603455 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210064603456 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210064603456 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210064603456 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210064603456 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:46:04.816384 run osmo-stp_10.42.42.5(pid=6765): stdout: | (launched: 2022-12-10_06:46:03.283961) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:46:04.934945 run osmo-stp_10.42.42.5(pid=6765): stderr: | 20221210064603455 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210064603455 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210064603455 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210064603456 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210064603456 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210064603456 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210064603456 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:46:05.076718 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=6765): Process ended prematurely: osmo-stp_10.42.42.5(pid=6765) [trial-2370↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6765)] [trial-2370↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18] 06:46:05.085235 tst handover.py:18: Test FAILED (6.5 sec) 06:46:05.111595 run osmo-hlr_10.42.42.2(pid=6762): ERR: Terminated: ERROR {rc=237} [trial-2370↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6762)] 06:46:05.159238 run osmo-hlr_10.42.42.2(pid=6762): stdout: | (launched: 2022-12-10_06:46:02.367119) 06:46:05.208628 run osmo-hlr_10.42.42.2(pid=6762): stderr: | 20221210064602542 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210064602542 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210064602543 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210064602543 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210064602543 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210064602543 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210064602556 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/handover_2G:nanobts+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210064602565 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210064602566 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210064602566 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:46:05.277136 run osmo-msc_10.42.42.6(pid=6768): ERR: Terminated: ERROR {rc=2} [trial-2370↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6768)] 06:46:05.324420 run osmo-msc_10.42.42.6(pid=6768): stdout: | (launched: 2022-12-10_06:46:04.215110) 06:46:05.373314 run osmo-msc_10.42.42.6(pid=6768): stderr: | 20221210064604486 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210064604486 DLGLOBAL DEBUG validating counter group 0x7fee4a76fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210064604486 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210064604486 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210064604487 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210064604487 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210064604489 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210064604489 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210064604489 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210064604489 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:46:05.422983 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6761): Terminating (SIGTERM) 06:46:05.462409 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6764): Terminating (SIGTERM) 06:46:05.501891 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6767): Terminating (SIGTERM) 06:46:05.541676 --- ParallelTerminationStrategy: PID 6761 died... 06:46:05.560454 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6761): Terminated: ok {rc=0} 06:46:05.604665 --- ParallelTerminationStrategy: PID 6764 died... 06:46:05.623223 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6764): Terminated: ok {rc=0} 06:46:05.667492 --- ParallelTerminationStrategy: PID 6767 died... 06:46:05.685948 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6767): Terminated: ok {rc=0} 06:46:05.770856 bus /sierra_3: Setting Powered False 06:46:06.870395 bus /sierra_3: Setting Powered False 06:46:07.985928 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 handover_2G:nanobts+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 handover_2G:oc2g+bts1-octphy --------------------------------------------------------------------- 06:46:09.245890 tst handover_2G:oc2g+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:46:09.251087 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x bts (candidates: 11) 06:46:09.287651 tst handover_2G:oc2g+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 06:46:09.314224 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x modem (candidates: 12) 06:46:09.365565 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x bts (candidates: 11) 06:46:09.401913 tst handover_2G:oc2g+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 06:46:09.428242 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x modem (candidates: 12) 06:46:09.976728 tst handover_2G:oc2g+bts1-octphy: RESERVED RESOURCES for handover_2G: bts OC-2G OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 handover_2G:oc2g+bts1-octphy handover.py ---------------------------------------------- 06:46:09.982101 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 06:46:09.992885 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 06:46:10.027495 tst handover.py: using LAC 26579 06:46:10.155393 tst handover.py: using RAC 59 06:46:10.283812 tst handover.py: using CellId 26579 06:46:10.409385 tst handover.py: using BVCI 26580 06:46:10.525984 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 06:46:10.560593 tst handover.py: using LAC 26580 06:46:10.686399 tst handover.py: using RAC 60 06:46:10.811383 tst handover.py: using CellId 26580 06:46:10.937150 tst handover.py: using BVCI 26581 06:46:11.053663 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 06:46:11.064921 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 06:46:11.075988 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 06:46:11.087757 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 06:46:11.099431 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 06:46:11.111095 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 06:46:11.231997 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 06:46:11.353099 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:46:11.821594 run create_hlr_db(pid=6774): Launched 06:46:11.950936 bus /sierra_2: Setting Powered False 06:46:13.013930 run create_hlr_db(pid=6774): Terminated: ok {rc=0} 06:46:13.414817 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6776): Launched 06:46:13.714437 run osmo-hlr_10.42.42.2(pid=6777): Launched 06:46:13.828477 run osmo-stp_10.42.42.5: Starting osmo-stp 06:46:14.333448 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6779): Launched 06:46:14.632048 run osmo-stp_10.42.42.5(pid=6780): Launched 06:46:14.746525 run osmo-msc_10.42.42.6: Starting osmo-msc 06:46:15.262073 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6782): Launched 06:46:15.561503 run osmo-msc_10.42.42.6(pid=6783): Launched 06:46:15.729586 run osmo-stp_10.42.42.5(pid=6780): ERR: Terminated: ERROR {rc=1} [trial-2370↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6780)] 06:46:15.863279 run osmo-stp_10.42.42.5(pid=6780): stdout: | (launched: 2022-12-10_06:46:14.577619) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:46:16.063505 run osmo-stp_10.42.42.5(pid=6780): stderr: | 20221210064614744 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210064614744 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210064614745 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210064614745 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210064614748 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210064614748 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210064614748 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:46:16.222690 run osmo-stp_10.42.42.5(pid=6780): stdout: | (launched: 2022-12-10_06:46:14.577619) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:46:16.348482 run osmo-stp_10.42.42.5(pid=6780): stderr: | 20221210064614744 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210064614744 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210064614745 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210064614745 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210064614748 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210064614748 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210064614748 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:46:16.497145 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=6780): Process ended prematurely: osmo-stp_10.42.42.5(pid=6780) [trial-2370↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6780)] [trial-2370↪handover_2G:oc2g+bts1-octphy↪handover.py:18] 06:46:16.506473 tst handover.py:18: Test FAILED (6.5 sec) 06:46:16.535988 run osmo-hlr_10.42.42.2(pid=6777): ERR: Terminated: ERROR {rc=237} [trial-2370↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6777)] 06:46:16.586614 run osmo-hlr_10.42.42.2(pid=6777): stdout: | (launched: 2022-12-10_06:46:13.659557) 06:46:16.640330 run osmo-hlr_10.42.42.2(pid=6777): stderr: | 20221210064613836 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210064613836 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210064613836 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210064613836 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210064613836 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210064613836 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210064613848 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/handover_2G:oc2g+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210064613857 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210064613857 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210064613857 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:46:16.712029 run osmo-msc_10.42.42.6(pid=6783): ERR: Terminated: ERROR {rc=2} [trial-2370↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6783)] 06:46:16.762232 run osmo-msc_10.42.42.6(pid=6783): stdout: | (launched: 2022-12-10_06:46:15.505959) 06:46:16.813589 run osmo-msc_10.42.42.6(pid=6783): stderr: | 20221210064615777 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210064615777 DLGLOBAL DEBUG validating counter group 0x7f07b9376c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210064615777 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210064615777 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210064615778 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210064615778 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210064615779 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210064615780 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210064615780 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210064615780 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:46:16.865290 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6776): Terminating (SIGTERM) 06:46:16.906839 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6779): Terminating (SIGTERM) 06:46:16.948367 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6782): Terminating (SIGTERM) 06:46:16.990286 --- ParallelTerminationStrategy: PID 6776 died... 06:46:17.009804 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6776): Terminated: ok {rc=0} 06:46:17.056655 --- ParallelTerminationStrategy: PID 6779 died... 06:46:17.076041 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6779): Terminated: ok {rc=0} 06:46:17.124194 --- ParallelTerminationStrategy: PID 6782 died... 06:46:17.144139 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6782): Terminated: ok {rc=0} 06:46:17.234490 bus /sierra_3: Setting Powered False 06:46:18.333139 bus /sierra_3: Setting Powered False 06:46:19.447590 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 handover_2G:oc2g+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 handover_2G:oc2g+bts1-trx-lms --------------------------------------------------------------------- 06:46:20.683177 tst handover_2G:oc2g+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:46:20.688474 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 06:46:20.738821 tst handover_2G:oc2g+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 06:46:20.765431 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 06:46:20.817433 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 06:46:20.867394 tst handover_2G:oc2g+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 06:46:20.893690 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 06:46:21.442403 tst handover_2G:oc2g+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OC-2G LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 handover_2G:oc2g+bts1-trx-lms handover.py ---------------------------------------------- 06:46:21.447814 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 06:46:21.458585 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 06:46:21.492562 tst handover.py: using LAC 26581 06:46:21.610671 tst handover.py: using RAC 61 06:46:21.728063 tst handover.py: using CellId 26581 06:46:21.845577 tst handover.py: using BVCI 26582 06:46:21.956051 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 06:46:22.003839 tst handover.py: using LAC 26582 06:46:22.129496 tst handover.py: using RAC 62 06:46:22.248035 tst handover.py: using CellId 26582 06:46:22.365396 tst handover.py: using BVCI 26583 06:46:22.475608 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 06:46:22.486616 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 06:46:22.497503 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 06:46:22.509060 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 06:46:22.520324 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 06:46:22.531801 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 06:46:22.653379 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 06:46:22.773482 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:46:23.242338 run create_hlr_db(pid=6788): Launched 06:46:23.373579 bus /sierra_2: Setting Powered False 06:46:24.437085 run create_hlr_db(pid=6788): Terminated: ok {rc=0} 06:46:24.839113 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6790): Launched 06:46:25.137592 run osmo-hlr_10.42.42.2(pid=6791): Launched 06:46:25.251932 run osmo-stp_10.42.42.5: Starting osmo-stp 06:46:25.754464 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6793): Launched 06:46:26.053032 run osmo-stp_10.42.42.5(pid=6794): Launched 06:46:26.167111 run osmo-msc_10.42.42.6: Starting osmo-msc 06:46:26.682420 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6796): Launched 06:46:26.981584 run osmo-msc_10.42.42.6(pid=6797): Launched 06:46:27.150177 run osmo-stp_10.42.42.5(pid=6794): ERR: Terminated: ERROR {rc=1} [trial-2370↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6794)] 06:46:27.276930 run osmo-stp_10.42.42.5(pid=6794): stdout: | (launched: 2022-12-10_06:46:25.998157) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:46:27.403494 run osmo-stp_10.42.42.5(pid=6794): stderr: | 20221210064626167 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210064626167 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210064626167 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210064626168 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210064626170 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210064626170 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210064626170 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:46:27.528349 run osmo-stp_10.42.42.5(pid=6794): stdout: | (launched: 2022-12-10_06:46:25.998157) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:46:27.646917 run osmo-stp_10.42.42.5(pid=6794): stderr: | 20221210064626167 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210064626167 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210064626167 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210064626168 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210064626170 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210064626170 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210064626170 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:46:27.788891 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=6794): Process ended prematurely: osmo-stp_10.42.42.5(pid=6794) [trial-2370↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6794)] [trial-2370↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18] 06:46:27.797131 tst handover.py:18: Test FAILED (6.3 sec) 06:46:27.823101 run osmo-hlr_10.42.42.2(pid=6791): ERR: Terminated: ERROR {rc=237} [trial-2370↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6791)] 06:46:27.870269 run osmo-hlr_10.42.42.2(pid=6791): stdout: | (launched: 2022-12-10_06:46:25.082864) 06:46:27.918935 run osmo-hlr_10.42.42.2(pid=6791): stderr: | 20221210064625259 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210064625259 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210064625259 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210064625259 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210064625260 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210064625260 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210064625271 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/handover_2G:oc2g+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210064625280 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210064625280 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210064625280 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:46:27.986855 run osmo-msc_10.42.42.6(pid=6797): ERR: Terminated: ERROR {rc=2} [trial-2370↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6797)] 06:46:28.033681 run osmo-msc_10.42.42.6(pid=6797): stdout: | (launched: 2022-12-10_06:46:26.926257) 06:46:28.082156 run osmo-msc_10.42.42.6(pid=6797): stderr: | 20221210064627196 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210064627196 DLGLOBAL DEBUG validating counter group 0x7f06c5f4fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210064627196 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210064627196 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210064627196 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210064627196 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210064627198 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210064627199 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210064627199 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210064627199 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:46:28.131075 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6790): Terminating (SIGTERM) 06:46:28.170066 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6793): Terminating (SIGTERM) 06:46:28.209149 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6796): Terminating (SIGTERM) 06:46:28.248460 --- ParallelTerminationStrategy: PID 6790 died... 06:46:28.267043 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6790): Terminated: ok {rc=0} 06:46:28.310432 --- ParallelTerminationStrategy: PID 6793 died... 06:46:28.328549 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6793): Terminated: ok {rc=0} 06:46:28.372049 --- ParallelTerminationStrategy: PID 6796 died... 06:46:28.390195 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6796): Terminated: ok {rc=0} 06:46:28.474867 bus /sierra_3: Setting Powered False 06:46:29.573559 bus /sierra_3: Setting Powered False 06:46:30.687587 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 handover_2G:oc2g+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 handover_2G:oc2g+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 06:46:31.985910 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:46:31.991865 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 06:46:32.081420 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 06:46:32.131484 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 06:46:32.187760 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 06:46:32.250286 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 06:46:32.343053 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 06:46:32.809445 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OC-2G LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 handover_2G:oc2g+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 06:46:32.814743 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:46:32.825944 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 06:46:32.861305 tst handover.py: using LAC 26583 06:46:32.977930 tst handover.py: using RAC 63 06:46:33.094352 tst handover.py: using CellId 26583 06:46:33.213268 tst handover.py: using BVCI 26584 06:46:33.322232 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 06:46:33.366228 tst handover.py: using LAC 26584 06:46:33.489441 tst handover.py: using RAC 64 06:46:33.606722 tst handover.py: using CellId 26584 06:46:33.723444 tst handover.py: using BVCI 26585 06:46:33.831479 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:46:33.842668 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:46:33.853609 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:46:33.864756 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:46:33.876019 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:46:33.887174 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 06:46:34.001004 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 06:46:34.119838 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:46:34.589998 run create_hlr_db(pid=6803): Launched 06:46:34.721590 bus /sierra_2: Setting Powered False 06:46:35.785242 run create_hlr_db(pid=6803): Terminated: ok {rc=0} 06:46:36.187650 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6805): Launched 06:46:36.488404 run osmo-hlr_10.42.42.2(pid=6806): Launched 06:46:36.604596 run osmo-stp_10.42.42.5: Starting osmo-stp 06:46:37.108138 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6808): Launched 06:46:37.406619 run osmo-stp_10.42.42.5(pid=6809): Launched 06:46:37.520562 run osmo-msc_10.42.42.6: Starting osmo-msc 06:46:38.038204 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6811): Launched 06:46:38.337385 run osmo-msc_10.42.42.6(pid=6812): Launched 06:46:38.505291 run osmo-stp_10.42.42.5(pid=6809): ERR: Terminated: ERROR {rc=1} [trial-2370↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6809)] 06:46:38.633792 run osmo-stp_10.42.42.5(pid=6809): stdout: | (launched: 2022-12-10_06:46:37.351616) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:46:38.760393 run osmo-stp_10.42.42.5(pid=6809): stderr: | 20221210064637520 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210064637521 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210064637521 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210064637521 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210064637522 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210064637522 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210064637522 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:46:38.884682 run osmo-stp_10.42.42.5(pid=6809): stdout: | (launched: 2022-12-10_06:46:37.351616) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:46:39.002808 run osmo-stp_10.42.42.5(pid=6809): stderr: | 20221210064637520 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210064637521 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210064637521 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210064637521 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210064637522 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210064637522 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210064637522 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:46:39.144673 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=6809): Process ended prematurely: osmo-stp_10.42.42.5(pid=6809) [trial-2370↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6809)] [trial-2370↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18] 06:46:39.152914 tst handover.py:18: Test FAILED (6.3 sec) 06:46:39.178991 run osmo-hlr_10.42.42.2(pid=6806): ERR: Terminated: ERROR {rc=237} [trial-2370↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6806)] 06:46:39.226443 run osmo-hlr_10.42.42.2(pid=6806): stdout: | (launched: 2022-12-10_06:46:36.432784) 06:46:39.275354 run osmo-hlr_10.42.42.2(pid=6806): stderr: | 20221210064636609 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210064636609 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210064636609 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210064636609 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210064636609 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210064636609 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210064636622 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/handover_2G:oc2g+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210064636630 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210064636631 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210064636631 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:46:39.344499 run osmo-msc_10.42.42.6(pid=6812): ERR: Terminated: ERROR {rc=2} [trial-2370↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6812)] 06:46:39.391917 run osmo-msc_10.42.42.6(pid=6812): stdout: | (launched: 2022-12-10_06:46:38.282364) 06:46:39.440551 run osmo-msc_10.42.42.6(pid=6812): stderr: | 20221210064638553 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210064638553 DLGLOBAL DEBUG validating counter group 0x7f8584c9ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210064638554 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210064638554 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210064638554 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210064638554 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210064638556 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210064638557 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210064638557 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210064638557 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:46:39.489828 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6805): Terminating (SIGTERM) 06:46:39.528830 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6808): Terminating (SIGTERM) 06:46:39.568154 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6811): Terminating (SIGTERM) 06:46:39.607496 --- ParallelTerminationStrategy: PID 6805 died... 06:46:39.626062 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6805): Terminated: ok {rc=0} 06:46:39.669585 --- ParallelTerminationStrategy: PID 6808 died... 06:46:39.687733 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6808): Terminated: ok {rc=0} 06:46:39.731219 --- ParallelTerminationStrategy: PID 6811 died... 06:46:39.749405 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6811): Terminated: ok {rc=0} 06:46:39.833649 bus /sierra_3: Setting Powered False 06:46:40.931684 bus /sierra_3: Setting Powered False 06:46:42.043275 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 handover_2G:oc2g+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 handover_2G:oc2g+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 06:46:43.295852 tst handover_2G:oc2g+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:46:43.300802 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 06:46:43.350993 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 06:46:43.377261 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 06:46:43.432378 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 06:46:43.483136 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 06:46:43.509210 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 06:46:44.056108 tst handover_2G:oc2g+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 handover_2G:oc2g+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 06:46:44.061341 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:46:44.071985 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 06:46:44.106489 tst handover.py: using LAC 26585 06:46:44.224269 tst handover.py: using RAC 65 06:46:44.340398 tst handover.py: using CellId 26585 06:46:44.467294 tst handover.py: using BVCI 26586 06:46:44.583627 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 06:46:44.635777 tst handover.py: using LAC 26586 06:46:44.761105 tst handover.py: using RAC 66 06:46:44.884359 tst handover.py: using CellId 26586 06:46:45.011728 tst handover.py: using BVCI 26587 06:46:45.128376 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:46:45.139765 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:46:45.151047 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:46:45.162493 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:46:45.174386 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:46:45.186023 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 06:46:45.300217 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 06:46:45.415020 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:46:45.862289 run create_hlr_db(pid=6817): Launched 06:46:45.983957 bus /sierra_2: Setting Powered False 06:46:47.044072 run create_hlr_db(pid=6817): Terminated: ok {rc=0} 06:46:47.442610 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6819): Launched 06:46:47.742209 run osmo-hlr_10.42.42.2(pid=6820): Launched 06:46:47.855858 run osmo-stp_10.42.42.5: Starting osmo-stp 06:46:48.360300 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6822): Launched 06:46:48.660187 run osmo-stp_10.42.42.5(pid=6823): Launched 06:46:48.774834 run osmo-msc_10.42.42.6: Starting osmo-msc 06:46:49.290367 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6825): Launched 06:46:49.589319 run osmo-msc_10.42.42.6(pid=6826): Launched 06:46:49.756803 run osmo-stp_10.42.42.5(pid=6823): ERR: Terminated: ERROR {rc=1} [trial-2370↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6823)] 06:46:49.883839 run osmo-stp_10.42.42.5(pid=6823): stdout: | (launched: 2022-12-10_06:46:48.605255) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:46:50.010628 run osmo-stp_10.42.42.5(pid=6823): stderr: | 20221210064648776 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210064648776 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210064648776 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210064648777 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210064648777 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210064648777 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210064648778 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:46:50.135263 run osmo-stp_10.42.42.5(pid=6823): stdout: | (launched: 2022-12-10_06:46:48.605255) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:46:50.253902 run osmo-stp_10.42.42.5(pid=6823): stderr: | 20221210064648776 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210064648776 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210064648776 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210064648777 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210064648777 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210064648777 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210064648778 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:46:50.396356 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=6823): Process ended prematurely: osmo-stp_10.42.42.5(pid=6823) [trial-2370↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6823)] [trial-2370↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18] 06:46:50.404614 tst handover.py:18: Test FAILED (6.3 sec) 06:46:50.430928 run osmo-hlr_10.42.42.2(pid=6820): ERR: Terminated: ERROR {rc=237} [trial-2370↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6820)] 06:46:50.478643 run osmo-hlr_10.42.42.2(pid=6820): stdout: | (launched: 2022-12-10_06:46:47.686629) 06:46:50.527971 run osmo-hlr_10.42.42.2(pid=6820): stderr: | 20221210064647863 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210064647863 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210064647863 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210064647863 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210064647863 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210064647863 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210064647875 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/handover_2G:oc2g+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210064647885 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210064647885 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210064647885 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:46:50.596449 run osmo-msc_10.42.42.6(pid=6826): ERR: Terminated: ERROR {rc=2} [trial-2370↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6826)] 06:46:50.643944 run osmo-msc_10.42.42.6(pid=6826): stdout: | (launched: 2022-12-10_06:46:49.534482) 06:46:50.692863 run osmo-msc_10.42.42.6(pid=6826): stderr: | 20221210064649802 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210064649803 DLGLOBAL DEBUG validating counter group 0x7ffbecc9fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210064649803 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210064649803 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210064649803 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210064649803 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210064649805 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210064649805 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210064649805 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210064649805 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:46:50.742208 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6819): Terminating (SIGTERM) 06:46:50.781303 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6822): Terminating (SIGTERM) 06:46:50.820710 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6825): Terminating (SIGTERM) 06:46:50.860428 --- ParallelTerminationStrategy: PID 6819 died... 06:46:50.879302 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6819): Terminated: ok {rc=0} 06:46:50.923108 --- ParallelTerminationStrategy: PID 6822 died... 06:46:50.941539 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6822): Terminated: ok {rc=0} 06:46:50.985216 --- ParallelTerminationStrategy: PID 6825 died... 06:46:51.003541 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6825): Terminated: ok {rc=0} 06:46:51.089482 bus /sierra_3: Setting Powered False 06:46:52.189547 bus /sierra_3: Setting Powered False 06:46:53.304429 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 handover_2G:oc2g+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 handover_2G:oc2g+bts1-sysmo --------------------------------------------------------------------- 06:46:54.557630 tst handover_2G:oc2g+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:46:54.562875 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x bts (candidates: 11) 06:46:54.601643 tst handover_2G:oc2g+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 06:46:54.627717 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x modem (candidates: 12) 06:46:54.679545 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x bts (candidates: 11) 06:46:54.717331 tst handover_2G:oc2g+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 06:46:54.743460 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x modem (candidates: 12) 06:46:55.292752 tst handover_2G:oc2g+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 handover_2G:oc2g+bts1-sysmo handover.py ---------------------------------------------- 06:46:55.298242 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:46:55.309069 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 06:46:55.343232 tst handover.py: using LAC 26587 06:46:55.461418 tst handover.py: using RAC 67 06:46:55.588551 tst handover.py: using CellId 26587 06:46:55.716490 tst handover.py: using BVCI 26588 06:46:55.832691 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 06:46:55.868862 tst handover.py: using LAC 26588 06:46:55.994436 tst handover.py: using RAC 68 06:46:56.121471 tst handover.py: using CellId 26588 06:46:56.246877 tst handover.py: using BVCI 26589 06:46:56.363028 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:46:56.374645 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:46:56.385644 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:46:56.396722 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:46:56.407970 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:46:56.419173 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 06:46:56.540148 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 06:46:56.655465 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:46:57.093455 run create_hlr_db(pid=6831): Launched 06:46:57.208465 bus /sierra_2: Setting Powered False 06:46:58.272335 run create_hlr_db(pid=6831): Terminated: ok {rc=0} 06:46:58.675322 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6833): Launched 06:46:58.974548 run osmo-hlr_10.42.42.2(pid=6834): Launched 06:46:59.089154 run osmo-stp_10.42.42.5: Starting osmo-stp 06:46:59.577083 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6836): Launched 06:46:59.876290 run osmo-stp_10.42.42.5(pid=6837): Launched 06:46:59.991205 run osmo-msc_10.42.42.6: Starting osmo-msc 06:47:00.506800 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6839): Launched 06:47:00.805871 run osmo-msc_10.42.42.6(pid=6840): Launched 06:47:01.081208 run osmo-stp_10.42.42.5(pid=6837): ERR: Terminated: ERROR {rc=1} [trial-2370↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6837)] 06:47:01.367638 run osmo-stp_10.42.42.5(pid=6837): stdout: | (launched: 2022-12-10_06:46:59.821367) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:47:01.558686 run osmo-stp_10.42.42.5(pid=6837): stderr: | 20221210064659992 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210064659992 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210064659992 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210064659993 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210064659993 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210064659993 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210064659994 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:47:01.700042 run osmo-stp_10.42.42.5(pid=6837): stdout: | (launched: 2022-12-10_06:46:59.821367) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:47:01.834548 run osmo-stp_10.42.42.5(pid=6837): stderr: | 20221210064659992 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210064659992 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210064659992 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210064659993 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210064659993 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210064659993 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210064659994 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:47:01.992062 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=6837): Process ended prematurely: osmo-stp_10.42.42.5(pid=6837) [trial-2370↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6837)] [trial-2370↪handover_2G:oc2g+bts1-sysmo↪handover.py:18] 06:47:02.001361 tst handover.py:18: Test FAILED (6.7 sec) 06:47:02.029713 run osmo-hlr_10.42.42.2(pid=6834): ERR: Terminated: ERROR {rc=237} [trial-2370↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6834)] 06:47:02.081151 run osmo-hlr_10.42.42.2(pid=6834): stdout: | (launched: 2022-12-10_06:46:58.919154) 06:47:02.134079 run osmo-hlr_10.42.42.2(pid=6834): stderr: | 20221210064659093 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210064659093 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210064659093 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210064659093 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210064659093 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210064659093 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210064659109 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/handover_2G:oc2g+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210064659119 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210064659119 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210064659119 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:47:02.209038 run osmo-msc_10.42.42.6(pid=6840): ERR: Terminated: ERROR {rc=2} [trial-2370↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6840)] 06:47:02.260190 run osmo-msc_10.42.42.6(pid=6840): stdout: | (launched: 2022-12-10_06:47:00.751060) 06:47:02.313332 run osmo-msc_10.42.42.6(pid=6840): stderr: | 20221210064701201 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210064701202 DLGLOBAL DEBUG validating counter group 0x7faa04c14c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210064701202 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210064701203 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210064701204 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210064701204 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210064701206 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210064701206 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210064701206 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210064701207 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:47:02.367811 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6833): Terminating (SIGTERM) 06:47:02.409719 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6836): Terminating (SIGTERM) 06:47:02.451750 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6839): Terminating (SIGTERM) 06:47:02.494503 --- ParallelTerminationStrategy: PID 6833 died... 06:47:02.514614 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6833): Terminated: ok {rc=0} 06:47:02.561848 --- ParallelTerminationStrategy: PID 6836 died... 06:47:02.581518 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6836): Terminated: ok {rc=0} 06:47:02.628920 --- ParallelTerminationStrategy: PID 6839 died... 06:47:02.649579 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6839): Terminated: ok {rc=0} 06:47:02.738696 bus /sierra_3: Setting Powered False 06:47:03.837729 bus /sierra_3: Setting Powered False 06:47:04.952559 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 handover_2G:oc2g+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 handover_2G:oc2g+bts1-trx-b200 --------------------------------------------------------------------- 06:47:06.192115 tst handover_2G:oc2g+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:47:06.197322 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 06:47:06.247086 tst handover_2G:oc2g+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 06:47:06.273565 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 06:47:06.325069 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 06:47:06.374545 tst handover_2G:oc2g+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 06:47:06.400491 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 06:47:06.952861 tst handover_2G:oc2g+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OC-2G Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 handover_2G:oc2g+bts1-trx-b200 handover.py ---------------------------------------------- 06:47:06.958484 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:47:06.969469 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 06:47:07.003977 tst handover.py: using LAC 26589 06:47:07.121876 tst handover.py: using RAC 69 06:47:07.241085 tst handover.py: using CellId 26589 06:47:07.358404 tst handover.py: using BVCI 26590 06:47:07.469171 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 06:47:07.516832 tst handover.py: using LAC 26590 06:47:07.634449 tst handover.py: using RAC 70 06:47:07.753311 tst handover.py: using CellId 26590 06:47:07.870116 tst handover.py: using BVCI 26591 06:47:07.979938 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:47:07.990735 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:47:08.001291 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:47:08.012038 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:47:08.022855 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:47:08.033602 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 06:47:08.147295 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 06:47:08.266156 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:47:08.735177 run create_hlr_db(pid=6845): Launched 06:47:08.865022 bus /sierra_2: Setting Powered False 06:47:09.928382 run create_hlr_db(pid=6845): Terminated: ok {rc=0} 06:47:10.346769 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6847): Launched 06:47:10.666873 run osmo-hlr_10.42.42.2(pid=6848): Launched 06:47:10.788404 run osmo-stp_10.42.42.5: Starting osmo-stp 06:47:11.315525 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6850): Launched 06:47:11.635581 run osmo-stp_10.42.42.5(pid=6851): Launched 06:47:11.758198 run osmo-msc_10.42.42.6: Starting osmo-msc 06:47:12.310367 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6853): Launched 06:47:12.630957 run osmo-msc_10.42.42.6(pid=6854): Launched 06:47:12.810825 run osmo-stp_10.42.42.5(pid=6851): ERR: Terminated: ERROR {rc=1} [trial-2370↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6851)] 06:47:12.945790 run osmo-stp_10.42.42.5(pid=6851): stdout: | (launched: 2022-12-10_06:47:11.577166) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:47:13.080425 run osmo-stp_10.42.42.5(pid=6851): stderr: | 20221210064711768 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210064711768 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210064711768 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210064711769 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210064711771 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210064711771 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210064711771 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:47:13.214542 run osmo-stp_10.42.42.5(pid=6851): stdout: | (launched: 2022-12-10_06:47:11.577166) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:47:13.341719 run osmo-stp_10.42.42.5(pid=6851): stderr: | 20221210064711768 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210064711768 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210064711768 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210064711769 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210064711771 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210064711771 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210064711771 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:47:13.493868 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=6851): Process ended prematurely: osmo-stp_10.42.42.5(pid=6851) [trial-2370↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6851)] [trial-2370↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18] 06:47:13.502799 tst handover.py:18: Test FAILED (6.5 sec) 06:47:13.530168 run osmo-hlr_10.42.42.2(pid=6848): ERR: Terminated: ERROR {rc=237} [trial-2370↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6848)] 06:47:13.579782 run osmo-hlr_10.42.42.2(pid=6848): stdout: | (launched: 2022-12-10_06:47:10.607998) 06:47:13.631344 run osmo-hlr_10.42.42.2(pid=6848): stderr: | 20221210064710808 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210064710808 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210064710808 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210064710808 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210064710808 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210064710808 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210064710821 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/handover_2G:oc2g+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210064710848 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210064710848 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210064710848 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:47:13.703515 run osmo-msc_10.42.42.6(pid=6854): ERR: Terminated: ERROR {rc=2} [trial-2370↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6854)] 06:47:13.753253 run osmo-msc_10.42.42.6(pid=6854): stdout: | (launched: 2022-12-10_06:47:12.572421) 06:47:13.804684 run osmo-msc_10.42.42.6(pid=6854): stderr: | 20221210064712895 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210064712895 DLGLOBAL DEBUG validating counter group 0x7f315b757c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210064712895 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210064712895 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210064712895 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210064712895 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210064712897 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210064712898 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210064712898 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210064712898 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:47:13.856514 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6847): Terminating (SIGTERM) 06:47:13.898372 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6850): Terminating (SIGTERM) 06:47:13.939821 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6853): Terminating (SIGTERM) 06:47:13.981665 --- ParallelTerminationStrategy: PID 6847 died... 06:47:14.001461 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6847): Terminated: ok {rc=0} 06:47:14.047298 --- ParallelTerminationStrategy: PID 6850 died... 06:47:14.066705 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6850): Terminated: ok {rc=0} 06:47:14.112324 --- ParallelTerminationStrategy: PID 6853 died... 06:47:14.131581 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6853): Terminated: ok {rc=0} 06:47:14.218808 bus /sierra_3: Setting Powered False 06:47:15.316215 bus /sierra_3: Setting Powered False 06:47:16.432782 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 handover_2G:oc2g+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 handover_2G:oc2g+bts1-trx-umtrx --------------------------------------------------------------------- 06:47:17.690536 tst handover_2G:oc2g+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:47:17.696401 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 06:47:17.746788 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 06:47:17.773794 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 06:47:17.826902 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 06:47:17.877819 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 06:47:17.904926 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 06:47:18.454126 tst handover_2G:oc2g+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OC-2G UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 handover_2G:oc2g+bts1-trx-umtrx handover.py ---------------------------------------------- 06:47:18.459949 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:47:18.471238 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 06:47:18.506366 tst handover.py: using LAC 26591 06:47:18.632375 tst handover.py: using RAC 71 06:47:18.758274 tst handover.py: using CellId 26591 06:47:18.888303 tst handover.py: using BVCI 26592 06:47:19.005460 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 06:47:19.052634 tst handover.py: using LAC 26592 06:47:19.176216 tst handover.py: using RAC 72 06:47:19.299376 tst handover.py: using CellId 26592 06:47:19.424395 tst handover.py: using BVCI 26593 06:47:19.540314 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:47:19.551634 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:47:19.562718 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:47:19.573749 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:47:19.585083 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:47:19.596139 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 06:47:19.715813 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 06:47:19.832442 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:47:20.300588 run create_hlr_db(pid=6859): Launched 06:47:20.430637 bus /sierra_2: Setting Powered False 06:47:21.494179 run create_hlr_db(pid=6859): Terminated: ok {rc=0} 06:47:21.897298 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6861): Launched 06:47:22.197545 run osmo-hlr_10.42.42.2(pid=6862): Launched 06:47:22.313545 run osmo-stp_10.42.42.5: Starting osmo-stp 06:47:22.815496 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6864): Launched 06:47:23.114191 run osmo-stp_10.42.42.5(pid=6865): Launched 06:47:23.228708 run osmo-msc_10.42.42.6: Starting osmo-msc 06:47:23.746213 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6867): Launched 06:47:24.046085 run osmo-msc_10.42.42.6(pid=6868): Launched 06:47:24.214304 run osmo-stp_10.42.42.5(pid=6865): ERR: Terminated: ERROR {rc=1} [trial-2370↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6865)] 06:47:24.341838 run osmo-stp_10.42.42.5(pid=6865): stdout: | (launched: 2022-12-10_06:47:23.059260) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:47:24.469073 run osmo-stp_10.42.42.5(pid=6865): stderr: | 20221210064723228 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210064723228 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210064723229 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210064723229 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210064723231 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210064723231 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210064723231 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:47:24.594289 run osmo-stp_10.42.42.5(pid=6865): stdout: | (launched: 2022-12-10_06:47:23.059260) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:47:24.713694 run osmo-stp_10.42.42.5(pid=6865): stderr: | 20221210064723228 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210064723228 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210064723229 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210064723229 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210064723231 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210064723231 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210064723231 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:47:24.857385 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=6865): Process ended prematurely: osmo-stp_10.42.42.5(pid=6865) [trial-2370↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6865)] [trial-2370↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18] 06:47:24.865870 tst handover.py:18: Test FAILED (6.4 sec) 06:47:24.892592 run osmo-hlr_10.42.42.2(pid=6862): ERR: Terminated: ERROR {rc=237} [trial-2370↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6862)] 06:47:24.940199 run osmo-hlr_10.42.42.2(pid=6862): stdout: | (launched: 2022-12-10_06:47:22.142776) 06:47:24.989503 run osmo-hlr_10.42.42.2(pid=6862): stderr: | 20221210064722316 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210064722316 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210064722316 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210064722316 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210064722316 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210064722316 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210064722328 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/handover_2G:oc2g+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210064722337 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210064722338 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210064722338 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:47:25.058117 run osmo-msc_10.42.42.6(pid=6868): ERR: Terminated: ERROR {rc=2} [trial-2370↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6868)] 06:47:25.105642 run osmo-msc_10.42.42.6(pid=6868): stdout: | (launched: 2022-12-10_06:47:23.990924) 06:47:25.154644 run osmo-msc_10.42.42.6(pid=6868): stderr: | 20221210064724257 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210064724257 DLGLOBAL DEBUG validating counter group 0x7ff6d01cdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210064724257 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210064724257 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210064724257 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210064724258 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210064724259 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210064724260 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210064724260 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210064724260 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:47:25.204064 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6861): Terminating (SIGTERM) 06:47:25.243774 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6864): Terminating (SIGTERM) 06:47:25.283530 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6867): Terminating (SIGTERM) 06:47:25.324256 --- ParallelTerminationStrategy: PID 6861 died... 06:47:25.343273 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6861): Terminated: ok {rc=0} 06:47:25.387886 --- ParallelTerminationStrategy: PID 6864 died... 06:47:25.406484 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6864): Terminated: ok {rc=0} 06:47:25.450763 --- ParallelTerminationStrategy: PID 6867 died... 06:47:25.469383 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6867): Terminated: ok {rc=0} 06:47:25.552797 bus /sierra_3: Setting Powered False 06:47:26.648682 bus /sierra_3: Setting Powered False 06:47:27.763913 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 handover_2G:oc2g+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 handover_2G:octphy+bts1-trx-lms --------------------------------------------------------------------- 06:47:29.020938 tst handover_2G:octphy+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:47:29.026669 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 06:47:29.076132 tst handover_2G:octphy+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 06:47:29.103650 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 06:47:29.155469 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 06:47:29.204812 tst handover_2G:octphy+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 06:47:29.231899 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 06:47:29.784063 tst handover_2G:octphy+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 handover_2G:octphy+bts1-trx-lms handover.py ---------------------------------------------- 06:47:29.789689 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 06:47:29.801133 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 06:47:29.835118 tst handover.py: using LAC 26593 06:47:29.960660 tst handover.py: using RAC 73 06:47:30.086184 tst handover.py: using CellId 26593 06:47:30.215593 tst handover.py: using BVCI 26594 06:47:30.326083 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 06:47:30.372663 tst handover.py: using LAC 26594 06:47:30.487850 tst handover.py: using RAC 74 06:47:30.603036 tst handover.py: using CellId 26594 06:47:30.719615 tst handover.py: using BVCI 26595 06:47:30.841620 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 06:47:30.860590 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 06:47:30.876345 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 06:47:30.888771 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 06:47:30.900604 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 06:47:30.912894 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 06:47:31.048771 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 06:47:31.167111 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:47:31.618543 run create_hlr_db(pid=6873): Launched 06:47:31.776589 bus /sierra_2: Setting Powered False 06:47:32.836887 run create_hlr_db(pid=6873): Terminated: ok {rc=0} 06:47:33.231275 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6875): Launched 06:47:33.530881 run osmo-hlr_10.42.42.2(pid=6876): Launched 06:47:33.645303 run osmo-stp_10.42.42.5: Starting osmo-stp 06:47:34.159525 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6878): Launched 06:47:34.458540 run osmo-stp_10.42.42.5(pid=6879): Launched 06:47:34.573037 run osmo-msc_10.42.42.6: Starting osmo-msc 06:47:35.094403 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6881): Launched 06:47:35.394299 run osmo-msc_10.42.42.6(pid=6882): Launched 06:47:35.561793 run osmo-stp_10.42.42.5(pid=6879): ERR: Terminated: ERROR {rc=1} [trial-2370↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6879)] 06:47:35.688475 run osmo-stp_10.42.42.5(pid=6879): stdout: | (launched: 2022-12-10_06:47:34.402934) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:47:35.815518 run osmo-stp_10.42.42.5(pid=6879): stderr: | 20221210064734572 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210064734572 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210064734572 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210064734573 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210064734575 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210064734575 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210064734575 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:47:35.942793 run osmo-stp_10.42.42.5(pid=6879): stdout: | (launched: 2022-12-10_06:47:34.402934) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:47:36.062881 run osmo-stp_10.42.42.5(pid=6879): stderr: | 20221210064734572 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210064734572 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210064734572 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210064734573 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210064734575 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210064734575 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210064734575 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:47:36.205705 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=6879): Process ended prematurely: osmo-stp_10.42.42.5(pid=6879) [trial-2370↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6879)] [trial-2370↪handover_2G:octphy+bts1-trx-lms↪handover.py:18] 06:47:36.213994 tst handover.py:18: Test FAILED (6.4 sec) 06:47:36.240426 run osmo-hlr_10.42.42.2(pid=6876): ERR: Terminated: ERROR {rc=237} [trial-2370↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6876)] 06:47:36.287699 run osmo-hlr_10.42.42.2(pid=6876): stdout: | (launched: 2022-12-10_06:47:33.476218) 06:47:36.336764 run osmo-hlr_10.42.42.2(pid=6876): stderr: | 20221210064733651 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210064733651 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210064733651 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210064733651 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210064733651 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210064733651 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210064733663 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/handover_2G:octphy+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210064733672 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210064733672 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210064733673 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:47:36.405309 run osmo-msc_10.42.42.6(pid=6882): ERR: Terminated: ERROR {rc=2} [trial-2370↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6882)] 06:47:36.452867 run osmo-msc_10.42.42.6(pid=6882): stdout: | (launched: 2022-12-10_06:47:35.339181) 06:47:36.501884 run osmo-msc_10.42.42.6(pid=6882): stderr: | 20221210064735609 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210064735609 DLGLOBAL DEBUG validating counter group 0x7f6fbbb95c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210064735609 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210064735609 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210064735610 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210064735610 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210064735611 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210064735612 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210064735612 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210064735612 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:47:36.551270 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6875): Terminating (SIGTERM) 06:47:36.590839 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6878): Terminating (SIGTERM) 06:47:36.630658 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6881): Terminating (SIGTERM) 06:47:36.670798 --- ParallelTerminationStrategy: PID 6875 died... 06:47:36.689809 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6875): Terminated: ok {rc=0} 06:47:36.733848 --- ParallelTerminationStrategy: PID 6878 died... 06:47:36.752199 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6878): Terminated: ok {rc=0} 06:47:36.796814 --- ParallelTerminationStrategy: PID 6881 died... 06:47:36.815774 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6881): Terminated: ok {rc=0} 06:47:36.901260 bus /sierra_3: Setting Powered False 06:47:38.001068 bus /sierra_3: Setting Powered False 06:47:39.116367 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 handover_2G:octphy+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 handover_2G:octphy+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 06:47:40.368632 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:47:40.373737 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 06:47:40.418279 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 06:47:40.444391 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 06:47:40.495150 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 06:47:40.539421 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 06:47:40.565702 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 06:47:41.117978 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 handover_2G:octphy+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 06:47:41.123224 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:47:41.134271 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 06:47:41.168134 tst handover.py: using LAC 26595 06:47:41.293960 tst handover.py: using RAC 75 06:47:41.419650 tst handover.py: using CellId 26595 06:47:41.546382 tst handover.py: using BVCI 26596 06:47:41.662923 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 06:47:41.708813 tst handover.py: using LAC 26596 06:47:41.836244 tst handover.py: using RAC 76 06:47:41.961725 tst handover.py: using CellId 26596 06:47:42.090258 tst handover.py: using BVCI 26597 06:47:42.206596 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:47:42.218252 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:47:42.229718 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:47:42.241362 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:47:42.252939 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:47:42.264578 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 06:47:42.379385 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 06:47:42.492514 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:47:42.931083 run create_hlr_db(pid=6888): Launched 06:47:43.046776 bus /sierra_2: Setting Powered False 06:47:44.106383 run create_hlr_db(pid=6888): Terminated: ok {rc=0} 06:47:44.517644 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6890): Launched 06:47:44.838353 run osmo-hlr_10.42.42.2(pid=6891): Launched 06:47:44.961317 run osmo-stp_10.42.42.5: Starting osmo-stp 06:47:45.487299 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6893): Launched 06:47:45.808311 run osmo-stp_10.42.42.5(pid=6894): Launched 06:47:46.022361 run osmo-msc_10.42.42.6: Starting osmo-msc 06:47:46.762506 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6896): Launched 06:47:47.160826 run osmo-msc_10.42.42.6(pid=6897): Launched 06:47:47.415567 run osmo-stp_10.42.42.5(pid=6894): ERR: Terminated: ERROR {rc=1} [trial-2370↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6894)] 06:47:47.561216 run osmo-stp_10.42.42.5(pid=6894): stdout: | (launched: 2022-12-10_06:47:45.749817) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:47:47.690644 run osmo-stp_10.42.42.5(pid=6894): stderr: | 20221210064746058 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210064746058 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210064746058 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210064746058 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210064746060 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210064746060 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210064746060 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:47:47.816000 run osmo-stp_10.42.42.5(pid=6894): stdout: | (launched: 2022-12-10_06:47:45.749817) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:47:47.935286 run osmo-stp_10.42.42.5(pid=6894): stderr: | 20221210064746058 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210064746058 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210064746058 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210064746058 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210064746060 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210064746060 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210064746060 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:47:48.078055 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=6894): Process ended prematurely: osmo-stp_10.42.42.5(pid=6894) [trial-2370↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6894)] [trial-2370↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18] 06:47:48.086480 tst handover.py:18: Test FAILED (7.0 sec) 06:47:48.113260 run osmo-hlr_10.42.42.2(pid=6891): ERR: Terminated: ERROR {rc=237} [trial-2370↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6891)] 06:47:48.160795 run osmo-hlr_10.42.42.2(pid=6891): stdout: | (launched: 2022-12-10_06:47:44.780186) 06:47:48.210385 run osmo-hlr_10.42.42.2(pid=6891): stderr: | 20221210064744977 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210064744977 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210064744977 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210064744977 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210064744977 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210064744977 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210064744989 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/handover_2G:octphy+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210064744998 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210064744998 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210064744998 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:47:48.279148 run osmo-msc_10.42.42.6(pid=6897): ERR: Terminated: ERROR {rc=2} [trial-2370↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6897)] 06:47:48.326904 run osmo-msc_10.42.42.6(pid=6897): stdout: | (launched: 2022-12-10_06:47:47.100930) 06:47:48.376558 run osmo-msc_10.42.42.6(pid=6897): stderr: | 20221210064747502 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210064747503 DLGLOBAL DEBUG validating counter group 0x7f18eb764c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210064747503 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210064747503 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210064747503 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210064747503 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210064747505 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210064747505 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210064747505 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210064747506 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:47:48.426383 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6890): Terminating (SIGTERM) 06:47:48.466333 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6893): Terminating (SIGTERM) 06:47:48.506459 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6896): Terminating (SIGTERM) 06:47:48.546691 --- ParallelTerminationStrategy: PID 6890 died... 06:47:48.565868 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6890): Terminated: ok {rc=0} 06:47:48.610753 --- ParallelTerminationStrategy: PID 6893 died... 06:47:48.629474 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6893): Terminated: ok {rc=0} 06:47:48.674099 --- ParallelTerminationStrategy: PID 6896 died... 06:47:48.692790 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6896): Terminated: ok {rc=0} 06:47:48.779192 bus /sierra_3: Setting Powered False 06:47:49.880227 bus /sierra_3: Setting Powered False 06:47:50.992287 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 handover_2G:octphy+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 handover_2G:octphy+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 06:47:52.249243 tst handover_2G:octphy+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:47:52.255216 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 06:47:52.305482 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 06:47:52.332736 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 06:47:52.386121 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 06:47:52.436901 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 06:47:52.463697 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 06:47:53.015324 tst handover_2G:octphy+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 handover_2G:octphy+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 06:47:53.020644 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:47:53.032091 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 06:47:53.065872 tst handover.py: using LAC 26597 06:47:53.191830 tst handover.py: using RAC 77 06:47:53.318878 tst handover.py: using CellId 26597 06:47:53.446028 tst handover.py: using BVCI 26598 06:47:53.563904 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 06:47:53.614353 tst handover.py: using LAC 26598 06:47:53.741293 tst handover.py: using RAC 78 06:47:53.868046 tst handover.py: using CellId 26598 06:47:53.993283 tst handover.py: using BVCI 26599 06:47:54.109562 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:47:54.120938 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:47:54.132338 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:47:54.143917 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:47:54.155387 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:47:54.166945 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 06:47:54.282956 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 06:47:54.402436 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:47:54.870616 run create_hlr_db(pid=6902): Launched 06:47:55.001507 bus /sierra_2: Setting Powered False 06:47:56.061233 run create_hlr_db(pid=6902): Terminated: ok {rc=0} 06:47:56.453705 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6904): Launched 06:47:56.753149 run osmo-hlr_10.42.42.2(pid=6905): Launched 06:47:56.867497 run osmo-stp_10.42.42.5: Starting osmo-stp 06:47:57.372500 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6907): Launched 06:47:57.671443 run osmo-stp_10.42.42.5(pid=6908): Launched 06:47:57.785319 run osmo-msc_10.42.42.6: Starting osmo-msc 06:47:58.301076 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6910): Launched 06:47:58.601585 run osmo-msc_10.42.42.6(pid=6911): Launched 06:47:58.769242 run osmo-stp_10.42.42.5(pid=6908): ERR: Terminated: ERROR {rc=1} [trial-2370↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6908)] 06:47:58.896360 run osmo-stp_10.42.42.5(pid=6908): stdout: | (launched: 2022-12-10_06:47:57.616629) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:47:59.023981 run osmo-stp_10.42.42.5(pid=6908): stderr: | 20221210064757786 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210064757786 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210064757787 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210064757787 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210064757788 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210064757788 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210064757788 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:47:59.149599 run osmo-stp_10.42.42.5(pid=6908): stdout: | (launched: 2022-12-10_06:47:57.616629) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:47:59.268636 run osmo-stp_10.42.42.5(pid=6908): stderr: | 20221210064757786 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210064757786 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210064757787 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210064757787 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210064757788 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210064757788 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210064757788 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:47:59.411125 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=6908): Process ended prematurely: osmo-stp_10.42.42.5(pid=6908) [trial-2370↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6908)] [trial-2370↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18] 06:47:59.419509 tst handover.py:18: Test FAILED (6.4 sec) 06:47:59.446134 run osmo-hlr_10.42.42.2(pid=6905): ERR: Terminated: ERROR {rc=237} [trial-2370↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6905)] 06:47:59.493826 run osmo-hlr_10.42.42.2(pid=6905): stdout: | (launched: 2022-12-10_06:47:56.698257) 06:47:59.543235 run osmo-hlr_10.42.42.2(pid=6905): stderr: | 20221210064756873 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210064756873 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210064756873 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210064756874 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210064756874 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210064756874 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210064756886 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/handover_2G:octphy+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210064756896 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210064756896 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210064756896 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:47:59.611816 run osmo-msc_10.42.42.6(pid=6911): ERR: Terminated: ERROR {rc=2} [trial-2370↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6911)] 06:47:59.659342 run osmo-msc_10.42.42.6(pid=6911): stdout: | (launched: 2022-12-10_06:47:58.545831) 06:47:59.708616 run osmo-msc_10.42.42.6(pid=6911): stderr: | 20221210064758814 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210064758814 DLGLOBAL DEBUG validating counter group 0x7fe32276ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210064758814 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210064758815 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210064758815 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210064758815 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210064758817 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210064758817 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210064758817 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210064758818 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:47:59.758566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6904): Terminating (SIGTERM) 06:47:59.798062 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6907): Terminating (SIGTERM) 06:47:59.837602 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6910): Terminating (SIGTERM) 06:47:59.877460 --- ParallelTerminationStrategy: PID 6904 died... 06:47:59.896230 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6904): Terminated: ok {rc=0} 06:47:59.940671 --- ParallelTerminationStrategy: PID 6907 died... 06:47:59.959234 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6907): Terminated: ok {rc=0} 06:48:00.003681 --- ParallelTerminationStrategy: PID 6910 died... 06:48:00.022356 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6910): Terminated: ok {rc=0} 06:48:00.107980 bus /sierra_3: Setting Powered False 06:48:01.206514 bus /sierra_3: Setting Powered False 06:48:02.318954 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 handover_2G:octphy+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 handover_2G:octphy+bts1-sysmo --------------------------------------------------------------------- 06:48:03.581727 tst handover_2G:octphy+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:48:03.587239 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x bts (candidates: 11) 06:48:03.624673 tst handover_2G:octphy+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 06:48:03.651801 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x modem (candidates: 12) 06:48:03.705172 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x bts (candidates: 11) 06:48:03.742918 tst handover_2G:octphy+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 06:48:03.769709 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x modem (candidates: 12) 06:48:04.319704 tst handover_2G:octphy+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 handover_2G:octphy+bts1-sysmo handover.py ---------------------------------------------- 06:48:04.325155 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:48:04.336845 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 06:48:04.374304 tst handover.py: using LAC 26599 06:48:04.498846 tst handover.py: using RAC 79 06:48:04.623717 tst handover.py: using CellId 26599 06:48:04.747891 tst handover.py: using BVCI 26600 06:48:04.865949 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 06:48:04.903527 tst handover.py: using LAC 26600 06:48:05.027550 tst handover.py: using RAC 80 06:48:05.152362 tst handover.py: using CellId 26600 06:48:05.282993 tst handover.py: using BVCI 26601 06:48:05.401145 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:48:05.412479 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:48:05.423530 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:48:05.434572 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:48:05.445672 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:48:05.456640 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 06:48:05.573810 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 06:48:05.694512 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:48:06.162932 run create_hlr_db(pid=6916): Launched 06:48:06.292767 bus /sierra_2: Setting Powered False 06:48:07.356726 run create_hlr_db(pid=6916): Terminated: ok {rc=0} 06:48:07.761070 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6918): Launched 06:48:08.060766 run osmo-hlr_10.42.42.2(pid=6919): Launched 06:48:08.176410 run osmo-stp_10.42.42.5: Starting osmo-stp 06:48:08.677441 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6921): Launched 06:48:08.975270 run osmo-stp_10.42.42.5(pid=6922): Launched 06:48:09.090515 run osmo-msc_10.42.42.6: Starting osmo-msc 06:48:09.606841 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6924): Launched 06:48:09.905168 run osmo-msc_10.42.42.6(pid=6925): Launched 06:48:10.073532 run osmo-stp_10.42.42.5(pid=6922): ERR: Terminated: ERROR {rc=1} [trial-2370↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6922)] 06:48:10.200936 run osmo-stp_10.42.42.5(pid=6922): stdout: | (launched: 2022-12-10_06:48:08.920640) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:48:10.328374 run osmo-stp_10.42.42.5(pid=6922): stderr: | 20221210064809088 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210064809088 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210064809088 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210064809089 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210064809089 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210064809089 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210064809089 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:48:10.453671 run osmo-stp_10.42.42.5(pid=6922): stdout: | (launched: 2022-12-10_06:48:08.920640) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:48:10.572238 run osmo-stp_10.42.42.5(pid=6922): stderr: | 20221210064809088 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210064809088 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210064809088 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210064809089 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210064809089 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210064809089 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210064809089 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:48:10.714662 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=6922): Process ended prematurely: osmo-stp_10.42.42.5(pid=6922) [trial-2370↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6922)] [trial-2370↪handover_2G:octphy+bts1-sysmo↪handover.py:18] 06:48:10.722853 tst handover.py:18: Test FAILED (6.4 sec) 06:48:10.749233 run osmo-hlr_10.42.42.2(pid=6919): ERR: Terminated: ERROR {rc=237} [trial-2370↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6919)] 06:48:10.797044 run osmo-hlr_10.42.42.2(pid=6919): stdout: | (launched: 2022-12-10_06:48:08.005813) 06:48:10.846522 run osmo-hlr_10.42.42.2(pid=6919): stderr: | 20221210064808179 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210064808179 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210064808179 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210064808179 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210064808179 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210064808179 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210064808191 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/handover_2G:octphy+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210064808201 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210064808201 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210064808202 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:48:10.915117 run osmo-msc_10.42.42.6(pid=6925): ERR: Terminated: ERROR {rc=2} [trial-2370↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6925)] 06:48:10.962492 run osmo-msc_10.42.42.6(pid=6925): stdout: | (launched: 2022-12-10_06:48:09.850281) 06:48:11.011250 run osmo-msc_10.42.42.6(pid=6925): stderr: | 20221210064810118 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210064810118 DLGLOBAL DEBUG validating counter group 0x7f8811c72c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210064810118 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210064810118 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210064810118 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210064810118 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210064810122 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210064810122 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210064810122 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210064810122 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:48:11.060627 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6918): Terminating (SIGTERM) 06:48:11.099595 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6921): Terminating (SIGTERM) 06:48:11.138639 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6924): Terminating (SIGTERM) 06:48:11.178007 --- ParallelTerminationStrategy: PID 6918 died... 06:48:11.196781 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6918): Terminated: ok {rc=0} 06:48:11.240325 --- ParallelTerminationStrategy: PID 6921 died... 06:48:11.258582 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6921): Terminated: ok {rc=0} 06:48:11.301853 --- ParallelTerminationStrategy: PID 6924 died... 06:48:11.320166 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6924): Terminated: ok {rc=0} 06:48:11.404536 bus /sierra_3: Setting Powered False 06:48:12.503105 bus /sierra_3: Setting Powered False 06:48:13.618618 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 handover_2G:octphy+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 handover_2G:octphy+bts1-trx-b200 --------------------------------------------------------------------- 06:48:14.854973 tst handover_2G:octphy+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:48:14.860222 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 06:48:14.909078 tst handover_2G:octphy+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 06:48:14.935256 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 06:48:14.987171 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 06:48:15.035826 tst handover_2G:octphy+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 06:48:15.062289 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 06:48:15.610525 tst handover_2G:octphy+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 handover_2G:octphy+bts1-trx-b200 handover.py ---------------------------------------------- 06:48:15.615890 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:48:15.626794 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 06:48:15.660827 tst handover.py: using LAC 26601 06:48:15.779622 tst handover.py: using RAC 81 06:48:15.924766 tst handover.py: using CellId 26601 06:48:16.055274 tst handover.py: using BVCI 26602 06:48:16.195917 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 06:48:16.247429 tst handover.py: using LAC 26602 06:48:16.376768 tst handover.py: using RAC 82 06:48:16.505272 tst handover.py: using CellId 26602 06:48:16.624389 tst handover.py: using BVCI 26603 06:48:16.774941 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:48:16.786336 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:48:16.797545 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:48:16.809484 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:48:16.821660 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:48:16.834333 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 06:48:16.954186 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 06:48:17.088630 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:48:17.585658 run create_hlr_db(pid=6930): Launched 06:48:17.716069 bus /sierra_2: Setting Powered False 06:48:18.780075 run create_hlr_db(pid=6930): Terminated: ok {rc=0} 06:48:19.183115 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6932): Launched 06:48:19.483092 run osmo-hlr_10.42.42.2(pid=6933): Launched 06:48:19.598698 run osmo-stp_10.42.42.5: Starting osmo-stp 06:48:20.102735 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6935): Launched 06:48:20.401184 run osmo-stp_10.42.42.5(pid=6936): Launched 06:48:20.516548 run osmo-msc_10.42.42.6: Starting osmo-msc 06:48:21.032769 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6938): Launched 06:48:21.331883 run osmo-msc_10.42.42.6(pid=6939): Launched 06:48:21.499677 run osmo-stp_10.42.42.5(pid=6936): ERR: Terminated: ERROR {rc=1} [trial-2370↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6936)] 06:48:21.627112 run osmo-stp_10.42.42.5(pid=6936): stdout: | (launched: 2022-12-10_06:48:20.345988) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:48:21.753796 run osmo-stp_10.42.42.5(pid=6936): stderr: | 20221210064820515 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210064820516 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210064820516 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210064820516 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210064820517 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210064820517 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210064820517 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:48:21.878787 run osmo-stp_10.42.42.5(pid=6936): stdout: | (launched: 2022-12-10_06:48:20.345988) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:48:21.997738 run osmo-stp_10.42.42.5(pid=6936): stderr: | 20221210064820515 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210064820516 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210064820516 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210064820516 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210064820517 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210064820517 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210064820517 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:48:22.139976 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=6936): Process ended prematurely: osmo-stp_10.42.42.5(pid=6936) [trial-2370↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6936)] [trial-2370↪handover_2G:octphy+bts1-trx-b200↪handover.py:18] 06:48:22.148663 tst handover.py:18: Test FAILED (6.5 sec) 06:48:22.175172 run osmo-hlr_10.42.42.2(pid=6933): ERR: Terminated: ERROR {rc=237} [trial-2370↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6933)] 06:48:22.222587 run osmo-hlr_10.42.42.2(pid=6933): stdout: | (launched: 2022-12-10_06:48:19.427880) 06:48:22.271888 run osmo-hlr_10.42.42.2(pid=6933): stderr: | 20221210064819606 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210064819606 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210064819606 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210064819606 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210064819606 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210064819606 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210064819618 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/handover_2G:octphy+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210064819627 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210064819627 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210064819627 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:48:22.340682 run osmo-msc_10.42.42.6(pid=6939): ERR: Terminated: ERROR {rc=2} [trial-2370↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6939)] 06:48:22.388565 run osmo-msc_10.42.42.6(pid=6939): stdout: | (launched: 2022-12-10_06:48:21.276902) 06:48:22.437945 run osmo-msc_10.42.42.6(pid=6939): stderr: | 20221210064821547 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210064821547 DLGLOBAL DEBUG validating counter group 0x7fa1d32c5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210064821547 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210064821547 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210064821547 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210064821547 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210064821549 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210064821550 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210064821550 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210064821550 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:48:22.487668 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6932): Terminating (SIGTERM) 06:48:22.527317 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6935): Terminating (SIGTERM) 06:48:22.567454 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6938): Terminating (SIGTERM) 06:48:22.607393 --- ParallelTerminationStrategy: PID 6932 died... 06:48:22.626325 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6932): Terminated: ok {rc=0} 06:48:22.670103 --- ParallelTerminationStrategy: PID 6935 died... 06:48:22.688459 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6935): Terminated: ok {rc=0} 06:48:22.732670 --- ParallelTerminationStrategy: PID 6938 died... 06:48:22.751111 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6938): Terminated: ok {rc=0} 06:48:22.836158 bus /sierra_3: Setting Powered False 06:48:23.936040 bus /sierra_3: Setting Powered False 06:48:25.051275 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 handover_2G:octphy+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 handover_2G:octphy+bts1-trx-umtrx --------------------------------------------------------------------- 06:48:26.307008 tst handover_2G:octphy+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:48:26.312713 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 06:48:26.362506 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 06:48:26.390211 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 06:48:26.443544 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 06:48:26.494476 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 06:48:26.521956 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 06:48:27.069942 tst handover_2G:octphy+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 handover_2G:octphy+bts1-trx-umtrx handover.py ---------------------------------------------- 06:48:27.075565 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:48:27.087053 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 06:48:27.121350 tst handover.py: using LAC 26603 06:48:27.249385 tst handover.py: using RAC 83 06:48:27.375641 tst handover.py: using CellId 26603 06:48:27.501783 tst handover.py: using BVCI 26604 06:48:27.612194 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 06:48:27.659522 tst handover.py: using LAC 26604 06:48:27.778691 tst handover.py: using RAC 84 06:48:27.897302 tst handover.py: using CellId 26604 06:48:28.013468 tst handover.py: using BVCI 26605 06:48:28.121730 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:48:28.132393 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:48:28.143029 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:48:28.153780 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:48:28.164785 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:48:28.175633 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 06:48:28.292427 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 06:48:28.410283 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:48:28.851550 run create_hlr_db(pid=6944): Launched 06:48:28.972445 bus /sierra_2: Setting Powered False 06:48:30.035842 run create_hlr_db(pid=6944): Terminated: ok {rc=0} 06:48:30.456319 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6946): Launched 06:48:30.778308 run osmo-hlr_10.42.42.2(pid=6947): Launched 06:48:30.994637 run osmo-stp_10.42.42.5: Starting osmo-stp 06:48:31.709258 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6949): Launched 06:48:32.058293 run osmo-stp_10.42.42.5(pid=6950): Launched 06:48:32.180859 run osmo-msc_10.42.42.6: Starting osmo-msc 06:48:32.809856 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6952): Launched 06:48:33.110733 run osmo-msc_10.42.42.6(pid=6953): Launched 06:48:33.279046 run osmo-stp_10.42.42.5(pid=6950): ERR: Terminated: ERROR {rc=1} [trial-2370↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6950)] 06:48:33.406471 run osmo-stp_10.42.42.5(pid=6950): stdout: | (launched: 2022-12-10_06:48:31.987335) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:48:33.533726 run osmo-stp_10.42.42.5(pid=6950): stderr: | 20221210064832297 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210064832297 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210064832297 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210064832298 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210064832298 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210064832298 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210064832299 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:48:33.659129 run osmo-stp_10.42.42.5(pid=6950): stdout: | (launched: 2022-12-10_06:48:31.987335) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:48:33.779005 run osmo-stp_10.42.42.5(pid=6950): stderr: | 20221210064832297 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210064832297 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210064832297 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210064832298 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210064832298 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210064832298 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210064832299 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:48:33.921972 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=6950): Process ended prematurely: osmo-stp_10.42.42.5(pid=6950) [trial-2370↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6950)] [trial-2370↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18] 06:48:33.930349 tst handover.py:18: Test FAILED (6.8 sec) 06:48:33.956749 run osmo-hlr_10.42.42.2(pid=6947): ERR: Terminated: ERROR {rc=237} [trial-2370↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6947)] 06:48:34.004731 run osmo-hlr_10.42.42.2(pid=6947): stdout: | (launched: 2022-12-10_06:48:30.719478) 06:48:34.053990 run osmo-hlr_10.42.42.2(pid=6947): stderr: | 20221210064830985 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210064830985 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210064830985 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210064830985 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210064830985 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210064830985 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210064831006 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/handover_2G:octphy+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210064831019 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210064831019 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210064831019 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:48:34.122641 run osmo-msc_10.42.42.6(pid=6953): ERR: Terminated: ERROR {rc=2} [trial-2370↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6953)] 06:48:34.169948 run osmo-msc_10.42.42.6(pid=6953): stdout: | (launched: 2022-12-10_06:48:33.055211) 06:48:34.218903 run osmo-msc_10.42.42.6(pid=6953): stderr: | 20221210064833325 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210064833325 DLGLOBAL DEBUG validating counter group 0x7f7d47a56c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210064833325 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210064833325 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210064833325 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210064833326 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210064833327 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210064833328 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210064833328 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210064833328 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:48:34.268516 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6946): Terminating (SIGTERM) 06:48:34.307890 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6949): Terminating (SIGTERM) 06:48:34.347201 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6952): Terminating (SIGTERM) 06:48:34.386989 --- ParallelTerminationStrategy: PID 6946 died... 06:48:34.405817 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6946): Terminated: ok {rc=0} 06:48:34.449778 --- ParallelTerminationStrategy: PID 6949 died... 06:48:34.468094 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6949): Terminated: ok {rc=0} 06:48:34.511999 --- ParallelTerminationStrategy: PID 6952 died... 06:48:34.530462 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6952): Terminated: ok {rc=0} 06:48:34.616178 bus /sierra_3: Setting Powered False 06:48:35.715475 bus /sierra_3: Setting Powered False 06:48:36.830698 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 handover_2G:octphy+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 handover_2G:trx-lms+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 06:48:38.081575 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:48:38.086743 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 06:48:38.145020 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 06:48:38.171761 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 06:48:38.223869 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 06:48:38.284830 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 06:48:38.312551 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 06:48:38.863211 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 06:48:38.868721 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:48:38.880178 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 06:48:38.931344 tst handover.py: using LAC 26605 06:48:39.062135 tst handover.py: using RAC 85 06:48:39.188005 tst handover.py: using CellId 26605 06:48:39.310694 tst handover.py: using BVCI 26606 06:48:39.426974 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 06:48:39.470751 tst handover.py: using LAC 26606 06:48:39.595944 tst handover.py: using RAC 86 06:48:39.719612 tst handover.py: using CellId 26606 06:48:39.837056 tst handover.py: using BVCI 26607 06:48:39.945455 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:48:39.956637 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:48:39.967852 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:48:39.980127 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:48:39.992055 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:48:40.003183 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 06:48:40.122018 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 06:48:40.236603 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:48:40.675051 run create_hlr_db(pid=6958): Launched 06:48:40.789276 bus /sierra_2: Setting Powered False 06:48:41.849386 run create_hlr_db(pid=6958): Terminated: ok {rc=0} 06:48:42.259288 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6960): Launched 06:48:42.579709 run osmo-hlr_10.42.42.2(pid=6961): Launched 06:48:42.702677 run osmo-stp_10.42.42.5: Starting osmo-stp 06:48:43.228651 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6963): Launched 06:48:43.548759 run osmo-stp_10.42.42.5(pid=6964): Launched 06:48:43.670798 run osmo-msc_10.42.42.6: Starting osmo-msc 06:48:44.222467 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6966): Launched 06:48:44.543070 run osmo-msc_10.42.42.6(pid=6967): Launched 06:48:44.722376 run osmo-stp_10.42.42.5(pid=6964): ERR: Terminated: ERROR {rc=1} [trial-2370↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6964)] 06:48:44.856423 run osmo-stp_10.42.42.5(pid=6964): stdout: | (launched: 2022-12-10_06:48:43.490382) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:48:44.991240 run osmo-stp_10.42.42.5(pid=6964): stderr: | 20221210064843685 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210064843685 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210064843686 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210064843686 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210064843686 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210064843686 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210064843686 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:48:45.126099 run osmo-stp_10.42.42.5(pid=6964): stdout: | (launched: 2022-12-10_06:48:43.490382) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:48:45.253194 run osmo-stp_10.42.42.5(pid=6964): stderr: | 20221210064843685 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210064843685 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210064843686 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210064843686 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210064843686 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210064843686 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210064843686 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:48:45.405186 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=6964): Process ended prematurely: osmo-stp_10.42.42.5(pid=6964) [trial-2370↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6964)] [trial-2370↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18] 06:48:45.414025 tst handover.py:18: Test FAILED (6.5 sec) 06:48:45.441546 run osmo-hlr_10.42.42.2(pid=6961): ERR: Terminated: ERROR {rc=237} [trial-2370↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6961)] 06:48:45.490998 run osmo-hlr_10.42.42.2(pid=6961): stdout: | (launched: 2022-12-10_06:48:42.521215) 06:48:45.542117 run osmo-hlr_10.42.42.2(pid=6961): stderr: | 20221210064842719 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210064842719 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210064842719 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210064842719 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210064842720 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210064842720 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210064842732 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/handover_2G:trx-lms+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210064842740 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210064842740 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210064842740 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:48:45.613525 run osmo-msc_10.42.42.6(pid=6967): ERR: Terminated: ERROR {rc=2} [trial-2370↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6967)] 06:48:45.663096 run osmo-msc_10.42.42.6(pid=6967): stdout: | (launched: 2022-12-10_06:48:44.484389) 06:48:45.714476 run osmo-msc_10.42.42.6(pid=6967): stderr: | 20221210064844809 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210064844809 DLGLOBAL DEBUG validating counter group 0x7fad6b165c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210064844809 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210064844809 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210064844809 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210064844810 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210064844811 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210064844812 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210064844812 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210064844812 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:48:45.765894 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6960): Terminating (SIGTERM) 06:48:45.806958 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6963): Terminating (SIGTERM) 06:48:45.854619 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6966): Terminating (SIGTERM) 06:48:45.915788 --- ParallelTerminationStrategy: PID 6960 died... 06:48:45.935342 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6960): Terminated: ok {rc=0} 06:48:45.981519 --- ParallelTerminationStrategy: PID 6963 died... 06:48:46.001483 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6963): Terminated: ok {rc=0} 06:48:46.048153 --- ParallelTerminationStrategy: PID 6966 died... 06:48:46.071053 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6966): Terminated: ok {rc=0} 06:48:46.164225 bus /sierra_3: Setting Powered False 06:48:47.279286 bus /sierra_3: Setting Powered False 06:48:48.395698 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 handover_2G:trx-lms+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 handover_2G:trx-lms+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 06:48:49.659685 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:48:49.665366 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 06:48:49.729359 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 06:48:49.755959 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 06:48:49.809157 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 06:48:49.873055 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 06:48:49.899640 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 06:48:50.449112 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 handover_2G:trx-lms+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 06:48:50.454531 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:48:50.465653 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 06:48:50.513261 tst handover.py: using LAC 26607 06:48:50.632532 tst handover.py: using RAC 87 06:48:50.759269 tst handover.py: using CellId 26607 06:48:50.884340 tst handover.py: using BVCI 26608 06:48:51.000915 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 06:48:51.050952 tst handover.py: using LAC 26608 06:48:51.175680 tst handover.py: using RAC 88 06:48:51.300901 tst handover.py: using CellId 26608 06:48:51.426420 tst handover.py: using BVCI 26609 06:48:51.544268 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:48:51.555869 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:48:51.567178 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:48:51.578575 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:48:51.590371 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:48:51.601725 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 06:48:51.719201 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 06:48:51.839720 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:48:52.308268 run create_hlr_db(pid=6972): Launched 06:48:52.438924 bus /sierra_2: Setting Powered False 06:48:53.503000 run create_hlr_db(pid=6972): Terminated: ok {rc=0} 06:48:53.905191 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6974): Launched 06:48:54.205055 run osmo-hlr_10.42.42.2(pid=6975): Launched 06:48:54.320485 run osmo-stp_10.42.42.5: Starting osmo-stp 06:48:54.824619 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6977): Launched 06:48:55.123225 run osmo-stp_10.42.42.5(pid=6978): Launched 06:48:55.237825 run osmo-msc_10.42.42.6: Starting osmo-msc 06:48:55.753868 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6980): Launched 06:48:56.053664 run osmo-msc_10.42.42.6(pid=6981): Launched 06:48:56.221734 run osmo-stp_10.42.42.5(pid=6978): ERR: Terminated: ERROR {rc=1} [trial-2370↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6978)] 06:48:56.349363 run osmo-stp_10.42.42.5(pid=6978): stdout: | (launched: 2022-12-10_06:48:55.068633) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:48:56.476855 run osmo-stp_10.42.42.5(pid=6978): stderr: | 20221210064855238 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210064855238 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210064855239 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210064855239 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210064855239 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210064855239 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210064855240 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:48:56.601848 run osmo-stp_10.42.42.5(pid=6978): stdout: | (launched: 2022-12-10_06:48:55.068633) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:48:56.720621 run osmo-stp_10.42.42.5(pid=6978): stderr: | 20221210064855238 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210064855238 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210064855239 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210064855239 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210064855239 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210064855239 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210064855240 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:48:56.863015 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=6978): Process ended prematurely: osmo-stp_10.42.42.5(pid=6978) [trial-2370↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6978)] [trial-2370↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18] 06:48:56.871239 tst handover.py:18: Test FAILED (6.4 sec) 06:48:56.897707 run osmo-hlr_10.42.42.2(pid=6975): ERR: Terminated: ERROR {rc=237} [trial-2370↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6975)] 06:48:56.945211 run osmo-hlr_10.42.42.2(pid=6975): stdout: | (launched: 2022-12-10_06:48:54.149977) 06:48:56.994437 run osmo-hlr_10.42.42.2(pid=6975): stderr: | 20221210064854325 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210064854325 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210064854326 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210064854326 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210064854326 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210064854326 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210064854343 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/handover_2G:trx-lms+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210064854352 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210064854353 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210064854354 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:48:57.063099 run osmo-msc_10.42.42.6(pid=6981): ERR: Terminated: ERROR {rc=2} [trial-2370↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6981)] 06:48:57.110925 run osmo-msc_10.42.42.6(pid=6981): stdout: | (launched: 2022-12-10_06:48:55.998556) 06:48:57.159947 run osmo-msc_10.42.42.6(pid=6981): stderr: | 20221210064856268 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210064856268 DLGLOBAL DEBUG validating counter group 0x7f0433abac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210064856268 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210064856268 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210064856268 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210064856268 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210064856270 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210064856270 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210064856271 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210064856271 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:48:57.209441 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6974): Terminating (SIGTERM) 06:48:57.249071 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6977): Terminating (SIGTERM) 06:48:57.288862 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6980): Terminating (SIGTERM) 06:48:57.328925 --- ParallelTerminationStrategy: PID 6974 died... 06:48:57.347892 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6974): Terminated: ok {rc=0} 06:48:57.392454 --- ParallelTerminationStrategy: PID 6977 died... 06:48:57.411153 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6977): Terminated: ok {rc=0} 06:48:57.455378 --- ParallelTerminationStrategy: PID 6980 died... 06:48:57.473974 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6980): Terminated: ok {rc=0} 06:48:57.559477 bus /sierra_3: Setting Powered False 06:48:58.658603 bus /sierra_3: Setting Powered False 06:48:59.774339 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 handover_2G:trx-lms+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 handover_2G:trx-lms+bts1-sysmo --------------------------------------------------------------------- 06:49:01.082162 tst handover_2G:trx-lms+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:49:01.087781 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x bts (candidates: 11) 06:49:01.141623 tst handover_2G:trx-lms+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 06:49:01.170205 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x modem (candidates: 12) 06:49:01.223378 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x bts (candidates: 11) 06:49:01.292348 tst handover_2G:trx-lms+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 06:49:01.329340 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x modem (candidates: 12) 06:49:01.853842 tst handover_2G:trx-lms+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 handover_2G:trx-lms+bts1-sysmo handover.py ---------------------------------------------- 06:49:01.861684 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:49:01.873451 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 06:49:01.926812 tst handover.py: using LAC 26609 06:49:02.054769 tst handover.py: using RAC 89 06:49:02.211003 tst handover.py: using CellId 26609 06:49:02.332353 tst handover.py: using BVCI 26610 06:49:02.442193 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 06:49:02.476563 tst handover.py: using LAC 26610 06:49:02.594376 tst handover.py: using RAC 90 06:49:02.714276 tst handover.py: using CellId 26610 06:49:02.831800 tst handover.py: using BVCI 26611 06:49:02.940931 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:49:02.951821 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:49:02.962615 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:49:02.974172 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:49:02.985639 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:49:02.996914 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 06:49:03.110932 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 06:49:03.229838 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:49:03.698880 run create_hlr_db(pid=6986): Launched 06:49:03.829963 bus /sierra_2: Setting Powered False 06:49:04.893789 run create_hlr_db(pid=6986): Terminated: ok {rc=0} 06:49:05.311304 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6988): Launched 06:49:05.631843 run osmo-hlr_10.42.42.2(pid=6989): Launched 06:49:05.754682 run osmo-stp_10.42.42.5: Starting osmo-stp 06:49:06.276700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6991): Launched 06:49:06.596108 run osmo-stp_10.42.42.5(pid=6992): Launched 06:49:06.718897 run osmo-msc_10.42.42.6: Starting osmo-msc 06:49:07.270551 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6994): Launched 06:49:07.590399 run osmo-msc_10.42.42.6(pid=6995): Launched 06:49:07.770556 run osmo-stp_10.42.42.5(pid=6992): ERR: Terminated: ERROR {rc=1} [trial-2370↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6992)] 06:49:07.905154 run osmo-stp_10.42.42.5(pid=6992): stdout: | (launched: 2022-12-10_06:49:06.537789) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:49:08.040106 run osmo-stp_10.42.42.5(pid=6992): stderr: | 20221210064906732 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210064906732 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210064906732 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210064906733 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210064906733 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210064906733 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210064906733 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:49:08.174667 run osmo-stp_10.42.42.5(pid=6992): stdout: | (launched: 2022-12-10_06:49:06.537789) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:49:08.301419 run osmo-stp_10.42.42.5(pid=6992): stderr: | 20221210064906732 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210064906732 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210064906732 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210064906733 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210064906733 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210064906733 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210064906733 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:49:08.453770 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=6992): Process ended prematurely: osmo-stp_10.42.42.5(pid=6992) [trial-2370↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6992)] [trial-2370↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18] 06:49:08.462503 tst handover.py:18: Test FAILED (6.6 sec) 06:49:08.489676 run osmo-hlr_10.42.42.2(pid=6989): ERR: Terminated: ERROR {rc=237} [trial-2370↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6989)] 06:49:08.538949 run osmo-hlr_10.42.42.2(pid=6989): stdout: | (launched: 2022-12-10_06:49:05.572580) 06:49:08.589899 run osmo-hlr_10.42.42.2(pid=6989): stderr: | 20221210064905772 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210064905772 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210064905772 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210064905772 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210064905772 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210064905772 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210064905786 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/handover_2G:trx-lms+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210064905794 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210064905794 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210064905794 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:49:08.661125 run osmo-msc_10.42.42.6(pid=6995): ERR: Terminated: ERROR {rc=2} [trial-2370↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6995)] 06:49:08.710774 run osmo-msc_10.42.42.6(pid=6995): stdout: | (launched: 2022-12-10_06:49:07.531646) 06:49:08.761651 run osmo-msc_10.42.42.6(pid=6995): stderr: | 20221210064907854 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210064907854 DLGLOBAL DEBUG validating counter group 0x7fc9a8f0bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210064907854 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210064907854 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210064907854 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210064907855 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210064907856 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210064907857 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210064907857 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210064907857 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:49:08.813143 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6988): Terminating (SIGTERM) 06:49:08.853932 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6991): Terminating (SIGTERM) 06:49:08.895082 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6994): Terminating (SIGTERM) 06:49:08.936626 --- ParallelTerminationStrategy: PID 6988 died... 06:49:08.956051 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6988): Terminated: ok {rc=0} 06:49:09.001663 --- ParallelTerminationStrategy: PID 6991 died... 06:49:09.020895 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6991): Terminated: ok {rc=0} 06:49:09.066542 --- ParallelTerminationStrategy: PID 6994 died... 06:49:09.085849 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6994): Terminated: ok {rc=0} 06:49:09.171339 bus /sierra_3: Setting Powered False 06:49:10.268570 bus /sierra_3: Setting Powered False 06:49:11.379156 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 handover_2G:trx-lms+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 handover_2G:trx-lms+bts1-trx-b200 --------------------------------------------------------------------- 06:49:12.628241 tst handover_2G:trx-lms+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:49:12.633565 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 06:49:12.695547 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 06:49:12.722192 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 06:49:12.774648 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 06:49:12.838102 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 06:49:12.864455 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 06:49:13.414334 tst handover_2G:trx-lms+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 handover_2G:trx-lms+bts1-trx-b200 handover.py ---------------------------------------------- 06:49:13.419698 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:49:13.430491 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 06:49:13.477467 tst handover.py: using LAC 26611 06:49:13.596731 tst handover.py: using RAC 91 06:49:13.715369 tst handover.py: using CellId 26611 06:49:13.834315 tst handover.py: using BVCI 26612 06:49:13.944469 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 06:49:13.992235 tst handover.py: using LAC 26612 06:49:14.110347 tst handover.py: using RAC 92 06:49:14.226922 tst handover.py: using CellId 26612 06:49:14.345417 tst handover.py: using BVCI 26613 06:49:14.455430 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:49:14.466454 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:49:14.477545 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:49:14.488385 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:49:14.499489 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:49:14.510391 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 06:49:14.624801 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 06:49:14.742664 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:49:15.210658 run create_hlr_db(pid=7000): Launched 06:49:15.340795 bus /sierra_2: Setting Powered False 06:49:16.404571 run create_hlr_db(pid=7000): Terminated: ok {rc=0} 06:49:16.839801 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7002): Launched 06:49:17.174898 run osmo-hlr_10.42.42.2(pid=7003): Launched 06:49:17.298052 run osmo-stp_10.42.42.5: Starting osmo-stp 06:49:17.823790 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7005): Launched 06:49:18.145066 run osmo-stp_10.42.42.5(pid=7006): Launched 06:49:18.266655 run osmo-msc_10.42.42.6: Starting osmo-msc 06:49:18.822692 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7008): Launched 06:49:19.144075 run osmo-msc_10.42.42.6(pid=7009): Launched 06:49:19.323256 run osmo-stp_10.42.42.5(pid=7006): ERR: Terminated: ERROR {rc=1} [trial-2370↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7006)] 06:49:19.458828 run osmo-stp_10.42.42.5(pid=7006): stdout: | (launched: 2022-12-10_06:49:18.086146) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:49:19.594109 run osmo-stp_10.42.42.5(pid=7006): stderr: | 20221210064918280 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210064918280 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210064918280 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210064918281 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210064918281 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210064918281 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210064918281 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:49:19.730168 run osmo-stp_10.42.42.5(pid=7006): stdout: | (launched: 2022-12-10_06:49:18.086146) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:49:19.857881 run osmo-stp_10.42.42.5(pid=7006): stderr: | 20221210064918280 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210064918280 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210064918280 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210064918281 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210064918281 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210064918281 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210064918281 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:49:20.010528 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=7006): Process ended prematurely: osmo-stp_10.42.42.5(pid=7006) [trial-2370↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7006)] [trial-2370↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18] 06:49:20.019289 tst handover.py:18: Test FAILED (6.6 sec) 06:49:20.046514 run osmo-hlr_10.42.42.2(pid=7003): ERR: Terminated: ERROR {rc=237} [trial-2370↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7003)] 06:49:20.096098 run osmo-hlr_10.42.42.2(pid=7003): stdout: | (launched: 2022-12-10_06:49:17.116279) 06:49:20.147541 run osmo-hlr_10.42.42.2(pid=7003): stderr: | 20221210064917313 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210064917313 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210064917313 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210064917313 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210064917313 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210064917313 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210064917326 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/handover_2G:trx-lms+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210064917334 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210064917334 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210064917334 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:49:20.219568 run osmo-msc_10.42.42.6(pid=7009): ERR: Terminated: ERROR {rc=2} [trial-2370↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7009)] 06:49:20.269327 run osmo-msc_10.42.42.6(pid=7009): stdout: | (launched: 2022-12-10_06:49:19.085370) 06:49:20.320569 run osmo-msc_10.42.42.6(pid=7009): stderr: | 20221210064919407 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210064919408 DLGLOBAL DEBUG validating counter group 0x7f26ac15fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210064919408 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210064919408 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210064919408 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210064919408 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210064919410 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210064919410 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210064919410 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210064919411 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:49:20.372448 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7002): Terminating (SIGTERM) 06:49:20.413745 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7005): Terminating (SIGTERM) 06:49:20.454951 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7008): Terminating (SIGTERM) 06:49:20.496651 --- ParallelTerminationStrategy: PID 7002 died... 06:49:20.516445 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7002): Terminated: ok {rc=0} 06:49:20.562301 --- ParallelTerminationStrategy: PID 7005 died... 06:49:20.581704 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7005): Terminated: ok {rc=0} 06:49:20.627189 --- ParallelTerminationStrategy: PID 7008 died... 06:49:20.646617 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7008): Terminated: ok {rc=0} 06:49:20.734012 bus /sierra_3: Setting Powered False 06:49:21.833703 bus /sierra_3: Setting Powered False 06:49:22.948260 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 handover_2G:trx-lms+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 handover_2G:trx-lms+bts1-trx-umtrx --------------------------------------------------------------------- 06:49:24.219286 tst handover_2G:trx-lms+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:49:24.224758 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 06:49:24.287447 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 06:49:24.314695 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 06:49:24.368093 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 06:49:24.430940 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 06:49:24.457950 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 06:49:25.009990 tst handover_2G:trx-lms+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 handover_2G:trx-lms+bts1-trx-umtrx handover.py ---------------------------------------------- 06:49:25.016431 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:49:25.028318 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 06:49:25.075653 tst handover.py: using LAC 26613 06:49:25.194577 tst handover.py: using RAC 93 06:49:25.314484 tst handover.py: using CellId 26613 06:49:25.431794 tst handover.py: using BVCI 26614 06:49:25.540071 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 06:49:25.587113 tst handover.py: using LAC 26614 06:49:25.712727 tst handover.py: using RAC 94 06:49:25.841810 tst handover.py: using CellId 26614 06:49:25.967075 tst handover.py: using BVCI 26615 06:49:26.083394 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:49:26.094951 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:49:26.106283 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:49:26.117547 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:49:26.128677 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:49:26.139803 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 06:49:26.255497 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 06:49:26.372476 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:49:26.840350 run create_hlr_db(pid=7015): Launched 06:49:26.970833 bus /sierra_2: Setting Powered False 06:49:28.034567 run create_hlr_db(pid=7015): Terminated: ok {rc=0} 06:49:28.435545 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7017): Launched 06:49:28.734388 run osmo-hlr_10.42.42.2(pid=7018): Launched 06:49:28.849475 run osmo-stp_10.42.42.5: Starting osmo-stp 06:49:29.352837 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7020): Launched 06:49:29.650975 run osmo-stp_10.42.42.5(pid=7021): Launched 06:49:29.766115 run osmo-msc_10.42.42.6: Starting osmo-msc 06:49:30.282034 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7023): Launched 06:49:30.581028 run osmo-msc_10.42.42.6(pid=7024): Launched 06:49:30.748687 run osmo-stp_10.42.42.5(pid=7021): ERR: Terminated: ERROR {rc=1} [trial-2370↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7021)] 06:49:30.964154 run osmo-stp_10.42.42.5(pid=7021): stdout: | (launched: 2022-12-10_06:49:29.596011) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:49:31.096816 run osmo-stp_10.42.42.5(pid=7021): stderr: | 20221210064929766 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210064929766 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210064929766 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210064929767 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210064929767 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210064929767 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210064929767 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:49:31.236075 run osmo-stp_10.42.42.5(pid=7021): stdout: | (launched: 2022-12-10_06:49:29.596011) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:49:31.369124 run osmo-stp_10.42.42.5(pid=7021): stderr: | 20221210064929766 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210064929766 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210064929766 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210064929767 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210064929767 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210064929767 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210064929767 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:49:31.524802 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=7021): Process ended prematurely: osmo-stp_10.42.42.5(pid=7021) [trial-2370↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7021)] [trial-2370↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18] 06:49:31.533951 tst handover.py:18: Test FAILED (6.5 sec) 06:49:31.563552 run osmo-hlr_10.42.42.2(pid=7018): ERR: Terminated: ERROR {rc=237} [trial-2370↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7018)] 06:49:31.614882 run osmo-hlr_10.42.42.2(pid=7018): stdout: | (launched: 2022-12-10_06:49:28.679955) 06:49:31.669368 run osmo-hlr_10.42.42.2(pid=7018): stderr: | 20221210064928855 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210064928855 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210064928855 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210064928855 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210064928855 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210064928855 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210064928874 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/handover_2G:trx-lms+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210064928884 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210064928884 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210064928884 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:49:31.743181 run osmo-msc_10.42.42.6(pid=7024): ERR: Terminated: ERROR {rc=2} [trial-2370↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7024)] 06:49:31.795313 run osmo-msc_10.42.42.6(pid=7024): stdout: | (launched: 2022-12-10_06:49:30.525880) 06:49:31.849173 run osmo-msc_10.42.42.6(pid=7024): stderr: | 20221210064930799 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210064930799 DLGLOBAL DEBUG validating counter group 0x7fdefe155c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210064930799 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210064930799 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210064930799 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210064930799 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210064930801 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210064930802 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210064930802 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210064930802 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:49:31.902028 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7017): Terminating (SIGTERM) 06:49:31.945294 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7020): Terminating (SIGTERM) 06:49:31.991108 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7023): Terminating (SIGTERM) 06:49:32.036401 --- ParallelTerminationStrategy: PID 7017 died... 06:49:32.056838 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7017): Terminated: ok {rc=0} 06:49:32.105555 --- ParallelTerminationStrategy: PID 7020 died... 06:49:32.125441 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7020): Terminated: ok {rc=0} 06:49:32.173633 --- ParallelTerminationStrategy: PID 7023 died... 06:49:32.193561 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7023): Terminated: ok {rc=0} 06:49:32.281748 bus /sierra_3: Setting Powered False 06:49:33.377099 bus /sierra_3: Setting Powered False 06:49:34.491226 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 handover_2G:trx-lms+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 06:49:35.758178 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:49:35.765176 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 06:49:35.825792 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 06:49:35.853415 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 06:49:35.907892 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 06:49:35.969651 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 06:49:35.996844 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 06:49:36.548416 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 06:49:36.554117 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:49:36.566387 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 06:49:36.611443 tst handover.py: using LAC 26615 06:49:36.737922 tst handover.py: using RAC 95 06:49:36.864726 tst handover.py: using CellId 26615 06:49:36.989551 tst handover.py: using BVCI 26616 06:49:37.106783 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 06:49:37.157710 tst handover.py: using LAC 26616 06:49:37.275888 tst handover.py: using RAC 96 06:49:37.395860 tst handover.py: using CellId 26616 06:49:37.513409 tst handover.py: using BVCI 26617 06:49:37.630281 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:49:37.642453 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:49:37.654204 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:49:37.666130 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:49:37.677820 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:49:37.689332 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 06:49:37.807286 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 06:49:37.922501 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:49:38.360400 run create_hlr_db(pid=7030): Launched 06:49:38.475081 bus /sierra_2: Setting Powered False 06:49:39.534786 run create_hlr_db(pid=7030): Terminated: ok {rc=0} 06:49:39.945964 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7032): Launched 06:49:40.266059 run osmo-hlr_10.42.42.2(pid=7033): Launched 06:49:40.389390 run osmo-stp_10.42.42.5: Starting osmo-stp 06:49:40.918080 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7035): Launched 06:49:41.238491 run osmo-stp_10.42.42.5(pid=7036): Launched 06:49:41.361239 run osmo-msc_10.42.42.6: Starting osmo-msc 06:49:41.919431 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7038): Launched 06:49:42.239884 run osmo-msc_10.42.42.6(pid=7039): Launched 06:49:42.419004 run osmo-stp_10.42.42.5(pid=7036): ERR: Terminated: ERROR {rc=1} [trial-2370↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7036)] 06:49:42.554944 run osmo-stp_10.42.42.5(pid=7036): stdout: | (launched: 2022-12-10_06:49:41.180134) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:49:42.690340 run osmo-stp_10.42.42.5(pid=7036): stderr: | 20221210064941373 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210064941373 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210064941373 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210064941373 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210064941374 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210064941374 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210064941374 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:49:42.825148 run osmo-stp_10.42.42.5(pid=7036): stdout: | (launched: 2022-12-10_06:49:41.180134) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:49:42.952325 run osmo-stp_10.42.42.5(pid=7036): stderr: | 20221210064941373 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210064941373 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210064941373 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210064941373 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210064941374 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210064941374 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210064941374 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:49:43.105010 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=7036): Process ended prematurely: osmo-stp_10.42.42.5(pid=7036) [trial-2370↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7036)] [trial-2370↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18] 06:49:43.113968 tst handover.py:18: Test FAILED (6.6 sec) 06:49:43.141493 run osmo-hlr_10.42.42.2(pid=7033): ERR: Terminated: ERROR {rc=237} [trial-2370↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7033)] 06:49:43.191301 run osmo-hlr_10.42.42.2(pid=7033): stdout: | (launched: 2022-12-10_06:49:40.207344) 06:49:43.243079 run osmo-hlr_10.42.42.2(pid=7033): stderr: | 20221210064940406 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210064940406 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210064940406 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210064940406 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210064940407 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210064940407 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210064940420 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210064940429 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210064940430 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210064940430 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:49:43.314931 run osmo-msc_10.42.42.6(pid=7039): ERR: Terminated: ERROR {rc=2} [trial-2370↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7039)] 06:49:43.364806 run osmo-msc_10.42.42.6(pid=7039): stdout: | (launched: 2022-12-10_06:49:42.181318) 06:49:43.416017 run osmo-msc_10.42.42.6(pid=7039): stderr: | 20221210064942502 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210064942502 DLGLOBAL DEBUG validating counter group 0x7f85690b3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210064942502 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210064942503 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210064942503 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210064942503 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210064942505 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210064942505 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210064942505 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210064942505 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:49:43.467741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7032): Terminating (SIGTERM) 06:49:43.509056 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7035): Terminating (SIGTERM) 06:49:43.550426 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7038): Terminating (SIGTERM) 06:49:43.592066 --- ParallelTerminationStrategy: PID 7032 died... 06:49:43.612092 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7032): Terminated: ok {rc=0} 06:49:43.658123 --- ParallelTerminationStrategy: PID 7035 died... 06:49:43.677663 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7035): Terminated: ok {rc=0} 06:49:43.723578 --- ParallelTerminationStrategy: PID 7038 died... 06:49:43.743071 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7038): Terminated: ok {rc=0} 06:49:43.830402 bus /sierra_3: Setting Powered False 06:49:44.928586 bus /sierra_3: Setting Powered False 06:49:46.054899 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 handover_2G:trx-lms-limenet-micro+bts1-sysmo --------------------------------------------------------------------- 06:49:47.346031 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:49:47.351759 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x bts (candidates: 11) 06:49:47.399196 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 06:49:47.426401 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x modem (candidates: 12) 06:49:47.477738 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x bts (candidates: 11) 06:49:47.524857 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 06:49:47.551948 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x modem (candidates: 12) 06:49:48.106964 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover.py ---------------------------------------------- 06:49:48.112312 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:49:48.123696 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 06:49:48.168337 tst handover.py: using LAC 26617 06:49:48.293199 tst handover.py: using RAC 97 06:49:48.417007 tst handover.py: using CellId 26617 06:49:48.541135 tst handover.py: using BVCI 26618 06:49:48.656637 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 06:49:48.691774 tst handover.py: using LAC 26618 06:49:48.816042 tst handover.py: using RAC 98 06:49:48.941303 tst handover.py: using CellId 26618 06:49:49.065391 tst handover.py: using BVCI 26619 06:49:49.181490 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:49:49.192712 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:49:49.204023 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:49:49.215263 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:49:49.226526 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:49:49.237761 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 06:49:49.352142 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 06:49:49.471262 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:49:49.941565 run create_hlr_db(pid=7044): Launched 06:49:50.072314 bus /sierra_2: Setting Powered False 06:49:51.136355 run create_hlr_db(pid=7044): Terminated: ok {rc=0} 06:49:51.539263 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7046): Launched 06:49:51.839483 run osmo-hlr_10.42.42.2(pid=7047): Launched 06:49:51.954461 run osmo-stp_10.42.42.5: Starting osmo-stp 06:49:52.442955 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7049): Launched 06:49:52.742659 run osmo-stp_10.42.42.5(pid=7050): Launched 06:49:52.857486 run osmo-msc_10.42.42.6: Starting osmo-msc 06:49:53.372802 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7052): Launched 06:49:53.672551 run osmo-msc_10.42.42.6(pid=7053): Launched 06:49:53.854541 run osmo-stp_10.42.42.5(pid=7050): ERR: Terminated: ERROR {rc=1} [trial-2370↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7050)] 06:49:53.992146 run osmo-stp_10.42.42.5(pid=7050): stdout: | (launched: 2022-12-10_06:49:52.687782) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:49:54.128317 run osmo-stp_10.42.42.5(pid=7050): stderr: | 20221210064952858 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210064952859 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210064952859 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210064952859 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210064952860 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210064952860 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210064952860 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:49:54.263946 run osmo-stp_10.42.42.5(pid=7050): stdout: | (launched: 2022-12-10_06:49:52.687782) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:49:54.391672 run osmo-stp_10.42.42.5(pid=7050): stderr: | 20221210064952858 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210064952859 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210064952859 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210064952859 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210064952860 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210064952860 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210064952860 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:49:54.544138 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=7050): Process ended prematurely: osmo-stp_10.42.42.5(pid=7050) [trial-2370↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7050)] [trial-2370↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18] 06:49:54.553129 tst handover.py:18: Test FAILED (6.4 sec) 06:49:54.581130 run osmo-hlr_10.42.42.2(pid=7047): ERR: Terminated: ERROR {rc=237} [trial-2370↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7047)] 06:49:54.631316 run osmo-hlr_10.42.42.2(pid=7047): stdout: | (launched: 2022-12-10_06:49:51.783665) 06:49:54.682765 run osmo-hlr_10.42.42.2(pid=7047): stderr: | 20221210064951961 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210064951961 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210064951961 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210064951961 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210064951961 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210064951961 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210064951973 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/handover_2G:trx-lms-limenet-micro+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210064951983 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210064951984 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210064951984 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:49:54.755369 run osmo-msc_10.42.42.6(pid=7053): ERR: Terminated: ERROR {rc=2} [trial-2370↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7053)] 06:49:54.805325 run osmo-msc_10.42.42.6(pid=7053): stdout: | (launched: 2022-12-10_06:49:53.617368) 06:49:54.856791 run osmo-msc_10.42.42.6(pid=7053): stderr: | 20221210064953934 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210064953934 DLGLOBAL DEBUG validating counter group 0x7f50489a2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210064953934 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210064953934 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210064953935 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210064953935 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210064953936 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210064953937 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210064953937 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210064953937 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:49:54.908515 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7046): Terminating (SIGTERM) 06:49:54.950009 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7049): Terminating (SIGTERM) 06:49:54.991917 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7052): Terminating (SIGTERM) 06:49:55.033884 --- ParallelTerminationStrategy: PID 7046 died... 06:49:55.053632 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7046): Terminated: ok {rc=0} 06:49:55.099920 --- ParallelTerminationStrategy: PID 7049 died... 06:49:55.119363 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7049): Terminated: ok {rc=0} 06:49:55.165573 --- ParallelTerminationStrategy: PID 7052 died... 06:49:55.185086 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7052): Terminated: ok {rc=0} 06:49:55.273467 bus /sierra_3: Setting Powered False 06:49:56.372274 bus /sierra_3: Setting Powered False 06:49:57.488192 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 handover_2G:trx-lms-limenet-micro+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 --------------------------------------------------------------------- 06:49:58.744588 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:49:58.750033 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 06:49:58.809685 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 06:49:58.836854 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 06:49:58.890511 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 06:49:58.950691 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 06:49:58.977672 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 06:49:59.530612 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover.py ---------------------------------------------- 06:49:59.535955 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:49:59.547365 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 06:49:59.591979 tst handover.py: using LAC 26619 06:49:59.716827 tst handover.py: using RAC 99 06:49:59.835169 tst handover.py: using CellId 26619 06:49:59.954117 tst handover.py: using BVCI 26620 06:50:00.064929 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 06:50:00.113055 tst handover.py: using LAC 26620 06:50:00.235899 tst handover.py: using RAC 100 06:50:00.353353 tst handover.py: using CellId 26620 06:50:00.469079 tst handover.py: using BVCI 26621 06:50:00.577271 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:50:00.588240 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:50:00.599019 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:50:00.610202 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:50:00.621860 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:50:00.633648 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 06:50:00.752118 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 06:50:00.883421 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:50:01.382465 run create_hlr_db(pid=7061): Launched 06:50:01.548623 bus /sierra_2: Setting Powered False 06:50:02.610578 run create_hlr_db(pid=7061): Terminated: ok {rc=0} 06:50:03.014689 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7063): Launched 06:50:03.315166 run osmo-hlr_10.42.42.2(pid=7064): Launched 06:50:03.429812 run osmo-stp_10.42.42.5: Starting osmo-stp 06:50:03.933556 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7066): Launched 06:50:04.233026 run osmo-stp_10.42.42.5(pid=7067): Launched 06:50:04.347753 run osmo-msc_10.42.42.6: Starting osmo-msc 06:50:04.864161 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7069): Launched 06:50:05.186086 run osmo-msc_10.42.42.6(pid=7070): Launched 06:50:05.365205 run osmo-stp_10.42.42.5(pid=7067): ERR: Terminated: ERROR {rc=1} [trial-2370↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7067)] 06:50:05.499554 run osmo-stp_10.42.42.5(pid=7067): stdout: | (launched: 2022-12-10_06:50:04.177892) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:50:05.635998 run osmo-stp_10.42.42.5(pid=7067): stderr: | 20221210065004349 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210065004349 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210065004349 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210065004349 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210065004350 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210065004350 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210065004350 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:50:05.771230 run osmo-stp_10.42.42.5(pid=7067): stdout: | (launched: 2022-12-10_06:50:04.177892) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:50:05.898508 run osmo-stp_10.42.42.5(pid=7067): stderr: | 20221210065004349 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210065004349 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210065004349 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210065004349 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210065004350 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210065004350 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210065004350 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:50:06.050511 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=7067): Process ended prematurely: osmo-stp_10.42.42.5(pid=7067) [trial-2370↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7067)] [trial-2370↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18] 06:50:06.059538 tst handover.py:18: Test FAILED (6.5 sec) 06:50:06.087164 run osmo-hlr_10.42.42.2(pid=7064): ERR: Terminated: ERROR {rc=237} [trial-2370↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7064)] 06:50:06.136936 run osmo-hlr_10.42.42.2(pid=7064): stdout: | (launched: 2022-12-10_06:50:03.260154) 06:50:06.188213 run osmo-hlr_10.42.42.2(pid=7064): stderr: | 20221210065003434 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210065003434 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210065003434 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210065003434 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210065003434 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210065003434 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210065003446 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/handover_2G:trx-lms-limenet-micro+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210065003455 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210065003455 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210065003455 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:50:06.259785 run osmo-msc_10.42.42.6(pid=7070): ERR: Terminated: ERROR {rc=2} [trial-2370↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7070)] 06:50:06.309368 run osmo-msc_10.42.42.6(pid=7070): stdout: | (launched: 2022-12-10_06:50:05.127378) 06:50:06.360684 run osmo-msc_10.42.42.6(pid=7070): stderr: | 20221210065005448 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210065005448 DLGLOBAL DEBUG validating counter group 0x7f587290ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210065005448 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210065005448 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210065005448 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210065005449 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210065005450 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210065005451 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210065005451 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210065005451 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:50:06.412387 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7063): Terminating (SIGTERM) 06:50:06.453547 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7066): Terminating (SIGTERM) 06:50:06.494902 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7069): Terminating (SIGTERM) 06:50:06.536723 --- ParallelTerminationStrategy: PID 7063 died... 06:50:06.556809 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7063): Terminated: ok {rc=0} 06:50:06.603006 --- ParallelTerminationStrategy: PID 7066 died... 06:50:06.622494 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7066): Terminated: ok {rc=0} 06:50:06.668073 --- ParallelTerminationStrategy: PID 7069 died... 06:50:06.687476 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7069): Terminated: ok {rc=0} 06:50:06.774082 bus /sierra_3: Setting Powered False 06:50:07.871889 bus /sierra_3: Setting Powered False 06:50:08.987900 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx --------------------------------------------------------------------- 06:50:10.269339 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:50:10.276597 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 06:50:10.336476 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 06:50:10.364034 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 06:50:10.415571 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 06:50:10.474252 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 06:50:10.501241 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 06:50:11.055556 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover.py ---------------------------------------------- 06:50:11.060885 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:50:11.072487 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 06:50:11.117066 tst handover.py: using LAC 26621 06:50:11.241429 tst handover.py: using RAC 101 06:50:11.365805 tst handover.py: using CellId 26621 06:50:11.489658 tst handover.py: using BVCI 26622 06:50:11.605916 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 06:50:11.653578 tst handover.py: using LAC 26622 06:50:11.779430 tst handover.py: using RAC 102 06:50:11.903788 tst handover.py: using CellId 26622 06:50:12.027962 tst handover.py: using BVCI 26623 06:50:12.145349 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:50:12.156751 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:50:12.168135 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:50:12.179467 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:50:12.190830 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:50:12.202120 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 06:50:12.316753 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 06:50:12.431727 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:50:12.868209 run create_hlr_db(pid=7075): Launched 06:50:12.983929 bus /sierra_2: Setting Powered False 06:50:14.044237 run create_hlr_db(pid=7075): Terminated: ok {rc=0} 06:50:14.436672 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7077): Launched 06:50:14.736717 run osmo-hlr_10.42.42.2(pid=7078): Launched 06:50:14.850438 run osmo-stp_10.42.42.5: Starting osmo-stp 06:50:15.339504 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7080): Launched 06:50:15.638481 run osmo-stp_10.42.42.5(pid=7081): Launched 06:50:15.752472 run osmo-msc_10.42.42.6: Starting osmo-msc 06:50:16.325706 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7083): Launched 06:50:16.668270 run osmo-msc_10.42.42.6(pid=7084): Launched 06:50:16.931281 run osmo-stp_10.42.42.5(pid=7081): ERR: Terminated: ERROR {rc=1} [trial-2370↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7081)] 06:50:17.101428 run osmo-stp_10.42.42.5(pid=7081): stdout: | (launched: 2022-12-10_06:50:15.583676) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:50:17.364604 run osmo-stp_10.42.42.5(pid=7081): stderr: | 20221210065015752 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210065015752 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210065015752 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210065015753 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210065015756 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210065015756 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210065015756 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:50:17.499166 run osmo-stp_10.42.42.5(pid=7081): stdout: | (launched: 2022-12-10_06:50:15.583676) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:50:17.626819 run osmo-stp_10.42.42.5(pid=7081): stderr: | 20221210065015752 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210065015752 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210065015752 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210065015753 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210065015756 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210065015756 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210065015756 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:50:17.779973 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=7081): Process ended prematurely: osmo-stp_10.42.42.5(pid=7081) [trial-2370↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7081)] [trial-2370↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18] 06:50:17.789093 tst handover.py:18: Test FAILED (6.7 sec) 06:50:17.816251 run osmo-hlr_10.42.42.2(pid=7078): ERR: Terminated: ERROR {rc=237} [trial-2370↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7078)] 06:50:17.865542 run osmo-hlr_10.42.42.2(pid=7078): stdout: | (launched: 2022-12-10_06:50:14.681605) 06:50:17.916659 run osmo-hlr_10.42.42.2(pid=7078): stderr: | 20221210065014858 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210065014858 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210065014858 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210065014858 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210065014858 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210065014859 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210065014871 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210065014880 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210065014880 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210065014880 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:50:17.988032 run osmo-msc_10.42.42.6(pid=7084): ERR: Terminated: ERROR {rc=2} [trial-2370↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7084)] 06:50:18.037339 run osmo-msc_10.42.42.6(pid=7084): stdout: | (launched: 2022-12-10_06:50:16.605980) 06:50:18.088297 run osmo-msc_10.42.42.6(pid=7084): stderr: | 20221210065017150 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210065017150 DLGLOBAL DEBUG validating counter group 0x7fe14a8fac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210065017150 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210065017150 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210065017151 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210065017152 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210065017155 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210065017155 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210065017155 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210065017155 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:50:18.139738 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7077): Terminating (SIGTERM) 06:50:18.181176 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7080): Terminating (SIGTERM) 06:50:18.222300 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7083): Terminating (SIGTERM) 06:50:18.263557 --- ParallelTerminationStrategy: PID 7077 died... 06:50:18.283402 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7077): Terminated: ok {rc=0} 06:50:18.329220 --- ParallelTerminationStrategy: PID 7080 died... 06:50:18.348631 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7080): Terminated: ok {rc=0} 06:50:18.394259 --- ParallelTerminationStrategy: PID 7083 died... 06:50:18.413570 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7083): Terminated: ok {rc=0} 06:50:18.500092 bus /sierra_3: Setting Powered False 06:50:19.597839 bus /sierra_3: Setting Powered False 06:50:20.711625 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 handover_2G:trx-sysmocell5000+bts1-sysmo --------------------------------------------------------------------- 06:50:21.974144 tst handover_2G:trx-sysmocell5000+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:50:21.980601 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x bts (candidates: 11) 06:50:22.032801 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 06:50:22.059851 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x modem (candidates: 12) 06:50:22.115048 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x bts (candidates: 11) 06:50:22.167069 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 06:50:22.194340 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x modem (candidates: 12) 06:50:22.744526 tst handover_2G:trx-sysmocell5000+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 handover_2G:trx-sysmocell5000+bts1-sysmo handover.py ---------------------------------------------- 06:50:22.750036 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:50:22.761468 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 06:50:22.810445 tst handover.py: using LAC 26623 06:50:22.937488 tst handover.py: using RAC 103 06:50:23.062489 tst handover.py: using CellId 26623 06:50:23.187634 tst handover.py: using BVCI 26624 06:50:23.304197 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 06:50:23.340599 tst handover.py: using LAC 26624 06:50:23.467497 tst handover.py: using RAC 104 06:50:23.593400 tst handover.py: using CellId 26624 06:50:23.718014 tst handover.py: using BVCI 26625 06:50:23.834337 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:50:23.845712 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:50:23.856752 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:50:23.867993 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:50:23.879300 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:50:23.890565 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 06:50:24.005779 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 06:50:24.121087 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:50:24.560241 run create_hlr_db(pid=7089): Launched 06:50:24.678693 bus /sierra_2: Setting Powered False 06:50:25.743521 run create_hlr_db(pid=7089): Terminated: ok {rc=0} 06:50:26.163459 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7091): Launched 06:50:26.485714 run osmo-hlr_10.42.42.2(pid=7092): Launched 06:50:26.608747 run osmo-stp_10.42.42.5: Starting osmo-stp 06:50:27.137650 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7094): Launched 06:50:27.458541 run osmo-stp_10.42.42.5(pid=7095): Launched 06:50:27.581772 run osmo-msc_10.42.42.6: Starting osmo-msc 06:50:28.134708 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7097): Launched 06:50:28.457065 run osmo-msc_10.42.42.6(pid=7098): Launched 06:50:28.636782 run osmo-stp_10.42.42.5(pid=7095): ERR: Terminated: ERROR {rc=1} [trial-2370↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7095)] 06:50:28.771938 run osmo-stp_10.42.42.5(pid=7095): stdout: | (launched: 2022-12-10_06:50:27.400044) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:50:28.907768 run osmo-stp_10.42.42.5(pid=7095): stderr: | 20221210065027594 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210065027594 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210065027595 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210065027595 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210065027595 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210065027595 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210065027595 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:50:29.042349 run osmo-stp_10.42.42.5(pid=7095): stdout: | (launched: 2022-12-10_06:50:27.400044) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:50:29.170015 run osmo-stp_10.42.42.5(pid=7095): stderr: | 20221210065027594 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210065027594 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210065027595 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210065027595 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210065027595 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210065027595 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210065027595 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:50:29.322428 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=7095): Process ended prematurely: osmo-stp_10.42.42.5(pid=7095) [trial-2370↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7095)] [trial-2370↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18] 06:50:29.331452 tst handover.py:18: Test FAILED (6.6 sec) 06:50:29.359114 run osmo-hlr_10.42.42.2(pid=7092): ERR: Terminated: ERROR {rc=237} [trial-2370↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7092)] 06:50:29.409206 run osmo-hlr_10.42.42.2(pid=7092): stdout: | (launched: 2022-12-10_06:50:26.427090) 06:50:29.460629 run osmo-hlr_10.42.42.2(pid=7092): stderr: | 20221210065026624 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210065026624 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210065026624 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210065026624 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210065026624 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210065026624 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210065026637 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/handover_2G:trx-sysmocell5000+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210065026645 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210065026645 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210065026645 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:50:29.532427 run osmo-msc_10.42.42.6(pid=7098): ERR: Terminated: ERROR {rc=2} [trial-2370↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7098)] 06:50:29.582131 run osmo-msc_10.42.42.6(pid=7098): stdout: | (launched: 2022-12-10_06:50:28.398018) 06:50:29.633535 run osmo-msc_10.42.42.6(pid=7098): stderr: | 20221210065028720 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210065028720 DLGLOBAL DEBUG validating counter group 0x7fdcc2804c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210065028720 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210065028720 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210065028720 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210065028720 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210065028722 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210065028722 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210065028723 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210065028723 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:50:29.685389 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7091): Terminating (SIGTERM) 06:50:29.726509 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7094): Terminating (SIGTERM) 06:50:29.768282 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7097): Terminating (SIGTERM) 06:50:29.810352 --- ParallelTerminationStrategy: PID 7091 died... 06:50:29.830366 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7091): Terminated: ok {rc=0} 06:50:29.876923 --- ParallelTerminationStrategy: PID 7094 died... 06:50:29.896633 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7094): Terminated: ok {rc=0} 06:50:29.942556 --- ParallelTerminationStrategy: PID 7097 died... 06:50:29.962343 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7097): Terminated: ok {rc=0} 06:50:30.049384 bus /sierra_3: Setting Powered False 06:50:31.150033 bus /sierra_3: Setting Powered False 06:50:32.266551 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 handover_2G:trx-sysmocell5000+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 handover_2G:trx-sysmocell5000+bts1-trx-b200 --------------------------------------------------------------------- 06:50:33.524095 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:50:33.529537 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 06:50:33.592342 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 06:50:33.618835 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 06:50:33.671728 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 06:50:33.737592 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 06:50:33.763687 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 06:50:34.309705 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 handover_2G:trx-sysmocell5000+bts1-trx-b200 handover.py ---------------------------------------------- 06:50:34.314897 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:50:34.325938 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 06:50:34.373965 tst handover.py: using LAC 26625 06:50:34.493276 tst handover.py: using RAC 105 06:50:34.609569 tst handover.py: using CellId 26625 06:50:34.736524 tst handover.py: using BVCI 26626 06:50:34.853518 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 06:50:34.902442 tst handover.py: using LAC 26626 06:50:35.028458 tst handover.py: using RAC 106 06:50:35.153844 tst handover.py: using CellId 26626 06:50:35.279472 tst handover.py: using BVCI 26627 06:50:35.395809 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:50:35.407159 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:50:35.418358 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:50:35.429654 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:50:35.440813 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:50:35.451933 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 06:50:35.566866 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 06:50:35.684423 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:50:36.154153 run create_hlr_db(pid=7103): Launched 06:50:36.283895 bus /sierra_2: Setting Powered False 06:50:37.348066 run create_hlr_db(pid=7103): Terminated: ok {rc=0} 06:50:37.751673 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7105): Launched 06:50:38.051420 run osmo-hlr_10.42.42.2(pid=7106): Launched 06:50:38.166508 run osmo-stp_10.42.42.5: Starting osmo-stp 06:50:38.668080 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7108): Launched 06:50:38.968121 run osmo-stp_10.42.42.5(pid=7109): Launched 06:50:39.082915 run osmo-msc_10.42.42.6: Starting osmo-msc 06:50:39.598603 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7111): Launched 06:50:39.896329 run osmo-msc_10.42.42.6(pid=7112): Launched 06:50:40.064595 run osmo-stp_10.42.42.5(pid=7109): ERR: Terminated: ERROR {rc=1} [trial-2370↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7109)] 06:50:40.192078 run osmo-stp_10.42.42.5(pid=7109): stdout: | (launched: 2022-12-10_06:50:38.912884) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:50:40.319559 run osmo-stp_10.42.42.5(pid=7109): stderr: | 20221210065039081 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210065039081 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210065039082 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210065039082 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210065039084 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210065039084 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210065039084 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:50:40.444728 run osmo-stp_10.42.42.5(pid=7109): stdout: | (launched: 2022-12-10_06:50:38.912884) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:50:40.563458 run osmo-stp_10.42.42.5(pid=7109): stderr: | 20221210065039081 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210065039081 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210065039082 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210065039082 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210065039084 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210065039084 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210065039084 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:50:40.705781 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=7109): Process ended prematurely: osmo-stp_10.42.42.5(pid=7109) [trial-2370↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7109)] [trial-2370↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18] 06:50:40.714029 tst handover.py:18: Test FAILED (6.4 sec) 06:50:40.740258 run osmo-hlr_10.42.42.2(pid=7106): ERR: Terminated: ERROR {rc=237} [trial-2370↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7106)] 06:50:40.787746 run osmo-hlr_10.42.42.2(pid=7106): stdout: | (launched: 2022-12-10_06:50:37.996585) 06:50:40.837392 run osmo-hlr_10.42.42.2(pid=7106): stderr: | 20221210065038172 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210065038172 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210065038172 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210065038172 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210065038172 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210065038172 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210065038182 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/handover_2G:trx-sysmocell5000+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210065038191 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210065038191 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210065038191 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:50:40.905784 run osmo-msc_10.42.42.6(pid=7112): ERR: Terminated: ERROR {rc=2} [trial-2370↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7112)] 06:50:40.953275 run osmo-msc_10.42.42.6(pid=7112): stdout: | (launched: 2022-12-10_06:50:39.841382) 06:50:41.002212 run osmo-msc_10.42.42.6(pid=7112): stderr: | 20221210065040110 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210065040110 DLGLOBAL DEBUG validating counter group 0x7f562068cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210065040110 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210065040110 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210065040110 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210065040110 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210065040114 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210065040114 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210065040114 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210065040114 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:50:41.051768 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7105): Terminating (SIGTERM) 06:50:41.091098 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7108): Terminating (SIGTERM) 06:50:41.130435 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7111): Terminating (SIGTERM) 06:50:41.169968 --- ParallelTerminationStrategy: PID 7105 died... 06:50:41.188738 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7105): Terminated: ok {rc=0} 06:50:41.232606 --- ParallelTerminationStrategy: PID 7108 died... 06:50:41.251062 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7108): Terminated: ok {rc=0} 06:50:41.295067 --- ParallelTerminationStrategy: PID 7111 died... 06:50:41.313571 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7111): Terminated: ok {rc=0} 06:50:41.398882 bus /sierra_3: Setting Powered False 06:50:42.496932 bus /sierra_3: Setting Powered False 06:50:43.612383 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 handover_2G:trx-sysmocell5000+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 handover_2G:trx-sysmocell5000+bts1-trx-umtrx --------------------------------------------------------------------- 06:50:44.887794 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:50:44.894052 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 06:50:44.957546 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 06:50:44.984617 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 06:50:45.038406 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 06:50:45.103038 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 06:50:45.130033 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 06:50:45.680384 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover.py ---------------------------------------------- 06:50:45.685935 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:50:45.697455 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 06:50:45.746070 tst handover.py: using LAC 26627 06:50:45.870979 tst handover.py: using RAC 107 06:50:46.003174 tst handover.py: using CellId 26627 06:50:46.131174 tst handover.py: using BVCI 26628 06:50:46.251683 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 06:50:46.303711 tst handover.py: using LAC 26628 06:50:46.459360 tst handover.py: using RAC 108 06:50:46.586191 tst handover.py: using CellId 26628 06:50:46.712691 tst handover.py: using BVCI 26629 06:50:46.833199 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:50:46.845296 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:50:46.857825 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:50:46.870039 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:50:46.882444 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:50:46.894402 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 06:50:47.016942 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 06:50:47.139723 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:50:47.613387 run create_hlr_db(pid=7117): Launched 06:50:47.744412 bus /sierra_2: Setting Powered False 06:50:48.807729 run create_hlr_db(pid=7117): Terminated: ok {rc=0} 06:50:49.226145 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7119): Launched 06:50:49.545919 run osmo-hlr_10.42.42.2(pid=7120): Launched 06:50:49.668534 run osmo-stp_10.42.42.5: Starting osmo-stp 06:50:50.196506 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7122): Launched 06:50:50.517942 run osmo-stp_10.42.42.5(pid=7123): Launched 06:50:50.640159 run osmo-msc_10.42.42.6: Starting osmo-msc 06:50:51.191920 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7125): Launched 06:50:51.512870 run osmo-msc_10.42.42.6(pid=7126): Launched 06:50:51.691671 run osmo-stp_10.42.42.5(pid=7123): ERR: Terminated: ERROR {rc=1} [trial-2370↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7123)] 06:50:51.827511 run osmo-stp_10.42.42.5(pid=7123): stdout: | (launched: 2022-12-10_06:50:50.459002) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:50:51.963248 run osmo-stp_10.42.42.5(pid=7123): stderr: | 20221210065050653 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210065050653 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210065050653 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210065050654 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210065050654 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210065050654 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210065050654 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:50:52.098013 run osmo-stp_10.42.42.5(pid=7123): stdout: | (launched: 2022-12-10_06:50:50.459002) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:50:52.225359 run osmo-stp_10.42.42.5(pid=7123): stderr: | 20221210065050653 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210065050653 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210065050653 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210065050654 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210065050654 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210065050654 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210065050654 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:50:52.377618 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=7123): Process ended prematurely: osmo-stp_10.42.42.5(pid=7123) [trial-2370↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7123)] [trial-2370↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18] 06:50:52.386482 tst handover.py:18: Test FAILED (6.7 sec) 06:50:52.413814 run osmo-hlr_10.42.42.2(pid=7120): ERR: Terminated: ERROR {rc=237} [trial-2370↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7120)] 06:50:52.463840 run osmo-hlr_10.42.42.2(pid=7120): stdout: | (launched: 2022-12-10_06:50:49.487243) 06:50:52.515256 run osmo-hlr_10.42.42.2(pid=7120): stderr: | 20221210065049687 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210065049687 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210065049687 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210065049687 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210065049687 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210065049687 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210065049699 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/handover_2G:trx-sysmocell5000+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210065049707 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210065049707 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210065049708 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:50:52.587299 run osmo-msc_10.42.42.6(pid=7126): ERR: Terminated: ERROR {rc=2} [trial-2370↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7126)] 06:50:52.637170 run osmo-msc_10.42.42.6(pid=7126): stdout: | (launched: 2022-12-10_06:50:51.454093) 06:50:52.688564 run osmo-msc_10.42.42.6(pid=7126): stderr: | 20221210065051778 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210065051779 DLGLOBAL DEBUG validating counter group 0x7f2b6855fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210065051779 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210065051779 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210065051779 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210065051779 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210065051781 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210065051781 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210065051781 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210065051782 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:50:52.740164 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7119): Terminating (SIGTERM) 06:50:52.781805 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7122): Terminating (SIGTERM) 06:50:52.823215 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7125): Terminating (SIGTERM) 06:50:52.864697 --- ParallelTerminationStrategy: PID 7119 died... 06:50:52.884365 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7119): Terminated: ok {rc=0} 06:50:52.930334 --- ParallelTerminationStrategy: PID 7122 died... 06:50:52.949803 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7122): Terminated: ok {rc=0} 06:50:52.995468 --- ParallelTerminationStrategy: PID 7125 died... 06:50:53.014917 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7125): Terminated: ok {rc=0} 06:50:53.101861 bus /sierra_3: Setting Powered False 06:50:54.199716 bus /sierra_3: Setting Powered False 06:50:55.316348 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 handover_2G:trx-sysmocell5000+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 handover_2G:sysmo+bts1-trx-b200 --------------------------------------------------------------------- 06:50:56.584328 tst handover_2G:sysmo+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:50:56.589501 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 06:50:56.639696 tst handover_2G:sysmo+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 06:50:56.666565 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 06:50:56.719070 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 06:50:56.769971 tst handover_2G:sysmo+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 06:50:56.796374 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 06:50:57.349347 tst handover_2G:sysmo+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 handover_2G:sysmo+bts1-trx-b200 handover.py ---------------------------------------------- 06:50:57.354703 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:50:57.366107 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 06:50:57.400852 tst handover.py: using LAC 26629 06:50:57.526245 tst handover.py: using RAC 109 06:50:57.652686 tst handover.py: using CellId 26629 06:50:57.779885 tst handover.py: using BVCI 26630 06:50:57.897410 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 06:50:57.946865 tst handover.py: using LAC 26630 06:50:58.073434 tst handover.py: using RAC 110 06:50:58.198964 tst handover.py: using CellId 26630 06:50:58.326162 tst handover.py: using BVCI 26631 06:50:58.443446 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:50:58.454713 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:50:58.465781 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:50:58.477021 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:50:58.488243 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:50:58.499418 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 06:50:58.614422 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 06:50:58.728422 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:50:59.169084 run create_hlr_db(pid=7131): Launched 06:50:59.284599 bus /sierra_2: Setting Powered False 06:51:00.345459 run create_hlr_db(pid=7131): Terminated: ok {rc=0} 06:51:00.738224 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7133): Launched 06:51:01.062778 run osmo-hlr_10.42.42.2(pid=7134): Launched 06:51:01.178368 run osmo-stp_10.42.42.5: Starting osmo-stp 06:51:01.865848 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7136): Launched 06:51:02.176825 run osmo-stp_10.42.42.5(pid=7137): Launched 06:51:02.394576 run osmo-msc_10.42.42.6: Starting osmo-msc 06:51:02.956881 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7139): Launched 06:51:03.276824 run osmo-msc_10.42.42.6(pid=7140): Launched 06:51:03.455515 run osmo-stp_10.42.42.5(pid=7137): ERR: Terminated: ERROR {rc=1} [trial-2370↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7137)] 06:51:03.589179 run osmo-stp_10.42.42.5(pid=7137): stdout: | (launched: 2022-12-10_06:51:02.117412) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:51:03.724160 run osmo-stp_10.42.42.5(pid=7137): stderr: | 20221210065102428 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210065102429 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210065102429 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210065102429 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210065102430 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210065102430 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210065102430 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:51:03.859038 run osmo-stp_10.42.42.5(pid=7137): stdout: | (launched: 2022-12-10_06:51:02.117412) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:51:03.985796 run osmo-stp_10.42.42.5(pid=7137): stderr: | 20221210065102428 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210065102429 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210065102429 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210065102429 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210065102430 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210065102430 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210065102430 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:51:04.138073 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=7137): Process ended prematurely: osmo-stp_10.42.42.5(pid=7137) [trial-2370↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7137)] [trial-2370↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18] 06:51:04.146900 tst handover.py:18: Test FAILED (6.8 sec) 06:51:04.173967 run osmo-hlr_10.42.42.2(pid=7134): ERR: Terminated: ERROR {rc=237} [trial-2370↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7134)] 06:51:04.223244 run osmo-hlr_10.42.42.2(pid=7134): stdout: | (launched: 2022-12-10_06:51:01.003398) 06:51:04.274082 run osmo-hlr_10.42.42.2(pid=7134): stderr: | 20221210065101403 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210065101403 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210065101403 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210065101404 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210065101404 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210065101404 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210065101431 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/handover_2G:sysmo+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210065101450 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210065101451 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210065101451 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:51:04.345325 run osmo-msc_10.42.42.6(pid=7140): ERR: Terminated: ERROR {rc=2} [trial-2370↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7140)] 06:51:04.394512 run osmo-msc_10.42.42.6(pid=7140): stdout: | (launched: 2022-12-10_06:51:03.218160) 06:51:04.445558 run osmo-msc_10.42.42.6(pid=7140): stderr: | 20221210065103541 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210065103542 DLGLOBAL DEBUG validating counter group 0x7f059efa4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210065103542 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210065103542 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210065103542 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210065103542 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210065103544 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210065103544 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210065103544 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210065103544 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:51:04.496587 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7133): Terminating (SIGTERM) 06:51:04.538212 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7136): Terminating (SIGTERM) 06:51:04.579424 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7139): Terminating (SIGTERM) 06:51:04.620602 --- ParallelTerminationStrategy: PID 7133 died... 06:51:04.640428 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7133): Terminated: ok {rc=0} 06:51:04.685751 --- ParallelTerminationStrategy: PID 7136 died... 06:51:04.704926 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7136): Terminated: ok {rc=0} 06:51:04.750233 --- ParallelTerminationStrategy: PID 7139 died... 06:51:04.769709 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7139): Terminated: ok {rc=0} 06:51:04.855820 bus /sierra_3: Setting Powered False 06:51:05.952367 bus /sierra_3: Setting Powered False 06:51:07.067373 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 handover_2G:sysmo+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 handover_2G:sysmo+bts1-trx-umtrx --------------------------------------------------------------------- 06:51:08.317037 tst handover_2G:sysmo+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:51:08.322001 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 06:51:08.371717 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 06:51:08.398295 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 06:51:08.449348 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 06:51:08.498543 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 06:51:08.525305 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 06:51:09.076447 tst handover_2G:sysmo+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 handover_2G:sysmo+bts1-trx-umtrx handover.py ---------------------------------------------- 06:51:09.082680 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:51:09.093860 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 06:51:09.135174 tst handover.py: using LAC 26631 06:51:09.273178 tst handover.py: using RAC 111 06:51:09.390896 tst handover.py: using CellId 26631 06:51:09.507344 tst handover.py: using BVCI 26632 06:51:09.615446 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 06:51:09.661168 tst handover.py: using LAC 26632 06:51:09.778275 tst handover.py: using RAC 112 06:51:09.894902 tst handover.py: using CellId 26632 06:51:10.010420 tst handover.py: using BVCI 26633 06:51:10.128902 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:51:10.140229 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:51:10.151298 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:51:10.162941 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:51:10.174624 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:51:10.186175 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 06:51:10.302003 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 06:51:10.414713 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:51:10.851546 run create_hlr_db(pid=7145): Launched 06:51:10.966508 bus /sierra_2: Setting Powered False 06:51:12.025873 run create_hlr_db(pid=7145): Terminated: ok {rc=0} 06:51:12.435796 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7147): Launched 06:51:12.756885 run osmo-hlr_10.42.42.2(pid=7148): Launched 06:51:12.879103 run osmo-stp_10.42.42.5: Starting osmo-stp 06:51:13.402847 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7150): Launched 06:51:13.725284 run osmo-stp_10.42.42.5(pid=7151): Launched 06:51:13.848108 run osmo-msc_10.42.42.6: Starting osmo-msc 06:51:14.400856 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7153): Launched 06:51:14.722343 run osmo-msc_10.42.42.6(pid=7154): Launched 06:51:14.901691 run osmo-stp_10.42.42.5(pid=7151): ERR: Terminated: ERROR {rc=1} [trial-2370↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7151)] 06:51:15.036656 run osmo-stp_10.42.42.5(pid=7151): stdout: | (launched: 2022-12-10_06:51:13.666479) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:51:15.171878 run osmo-stp_10.42.42.5(pid=7151): stderr: | 20221210065113858 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210065113858 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210065113859 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210065113859 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210065113859 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210065113860 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210065113860 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:51:15.306819 run osmo-stp_10.42.42.5(pid=7151): stdout: | (launched: 2022-12-10_06:51:13.666479) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:51:15.434104 run osmo-stp_10.42.42.5(pid=7151): stderr: | 20221210065113858 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210065113858 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210065113859 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210065113859 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210065113859 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210065113860 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210065113860 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:51:15.586823 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=7151): Process ended prematurely: osmo-stp_10.42.42.5(pid=7151) [trial-2370↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7151)] [trial-2370↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18] 06:51:15.595899 tst handover.py:18: Test FAILED (6.5 sec) 06:51:15.623258 run osmo-hlr_10.42.42.2(pid=7148): ERR: Terminated: ERROR {rc=237} [trial-2370↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7148)] 06:51:15.672783 run osmo-hlr_10.42.42.2(pid=7148): stdout: | (launched: 2022-12-10_06:51:12.698185) 06:51:15.723629 run osmo-hlr_10.42.42.2(pid=7148): stderr: | 20221210065112896 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210065112896 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210065112896 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210065112896 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210065112896 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210065112896 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210065112909 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/handover_2G:sysmo+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210065112917 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210065112917 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210065112917 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:51:15.795334 run osmo-msc_10.42.42.6(pid=7154): ERR: Terminated: ERROR {rc=2} [trial-2370↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7154)] 06:51:15.850504 run osmo-msc_10.42.42.6(pid=7154): stdout: | (launched: 2022-12-10_06:51:14.663266) 06:51:15.911707 run osmo-msc_10.42.42.6(pid=7154): stderr: | 20221210065114985 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210065114986 DLGLOBAL DEBUG validating counter group 0x7f4c0e33bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210065114986 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210065114986 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210065114986 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210065114986 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210065114988 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210065114988 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210065114988 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210065114988 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:51:15.973762 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7147): Terminating (SIGTERM) 06:51:16.015744 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7150): Terminating (SIGTERM) 06:51:16.060648 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7153): Terminating (SIGTERM) 06:51:16.105040 --- ParallelTerminationStrategy: PID 7147 died... 06:51:16.126027 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7147): Terminated: ok {rc=0} 06:51:16.175547 --- ParallelTerminationStrategy: PID 7150 died... 06:51:16.196190 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7150): Terminated: ok {rc=0} 06:51:16.243724 --- ParallelTerminationStrategy: PID 7153 died... 06:51:16.264336 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7153): Terminated: ok {rc=0} 06:51:16.360746 bus /sierra_3: Setting Powered False 06:51:17.474797 bus /sierra_3: Setting Powered False 06:51:18.590179 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 handover_2G:sysmo+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2370 handover_2G:trx-b200+bts1-trx-umtrx --------------------------------------------------------------------- 06:51:19.846474 tst handover_2G:trx-b200+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:51:19.852031 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 06:51:19.915470 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 06:51:19.942632 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 06:51:19.995328 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 06:51:20.058875 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 06:51:20.086226 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 06:51:20.637810 tst handover_2G:trx-b200+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts Ettus B200 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2370 handover_2G:trx-b200+bts1-trx-umtrx handover.py ---------------------------------------------- 06:51:20.643171 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:51:20.654663 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 06:51:20.703703 tst handover.py: using LAC 26633 06:51:20.830913 tst handover.py: using RAC 113 06:51:20.957125 tst handover.py: using CellId 26633 06:51:21.083988 tst handover.py: using BVCI 26634 06:51:21.200129 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 06:51:21.249040 tst handover.py: using LAC 26634 06:51:21.379074 tst handover.py: using RAC 114 06:51:21.504192 tst handover.py: using CellId 26634 06:51:21.629598 tst handover.py: using BVCI 26635 06:51:21.745615 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:51:21.756871 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:51:21.768126 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:51:21.779645 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:51:21.790911 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:51:21.802087 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 06:51:21.940223 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 06:51:22.057836 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:51:22.494760 run create_hlr_db(pid=7159): Launched 06:51:22.610250 bus /sierra_2: Setting Powered False 06:51:23.670766 run create_hlr_db(pid=7159): Terminated: ok {rc=0} 06:51:24.082656 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7161): Launched 06:51:24.387418 run osmo-hlr_10.42.42.2(pid=7162): Launched 06:51:24.502288 run osmo-stp_10.42.42.5: Starting osmo-stp 06:51:25.008016 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7164): Launched 06:51:25.308710 run osmo-stp_10.42.42.5(pid=7165): Launched 06:51:25.424205 run osmo-msc_10.42.42.6: Starting osmo-msc 06:51:25.941721 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7167): Launched 06:51:26.241697 run osmo-msc_10.42.42.6(pid=7168): Launched 06:51:26.409246 run osmo-stp_10.42.42.5(pid=7165): ERR: Terminated: ERROR {rc=1} [trial-2370↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7165)] 06:51:26.536143 run osmo-stp_10.42.42.5(pid=7165): stdout: | (launched: 2022-12-10_06:51:25.253781) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:51:26.663415 run osmo-stp_10.42.42.5(pid=7165): stderr: | 20221210065125423 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210065125423 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210065125424 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210065125424 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210065125425 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210065125425 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210065125425 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:51:26.789120 run osmo-stp_10.42.42.5(pid=7165): stdout: | (launched: 2022-12-10_06:51:25.253781) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:51:26.908180 run osmo-stp_10.42.42.5(pid=7165): stderr: | 20221210065125423 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210065125423 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210065125424 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210065125424 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210065125425 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210065125425 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210065125425 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:51:27.050933 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=7165): Process ended prematurely: osmo-stp_10.42.42.5(pid=7165) [trial-2370↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7165)] [trial-2370↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18] 06:51:27.059405 tst handover.py:18: Test FAILED (6.4 sec) 06:51:27.085985 run osmo-hlr_10.42.42.2(pid=7162): ERR: Terminated: ERROR {rc=237} [trial-2370↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7162)] 06:51:27.133916 run osmo-hlr_10.42.42.2(pid=7162): stdout: | (launched: 2022-12-10_06:51:24.331979) 06:51:27.183189 run osmo-hlr_10.42.42.2(pid=7162): stderr: | 20221210065124508 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210065124508 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210065124508 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210065124508 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210065124508 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210065124508 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210065124520 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/handover_2G:trx-b200+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210065124528 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210065124529 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210065124529 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:51:27.251923 run osmo-msc_10.42.42.6(pid=7168): ERR: Terminated: ERROR {rc=2} [trial-2370↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7168)] 06:51:27.299667 run osmo-msc_10.42.42.6(pid=7168): stdout: | (launched: 2022-12-10_06:51:26.186656) 06:51:27.348821 run osmo-msc_10.42.42.6(pid=7168): stderr: | 20221210065126457 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210065126457 DLGLOBAL DEBUG validating counter group 0x7f9fd149dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210065126457 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210065126457 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210065126458 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210065126458 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210065126459 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210065126460 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210065126461 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210065126461 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:51:27.398586 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7161): Terminating (SIGTERM) 06:51:27.438162 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7164): Terminating (SIGTERM) 06:51:27.477815 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7167): Terminating (SIGTERM) 06:51:27.517697 --- ParallelTerminationStrategy: PID 7161 died... 06:51:27.536699 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7161): Terminated: ok {rc=0} 06:51:27.581169 --- ParallelTerminationStrategy: PID 7164 died... 06:51:27.599921 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7164): Terminated: ok {rc=0} 06:51:27.644030 --- ParallelTerminationStrategy: PID 7167 died... 06:51:27.662695 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7167): Terminated: ok {rc=0} 06:51:27.748114 bus /sierra_3: Setting Powered False 06:51:28.846498 bus /sierra_3: Setting Powered False 06:51:29.961372 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2370 handover_2G:trx-b200+bts1-trx-umtrx FAIL --------------------------------------------------------------------- 06:51:31.234786 tst trial-2370: Storing JUnit report in /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/trial-2370.xml -------------------------------------------------------------------------------------------- trial-2370 FAIL -------------------------------------------------------------------------------------------- 06:51:33.220566 tst trial-2370: trial-2370: FAIL, 200 suites failed FAIL: nitb_sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (5.0 sec) Error: osmo-nitb_10.42.42.2(pid=30799): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30799) [trial-2370↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30799)] FAIL: sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (14.1 sec) Error: osmo-stp_10.42.42.5(pid=30812): Process ended prematurely: osmo-stp_10.42.42.5(pid=30812) [trial-2370↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30812)] FAIL: nitb_ussd:sysmo (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=30822): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30822) [trial-2370↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30822)] FAIL: ussd:sysmo (fail: 1) FAIL: assert_extension.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=30832): Process ended prematurely: osmo-stp_10.42.42.5(pid=30832) [trial-2370↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30832)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=30846): Process ended prematurely: osmo-stp_10.42.42.5(pid=30846) [trial-2370↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30846)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=30857): Process ended prematurely: osmo-stp_10.42.42.5(pid=30857) [trial-2370↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30857)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=30871): Process ended prematurely: osmo-stp_10.42.42.5(pid=30871) [trial-2370↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30871)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=30882): Process ended prematurely: osmo-stp_10.42.42.5(pid=30882) [trial-2370↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30882)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=30896): Process ended prematurely: osmo-stp_10.42.42.5(pid=30896) [trial-2370↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30896)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=30907): Process ended prematurely: osmo-stp_10.42.42.5(pid=30907) [trial-2370↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30907)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=30921): Process ended prematurely: osmo-stp_10.42.42.5(pid=30921) [trial-2370↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30921)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=30932): Process ended prematurely: osmo-stp_10.42.42.5(pid=30932) [trial-2370↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30932)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=30946): Process ended prematurely: osmo-stp_10.42.42.5(pid=30946) [trial-2370↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30946)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=30957): Process ended prematurely: osmo-stp_10.42.42.5(pid=30957) [trial-2370↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30957)] FAIL: voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=30973): Process ended prematurely: osmo-stp_10.42.42.5(pid=30973) [trial-2370↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30973)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=30985): Process ended prematurely: osmo-stp_10.42.42.5(pid=30985) [trial-2370↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30985)] FAIL: voice:sysmo+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=30999): Process ended prematurely: osmo-stp_10.42.42.5(pid=30999) [trial-2370↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30999)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=31010): Process ended prematurely: osmo-stp_10.42.42.5(pid=31010) [trial-2370↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31010)] FAIL: emergency:sysmo (fail: 2) FAIL: emergency_mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=31025): Process ended prematurely: osmo-stp_10.42.42.5(pid=31025) [trial-2370↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31025)] FAIL: emergency_preemptive_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=31036): Process ended prematurely: osmo-stp_10.42.42.5(pid=31036) [trial-2370↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31036)] FAIL: gprs:sysmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.7 sec) Error: osmo-stp_10.42.42.5(pid=31054): Process ended prematurely: osmo-stp_10.42.42.5(pid=31054) [trial-2370↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31054)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=31067): Process ended prematurely: osmo-stp_10.42.42.5(pid=31067) [trial-2370↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31067)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=31085): Process ended prematurely: osmo-stp_10.42.42.5(pid=31085) [trial-2370↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31085)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=31096): Process ended prematurely: osmo-stp_10.42.42.5(pid=31096) [trial-2370↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31096)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=31106): Process ended prematurely: osmo-stp_10.42.42.5(pid=31106) [trial-2370↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31106)] FAIL: gprs:sysmo+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=31124): Process ended prematurely: osmo-stp_10.42.42.5(pid=31124) [trial-2370↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31124)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=31136): Process ended prematurely: osmo-stp_10.42.42.5(pid=31136) [trial-2370↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31136)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=31157): Process ended prematurely: osmo-stp_10.42.42.5(pid=31157) [trial-2370↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31157)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=31167): Process ended prematurely: osmo-stp_10.42.42.5(pid=31167) [trial-2370↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31167)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=31177): Process ended prematurely: osmo-stp_10.42.42.5(pid=31177) [trial-2370↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31177)] FAIL: gprs:sysmo+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=31196): Process ended prematurely: osmo-stp_10.42.42.5(pid=31196) [trial-2370↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31196)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=31208): Process ended prematurely: osmo-stp_10.42.42.5(pid=31208) [trial-2370↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31208)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=31226): Process ended prematurely: osmo-stp_10.42.42.5(pid=31226) [trial-2370↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31226)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=31236): Process ended prematurely: osmo-stp_10.42.42.5(pid=31236) [trial-2370↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31236)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=31246): Process ended prematurely: osmo-stp_10.42.42.5(pid=31246) [trial-2370↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31246)] FAIL: gprs:sysmo+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=31263): Process ended prematurely: osmo-stp_10.42.42.5(pid=31263) [trial-2370↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31263)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=31275): Process ended prematurely: osmo-stp_10.42.42.5(pid=31275) [trial-2370↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31275)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=31293): Process ended prematurely: osmo-stp_10.42.42.5(pid=31293) [trial-2370↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31293)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=31303): Process ended prematurely: osmo-stp_10.42.42.5(pid=31303) [trial-2370↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31303)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=31313): Process ended prematurely: osmo-stp_10.42.42.5(pid=31313) [trial-2370↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31313)] FAIL: dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=31329): Process ended prematurely: osmo-stp_10.42.42.5(pid=31329) [trial-2370↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31329)] FAIL: dynts:sysmo+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=31342): Process ended prematurely: osmo-stp_10.42.42.5(pid=31342) [trial-2370↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31342)] FAIL: nitb_sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=31350): Process ended prematurely: osmo-nitb_10.42.42.2(pid=31350) [trial-2370↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31350)] FAIL: sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=31360): Process ended prematurely: osmo-stp_10.42.42.5(pid=31360) [trial-2370↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31360)] FAIL: nitb_ussd:oc2g (fail: 1) FAIL: assert_extension.py (3.6 sec) Error: osmo-nitb_10.42.42.2(pid=31451): Process ended prematurely: osmo-nitb_10.42.42.2(pid=31451) [trial-2370↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31451)] FAIL: ussd:oc2g (fail: 1) FAIL: assert_extension.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=31650): Process ended prematurely: osmo-stp_10.42.42.5(pid=31650) [trial-2370↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31650)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=31664): Process ended prematurely: osmo-stp_10.42.42.5(pid=31664) [trial-2370↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31664)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=31676): Process ended prematurely: osmo-stp_10.42.42.5(pid=31676) [trial-2370↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31676)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=31691): Process ended prematurely: osmo-stp_10.42.42.5(pid=31691) [trial-2370↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31691)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=31703): Process ended prematurely: osmo-stp_10.42.42.5(pid=31703) [trial-2370↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31703)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=31718): Process ended prematurely: osmo-stp_10.42.42.5(pid=31718) [trial-2370↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31718)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=31729): Process ended prematurely: osmo-stp_10.42.42.5(pid=31729) [trial-2370↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31729)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=31743): Process ended prematurely: osmo-stp_10.42.42.5(pid=31743) [trial-2370↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31743)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=31754): Process ended prematurely: osmo-stp_10.42.42.5(pid=31754) [trial-2370↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31754)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=31771): Process ended prematurely: osmo-stp_10.42.42.5(pid=31771) [trial-2370↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31771)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=31782): Process ended prematurely: osmo-stp_10.42.42.5(pid=31782) [trial-2370↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31782)] FAIL: voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=31796): Process ended prematurely: osmo-stp_10.42.42.5(pid=31796) [trial-2370↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31796)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=31807): Process ended prematurely: osmo-stp_10.42.42.5(pid=31807) [trial-2370↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31807)] FAIL: voice:oc2g+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=31821): Process ended prematurely: osmo-stp_10.42.42.5(pid=31821) [trial-2370↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31821)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=31832): Process ended prematurely: osmo-stp_10.42.42.5(pid=31832) [trial-2370↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31832)] FAIL: emergency:oc2g (fail: 2) FAIL: emergency_mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=31846): Process ended prematurely: osmo-stp_10.42.42.5(pid=31846) [trial-2370↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31846)] FAIL: emergency_preemptive_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=31857): Process ended prematurely: osmo-stp_10.42.42.5(pid=31857) [trial-2370↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31857)] FAIL: gprs:oc2g (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=31875): Process ended prematurely: osmo-stp_10.42.42.5(pid=31875) [trial-2370↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31875)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=31887): Process ended prematurely: osmo-stp_10.42.42.5(pid=31887) [trial-2370↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31887)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=31914): Process ended prematurely: osmo-stp_10.42.42.5(pid=31914) [trial-2370↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31914)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=31924): Process ended prematurely: osmo-stp_10.42.42.5(pid=31924) [trial-2370↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31924)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=31934): Process ended prematurely: osmo-stp_10.42.42.5(pid=31934) [trial-2370↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31934)] FAIL: gprs:oc2g+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=31951): Process ended prematurely: osmo-stp_10.42.42.5(pid=31951) [trial-2370↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31951)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=31963): Process ended prematurely: osmo-stp_10.42.42.5(pid=31963) [trial-2370↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31963)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=31981): Process ended prematurely: osmo-stp_10.42.42.5(pid=31981) [trial-2370↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31981)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=31991): Process ended prematurely: osmo-stp_10.42.42.5(pid=31991) [trial-2370↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31991)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=32001): Process ended prematurely: osmo-stp_10.42.42.5(pid=32001) [trial-2370↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32001)] FAIL: gprs:oc2g+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=32018): Process ended prematurely: osmo-stp_10.42.42.5(pid=32018) [trial-2370↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32018)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=32030): Process ended prematurely: osmo-stp_10.42.42.5(pid=32030) [trial-2370↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32030)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=32048): Process ended prematurely: osmo-stp_10.42.42.5(pid=32048) [trial-2370↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32048)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=32059): Process ended prematurely: osmo-stp_10.42.42.5(pid=32059) [trial-2370↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32059)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=32070): Process ended prematurely: osmo-stp_10.42.42.5(pid=32070) [trial-2370↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32070)] FAIL: gprs:oc2g+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=32088): Process ended prematurely: osmo-stp_10.42.42.5(pid=32088) [trial-2370↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32088)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=32100): Process ended prematurely: osmo-stp_10.42.42.5(pid=32100) [trial-2370↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32100)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=32121): Process ended prematurely: osmo-stp_10.42.42.5(pid=32121) [trial-2370↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32121)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=32131): Process ended prematurely: osmo-stp_10.42.42.5(pid=32131) [trial-2370↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32131)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=32141): Process ended prematurely: osmo-stp_10.42.42.5(pid=32141) [trial-2370↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32141)] FAIL: dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=32155): Process ended prematurely: osmo-stp_10.42.42.5(pid=32155) [trial-2370↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32155)] FAIL: dynts:oc2g+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=32168): Process ended prematurely: osmo-stp_10.42.42.5(pid=32168) [trial-2370↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32168)] FAIL: nitb_sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=32176): Process ended prematurely: osmo-nitb_10.42.42.2(pid=32176) [trial-2370↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32176)] FAIL: sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=32186): Process ended prematurely: osmo-stp_10.42.42.5(pid=32186) [trial-2370↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32186)] FAIL: nitb_ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=32195): Process ended prematurely: osmo-nitb_10.42.42.2(pid=32195) [trial-2370↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32195)] FAIL: ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=32205): Process ended prematurely: osmo-stp_10.42.42.5(pid=32205) [trial-2370↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32205)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=32219): Process ended prematurely: osmo-stp_10.42.42.5(pid=32219) [trial-2370↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32219)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=32230): Process ended prematurely: osmo-stp_10.42.42.5(pid=32230) [trial-2370↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32230)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=32244): Process ended prematurely: osmo-stp_10.42.42.5(pid=32244) [trial-2370↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32244)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=32255): Process ended prematurely: osmo-stp_10.42.42.5(pid=32255) [trial-2370↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32255)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=32269): Process ended prematurely: osmo-stp_10.42.42.5(pid=32269) [trial-2370↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32269)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=32280): Process ended prematurely: osmo-stp_10.42.42.5(pid=32280) [trial-2370↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32280)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=32294): Process ended prematurely: osmo-stp_10.42.42.5(pid=32294) [trial-2370↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32294)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=32308): Process ended prematurely: osmo-stp_10.42.42.5(pid=32308) [trial-2370↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32308)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=32322): Process ended prematurely: osmo-stp_10.42.42.5(pid=32322) [trial-2370↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32322)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=32333): Process ended prematurely: osmo-stp_10.42.42.5(pid=32333) [trial-2370↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32333)] FAIL: voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=32347): Process ended prematurely: osmo-stp_10.42.42.5(pid=32347) [trial-2370↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32347)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=32358): Process ended prematurely: osmo-stp_10.42.42.5(pid=32358) [trial-2370↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32358)] FAIL: voice:trx-b200+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=32372): Process ended prematurely: osmo-stp_10.42.42.5(pid=32372) [trial-2370↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32372)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=32383): Process ended prematurely: osmo-stp_10.42.42.5(pid=32383) [trial-2370↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32383)] FAIL: voice:trx-b200+mod-bts0-trxdversion0 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=32398): Process ended prematurely: osmo-stp_10.42.42.5(pid=32398) [trial-2370↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32398)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=32409): Process ended prematurely: osmo-stp_10.42.42.5(pid=32409) [trial-2370↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32409)] FAIL: voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=32423): Process ended prematurely: osmo-stp_10.42.42.5(pid=32423) [trial-2370↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32423)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=32435): Process ended prematurely: osmo-stp_10.42.42.5(pid=32435) [trial-2370↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32435)] FAIL: emergency:trx-b200 (fail: 2) FAIL: emergency_mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=32449): Process ended prematurely: osmo-stp_10.42.42.5(pid=32449) [trial-2370↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32449)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=32460): Process ended prematurely: osmo-stp_10.42.42.5(pid=32460) [trial-2370↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32460)] FAIL: gprs:trx-b200 (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=32483): Process ended prematurely: osmo-stp_10.42.42.5(pid=32483) [trial-2370↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32483)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=32495): Process ended prematurely: osmo-stp_10.42.42.5(pid=32495) [trial-2370↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32495)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=32513): Process ended prematurely: osmo-stp_10.42.42.5(pid=32513) [trial-2370↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32513)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=32523): Process ended prematurely: osmo-stp_10.42.42.5(pid=32523) [trial-2370↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32523)] FAIL: ping_idle_ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=32533): Process ended prematurely: osmo-stp_10.42.42.5(pid=32533) [trial-2370↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32533)] FAIL: gprs:trx-b200+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=32551): Process ended prematurely: osmo-stp_10.42.42.5(pid=32551) [trial-2370↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32551)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=32563): Process ended prematurely: osmo-stp_10.42.42.5(pid=32563) [trial-2370↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32563)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=32581): Process ended prematurely: osmo-stp_10.42.42.5(pid=32581) [trial-2370↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32581)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=32591): Process ended prematurely: osmo-stp_10.42.42.5(pid=32591) [trial-2370↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32591)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=32601): Process ended prematurely: osmo-stp_10.42.42.5(pid=32601) [trial-2370↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32601)] FAIL: gprs:trx-b200+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=32618): Process ended prematurely: osmo-stp_10.42.42.5(pid=32618) [trial-2370↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32618)] FAIL: iperf3.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=32630): Process ended prematurely: osmo-stp_10.42.42.5(pid=32630) [trial-2370↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32630)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=32652): Process ended prematurely: osmo-stp_10.42.42.5(pid=32652) [trial-2370↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32652)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=32662): Process ended prematurely: osmo-stp_10.42.42.5(pid=32662) [trial-2370↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32662)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=32672): Process ended prematurely: osmo-stp_10.42.42.5(pid=32672) [trial-2370↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32672)] FAIL: gprs:trx-b200+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=32690): Process ended prematurely: osmo-stp_10.42.42.5(pid=32690) [trial-2370↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32690)] FAIL: iperf3.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=518): Process ended prematurely: osmo-stp_10.42.42.5(pid=518) [trial-2370↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=518)] FAIL: iperf3m4.py (12.1 sec) Error: osmo-stp_10.42.42.5(pid=536): Process ended prematurely: osmo-stp_10.42.42.5(pid=536) [trial-2370↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=536)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=546): Process ended prematurely: osmo-stp_10.42.42.5(pid=546) [trial-2370↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=546)] FAIL: ping_idle_ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=556): Process ended prematurely: osmo-stp_10.42.42.5(pid=556) [trial-2370↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=556)] FAIL: gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=573): Process ended prematurely: osmo-stp_10.42.42.5(pid=573) [trial-2370↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=573)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=585): Process ended prematurely: osmo-stp_10.42.42.5(pid=585) [trial-2370↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=585)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=603): Process ended prematurely: osmo-stp_10.42.42.5(pid=603) [trial-2370↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=603)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=613): Process ended prematurely: osmo-stp_10.42.42.5(pid=613) [trial-2370↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=613)] FAIL: ping_idle_ping.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=627): Process ended prematurely: osmo-stp_10.42.42.5(pid=627) [trial-2370↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=627)] FAIL: dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=646): Process ended prematurely: osmo-stp_10.42.42.5(pid=646) [trial-2370↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=646)] FAIL: dynts:trx-b200+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=1040): Process ended prematurely: osmo-stp_10.42.42.5(pid=1040) [trial-2370↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1040)] FAIL: nitb_sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=1241): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1241) [trial-2370↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1241)] FAIL: sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=1251): Process ended prematurely: osmo-stp_10.42.42.5(pid=1251) [trial-2370↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1251)] FAIL: nitb_ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=1260): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1260) [trial-2370↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1260)] FAIL: ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=1270): Process ended prematurely: osmo-stp_10.42.42.5(pid=1270) [trial-2370↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1270)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=1284): Process ended prematurely: osmo-stp_10.42.42.5(pid=1284) [trial-2370↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1284)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=1295): Process ended prematurely: osmo-stp_10.42.42.5(pid=1295) [trial-2370↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1295)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=1309): Process ended prematurely: osmo-stp_10.42.42.5(pid=1309) [trial-2370↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1309)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=1320): Process ended prematurely: osmo-stp_10.42.42.5(pid=1320) [trial-2370↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1320)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=1335): Process ended prematurely: osmo-stp_10.42.42.5(pid=1335) [trial-2370↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1335)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=1346): Process ended prematurely: osmo-stp_10.42.42.5(pid=1346) [trial-2370↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1346)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=1360): Process ended prematurely: osmo-stp_10.42.42.5(pid=1360) [trial-2370↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1360)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=1371): Process ended prematurely: osmo-stp_10.42.42.5(pid=1371) [trial-2370↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1371)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=1385): Process ended prematurely: osmo-stp_10.42.42.5(pid=1385) [trial-2370↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1385)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=1398): Process ended prematurely: osmo-stp_10.42.42.5(pid=1398) [trial-2370↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1398)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=1412): Process ended prematurely: osmo-stp_10.42.42.5(pid=1412) [trial-2370↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1412)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=1423): Process ended prematurely: osmo-stp_10.42.42.5(pid=1423) [trial-2370↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1423)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=1437): Process ended prematurely: osmo-stp_10.42.42.5(pid=1437) [trial-2370↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1437)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=1449): Process ended prematurely: osmo-stp_10.42.42.5(pid=1449) [trial-2370↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1449)] FAIL: emergency:trx-sysmocell5000 (fail: 2) FAIL: emergency_mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=1463): Process ended prematurely: osmo-stp_10.42.42.5(pid=1463) [trial-2370↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1463)] FAIL: emergency_preemptive_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=1474): Process ended prematurely: osmo-stp_10.42.42.5(pid=1474) [trial-2370↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1474)] FAIL: gprs:trx-sysmocell5000 (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=1493): Process ended prematurely: osmo-stp_10.42.42.5(pid=1493) [trial-2370↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1493)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=1505): Process ended prematurely: osmo-stp_10.42.42.5(pid=1505) [trial-2370↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1505)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=1523): Process ended prematurely: osmo-stp_10.42.42.5(pid=1523) [trial-2370↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1523)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=1533): Process ended prematurely: osmo-stp_10.42.42.5(pid=1533) [trial-2370↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1533)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=1543): Process ended prematurely: osmo-stp_10.42.42.5(pid=1543) [trial-2370↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1543)] FAIL: gprs:trx-sysmocell5000+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=1602): Process ended prematurely: osmo-stp_10.42.42.5(pid=1602) [trial-2370↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1602)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=1616): Process ended prematurely: osmo-stp_10.42.42.5(pid=1616) [trial-2370↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1616)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=1634): Process ended prematurely: osmo-stp_10.42.42.5(pid=1634) [trial-2370↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1634)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=1644): Process ended prematurely: osmo-stp_10.42.42.5(pid=1644) [trial-2370↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1644)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=1654): Process ended prematurely: osmo-stp_10.42.42.5(pid=1654) [trial-2370↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1654)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=1671): Process ended prematurely: osmo-stp_10.42.42.5(pid=1671) [trial-2370↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1671)] FAIL: iperf3.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=1683): Process ended prematurely: osmo-stp_10.42.42.5(pid=1683) [trial-2370↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1683)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=1701): Process ended prematurely: osmo-stp_10.42.42.5(pid=1701) [trial-2370↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1701)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=1711): Process ended prematurely: osmo-stp_10.42.42.5(pid=1711) [trial-2370↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1711)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=1721): Process ended prematurely: osmo-stp_10.42.42.5(pid=1721) [trial-2370↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1721)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=1738): Process ended prematurely: osmo-stp_10.42.42.5(pid=1738) [trial-2370↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1738)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=1750): Process ended prematurely: osmo-stp_10.42.42.5(pid=1750) [trial-2370↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1750)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=1768): Process ended prematurely: osmo-stp_10.42.42.5(pid=1768) [trial-2370↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1768)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=1781): Process ended prematurely: osmo-stp_10.42.42.5(pid=1781) [trial-2370↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1781)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=1791): Process ended prematurely: osmo-stp_10.42.42.5(pid=1791) [trial-2370↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1791)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=1805): Process ended prematurely: osmo-stp_10.42.42.5(pid=1805) [trial-2370↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1805)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=1821): Process ended prematurely: osmo-stp_10.42.42.5(pid=1821) [trial-2370↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1821)] FAIL: nitb_sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=1829): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1829) [trial-2370↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1829)] FAIL: sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=1839): Process ended prematurely: osmo-stp_10.42.42.5(pid=1839) [trial-2370↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1839)] FAIL: nitb_ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=1849): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1849) [trial-2370↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1849)] FAIL: ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=1859): Process ended prematurely: osmo-stp_10.42.42.5(pid=1859) [trial-2370↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1859)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=1873): Process ended prematurely: osmo-stp_10.42.42.5(pid=1873) [trial-2370↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1873)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=1884): Process ended prematurely: osmo-stp_10.42.42.5(pid=1884) [trial-2370↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1884)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=1898): Process ended prematurely: osmo-stp_10.42.42.5(pid=1898) [trial-2370↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1898)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=1909): Process ended prematurely: osmo-stp_10.42.42.5(pid=1909) [trial-2370↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1909)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=1924): Process ended prematurely: osmo-stp_10.42.42.5(pid=1924) [trial-2370↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1924)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=1937): Process ended prematurely: osmo-stp_10.42.42.5(pid=1937) [trial-2370↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1937)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=1956): Process ended prematurely: osmo-stp_10.42.42.5(pid=1956) [trial-2370↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1956)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=1968): Process ended prematurely: osmo-stp_10.42.42.5(pid=1968) [trial-2370↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1968)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=1982): Process ended prematurely: osmo-stp_10.42.42.5(pid=1982) [trial-2370↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1982)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=1993): Process ended prematurely: osmo-stp_10.42.42.5(pid=1993) [trial-2370↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1993)] FAIL: voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=2008): Process ended prematurely: osmo-stp_10.42.42.5(pid=2008) [trial-2370↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2008)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=2019): Process ended prematurely: osmo-stp_10.42.42.5(pid=2019) [trial-2370↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2019)] FAIL: voice:trx-umtrx+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=2033): Process ended prematurely: osmo-stp_10.42.42.5(pid=2033) [trial-2370↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2033)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=2044): Process ended prematurely: osmo-stp_10.42.42.5(pid=2044) [trial-2370↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2044)] FAIL: voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=2058): Process ended prematurely: osmo-stp_10.42.42.5(pid=2058) [trial-2370↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2058)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=2069): Process ended prematurely: osmo-stp_10.42.42.5(pid=2069) [trial-2370↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2069)] FAIL: emergency:trx-umtrx (fail: 2) FAIL: emergency_mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=2083): Process ended prematurely: osmo-stp_10.42.42.5(pid=2083) [trial-2370↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2083)] FAIL: emergency_preemptive_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=2094): Process ended prematurely: osmo-stp_10.42.42.5(pid=2094) [trial-2370↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2094)] FAIL: gprs:trx-umtrx (fail: 5) FAIL: cs_paging_gprs_active.py (8.3 sec) Error: osmo-stp_10.42.42.5(pid=2112): Process ended prematurely: osmo-stp_10.42.42.5(pid=2112) [trial-2370↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2112)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=2124): Process ended prematurely: osmo-stp_10.42.42.5(pid=2124) [trial-2370↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2124)] FAIL: iperf3m4.py (10.1 sec) Error: osmo-stp_10.42.42.5(pid=2144): Process ended prematurely: osmo-stp_10.42.42.5(pid=2144) [trial-2370↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2144)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=2154): Process ended prematurely: osmo-stp_10.42.42.5(pid=2154) [trial-2370↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2154)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=2164): Process ended prematurely: osmo-stp_10.42.42.5(pid=2164) [trial-2370↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2164)] FAIL: gprs:trx-umtrx+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (9.7 sec) Error: osmo-stp_10.42.42.5(pid=2230): Process ended prematurely: osmo-stp_10.42.42.5(pid=2230) [trial-2370↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2230)] FAIL: iperf3.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=2465): Process ended prematurely: osmo-stp_10.42.42.5(pid=2465) [trial-2370↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2465)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=2484): Process ended prematurely: osmo-stp_10.42.42.5(pid=2484) [trial-2370↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2484)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=2494): Process ended prematurely: osmo-stp_10.42.42.5(pid=2494) [trial-2370↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2494)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=2504): Process ended prematurely: osmo-stp_10.42.42.5(pid=2504) [trial-2370↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2504)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=2523): Process ended prematurely: osmo-stp_10.42.42.5(pid=2523) [trial-2370↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2523)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=2535): Process ended prematurely: osmo-stp_10.42.42.5(pid=2535) [trial-2370↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2535)] FAIL: iperf3m4.py (10.3 sec) Error: osmo-stp_10.42.42.5(pid=2553): Process ended prematurely: osmo-stp_10.42.42.5(pid=2553) [trial-2370↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2553)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=2563): Process ended prematurely: osmo-stp_10.42.42.5(pid=2563) [trial-2370↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2563)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=2583): Process ended prematurely: osmo-stp_10.42.42.5(pid=2583) [trial-2370↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2583)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=2952): Process ended prematurely: osmo-stp_10.42.42.5(pid=2952) [trial-2370↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2952)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=3140): Process ended prematurely: osmo-stp_10.42.42.5(pid=3140) [trial-2370↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3140)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=3158): Process ended prematurely: osmo-stp_10.42.42.5(pid=3158) [trial-2370↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3158)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=3168): Process ended prematurely: osmo-stp_10.42.42.5(pid=3168) [trial-2370↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3168)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=3178): Process ended prematurely: osmo-stp_10.42.42.5(pid=3178) [trial-2370↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3178)] FAIL: gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=3195): Process ended prematurely: osmo-stp_10.42.42.5(pid=3195) [trial-2370↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3195)] FAIL: iperf3.py (7.2 sec) Error: osmo-stp_10.42.42.5(pid=3207): Process ended prematurely: osmo-stp_10.42.42.5(pid=3207) [trial-2370↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3207)] FAIL: iperf3m4.py (10.3 sec) Error: osmo-stp_10.42.42.5(pid=3225): Process ended prematurely: osmo-stp_10.42.42.5(pid=3225) [trial-2370↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3225)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=3235): Process ended prematurely: osmo-stp_10.42.42.5(pid=3235) [trial-2370↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3235)] FAIL: ping_idle_ping.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=3245): Process ended prematurely: osmo-stp_10.42.42.5(pid=3245) [trial-2370↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3245)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=3258): Process ended prematurely: osmo-stp_10.42.42.5(pid=3258) [trial-2370↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3258)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=3272): Process ended prematurely: osmo-stp_10.42.42.5(pid=3272) [trial-2370↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3272)] FAIL: nitb_sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=3281): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3281) [trial-2370↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3281)] FAIL: sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (5.7 sec) Error: osmo-stp_10.42.42.5(pid=3292): Process ended prematurely: osmo-stp_10.42.42.5(pid=3292) [trial-2370↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3292)] FAIL: nitb_ussd:trx-lms (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=3301): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3301) [trial-2370↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3301)] FAIL: ussd:trx-lms (fail: 1) FAIL: assert_extension.py (5.6 sec) Error: osmo-stp_10.42.42.5(pid=3311): Process ended prematurely: osmo-stp_10.42.42.5(pid=3311) [trial-2370↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3311)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=3325): Process ended prematurely: osmo-stp_10.42.42.5(pid=3325) [trial-2370↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3325)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=3336): Process ended prematurely: osmo-stp_10.42.42.5(pid=3336) [trial-2370↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3336)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=3350): Process ended prematurely: osmo-stp_10.42.42.5(pid=3350) [trial-2370↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3350)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=3361): Process ended prematurely: osmo-stp_10.42.42.5(pid=3361) [trial-2370↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3361)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=3375): Process ended prematurely: osmo-stp_10.42.42.5(pid=3375) [trial-2370↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3375)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=3386): Process ended prematurely: osmo-stp_10.42.42.5(pid=3386) [trial-2370↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3386)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=3402): Process ended prematurely: osmo-stp_10.42.42.5(pid=3402) [trial-2370↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3402)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=3413): Process ended prematurely: osmo-stp_10.42.42.5(pid=3413) [trial-2370↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3413)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=3428): Process ended prematurely: osmo-stp_10.42.42.5(pid=3428) [trial-2370↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3428)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=3439): Process ended prematurely: osmo-stp_10.42.42.5(pid=3439) [trial-2370↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3439)] FAIL: voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=3453): Process ended prematurely: osmo-stp_10.42.42.5(pid=3453) [trial-2370↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3453)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=3467): Process ended prematurely: osmo-stp_10.42.42.5(pid=3467) [trial-2370↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3467)] FAIL: voice:trx-lms+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=3481): Process ended prematurely: osmo-stp_10.42.42.5(pid=3481) [trial-2370↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3481)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=3492): Process ended prematurely: osmo-stp_10.42.42.5(pid=3492) [trial-2370↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3492)] FAIL: emergency:trx-lms (fail: 2) FAIL: emergency_mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=3506): Process ended prematurely: osmo-stp_10.42.42.5(pid=3506) [trial-2370↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3506)] FAIL: emergency_preemptive_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=3517): Process ended prematurely: osmo-stp_10.42.42.5(pid=3517) [trial-2370↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3517)] FAIL: gprs:trx-lms (fail: 5) FAIL: cs_paging_gprs_active.py (8.3 sec) Error: osmo-stp_10.42.42.5(pid=3535): Process ended prematurely: osmo-stp_10.42.42.5(pid=3535) [trial-2370↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3535)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=3547): Process ended prematurely: osmo-stp_10.42.42.5(pid=3547) [trial-2370↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3547)] FAIL: iperf3m4.py (10.2 sec) Error: osmo-stp_10.42.42.5(pid=3565): Process ended prematurely: osmo-stp_10.42.42.5(pid=3565) [trial-2370↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3565)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=3575): Process ended prematurely: osmo-stp_10.42.42.5(pid=3575) [trial-2370↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3575)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=3585): Process ended prematurely: osmo-stp_10.42.42.5(pid=3585) [trial-2370↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3585)] FAIL: gprs:trx-lms+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=3605): Process ended prematurely: osmo-stp_10.42.42.5(pid=3605) [trial-2370↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3605)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=3617): Process ended prematurely: osmo-stp_10.42.42.5(pid=3617) [trial-2370↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3617)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=3635): Process ended prematurely: osmo-stp_10.42.42.5(pid=3635) [trial-2370↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3635)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=3645): Process ended prematurely: osmo-stp_10.42.42.5(pid=3645) [trial-2370↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3645)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=3655): Process ended prematurely: osmo-stp_10.42.42.5(pid=3655) [trial-2370↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3655)] FAIL: gprs:trx-lms+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=3672): Process ended prematurely: osmo-stp_10.42.42.5(pid=3672) [trial-2370↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3672)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=3684): Process ended prematurely: osmo-stp_10.42.42.5(pid=3684) [trial-2370↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3684)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=3702): Process ended prematurely: osmo-stp_10.42.42.5(pid=3702) [trial-2370↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3702)] FAIL: ping.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=3712): Process ended prematurely: osmo-stp_10.42.42.5(pid=3712) [trial-2370↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3712)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=3722): Process ended prematurely: osmo-stp_10.42.42.5(pid=3722) [trial-2370↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3722)] FAIL: gprs:trx-lms+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=3739): Process ended prematurely: osmo-stp_10.42.42.5(pid=3739) [trial-2370↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3739)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=3752): Process ended prematurely: osmo-stp_10.42.42.5(pid=3752) [trial-2370↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3752)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=3771): Process ended prematurely: osmo-stp_10.42.42.5(pid=3771) [trial-2370↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3771)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=3781): Process ended prematurely: osmo-stp_10.42.42.5(pid=3781) [trial-2370↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3781)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=3791): Process ended prematurely: osmo-stp_10.42.42.5(pid=3791) [trial-2370↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3791)] FAIL: dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=3812): Process ended prematurely: osmo-stp_10.42.42.5(pid=3812) [trial-2370↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3812)] FAIL: dynts:trx-lms+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=3828): Process ended prematurely: osmo-stp_10.42.42.5(pid=3828) [trial-2370↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3828)] FAIL: nitb_sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=3837): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3837) [trial-2370↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3837)] FAIL: sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=3847): Process ended prematurely: osmo-stp_10.42.42.5(pid=3847) [trial-2370↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3847)] FAIL: nitb_ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=3856): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3856) [trial-2370↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3856)] FAIL: ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (5.6 sec) Error: osmo-stp_10.42.42.5(pid=3866): Process ended prematurely: osmo-stp_10.42.42.5(pid=3866) [trial-2370↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3866)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=3880): Process ended prematurely: osmo-stp_10.42.42.5(pid=3880) [trial-2370↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3880)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=3891): Process ended prematurely: osmo-stp_10.42.42.5(pid=3891) [trial-2370↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3891)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=3905): Process ended prematurely: osmo-stp_10.42.42.5(pid=3905) [trial-2370↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3905)] FAIL: mo_mt_call_osmux.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=3916): Process ended prematurely: osmo-stp_10.42.42.5(pid=3916) [trial-2370↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3916)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=3930): Process ended prematurely: osmo-stp_10.42.42.5(pid=3930) [trial-2370↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3930)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=3941): Process ended prematurely: osmo-stp_10.42.42.5(pid=3941) [trial-2370↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3941)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=3955): Process ended prematurely: osmo-stp_10.42.42.5(pid=3955) [trial-2370↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3955)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=3966): Process ended prematurely: osmo-stp_10.42.42.5(pid=3966) [trial-2370↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3966)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=3980): Process ended prematurely: osmo-stp_10.42.42.5(pid=3980) [trial-2370↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3980)] FAIL: mo_mt_call_osmux.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=3991): Process ended prematurely: osmo-stp_10.42.42.5(pid=3991) [trial-2370↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3991)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=4006): Process ended prematurely: osmo-stp_10.42.42.5(pid=4006) [trial-2370↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4006)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=4017): Process ended prematurely: osmo-stp_10.42.42.5(pid=4017) [trial-2370↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4017)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=4031): Process ended prematurely: osmo-stp_10.42.42.5(pid=4031) [trial-2370↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4031)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=4042): Process ended prematurely: osmo-stp_10.42.42.5(pid=4042) [trial-2370↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4042)] FAIL: emergency:trx-lms-limenet-micro (fail: 2) FAIL: emergency_mo_mt_call.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=4325): Process ended prematurely: osmo-stp_10.42.42.5(pid=4325) [trial-2370↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4325)] FAIL: emergency_preemptive_call.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=4339): Process ended prematurely: osmo-stp_10.42.42.5(pid=4339) [trial-2370↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4339)] FAIL: gprs:trx-lms-limenet-micro (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=4359): Process ended prematurely: osmo-stp_10.42.42.5(pid=4359) [trial-2370↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4359)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=4371): Process ended prematurely: osmo-stp_10.42.42.5(pid=4371) [trial-2370↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4371)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=4389): Process ended prematurely: osmo-stp_10.42.42.5(pid=4389) [trial-2370↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4389)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=4399): Process ended prematurely: osmo-stp_10.42.42.5(pid=4399) [trial-2370↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4399)] FAIL: ping_idle_ping.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=4409): Process ended prematurely: osmo-stp_10.42.42.5(pid=4409) [trial-2370↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4409)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=4426): Process ended prematurely: osmo-stp_10.42.42.5(pid=4426) [trial-2370↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4426)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=4438): Process ended prematurely: osmo-stp_10.42.42.5(pid=4438) [trial-2370↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4438)] FAIL: iperf3m4.py (10.0 sec) Error: osmo-stp_10.42.42.5(pid=4459): Process ended prematurely: osmo-stp_10.42.42.5(pid=4459) [trial-2370↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4459)] FAIL: ping.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=4469): Process ended prematurely: osmo-stp_10.42.42.5(pid=4469) [trial-2370↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4469)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=4479): Process ended prematurely: osmo-stp_10.42.42.5(pid=4479) [trial-2370↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4479)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=4496): Process ended prematurely: osmo-stp_10.42.42.5(pid=4496) [trial-2370↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4496)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=4508): Process ended prematurely: osmo-stp_10.42.42.5(pid=4508) [trial-2370↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4508)] FAIL: iperf3m4.py (10.3 sec) Error: osmo-stp_10.42.42.5(pid=4527): Process ended prematurely: osmo-stp_10.42.42.5(pid=4527) [trial-2370↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4527)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=4537): Process ended prematurely: osmo-stp_10.42.42.5(pid=4537) [trial-2370↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4537)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=4547): Process ended prematurely: osmo-stp_10.42.42.5(pid=4547) [trial-2370↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4547)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=4565): Process ended prematurely: osmo-stp_10.42.42.5(pid=4565) [trial-2370↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4565)] FAIL: iperf3.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=4577): Process ended prematurely: osmo-stp_10.42.42.5(pid=4577) [trial-2370↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4577)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=4595): Process ended prematurely: osmo-stp_10.42.42.5(pid=4595) [trial-2370↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4595)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=4605): Process ended prematurely: osmo-stp_10.42.42.5(pid=4605) [trial-2370↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4605)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=4615): Process ended prematurely: osmo-stp_10.42.42.5(pid=4615) [trial-2370↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4615)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=4629): Process ended prematurely: osmo-stp_10.42.42.5(pid=4629) [trial-2370↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4629)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=4642): Process ended prematurely: osmo-stp_10.42.42.5(pid=4642) [trial-2370↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4642)] FAIL: nitb_sms:nanobts (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=4650): Process ended prematurely: osmo-nitb_10.42.42.2(pid=4650) [trial-2370↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4650)] FAIL: sms:nanobts+band-1900 (fail: 1) FAIL: mo_mt_sms.py (5.7 sec) Error: osmo-stp_10.42.42.5(pid=4660): Process ended prematurely: osmo-stp_10.42.42.5(pid=4660) [trial-2370↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4660)] FAIL: nitb_ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=4669): Process ended prematurely: osmo-nitb_10.42.42.2(pid=4669) [trial-2370↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4669)] FAIL: ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=4679): Process ended prematurely: osmo-stp_10.42.42.5(pid=4679) [trial-2370↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4679)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=4693): Process ended prematurely: osmo-stp_10.42.42.5(pid=4693) [trial-2370↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4693)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=4705): Process ended prematurely: osmo-stp_10.42.42.5(pid=4705) [trial-2370↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4705)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=4720): Process ended prematurely: osmo-stp_10.42.42.5(pid=4720) [trial-2370↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4720)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=4731): Process ended prematurely: osmo-stp_10.42.42.5(pid=4731) [trial-2370↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4731)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=4746): Process ended prematurely: osmo-stp_10.42.42.5(pid=4746) [trial-2370↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4746)] FAIL: mo_mt_call_osmux.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=4757): Process ended prematurely: osmo-stp_10.42.42.5(pid=4757) [trial-2370↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4757)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=4771): Process ended prematurely: osmo-stp_10.42.42.5(pid=4771) [trial-2370↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4771)] FAIL: mo_mt_call_osmux.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=4782): Process ended prematurely: osmo-stp_10.42.42.5(pid=4782) [trial-2370↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4782)] FAIL: voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=4796): Process ended prematurely: osmo-stp_10.42.42.5(pid=4796) [trial-2370↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4796)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=4817): Process ended prematurely: osmo-stp_10.42.42.5(pid=4817) [trial-2370↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4817)] FAIL: emergency:nanobts+band-1900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=5182): Process ended prematurely: osmo-stp_10.42.42.5(pid=5182) [trial-2370↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5182)] FAIL: emergency_preemptive_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=5369): Process ended prematurely: osmo-stp_10.42.42.5(pid=5369) [trial-2370↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5369)] FAIL: gprs:nanobts+band-1900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=5389): Process ended prematurely: osmo-stp_10.42.42.5(pid=5389) [trial-2370↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5389)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=5401): Process ended prematurely: osmo-stp_10.42.42.5(pid=5401) [trial-2370↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5401)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=5419): Process ended prematurely: osmo-stp_10.42.42.5(pid=5419) [trial-2370↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5419)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=5429): Process ended prematurely: osmo-stp_10.42.42.5(pid=5429) [trial-2370↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5429)] FAIL: ping_idle_ping.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=5439): Process ended prematurely: osmo-stp_10.42.42.5(pid=5439) [trial-2370↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5439)] FAIL: gprs:nanobts+band-1900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.2 sec) Error: osmo-stp_10.42.42.5(pid=5457): Process ended prematurely: osmo-stp_10.42.42.5(pid=5457) [trial-2370↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5457)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=5469): Process ended prematurely: osmo-stp_10.42.42.5(pid=5469) [trial-2370↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5469)] FAIL: iperf3m4.py (10.1 sec) Error: osmo-stp_10.42.42.5(pid=5487): Process ended prematurely: osmo-stp_10.42.42.5(pid=5487) [trial-2370↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5487)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=5497): Process ended prematurely: osmo-stp_10.42.42.5(pid=5497) [trial-2370↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5497)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=5510): Process ended prematurely: osmo-stp_10.42.42.5(pid=5510) [trial-2370↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5510)] FAIL: gprs:nanobts+band-1900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=5527): Process ended prematurely: osmo-stp_10.42.42.5(pid=5527) [trial-2370↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5527)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=5539): Process ended prematurely: osmo-stp_10.42.42.5(pid=5539) [trial-2370↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5539)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=5558): Process ended prematurely: osmo-stp_10.42.42.5(pid=5558) [trial-2370↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5558)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=5568): Process ended prematurely: osmo-stp_10.42.42.5(pid=5568) [trial-2370↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5568)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=5578): Process ended prematurely: osmo-stp_10.42.42.5(pid=5578) [trial-2370↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5578)] FAIL: dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=5591): Process ended prematurely: osmo-stp_10.42.42.5(pid=5591) [trial-2370↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5591)] FAIL: sms:nanobts+band-900 (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=5604): Process ended prematurely: osmo-stp_10.42.42.5(pid=5604) [trial-2370↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5604)] FAIL: nitb_ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=5615): Process ended prematurely: osmo-nitb_10.42.42.2(pid=5615) [trial-2370↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5615)] FAIL: ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=5625): Process ended prematurely: osmo-stp_10.42.42.5(pid=5625) [trial-2370↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5625)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=5639): Process ended prematurely: osmo-stp_10.42.42.5(pid=5639) [trial-2370↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5639)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=5650): Process ended prematurely: osmo-stp_10.42.42.5(pid=5650) [trial-2370↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5650)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=5664): Process ended prematurely: osmo-stp_10.42.42.5(pid=5664) [trial-2370↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5664)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=5675): Process ended prematurely: osmo-stp_10.42.42.5(pid=5675) [trial-2370↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5675)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=5692): Process ended prematurely: osmo-stp_10.42.42.5(pid=5692) [trial-2370↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5692)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=5703): Process ended prematurely: osmo-stp_10.42.42.5(pid=5703) [trial-2370↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5703)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=5717): Process ended prematurely: osmo-stp_10.42.42.5(pid=5717) [trial-2370↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5717)] FAIL: mo_mt_call_osmux.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=5728): Process ended prematurely: osmo-stp_10.42.42.5(pid=5728) [trial-2370↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5728)] FAIL: voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=5743): Process ended prematurely: osmo-stp_10.42.42.5(pid=5743) [trial-2370↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5743)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=5754): Process ended prematurely: osmo-stp_10.42.42.5(pid=5754) [trial-2370↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5754)] FAIL: voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=5768): Process ended prematurely: osmo-stp_10.42.42.5(pid=5768) [trial-2370↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5768)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=5779): Process ended prematurely: osmo-stp_10.42.42.5(pid=5779) [trial-2370↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5779)] FAIL: emergency:nanobts+band-900 (fail: 2) FAIL: emergency_mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=5794): Process ended prematurely: osmo-stp_10.42.42.5(pid=5794) [trial-2370↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5794)] FAIL: emergency_preemptive_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=5805): Process ended prematurely: osmo-stp_10.42.42.5(pid=5805) [trial-2370↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5805)] FAIL: gprs:nanobts+band-900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=5823): Process ended prematurely: osmo-stp_10.42.42.5(pid=5823) [trial-2370↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5823)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=5835): Process ended prematurely: osmo-stp_10.42.42.5(pid=5835) [trial-2370↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5835)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=5853): Process ended prematurely: osmo-stp_10.42.42.5(pid=5853) [trial-2370↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5853)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=5863): Process ended prematurely: osmo-stp_10.42.42.5(pid=5863) [trial-2370↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5863)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=5876): Process ended prematurely: osmo-stp_10.42.42.5(pid=5876) [trial-2370↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5876)] FAIL: gprs:nanobts+band-900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.2 sec) Error: osmo-stp_10.42.42.5(pid=5894): Process ended prematurely: osmo-stp_10.42.42.5(pid=5894) [trial-2370↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5894)] FAIL: iperf3.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=5906): Process ended prematurely: osmo-stp_10.42.42.5(pid=5906) [trial-2370↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5906)] FAIL: iperf3m4.py (11.9 sec) Error: osmo-stp_10.42.42.5(pid=6084): Process ended prematurely: osmo-stp_10.42.42.5(pid=6084) [trial-2370↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6084)] FAIL: ping.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=6208): Process ended prematurely: osmo-stp_10.42.42.5(pid=6208) [trial-2370↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6208)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=6218): Process ended prematurely: osmo-stp_10.42.42.5(pid=6218) [trial-2370↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6218)] FAIL: gprs:nanobts+band-900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=6236): Process ended prematurely: osmo-stp_10.42.42.5(pid=6236) [trial-2370↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6236)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=6249): Process ended prematurely: osmo-stp_10.42.42.5(pid=6249) [trial-2370↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6249)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=6267): Process ended prematurely: osmo-stp_10.42.42.5(pid=6267) [trial-2370↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6267)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=6278): Process ended prematurely: osmo-stp_10.42.42.5(pid=6278) [trial-2370↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6278)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=6288): Process ended prematurely: osmo-stp_10.42.42.5(pid=6288) [trial-2370↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6288)] FAIL: gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=6305): Process ended prematurely: osmo-stp_10.42.42.5(pid=6305) [trial-2370↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6305)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=6320): Process ended prematurely: osmo-stp_10.42.42.5(pid=6320) [trial-2370↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6320)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=6385): Process ended prematurely: osmo-stp_10.42.42.5(pid=6385) [trial-2370↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6385)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=6396): Process ended prematurely: osmo-stp_10.42.42.5(pid=6396) [trial-2370↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6396)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=6406): Process ended prematurely: osmo-stp_10.42.42.5(pid=6406) [trial-2370↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6406)] FAIL: dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=6419): Process ended prematurely: osmo-stp_10.42.42.5(pid=6419) [trial-2370↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6419)] FAIL: nitb_smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (2.4 sec) Error: osmo-nitb_10.42.42.2(pid=6428): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6428) [trial-2370↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6428)] FAIL: esme_connect_policy_closed.py (2.1 sec) Error: osmo-nitb_10.42.42.2(pid=6430): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6430) [trial-2370↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6430)] FAIL: esme_ms_sms_storeforward.py (2.8 sec) Error: osmo-nitb_10.42.42.2(pid=6432): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6432) [trial-2370↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6432)] FAIL: esme_ms_sms_transaction.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=6436): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6436) [trial-2370↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6436)] FAIL: smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (5.8 sec) Error: osmo-hlr_10.42.42.2(pid=6445): Process ended prematurely: osmo-hlr_10.42.42.2(pid=6445) [trial-2370↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6445)] FAIL: esme_connect_policy_closed.py (6.1 sec) Error: osmo-hlr_10.42.42.2(pid=6456): Process ended prematurely: osmo-hlr_10.42.42.2(pid=6456) [trial-2370↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6456)] FAIL: esme_ms_sms_storeforward.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=6468): Process ended prematurely: osmo-stp_10.42.42.5(pid=6468) [trial-2370↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6468)] FAIL: esme_ms_sms_transaction.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=6479): Process ended prematurely: osmo-stp_10.42.42.5(pid=6479) [trial-2370↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6479)] FAIL: encryption (fail: 4) FAIL: register_a5_0_authopt.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=6493): Process ended prematurely: osmo-stp_10.42.42.5(pid=6493) [trial-2370↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6493)] FAIL: register_a5_0_authreq.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=6504): Process ended prematurely: osmo-stp_10.42.42.5(pid=6504) [trial-2370↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6504)] FAIL: register_a5_1_authreq.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=6520): Process ended prematurely: osmo-stp_10.42.42.5(pid=6520) [trial-2370↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6520)] FAIL: register_a5_3_authreq.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=6531): Process ended prematurely: osmo-stp_10.42.42.5(pid=6531) [trial-2370↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6531)] FAIL: 4g:srsenb-rftype@zmq+srsue-rftype@zmq (fail: 7) FAIL: handover.py (19.5 sec) Error: srsepc(pid=6551): Process ended prematurely: srsepc(pid=6551) [trial-2370↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=6551)] FAIL: iperf3_bidir.py (18.9 sec) Error: srsepc(pid=6567): Process ended prematurely: srsepc(pid=6567) [trial-2370↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=6567)] FAIL: iperf3_dl.py (18.5 sec) Error: srsepc(pid=6583): Process ended prematurely: srsepc(pid=6583) [trial-2370↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=6583)] FAIL: iperf3_ul.py (18.3 sec) Error: srsepc(pid=6599): Process ended prematurely: srsepc(pid=6599) [trial-2370↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=6599)] FAIL: ping.py (18.3 sec) Error: srsepc(pid=6615): Process ended prematurely: srsepc(pid=6615) [trial-2370↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=6615)] FAIL: rrc_idle_mo_ping.py (18.5 sec) Error: srsepc(pid=6631): Process ended prematurely: srsepc(pid=6631) [trial-2370↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=6631)] FAIL: rrc_idle_mt_ping.py (18.5 sec) Error: srsepc(pid=6648): Process ended prematurely: srsepc(pid=6648) [trial-2370↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=6648)] FAIL: handover_2G:nanobts+bts1-oc2g (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=6661): Process ended prematurely: osmo-stp_10.42.42.5(pid=6661) [trial-2370↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6661)] FAIL: handover_2G:nanobts+bts1-octphy (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=6676): Process ended prematurely: osmo-stp_10.42.42.5(pid=6676) [trial-2370↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6676)] FAIL: handover_2G:nanobts+bts1-trx-lms (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=6693): Process ended prematurely: osmo-stp_10.42.42.5(pid=6693) [trial-2370↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6693)] FAIL: handover_2G:nanobts+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=6707): Process ended prematurely: osmo-stp_10.42.42.5(pid=6707) [trial-2370↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6707)] FAIL: handover_2G:nanobts+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=6722): Process ended prematurely: osmo-stp_10.42.42.5(pid=6722) [trial-2370↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6722)] FAIL: handover_2G:nanobts+bts1-sysmo (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=6737): Process ended prematurely: osmo-stp_10.42.42.5(pid=6737) [trial-2370↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6737)] FAIL: handover_2G:nanobts+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=6751): Process ended prematurely: osmo-stp_10.42.42.5(pid=6751) [trial-2370↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6751)] FAIL: handover_2G:nanobts+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=6765): Process ended prematurely: osmo-stp_10.42.42.5(pid=6765) [trial-2370↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6765)] FAIL: handover_2G:oc2g+bts1-octphy (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=6780): Process ended prematurely: osmo-stp_10.42.42.5(pid=6780) [trial-2370↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6780)] FAIL: handover_2G:oc2g+bts1-trx-lms (fail: 1) FAIL: handover.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=6794): Process ended prematurely: osmo-stp_10.42.42.5(pid=6794) [trial-2370↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6794)] FAIL: handover_2G:oc2g+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=6809): Process ended prematurely: osmo-stp_10.42.42.5(pid=6809) [trial-2370↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6809)] FAIL: handover_2G:oc2g+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=6823): Process ended prematurely: osmo-stp_10.42.42.5(pid=6823) [trial-2370↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6823)] FAIL: handover_2G:oc2g+bts1-sysmo (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=6837): Process ended prematurely: osmo-stp_10.42.42.5(pid=6837) [trial-2370↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6837)] FAIL: handover_2G:oc2g+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=6851): Process ended prematurely: osmo-stp_10.42.42.5(pid=6851) [trial-2370↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6851)] FAIL: handover_2G:oc2g+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=6865): Process ended prematurely: osmo-stp_10.42.42.5(pid=6865) [trial-2370↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6865)] FAIL: handover_2G:octphy+bts1-trx-lms (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=6879): Process ended prematurely: osmo-stp_10.42.42.5(pid=6879) [trial-2370↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6879)] FAIL: handover_2G:octphy+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=6894): Process ended prematurely: osmo-stp_10.42.42.5(pid=6894) [trial-2370↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6894)] FAIL: handover_2G:octphy+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=6908): Process ended prematurely: osmo-stp_10.42.42.5(pid=6908) [trial-2370↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6908)] FAIL: handover_2G:octphy+bts1-sysmo (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=6922): Process ended prematurely: osmo-stp_10.42.42.5(pid=6922) [trial-2370↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6922)] FAIL: handover_2G:octphy+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=6936): Process ended prematurely: osmo-stp_10.42.42.5(pid=6936) [trial-2370↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6936)] FAIL: handover_2G:octphy+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=6950): Process ended prematurely: osmo-stp_10.42.42.5(pid=6950) [trial-2370↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6950)] FAIL: handover_2G:trx-lms+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=6964): Process ended prematurely: osmo-stp_10.42.42.5(pid=6964) [trial-2370↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6964)] FAIL: handover_2G:trx-lms+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=6978): Process ended prematurely: osmo-stp_10.42.42.5(pid=6978) [trial-2370↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6978)] FAIL: handover_2G:trx-lms+bts1-sysmo (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=6992): Process ended prematurely: osmo-stp_10.42.42.5(pid=6992) [trial-2370↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6992)] FAIL: handover_2G:trx-lms+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=7006): Process ended prematurely: osmo-stp_10.42.42.5(pid=7006) [trial-2370↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7006)] FAIL: handover_2G:trx-lms+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=7021): Process ended prematurely: osmo-stp_10.42.42.5(pid=7021) [trial-2370↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7021)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=7036): Process ended prematurely: osmo-stp_10.42.42.5(pid=7036) [trial-2370↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7036)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-sysmo (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=7050): Process ended prematurely: osmo-stp_10.42.42.5(pid=7050) [trial-2370↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7050)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=7067): Process ended prematurely: osmo-stp_10.42.42.5(pid=7067) [trial-2370↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7067)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=7081): Process ended prematurely: osmo-stp_10.42.42.5(pid=7081) [trial-2370↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7081)] FAIL: handover_2G:trx-sysmocell5000+bts1-sysmo (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=7095): Process ended prematurely: osmo-stp_10.42.42.5(pid=7095) [trial-2370↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7095)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=7109): Process ended prematurely: osmo-stp_10.42.42.5(pid=7109) [trial-2370↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7109)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=7123): Process ended prematurely: osmo-stp_10.42.42.5(pid=7123) [trial-2370↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7123)] FAIL: handover_2G:sysmo+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=7137): Process ended prematurely: osmo-stp_10.42.42.5(pid=7137) [trial-2370↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7137)] FAIL: handover_2G:sysmo+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=7151): Process ended prematurely: osmo-stp_10.42.42.5(pid=7151) [trial-2370↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7151)] FAIL: handover_2G:trx-b200+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=7165): Process ended prematurely: osmo-stp_10.42.42.5(pid=7165) [trial-2370↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7165)] + rm -rf trial-2370/inst + cd trial-2370 + command -v journalctl + [ ! -z /bin/journalctl ] + readlink last_run + journalctl -u ofono -o short-precise --since 2022-12-10 05:27:32 + readlink last_run + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370-run.tgz run.2022-12-10_05-27-43 + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370-bin.tgz checksums.md5 open5gs.build-8.tgz osmo-bsc.build-17657.tgz osmo-bts-oc2g.build-5534.tgz osmo-bts-sysmo.build-8038.tgz osmo-bts.build-7507.tgz osmo-ggsn.build-6680.tgz osmo-hlr.build-8701.tgz osmo-hnbgw.build-2952.tgz osmo-mgw.build-8946.tgz osmo-msc.build-29267.tgz osmo-nitb.build-12970.tgz osmo-pcu-oc2g.build-3908.tgz osmo-pcu-sysmo.build-5190.tgz osmo-pcu.build-5151.tgz osmo-sgsn.build-30044.tgz osmo-stp.build-9241.tgz osmo-trx.build-4676.tgz osmocom-bb.build-4701.tgz srslte.build-19.tgz + exit 1 Build step 'Execute shell' marked build as failure Archiving artifacts Recording test results [Checks API] No suitable checks publisher found. Sending e-mails to: pespin@sysmocom.de Finished: FAILURE