![[Jenkins]](/jenkins/static/342c126a/images/svgs/logo.svg){kind=logo}
Started by upstream project "osmo-gsm-tester_build-osmo-ggsn" build number 6688 originally caused by: Started by upstream project "master-osmo-ggsn" build number 6683 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-sgsn" build number 30080 originally caused by: Started by upstream project "master-osmo-sgsn" build number 37244 originally caused by: Started by upstream project "master-osmo-ggsn" build number 6683 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-pcu-sysmo" build number 5192 originally caused by: Started by upstream project "master-osmo-pcu" build number 5360 originally caused by: Started by an SCM change Started by upstream project "osmo-gsm-tester_build-osmo-pcu" build number 5153 originally caused by: Started by upstream project "master-osmo-pcu" build number 5360 originally caused by: Started by an SCM change Started by upstream project "osmo-gsm-tester_build-osmo-pcu-oc2g" build number 3910 originally caused by: Started by upstream project "master-osmo-pcu" build number 5360 originally caused by: Started by an SCM change Running as SYSTEM Building remotely on osmo-gsm-tester-prod (osmo-gsm-tester) in workspace /home/jenkins/workspace/osmo-gsm-tester_run-prod The recommended git tool is: NONE No credentials specified > git rev-parse --resolve-git-dir /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/.git # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url https://gerrit.osmocom.org/osmo-gsm-tester # timeout=10 Fetching upstream changes from https://gerrit.osmocom.org/osmo-gsm-tester > git --version # timeout=10 > git --version # 'git version 2.20.1' > git fetch --tags --force --progress -- https://gerrit.osmocom.org/osmo-gsm-tester +refs/heads/*:refs/remotes/origin/* # timeout=10 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 Checking out Revision bfc438bb2b17f4129018768a1f7bab52f1e96750 (refs/remotes/origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Commit message: "templates: osmo-msc: modernize" > git rev-list --no-walk bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bsc" build number 17675 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts" build number 7507 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-ggsn" build number 6688 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hlr" build number 8711 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-mgw" build number 8956 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hnbgw" build number 2978 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-msc" build number 29296 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu" build number 5153 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-sgsn" build number 30080 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-trx" build number 4679 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-nitb" build number 12985 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-stp" build number 9252 Copied 2 artifacts from "osmo-gsm-tester_build-osmocom-bb" build number 4708 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-sysmo" build number 8038 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-sysmo" build number 5192 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-oc2g" build number 5534 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-oc2g" build number 3910 Copied 2 artifacts from "osmo-gsm-tester_build-open5gs" build number 8 Copied 2 artifacts from "osmo-gsm-tester_build-srslte" build number 19 [osmo-gsm-tester_run-prod] $ /bin/sh /tmp/jenkins7206799543153628280.sh + unlink osmo-gsm-tester/sysmocom/resources.conf + ln -s resources.conf.prod osmo-gsm-tester/sysmocom/resources.conf + PATH=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src:/usr/local/bin:/usr/bin:/bin:/usr/games ./osmo-gsm-tester/contrib/jenkins-run.sh + base=/home/jenkins/workspace/osmo-gsm-tester_run-prod + dirname -- ./osmo-gsm-tester/contrib/jenkins-run.sh + CDPATH= cd -- ./osmo-gsm-tester/contrib + pwd -P + SCRIPT_DIR=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib + OSMO_GSM_TESTER_CONF=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf + date +%F %T + time_start=2022-12-12 22:05:32 + trial_dir_prefix=trial- + rm -rf trial-2382 trial-2382-bin.tgz trial-2382-run.tgz + trial_dir=trial-2383 + mkdir -p trial-2383 + mv open5gs.build-8.tgz osmo-bsc.build-17675.tgz osmo-bts-oc2g.build-5534.tgz osmo-bts-sysmo.build-8038.tgz osmo-bts.build-7507.tgz osmo-ggsn.build-6688.tgz osmo-hlr.build-8711.tgz osmo-hnbgw.build-2978.tgz osmo-mgw.build-8956.tgz osmo-msc.build-29296.tgz osmo-nitb.build-12985.tgz osmo-pcu-oc2g.build-3910.tgz osmo-pcu-sysmo.build-5192.tgz osmo-pcu.build-5153.tgz osmo-sgsn.build-30080.tgz osmo-stp.build-9252.tgz osmo-trx.build-4679.tgz osmocom-bb.build-4708.tgz srslte.build-19.tgz trial-2383 + cat open5gs.build-8.md5 osmo-bsc.build-17675.md5 osmo-bts-oc2g.build-5534.md5 osmo-bts-sysmo.build-8038.md5 osmo-bts.build-7507.md5 osmo-ggsn.build-6688.md5 osmo-hlr.build-8711.md5 osmo-hnbgw.build-2978.md5 osmo-mgw.build-8956.md5 osmo-msc.build-29296.md5 osmo-nitb.build-12985.md5 osmo-pcu-oc2g.build-3910.md5 osmo-pcu-sysmo.build-5192.md5 osmo-pcu.build-5153.md5 osmo-sgsn.build-30080.md5 osmo-stp.build-9252.md5 osmo-trx.build-4679.md5 osmocom-bb.build-4708.md5 srslte.build-19.md5 + rm open5gs.build-8.md5 osmo-bsc.build-17675.md5 osmo-bts-oc2g.build-5534.md5 osmo-bts-sysmo.build-8038.md5 osmo-bts.build-7507.md5 osmo-ggsn.build-6688.md5 osmo-hlr.build-8711.md5 osmo-hnbgw.build-2978.md5 osmo-mgw.build-8956.md5 osmo-msc.build-29296.md5 osmo-nitb.build-12985.md5 osmo-pcu-oc2g.build-3910.md5 osmo-pcu-sysmo.build-5192.md5 osmo-pcu.build-5153.md5 osmo-sgsn.build-30080.md5 osmo-stp.build-9252.md5 osmo-trx.build-4679.md5 osmocom-bb.build-4708.md5 srslte.build-19.md5 + exit_code=1 + which osmo-gsm-tester.py + python3 -u /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo-gsm-tester.py -c /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf trial-2383 combinations: None trial: 'trial-2383' tests: None Running default suites: nitb_sms:sysmo sms:sysmo nitb_ussd:sysmo ussd:sysmo voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:sysmo+mod-bts0-dynts-osmo emergency:sysmo gprs:sysmo gprs:sysmo+mod-bts0-egprs gprs:sysmo+mod-bts0-dynts-ipa gprs:sysmo+mod-bts0-dynts-osmo dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:sysmo+mod-bts0-dynts67-osmo nitb_sms:oc2g sms:oc2g nitb_ussd:oc2g ussd:oc2g voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:oc2g+mod-bts0-dynts-osmo emergency:oc2g gprs:oc2g gprs:oc2g+mod-bts0-egprs gprs:oc2g+mod-bts0-dynts-ipa gprs:oc2g+mod-bts0-dynts-osmo dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:oc2g+mod-bts0-dynts67-osmo nitb_sms:trx-b200 sms:trx-b200 nitb_ussd:trx-b200 ussd:trx-b200 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-b200+mod-bts0-dynts-osmo voice:trx-b200+mod-bts0-trxdversion0 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-b200 gprs:trx-b200 gprs:trx-b200+mod-bts0-egprs gprs:trx-b200+mod-bts0-dynts-ipa gprs:trx-b200+mod-bts0-dynts-osmo gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-b200+mod-bts0-dynts67-osmo nitb_sms:trx-sysmocell5000 sms:trx-sysmocell5000 nitb_ussd:trx-sysmocell5000 ussd:trx-sysmocell5000 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-sysmocell5000+mod-bts0-dynts-osmo emergency:trx-sysmocell5000 gprs:trx-sysmocell5000 gprs:trx-sysmocell5000+mod-bts0-egprs gprs:trx-sysmocell5000+mod-bts0-dynts-ipa gprs:trx-sysmocell5000+mod-bts0-dynts-osmo dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo nitb_sms:trx-umtrx sms:trx-umtrx nitb_ussd:trx-umtrx ussd:trx-umtrx voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-umtrx+mod-bts0-dynts-osmo voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-umtrx gprs:trx-umtrx gprs:trx-umtrx+mod-bts0-egprs gprs:trx-umtrx+mod-bts0-dynts-ipa gprs:trx-umtrx+mod-bts0-dynts-osmo gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-umtrx+mod-bts0-dynts67-osmo nitb_sms:trx-lms sms:trx-lms nitb_ussd:trx-lms ussd:trx-lms voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms+mod-bts0-dynts-osmo emergency:trx-lms gprs:trx-lms gprs:trx-lms+mod-bts0-egprs gprs:trx-lms+mod-bts0-dynts-ipa gprs:trx-lms+mod-bts0-dynts-osmo dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms+mod-bts0-dynts67-osmo nitb_sms:trx-lms-limenet-micro sms:trx-lms-limenet-micro nitb_ussd:trx-lms-limenet-micro ussd:trx-lms-limenet-micro voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo emergency:trx-lms-limenet-micro gprs:trx-lms-limenet-micro gprs:trx-lms-limenet-micro+mod-bts0-egprs gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo nitb_sms:nanobts sms:nanobts+band-1900 nitb_ussd:nanobts+band-1900 ussd:nanobts+band-1900 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any emergency:nanobts+band-1900 gprs:nanobts+band-1900 gprs:nanobts+band-1900+mod-bts0-egprs gprs:nanobts+band-1900+mod-bts0-dynts-ipa dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any sms:nanobts+band-900 nitb_ussd:nanobts+band-900 ussd:nanobts+band-900 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:nanobts+band-900 gprs:nanobts+band-900 gprs:nanobts+band-900+mod-bts0-egprs gprs:nanobts+band-900+mod-bts0-dynts-ipa gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any nitb_smpp smpp encryption 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover_2G:nanobts+bts1-oc2g handover_2G:nanobts+bts1-octphy handover_2G:nanobts+bts1-trx-lms handover_2G:nanobts+bts1-trx-lms-limenet-micro handover_2G:nanobts+bts1-trx-sysmocell5000 handover_2G:nanobts+bts1-sysmo handover_2G:nanobts+bts1-trx-b200 handover_2G:nanobts+bts1-trx-umtrx handover_2G:oc2g+bts1-octphy handover_2G:oc2g+bts1-trx-lms handover_2G:oc2g+bts1-trx-lms-limenet-micro handover_2G:oc2g+bts1-trx-sysmocell5000 handover_2G:oc2g+bts1-sysmo handover_2G:oc2g+bts1-trx-b200 handover_2G:oc2g+bts1-trx-umtrx handover_2G:octphy+bts1-trx-lms handover_2G:octphy+bts1-trx-lms-limenet-micro handover_2G:octphy+bts1-trx-sysmocell5000 handover_2G:octphy+bts1-sysmo handover_2G:octphy+bts1-trx-b200 handover_2G:octphy+bts1-trx-umtrx handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover_2G:trx-lms+bts1-trx-sysmocell5000 handover_2G:trx-lms+bts1-sysmo handover_2G:trx-lms+bts1-trx-b200 handover_2G:trx-lms+bts1-trx-umtrx handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover_2G:trx-sysmocell5000+bts1-sysmo handover_2G:trx-sysmocell5000+bts1-trx-b200 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover_2G:sysmo+bts1-trx-b200 handover_2G:sysmo+bts1-trx-umtrx handover_2G:trx-b200+bts1-trx-umtrx -------------------------------------------------------------------------------------------- trial-2383 -------------------------------------------------------------------------------------------- 22:05:43.499256 tst trial-2383: Detailed log at /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/log --------------------------------------------------------------------- trial-2383 nitb_sms:sysmo --------------------------------------------------------------------- 22:07:52.542985 tst nitb_sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:07:52.547254 tst nitb_sms:sysmo: Verifying 1 x bts (candidates: 11) 22:07:52.567967 tst nitb_sms:sysmo: Verifying 1 x ip_address (candidates: 9) 22:07:52.575117 tst nitb_sms:sysmo: Verifying 2 x modem (candidates: 12) 22:07:52.629857 tst nitb_sms:sysmo: Reserving 1 x bts (candidates: 11) 22:07:52.650224 tst nitb_sms:sysmo: Reserving 1 x ip_address (candidates: 9) 22:07:52.657335 tst nitb_sms:sysmo: Reserving 2 x modem (candidates: 12) 22:07:53.194674 tst nitb_sms:sysmo: RESERVED RESOURCES for nitb_sms: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 nitb_sms:sysmo mo_mt_sms.py ---------------------------------------------- 22:07:53.199425 tst nitb_sms:sysmo: Using 1 x ip_address (candidates: 1) 22:07:53.210061 tst nitb_sms:sysmo: Using 1 x bts (candidates: 1) 22:07:53.579050 tst mo_mt_sms.py: using LAC 31820 22:07:53.817086 tst mo_mt_sms.py: using RAC 200 22:07:53.931033 tst mo_mt_sms.py: using CellId 31820 22:07:54.043531 tst mo_mt_sms.py: using BVCI 31821 22:07:54.148729 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 22:07:54.328439 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 22:07:54.443351 tst mo_mt_sms.py:9: start nitb and bts... 22:07:54.643230 run osmo-nitb_10.42.42.2: Starting osmo-nitb 22:07:56.850786 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=614): Launched 22:07:57.149086 run osmo-nitb_10.42.42.2(pid=615): Launched 22:07:57.311863 run osmo-nitb_10.42.42.2(pid=615): ERR: Terminated: ERROR {rc=2} [trial-2383↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=615)] 22:07:57.434304 run osmo-nitb_10.42.42.2(pid=615): stdout: | (launched: 2022-12-12_22:07:57.094495) 22:07:57.558539 run osmo-nitb_10.42.42.2(pid=615): stderr: | (launched: 2022-12-12_22:07:57.138987) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:07:57.682804 run osmo-nitb_10.42.42.2(pid=615): stdout: | (launched: 2022-12-12_22:07:57.094495) 22:07:57.801361 run osmo-nitb_10.42.42.2(pid=615): stderr: | (launched: 2022-12-12_22:07:57.138987) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:07:57.943208 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=615): Process ended prematurely: osmo-nitb_10.42.42.2(pid=615) [trial-2383↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=615)] [trial-2383↪nitb_sms:sysmo↪mo_mt_sms.py:11] 22:07:57.951291 tst mo_mt_sms.py:11: Test FAILED (4.7 sec) 22:07:57.957711 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=614): Terminating (SIGTERM) 22:07:58.165709 --- ParallelTerminationStrategy: PID 614 died... 22:07:58.186407 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=614): Terminated: ok {rc=0} 22:07:58.269303 bus /sierra_3: Setting Powered False 22:07:59.365781 bus /sierra_3: Setting Powered False 22:08:00.482034 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 nitb_sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 sms:sysmo --------------------------------------------------------------------- 22:08:01.693363 tst sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:08:01.697789 tst sms:sysmo: Verifying 1 x bts (candidates: 11) 22:08:01.719712 tst sms:sysmo: Verifying 6 x ip_address (candidates: 9) 22:08:01.752432 tst sms:sysmo: Verifying 2 x modem (candidates: 12) 22:08:01.809024 tst sms:sysmo: Reserving 1 x bts (candidates: 11) 22:08:01.834935 tst sms:sysmo: Reserving 6 x ip_address (candidates: 9) 22:08:01.863681 tst sms:sysmo: Reserving 2 x modem (candidates: 12) 22:08:02.398798 tst sms:sysmo: RESERVED RESOURCES for sms: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 sms:sysmo mo_mt_sms.py ---------------------------------------------- 22:08:02.403928 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 22:08:02.414655 tst sms:sysmo: Using 1 x bts (candidates: 1) 22:08:02.449892 tst mo_mt_sms.py: using LAC 31821 22:08:02.576833 tst mo_mt_sms.py: using RAC 201 22:08:02.703030 tst mo_mt_sms.py: using CellId 31821 22:08:02.829353 tst mo_mt_sms.py: using BVCI 31822 22:08:02.946637 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 22:08:02.957771 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 22:08:02.968607 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 22:08:02.980333 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 22:08:02.992065 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 22:08:03.003947 tst sms:sysmo: Using 1 x modem (candidates: 2) 22:08:03.120634 tst sms:sysmo: Using 1 x modem (candidates: 2) 22:08:03.241832 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:08:04.976755 run create_hlr_db(pid=620): Launched 22:08:05.099106 bus /sierra_2: Setting Powered False 22:08:06.161994 run create_hlr_db(pid=620): Terminated: ok {rc=0} 22:08:06.607703 run pcap-recorder_any(filters='host 10.42.42.2')(pid=622): Launched 22:08:06.927447 run osmo-hlr_10.42.42.2(pid=623): Launched 22:08:07.050262 run osmo-stp_10.42.42.5: Starting osmo-stp 22:08:09.592509 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=625): Launched 22:08:09.912363 run osmo-stp_10.42.42.5(pid=626): Launched 22:08:10.035157 run osmo-msc_10.42.42.6: Starting osmo-msc 22:08:15.414961 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=628): Launched 22:08:15.734044 run osmo-msc_10.42.42.6(pid=629): Launched 22:08:16.024717 run osmo-stp_10.42.42.5(pid=626): ERR: Terminated: ERROR {rc=1} [trial-2383↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=626)] 22:08:16.292245 run osmo-stp_10.42.42.5(pid=626): stdout: | (launched: 2022-12-12_22:08:09.854162) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:08:16.589733 run osmo-stp_10.42.42.5(pid=626): stderr: | [0;m[38;5;43m20221212220810049 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212220810049 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212220810050 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212220810050 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212220810050 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212220810050 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212220810050 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:08:16.744541 run osmo-stp_10.42.42.5(pid=626): stdout: | (launched: 2022-12-12_22:08:09.854162) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:08:16.866891 run osmo-stp_10.42.42.5(pid=626): stderr: | [0;m[38;5;43m20221212220810049 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212220810049 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212220810050 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212220810050 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212220810050 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212220810050 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212220810050 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:08:17.038496 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=626): Process ended prematurely: osmo-stp_10.42.42.5(pid=626) [trial-2383↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=626)] [trial-2383↪sms:sysmo↪mo_mt_sms.py:16] 22:08:17.052737 tst mo_mt_sms.py:16: Test FAILED (14.6 sec) 22:08:17.091360 run osmo-hlr_10.42.42.2(pid=623): ERR: Terminated: ERROR {rc=237} [trial-2383↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=623)] 22:08:17.155734 run osmo-hlr_10.42.42.2(pid=623): stdout: | (launched: 2022-12-12_22:08:06.869803) 22:08:17.210010 run osmo-hlr_10.42.42.2(pid=623): stderr: | [0;m[1;31m20221212220807071 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212220807071 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212220807071 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212220807071 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212220807071 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212220807071 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212220807085 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/sms:sysmo/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212220807094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212220807095 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212220807095 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:08:17.279579 run osmo-msc_10.42.42.6(pid=629): ERR: Terminated: ERROR {rc=2} [trial-2383↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=629)] 22:08:17.328251 run osmo-msc_10.42.42.6(pid=629): stdout: | (launched: 2022-12-12_22:08:15.676196) 22:08:17.378499 run osmo-msc_10.42.42.6(pid=629): stderr: | [0;m[38;5;43m20221212220816092 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212220816092 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8ef983dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212220816092 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212220816092 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212220816092 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212220816092 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212220816096 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212220816098 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212220816098 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212220816098 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:08:17.430036 run pcap-recorder_any(filters='host 10.42.42.2')(pid=622): Terminating (SIGTERM) 22:08:17.470716 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=625): Terminating (SIGTERM) 22:08:17.510556 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=628): Terminating (SIGTERM) 22:08:17.550290 --- ParallelTerminationStrategy: PID 622 died... 22:08:17.569399 run pcap-recorder_any(filters='host 10.42.42.2')(pid=622): Terminated: ok {rc=0} 22:08:17.613475 --- ParallelTerminationStrategy: PID 625 died... 22:08:17.632060 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=625): Terminated: ok {rc=0} 22:08:17.675658 --- ParallelTerminationStrategy: PID 628 died... 22:08:17.694132 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=628): Terminated: ok {rc=0} 22:08:17.779550 bus /sierra_3: Setting Powered False 22:08:18.878583 bus /sierra_3: Setting Powered False 22:08:19.990536 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 nitb_ussd:sysmo --------------------------------------------------------------------- 22:08:21.320123 tst nitb_ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:08:21.324109 tst nitb_ussd:sysmo: Verifying 1 x bts (candidates: 11) 22:08:21.345329 tst nitb_ussd:sysmo: Verifying 1 x ip_address (candidates: 9) 22:08:21.353062 tst nitb_ussd:sysmo: Verifying 1 x modem (candidates: 12) 22:08:21.387278 tst nitb_ussd:sysmo: Reserving 1 x bts (candidates: 11) 22:08:21.410653 tst nitb_ussd:sysmo: Reserving 1 x ip_address (candidates: 9) 22:08:21.417777 tst nitb_ussd:sysmo: Reserving 1 x modem (candidates: 12) 22:08:21.937067 tst nitb_ussd:sysmo: RESERVED RESOURCES for nitb_ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2383 nitb_ussd:sysmo assert_extension.py ---------------------------------------------- 22:08:21.943176 tst nitb_ussd:sysmo: Using 1 x ip_address (candidates: 1) 22:08:21.954896 tst nitb_ussd:sysmo: Using 1 x bts (candidates: 1) 22:08:21.990837 tst assert_extension.py: using LAC 31822 22:08:22.118930 tst assert_extension.py: using RAC 202 22:08:22.243278 tst assert_extension.py: using CellId 31822 22:08:22.367720 tst assert_extension.py: using BVCI 31823 22:08:22.485614 tst nitb_ussd:sysmo: Using 1 x modem (candidates: 1) 22:08:22.600475 tst assert_extension.py:10: start nitb and bts... 22:08:22.802597 run osmo-nitb_10.42.42.2: Starting osmo-nitb 22:08:23.413959 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=635): Launched 22:08:23.712263 run osmo-nitb_10.42.42.2(pid=636): Launched 22:08:23.878053 run osmo-nitb_10.42.42.2(pid=636): ERR: Terminated: ERROR {rc=2} [trial-2383↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=636)] 22:08:24.012295 run osmo-nitb_10.42.42.2(pid=636): stdout: | (launched: 2022-12-12_22:08:23.657598) 22:08:24.148225 run osmo-nitb_10.42.42.2(pid=636): stderr: | (launched: 2022-12-12_22:08:23.701964) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:08:24.283354 run osmo-nitb_10.42.42.2(pid=636): stdout: | (launched: 2022-12-12_22:08:23.657598) 22:08:24.413290 run osmo-nitb_10.42.42.2(pid=636): stderr: | (launched: 2022-12-12_22:08:23.701964) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fa469b2b268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=636): Process ended prematurely: osmo-nitb_10.42.42.2(pid=636) [trial-2383↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=636)] 22:08:24.825647 tst osmo-nitb_10.42.42.2(pid=636): stdout: | (launched: 2022-12-12_22:08:23.657598) 22:08:24.946466 tst osmo-nitb_10.42.42.2(pid=636): stderr: | (launched: 2022-12-12_22:08:23.701964) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:08:25.089186 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=636): Process ended prematurely: osmo-nitb_10.42.42.2(pid=636) [trial-2383↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=636)] [trial-2383↪nitb_ussd:sysmo↪assert_extension.py:12] 22:08:25.097265 tst assert_extension.py:12: Test FAILED (3.1 sec) 22:08:25.103773 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=635): Terminating (SIGTERM) 22:08:25.311619 --- ParallelTerminationStrategy: PID 635 died... 22:08:25.332012 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=635): Terminated: ok {rc=0} 22:08:25.417173 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 nitb_ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 ussd:sysmo --------------------------------------------------------------------- 22:08:26.581810 tst ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:08:26.586835 tst ussd:sysmo: Verifying 1 x bts (candidates: 11) 22:08:26.609095 tst ussd:sysmo: Verifying 6 x ip_address (candidates: 9) 22:08:26.636659 tst ussd:sysmo: Verifying 1 x modem (candidates: 12) 22:08:26.672604 tst ussd:sysmo: Reserving 1 x bts (candidates: 11) 22:08:26.693618 tst ussd:sysmo: Reserving 6 x ip_address (candidates: 9) 22:08:26.720120 tst ussd:sysmo: Reserving 1 x modem (candidates: 12) 22:08:27.249322 tst ussd:sysmo: RESERVED RESOURCES for ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2383 ussd:sysmo assert_extension.py ---------------------------------------------- 22:08:27.255420 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 22:08:27.267087 tst ussd:sysmo: Using 1 x bts (candidates: 1) 22:08:27.303256 tst assert_extension.py: using LAC 31823 22:08:27.430814 tst assert_extension.py: using RAC 203 22:08:27.554849 tst assert_extension.py: using CellId 31823 22:08:27.676300 tst assert_extension.py: using BVCI 31824 22:08:27.785270 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 22:08:27.795869 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 22:08:27.806329 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 22:08:27.817686 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 22:08:27.828555 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 22:08:27.839444 tst ussd:sysmo: Using 1 x modem (candidates: 1) 22:08:27.955829 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:08:28.427859 run create_hlr_db(pid=641): Launched 22:08:28.551732 bus /sierra_2: Setting Powered False 22:08:29.611138 run create_hlr_db(pid=641): Terminated: ok {rc=0} 22:08:30.049678 run pcap-recorder_any(filters='host 10.42.42.2')(pid=643): Launched 22:08:30.370940 run osmo-hlr_10.42.42.2(pid=644): Launched 22:08:30.493681 run osmo-stp_10.42.42.5: Starting osmo-stp 22:08:31.068388 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=646): Launched 22:08:31.417744 run osmo-stp_10.42.42.5(pid=647): Launched 22:08:31.559504 run osmo-msc_10.42.42.6: Starting osmo-msc 22:08:32.256498 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=649): Launched 22:08:32.564599 run osmo-msc_10.42.42.6(pid=650): Launched 22:08:32.734042 run osmo-stp_10.42.42.5(pid=647): ERR: Terminated: ERROR {rc=1} [trial-2383↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=647)] 22:08:32.862099 run osmo-stp_10.42.42.5(pid=647): stdout: | (launched: 2022-12-12_22:08:31.344854) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:08:32.989122 run osmo-stp_10.42.42.5(pid=647): stderr: | [0;m[38;5;43m20221212220831705 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212220831705 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212220831705 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212220831706 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212220831706 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212220831706 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212220831706 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:08:33.114453 run osmo-stp_10.42.42.5(pid=647): stdout: | (launched: 2022-12-12_22:08:31.344854) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:08:33.233857 run osmo-stp_10.42.42.5(pid=647): stderr: | [0;m[38;5;43m20221212220831705 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212220831705 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212220831705 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212220831706 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212220831706 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212220831706 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212220831706 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:08:33.376530 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=647): Process ended prematurely: osmo-stp_10.42.42.5(pid=647) [trial-2383↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=647)] [trial-2383↪ussd:sysmo↪assert_extension.py:17] 22:08:33.384755 tst assert_extension.py:17: Test FAILED (6.1 sec) 22:08:33.410613 run osmo-hlr_10.42.42.2(pid=644): ERR: Terminated: ERROR {rc=237} [trial-2383↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=644)] 22:08:33.458003 run osmo-hlr_10.42.42.2(pid=644): stdout: | (launched: 2022-12-12_22:08:30.312705) 22:08:33.506815 run osmo-hlr_10.42.42.2(pid=644): stderr: | [0;m[1;31m20221212220830512 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212220830512 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212220830512 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212220830512 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212220830512 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212220830512 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212220830524 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/ussd:sysmo/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212220830533 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212220830533 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212220830533 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:08:33.574898 run osmo-msc_10.42.42.6(pid=650): ERR: Terminated: ERROR {rc=2} [trial-2383↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=650)] 22:08:33.622028 run osmo-msc_10.42.42.6(pid=650): stdout: | (launched: 2022-12-12_22:08:32.509333) 22:08:33.670831 run osmo-msc_10.42.42.6(pid=650): stderr: | [0;m[38;5;43m20221212220832782 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212220832782 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0e6b2e8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212220832782 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212220832782 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212220832782 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212220832782 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212220832785 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212220832785 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212220832785 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212220832785 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:08:33.720076 run pcap-recorder_any(filters='host 10.42.42.2')(pid=643): Terminating (SIGTERM) 22:08:33.759354 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=646): Terminating (SIGTERM) 22:08:33.798915 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=649): Terminating (SIGTERM) 22:08:33.839043 --- ParallelTerminationStrategy: PID 643 died... 22:08:33.857890 run pcap-recorder_any(filters='host 10.42.42.2')(pid=643): Terminated: ok {rc=0} 22:08:33.901391 --- ParallelTerminationStrategy: PID 646 died... 22:08:33.919959 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=646): Terminated: ok {rc=0} 22:08:33.963267 --- ParallelTerminationStrategy: PID 649 died... 22:08:33.981646 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=649): Terminated: ok {rc=0} 22:08:34.064386 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 22:08:35.259253 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:08:35.266634 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 22:08:35.288607 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 22:08:35.317546 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 22:08:35.371558 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 22:08:35.393056 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 22:08:35.420828 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 22:08:35.969412 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 22:08:36.023684 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:08:36.035416 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 22:08:36.093785 tst mo_mt_call.py: using LAC 31824 22:08:36.227355 tst mo_mt_call.py: using RAC 204 22:08:36.355864 tst mo_mt_call.py: using CellId 31824 22:08:36.483143 tst mo_mt_call.py: using BVCI 31825 22:08:36.602384 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:08:36.614035 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:08:36.625282 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:08:36.636936 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:08:36.648225 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:08:36.659747 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:08:36.776791 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:08:36.896159 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:08:37.403237 run create_hlr_db(pid=655): Launched 22:08:37.529262 bus /sierra_2: Setting Powered False 22:08:38.593588 run create_hlr_db(pid=655): Terminated: ok {rc=0} 22:08:39.048681 run pcap-recorder_any(filters='host 10.42.42.2')(pid=657): Launched 22:08:39.375382 run osmo-hlr_10.42.42.2(pid=658): Launched 22:08:39.500693 run osmo-stp_10.42.42.5: Starting osmo-stp 22:08:40.062141 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=660): Launched 22:08:40.389632 run osmo-stp_10.42.42.5(pid=661): Launched 22:08:40.515247 run osmo-msc_10.42.42.6: Starting osmo-msc 22:08:41.106593 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=663): Launched 22:08:41.432732 run osmo-msc_10.42.42.6(pid=664): Launched 22:08:41.615032 run osmo-stp_10.42.42.5(pid=661): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=661)] 22:08:41.752770 run osmo-stp_10.42.42.5(pid=661): stdout: | (launched: 2022-12-12_22:08:40.330160) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:08:41.891657 run osmo-stp_10.42.42.5(pid=661): stderr: | [0;m[38;5;43m20221212220840525 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212220840525 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212220840525 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212220840525 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212220840526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212220840526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212220840526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:08:42.029748 run osmo-stp_10.42.42.5(pid=661): stdout: | (launched: 2022-12-12_22:08:40.330160) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:08:42.160172 run osmo-stp_10.42.42.5(pid=661): stderr: | [0;m[38;5;43m20221212220840525 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212220840525 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212220840525 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212220840525 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212220840526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212220840526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212220840526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:08:42.316745 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=661): Process ended prematurely: osmo-stp_10.42.42.5(pid=661) [trial-2383↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=661)] [trial-2383↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 22:08:42.326353 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 22:08:42.354706 run osmo-hlr_10.42.42.2(pid=658): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=658)] 22:08:42.405032 run osmo-hlr_10.42.42.2(pid=658): stdout: | (launched: 2022-12-12_22:08:39.316014) 22:08:42.456881 run osmo-hlr_10.42.42.2(pid=658): stderr: | [0;m[1;31m20221212220839515 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212220839515 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212220839515 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212220839515 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212220839515 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212220839515 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212220839564 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212220839573 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212220839573 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212220839573 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:08:42.528603 run osmo-msc_10.42.42.6(pid=664): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=664)] 22:08:42.578629 run osmo-msc_10.42.42.6(pid=664): stdout: | (launched: 2022-12-12_22:08:41.373780) 22:08:42.630256 run osmo-msc_10.42.42.6(pid=664): stderr: | [0;m[38;5;43m20221212220841699 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212220841699 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8f56844c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212220841699 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212220841699 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212220841700 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212220841700 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212220841702 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212220841702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212220841702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212220841702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:08:42.682382 run pcap-recorder_any(filters='host 10.42.42.2')(pid=657): Terminating (SIGTERM) 22:08:42.724230 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=660): Terminating (SIGTERM) 22:08:42.766324 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=663): Terminating (SIGTERM) 22:08:42.808478 --- ParallelTerminationStrategy: PID 657 died... 22:08:42.828418 run pcap-recorder_any(filters='host 10.42.42.2')(pid=657): Terminated: ok {rc=0} 22:08:42.874978 --- ParallelTerminationStrategy: PID 660 died... 22:08:42.894356 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=660): Terminated: ok {rc=0} 22:08:42.940745 --- ParallelTerminationStrategy: PID 663 died... 22:08:42.960138 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=663): Terminated: ok {rc=0} 22:08:43.047396 bus /sierra_3: Setting Powered False 22:08:44.144797 bus /sierra_3: Setting Powered False 22:08:45.260124 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2383 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 22:08:46.441520 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:08:46.458104 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 22:08:46.530515 tst mo_mt_call_osmux.py: using LAC 31825 22:08:46.702512 tst mo_mt_call_osmux.py: using RAC 205 22:08:46.855990 tst mo_mt_call_osmux.py: using CellId 31825 22:08:46.999025 tst mo_mt_call_osmux.py: using BVCI 31826 22:08:47.142522 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:08:47.155207 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:08:47.169834 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:08:47.181335 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:08:47.192774 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:08:47.204299 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:08:47.324875 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:08:47.482324 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:08:48.043870 run create_hlr_db(pid=744): Launched 22:08:48.221721 bus /sierra_2: Setting Powered False 22:08:49.282842 run create_hlr_db(pid=744): Terminated: ok {rc=0} 22:08:49.764273 run pcap-recorder_any(filters='host 10.42.42.2')(pid=960): Launched 22:08:50.098176 run osmo-hlr_10.42.42.2(pid=961): Launched 22:08:50.334689 run osmo-stp_10.42.42.5: Starting osmo-stp 22:08:51.015641 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=964): Launched 22:08:51.365706 run osmo-stp_10.42.42.5(pid=966): Launched 22:08:51.603754 run osmo-msc_10.42.42.6: Starting osmo-msc 22:08:52.341687 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=968): Launched 22:08:52.689142 run osmo-msc_10.42.42.6(pid=969): Launched 22:08:53.055723 run osmo-stp_10.42.42.5(pid=966): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=966)] 22:08:53.340368 run osmo-stp_10.42.42.5(pid=966): stdout: | (launched: 2022-12-12_22:08:51.296326) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:08:53.505509 run osmo-stp_10.42.42.5(pid=966): stderr: | [0;m[38;5;43m20221212220851630 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212220851630 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212220851631 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212220851631 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212220851631 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212220851632 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212220851632 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:08:53.646538 run osmo-stp_10.42.42.5(pid=966): stdout: | (launched: 2022-12-12_22:08:51.296326) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:08:53.781332 run osmo-stp_10.42.42.5(pid=966): stderr: | [0;m[38;5;43m20221212220851630 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212220851630 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212220851631 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212220851631 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212220851631 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212220851632 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212220851632 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:08:53.942861 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=966): Process ended prematurely: osmo-stp_10.42.42.5(pid=966) [trial-2383↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=966)] [trial-2383↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 22:08:53.953993 tst mo_mt_call_osmux.py:8: Test FAILED (7.6 sec) 22:08:53.985699 run osmo-hlr_10.42.42.2(pid=961): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=961)] 22:08:54.038872 run osmo-hlr_10.42.42.2(pid=961): stdout: | (launched: 2022-12-12_22:08:50.034827) 22:08:54.093976 run osmo-hlr_10.42.42.2(pid=961): stderr: | [0;m[1;31m20221212220850384 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212220850384 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212220850384 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212220850384 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212220850384 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212220850384 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212220850428 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212220850445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212220850445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212220850445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:08:54.169817 run osmo-msc_10.42.42.6(pid=969): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=969)] 22:08:54.222912 run osmo-msc_10.42.42.6(pid=969): stdout: | (launched: 2022-12-12_22:08:52.623279) 22:08:54.277322 run osmo-msc_10.42.42.6(pid=969): stderr: | [0;m[38;5;43m20221212220853121 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212220853122 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f77b667ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212220853122 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212220853122 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212220853122 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212220853122 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212220853124 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212220853124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212220853129 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212220853129 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:08:54.332864 run pcap-recorder_any(filters='host 10.42.42.2')(pid=960): Terminating (SIGTERM) 22:08:54.378105 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=964): Terminating (SIGTERM) 22:08:54.424662 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=968): Terminating (SIGTERM) 22:08:54.472384 --- ParallelTerminationStrategy: PID 960 died... 22:08:54.493560 run pcap-recorder_any(filters='host 10.42.42.2')(pid=960): Terminated: ok {rc=0} 22:08:54.544745 --- ParallelTerminationStrategy: PID 964 died... 22:08:54.565633 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=964): Terminated: ok {rc=0} 22:08:54.615641 --- ParallelTerminationStrategy: PID 968 died... 22:08:54.636407 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=968): Terminated: ok {rc=0} 22:08:54.729720 bus /sierra_3: Setting Powered False 22:08:55.834666 bus /sierra_3: Setting Powered False 22:08:56.954588 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 22:08:58.196228 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:08:58.204067 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 22:08:58.231392 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 22:08:58.261162 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 22:08:58.314951 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 22:08:58.337664 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 22:08:58.368768 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 22:08:58.922578 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 22:08:58.980660 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:08:58.993238 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 22:08:59.054415 tst mo_mt_call.py: using LAC 31826 22:08:59.188899 tst mo_mt_call.py: using RAC 206 22:08:59.325515 tst mo_mt_call.py: using CellId 31826 22:08:59.462325 tst mo_mt_call.py: using BVCI 31827 22:08:59.592751 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:08:59.605462 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:08:59.620152 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:08:59.633732 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:08:59.646136 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:08:59.659487 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:08:59.788690 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:08:59.914080 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:09:00.444315 run create_hlr_db(pid=974): Launched 22:09:00.614976 bus /sierra_2: Setting Powered False 22:09:01.688884 run create_hlr_db(pid=974): Terminated: ok {rc=0} 22:09:02.201823 run pcap-recorder_any(filters='host 10.42.42.2')(pid=976): Launched 22:09:02.552412 run osmo-hlr_10.42.42.2(pid=977): Launched 22:09:02.803405 run osmo-stp_10.42.42.5: Starting osmo-stp 22:09:03.464422 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=979): Launched 22:09:03.816434 run osmo-stp_10.42.42.5(pid=980): Launched 22:09:04.067063 run osmo-msc_10.42.42.6: Starting osmo-msc 22:09:04.763844 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=982): Launched 22:09:05.114283 run osmo-msc_10.42.42.6(pid=983): Launched 22:09:05.485848 run osmo-stp_10.42.42.5(pid=980): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=980)] 22:09:05.784653 run osmo-stp_10.42.42.5(pid=980): stdout: | (launched: 2022-12-12_22:09:03.753842) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:09:05.957265 run osmo-stp_10.42.42.5(pid=980): stderr: | [0;m[38;5;43m20221212220904053 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212220904053 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212220904054 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212220904054 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212220904055 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212220904055 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212220904055 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:09:06.100221 run osmo-stp_10.42.42.5(pid=980): stdout: | (launched: 2022-12-12_22:09:03.753842) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:09:06.237410 run osmo-stp_10.42.42.5(pid=980): stderr: | [0;m[38;5;43m20221212220904053 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212220904053 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212220904054 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212220904054 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212220904055 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212220904055 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212220904055 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:09:06.399851 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=980): Process ended prematurely: osmo-stp_10.42.42.5(pid=980) [trial-2383↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=980)] [trial-2383↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 22:09:06.410515 tst mo_mt_call.py:8: Test FAILED (7.5 sec) 22:09:06.442929 run osmo-hlr_10.42.42.2(pid=977): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=977)] 22:09:06.497083 run osmo-hlr_10.42.42.2(pid=977): stdout: | (launched: 2022-12-12_22:09:02.490391) 22:09:06.552940 run osmo-hlr_10.42.42.2(pid=977): stderr: | [0;m[1;31m20221212220902727 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212220902727 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212220902728 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212220902728 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212220902728 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212220902728 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212220902754 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212220902767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212220902767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212220902767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:09:06.630207 run osmo-msc_10.42.42.6(pid=983): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=983)] 22:09:06.683817 run osmo-msc_10.42.42.6(pid=983): stdout: | (launched: 2022-12-12_22:09:05.051862) 22:09:06.738901 run osmo-msc_10.42.42.6(pid=983): stderr: | [0;m[38;5;43m20221212220905570 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212220905571 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f301a226c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212220905571 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212220905571 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212220905571 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212220905571 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212220905573 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212220905573 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212220905574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212220905574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:09:06.794675 run pcap-recorder_any(filters='host 10.42.42.2')(pid=976): Terminating (SIGTERM) 22:09:06.840706 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=979): Terminating (SIGTERM) 22:09:06.887458 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=982): Terminating (SIGTERM) 22:09:06.934115 --- ParallelTerminationStrategy: PID 976 died... 22:09:06.956303 run pcap-recorder_any(filters='host 10.42.42.2')(pid=976): Terminated: ok {rc=0} 22:09:07.007993 --- ParallelTerminationStrategy: PID 979 died... 22:09:07.029632 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=979): Terminated: ok {rc=0} 22:09:07.080016 --- ParallelTerminationStrategy: PID 982 died... 22:09:07.100717 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=982): Terminated: ok {rc=0} 22:09:07.193457 bus /sierra_3: Setting Powered False 22:09:08.300170 bus /sierra_3: Setting Powered False 22:09:09.420715 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2383 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 22:09:10.572751 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:09:10.585060 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 22:09:10.645406 tst mo_mt_call_osmux.py: using LAC 31827 22:09:10.776426 tst mo_mt_call_osmux.py: using RAC 207 22:09:10.906238 tst mo_mt_call_osmux.py: using CellId 31827 22:09:11.035915 tst mo_mt_call_osmux.py: using BVCI 31828 22:09:11.159673 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:09:11.171365 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:09:11.182982 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:09:11.194948 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:09:11.206890 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:09:11.218858 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:09:11.336775 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:09:11.456894 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:09:11.969657 run create_hlr_db(pid=988): Launched 22:09:12.096454 bus /sierra_2: Setting Powered False 22:09:13.161651 run create_hlr_db(pid=988): Terminated: ok {rc=0} 22:09:13.602053 run pcap-recorder_any(filters='host 10.42.42.2')(pid=990): Launched 22:09:13.910278 run osmo-hlr_10.42.42.2(pid=994): Launched 22:09:14.028435 run osmo-stp_10.42.42.5: Starting osmo-stp 22:09:14.560420 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=997): Launched 22:09:14.868895 run osmo-stp_10.42.42.5(pid=998): Launched 22:09:14.987067 run osmo-msc_10.42.42.6: Starting osmo-msc 22:09:15.545488 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1000): Launched 22:09:15.863547 run osmo-msc_10.42.42.6(pid=1001): Launched 22:09:16.167500 run osmo-stp_10.42.42.5(pid=998): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=998)] 22:09:16.343663 run osmo-stp_10.42.42.5(pid=998): stdout: | (launched: 2022-12-12_22:09:14.812285) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:09:16.615356 run osmo-stp_10.42.42.5(pid=998): stderr: | [0;m[38;5;43m20221212220914983 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212220914983 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212220914984 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212220914984 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212220914985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212220914985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212220914985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:09:16.755129 run osmo-stp_10.42.42.5(pid=998): stdout: | (launched: 2022-12-12_22:09:14.812285) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:09:16.881455 run osmo-stp_10.42.42.5(pid=998): stderr: | [0;m[38;5;43m20221212220914983 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212220914983 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212220914984 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212220914984 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212220914985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212220914985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212220914985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:09:17.030913 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=998): Process ended prematurely: osmo-stp_10.42.42.5(pid=998) [trial-2383↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=998)] [trial-2383↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 22:09:17.040293 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 22:09:17.067479 run osmo-hlr_10.42.42.2(pid=994): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=994)] 22:09:17.116456 run osmo-hlr_10.42.42.2(pid=994): stdout: | (launched: 2022-12-12_22:09:13.854035) 22:09:17.167175 run osmo-hlr_10.42.42.2(pid=994): stderr: | [0;m[1;31m20221212220914031 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212220914031 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212220914031 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212220914031 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212220914031 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212220914031 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212220914044 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212220914054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212220914054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212220914055 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:09:17.237986 run osmo-msc_10.42.42.6(pid=1001): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1001)] 22:09:17.286523 run osmo-msc_10.42.42.6(pid=1001): stdout: | (launched: 2022-12-12_22:09:15.798969) 22:09:17.336628 run osmo-msc_10.42.42.6(pid=1001): stderr: | [0;m[38;5;43m20221212220916338 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212220916338 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe6d74dfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212220916338 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212220916339 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212220916339 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212220916339 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212220916349 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212220916350 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212220916350 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212220916350 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:09:17.387490 run pcap-recorder_any(filters='host 10.42.42.2')(pid=990): Terminating (SIGTERM) 22:09:17.428132 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=997): Terminating (SIGTERM) 22:09:17.468663 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1000): Terminating (SIGTERM) 22:09:17.509266 --- ParallelTerminationStrategy: PID 990 died... 22:09:17.528482 run pcap-recorder_any(filters='host 10.42.42.2')(pid=990): Terminated: ok {rc=0} 22:09:17.573374 --- ParallelTerminationStrategy: PID 997 died... 22:09:17.592472 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=997): Terminated: ok {rc=0} 22:09:17.636749 --- ParallelTerminationStrategy: PID 1000 died... 22:09:17.655528 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1000): Terminated: ok {rc=0} 22:09:17.741324 bus /sierra_3: Setting Powered False 22:09:18.841298 bus /sierra_3: Setting Powered False 22:09:19.955012 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 22:09:21.192598 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:09:21.199927 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 22:09:21.221835 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 22:09:21.250642 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 22:09:21.306645 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 22:09:21.327336 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 22:09:21.353563 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 22:09:21.905118 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 22:09:21.958497 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:09:21.970191 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 22:09:22.026176 tst mo_mt_call.py: using LAC 31828 22:09:22.154417 tst mo_mt_call.py: using RAC 208 22:09:22.282896 tst mo_mt_call.py: using CellId 31828 22:09:22.411407 tst mo_mt_call.py: using BVCI 31829 22:09:22.531997 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:09:22.543550 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:09:22.554933 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:09:22.566748 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:09:22.578415 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:09:22.590562 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:09:22.708177 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:09:22.829519 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:09:23.309085 run create_hlr_db(pid=1006): Launched 22:09:23.435760 bus /sierra_2: Setting Powered False 22:09:24.500503 run create_hlr_db(pid=1006): Terminated: ok {rc=0} 22:09:24.959603 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1008): Launched 22:09:25.290744 run osmo-hlr_10.42.42.2(pid=1009): Launched 22:09:25.419019 run osmo-stp_10.42.42.5: Starting osmo-stp 22:09:25.991329 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1011): Launched 22:09:26.323715 run osmo-stp_10.42.42.5(pid=1012): Launched 22:09:26.450205 run osmo-msc_10.42.42.6: Starting osmo-msc 22:09:27.045931 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1014): Launched 22:09:27.378246 run osmo-msc_10.42.42.6(pid=1015): Launched 22:09:27.564518 run osmo-stp_10.42.42.5(pid=1012): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1012)] 22:09:27.705329 run osmo-stp_10.42.42.5(pid=1012): stdout: | (launched: 2022-12-12_22:09:26.261605) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:09:27.846453 run osmo-stp_10.42.42.5(pid=1012): stderr: | [0;m[38;5;43m20221212220926459 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212220926459 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212220926459 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212220926460 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212220926460 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212220926460 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212220926460 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:09:27.985239 run osmo-stp_10.42.42.5(pid=1012): stdout: | (launched: 2022-12-12_22:09:26.261605) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:09:28.117308 run osmo-stp_10.42.42.5(pid=1012): stderr: | [0;m[38;5;43m20221212220926459 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212220926459 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212220926459 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212220926460 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212220926460 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212220926460 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212220926460 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:09:28.275092 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1012): Process ended prematurely: osmo-stp_10.42.42.5(pid=1012) [trial-2383↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1012)] [trial-2383↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 22:09:28.284740 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 22:09:28.313562 run osmo-hlr_10.42.42.2(pid=1009): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1009)] 22:09:28.364640 run osmo-hlr_10.42.42.2(pid=1009): stdout: | (launched: 2022-12-12_22:09:25.230172) 22:09:28.417643 run osmo-hlr_10.42.42.2(pid=1009): stderr: | [0;m[1;31m20221212220925429 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212220925429 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212220925429 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212220925429 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212220925429 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212220925429 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212220925444 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212220925454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212220925454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212220925454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:09:28.490648 run osmo-msc_10.42.42.6(pid=1015): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1015)] 22:09:28.541216 run osmo-msc_10.42.42.6(pid=1015): stdout: | (launched: 2022-12-12_22:09:27.317581) 22:09:28.594018 run osmo-msc_10.42.42.6(pid=1015): stderr: | [0;m[38;5;43m20221212220927643 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212220927643 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc6da27dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212220927643 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212220927643 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212220927644 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212220927644 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212220927646 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212220927646 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212220927646 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212220927646 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:09:28.646703 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1008): Terminating (SIGTERM) 22:09:28.688864 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1011): Terminating (SIGTERM) 22:09:28.731149 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1014): Terminating (SIGTERM) 22:09:28.773690 --- ParallelTerminationStrategy: PID 1008 died... 22:09:28.793732 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1008): Terminated: ok {rc=0} 22:09:28.840847 --- ParallelTerminationStrategy: PID 1011 died... 22:09:28.860536 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1011): Terminated: ok {rc=0} 22:09:28.907629 --- ParallelTerminationStrategy: PID 1014 died... 22:09:28.927300 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1014): Terminated: ok {rc=0} 22:09:29.016537 bus /sierra_3: Setting Powered False 22:09:30.114706 bus /sierra_3: Setting Powered False 22:09:31.241570 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2383 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 22:09:32.390078 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:09:32.401679 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 22:09:32.457215 tst mo_mt_call_osmux.py: using LAC 31829 22:09:32.577410 tst mo_mt_call_osmux.py: using RAC 209 22:09:32.706469 tst mo_mt_call_osmux.py: using CellId 31829 22:09:32.835379 tst mo_mt_call_osmux.py: using BVCI 31830 22:09:32.956414 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:09:32.968149 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:09:32.979825 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:09:32.991642 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:09:33.003457 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:09:33.015320 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:09:33.135232 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:09:33.256593 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:09:33.772084 run create_hlr_db(pid=1017): Launched 22:09:33.899067 bus /sierra_2: Setting Powered False 22:09:34.963362 run create_hlr_db(pid=1017): Terminated: ok {rc=0} 22:09:35.404376 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1019): Launched 22:09:35.715859 run osmo-hlr_10.42.42.2(pid=1020): Launched 22:09:35.834413 run osmo-stp_10.42.42.5: Starting osmo-stp 22:09:36.371899 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1022): Launched 22:09:36.680051 run osmo-stp_10.42.42.5(pid=1023): Launched 22:09:36.797303 run osmo-msc_10.42.42.6: Starting osmo-msc 22:09:37.354057 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1025): Launched 22:09:37.664295 run osmo-msc_10.42.42.6(pid=1026): Launched 22:09:37.837225 run osmo-stp_10.42.42.5(pid=1023): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1023)] 22:09:37.967107 run osmo-stp_10.42.42.5(pid=1023): stdout: | (launched: 2022-12-12_22:09:36.623532) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:09:38.097595 run osmo-stp_10.42.42.5(pid=1023): stderr: | [0;m[38;5;43m20221212220936795 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212220936795 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212220936796 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212220936796 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212220936796 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212220936797 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212220936797 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:09:38.225947 run osmo-stp_10.42.42.5(pid=1023): stdout: | (launched: 2022-12-12_22:09:36.623532) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:09:38.347763 run osmo-stp_10.42.42.5(pid=1023): stderr: | [0;m[38;5;43m20221212220936795 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212220936795 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212220936796 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212220936796 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212220936796 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212220936797 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212220936797 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:09:38.494410 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1023): Process ended prematurely: osmo-stp_10.42.42.5(pid=1023) [trial-2383↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1023)] [trial-2383↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 22:09:38.503175 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 22:09:38.529177 run osmo-hlr_10.42.42.2(pid=1020): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1020)] 22:09:38.576366 run osmo-hlr_10.42.42.2(pid=1020): stdout: | (launched: 2022-12-12_22:09:35.659061) 22:09:38.625299 run osmo-hlr_10.42.42.2(pid=1020): stderr: | [0;m[1;31m20221212220935836 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212220935836 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212220935836 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212220935836 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212220935836 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212220935836 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212220935849 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212220935857 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212220935858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212220935858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:09:38.693658 run osmo-msc_10.42.42.6(pid=1026): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1026)] 22:09:38.740766 run osmo-msc_10.42.42.6(pid=1026): stdout: | (launched: 2022-12-12_22:09:37.607172) 22:09:38.789767 run osmo-msc_10.42.42.6(pid=1026): stderr: | [0;m[38;5;43m20221212220937882 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212220937882 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f486c0cac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212220937882 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212220937882 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212220937882 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212220937883 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212220937884 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212220937885 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212220937885 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212220937885 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:09:38.838627 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1019): Terminating (SIGTERM) 22:09:38.877842 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1022): Terminating (SIGTERM) 22:09:38.917112 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1025): Terminating (SIGTERM) 22:09:38.956425 --- ParallelTerminationStrategy: PID 1019 died... 22:09:38.975537 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1019): Terminated: ok {rc=0} 22:09:39.019351 --- ParallelTerminationStrategy: PID 1022 died... 22:09:39.037720 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1022): Terminated: ok {rc=0} 22:09:39.081056 --- ParallelTerminationStrategy: PID 1025 died... 22:09:39.099373 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1025): Terminated: ok {rc=0} 22:09:39.183234 bus /sierra_3: Setting Powered False 22:09:40.280528 bus /sierra_3: Setting Powered False 22:09:41.395350 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 22:09:42.634220 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:09:42.640424 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 22:09:42.660815 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 22:09:42.687133 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 22:09:42.738997 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 22:09:42.760323 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 22:09:42.787945 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 22:09:43.336241 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 22:09:43.392131 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:09:43.403811 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 22:09:43.461739 tst mo_mt_call.py: using LAC 31830 22:09:43.593074 tst mo_mt_call.py: using RAC 210 22:09:43.722918 tst mo_mt_call.py: using CellId 31830 22:09:43.858259 tst mo_mt_call.py: using BVCI 31831 22:09:43.979932 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:09:43.991535 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:09:44.002748 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:09:44.014332 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:09:44.025957 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:09:44.037527 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 22:09:44.152537 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 22:09:44.268626 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:09:44.748009 run create_hlr_db(pid=1032): Launched 22:09:44.875323 bus /sierra_2: Setting Powered False 22:09:45.950546 run create_hlr_db(pid=1032): Terminated: ok {rc=0} 22:09:46.457999 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1034): Launched 22:09:46.803515 run osmo-hlr_10.42.42.2(pid=1035): Launched 22:09:47.059913 run osmo-stp_10.42.42.5: Starting osmo-stp 22:09:47.645088 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1037): Launched 22:09:47.953071 run osmo-stp_10.42.42.5(pid=1038): Launched 22:09:48.070536 run osmo-msc_10.42.42.6: Starting osmo-msc 22:09:48.626096 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1040): Launched 22:09:48.933541 run osmo-msc_10.42.42.6(pid=1041): Launched 22:09:49.106516 run osmo-stp_10.42.42.5(pid=1038): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1038)] 22:09:49.237585 run osmo-stp_10.42.42.5(pid=1038): stdout: | (launched: 2022-12-12_22:09:47.896327) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:09:49.368870 run osmo-stp_10.42.42.5(pid=1038): stderr: | [0;m[38;5;43m20221212220948070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212220948070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212220948071 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212220948071 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212220948072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212220948072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212220948072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:09:49.498150 run osmo-stp_10.42.42.5(pid=1038): stdout: | (launched: 2022-12-12_22:09:47.896327) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:09:49.620671 run osmo-stp_10.42.42.5(pid=1038): stderr: | [0;m[38;5;43m20221212220948070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212220948070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212220948071 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212220948071 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212220948072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212220948072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212220948072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:09:49.767551 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1038): Process ended prematurely: osmo-stp_10.42.42.5(pid=1038) [trial-2383↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1038)] [trial-2383↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 22:09:49.776291 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 22:09:49.802275 run osmo-hlr_10.42.42.2(pid=1035): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1035)] 22:09:49.849622 run osmo-hlr_10.42.42.2(pid=1035): stdout: | (launched: 2022-12-12_22:09:46.739453) 22:09:49.899005 run osmo-hlr_10.42.42.2(pid=1035): stderr: | [0;m[1;31m20221212220947055 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212220947055 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212220947055 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212220947055 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212220947055 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212220947055 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212220947075 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212220947087 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212220947088 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212220947088 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:09:49.967451 run osmo-msc_10.42.42.6(pid=1041): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1041)] 22:09:50.015010 run osmo-msc_10.42.42.6(pid=1041): stdout: | (launched: 2022-12-12_22:09:48.877266) 22:09:50.064244 run osmo-msc_10.42.42.6(pid=1041): stderr: | [0;m[38;5;43m20221212220949151 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212220949151 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3506721c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212220949152 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212220949152 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212220949152 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212220949152 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212220949154 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212220949154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212220949154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212220949154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:09:50.113852 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1034): Terminating (SIGTERM) 22:09:50.153347 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1037): Terminating (SIGTERM) 22:09:50.192835 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1040): Terminating (SIGTERM) 22:09:50.232406 --- ParallelTerminationStrategy: PID 1034 died... 22:09:50.251490 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1034): Terminated: ok {rc=0} 22:09:50.295481 --- ParallelTerminationStrategy: PID 1037 died... 22:09:50.314031 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1037): Terminated: ok {rc=0} 22:09:50.357889 --- ParallelTerminationStrategy: PID 1040 died... 22:09:50.376256 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1040): Terminated: ok {rc=0} 22:09:50.459727 bus /sierra_3: Setting Powered False 22:09:51.557618 bus /sierra_3: Setting Powered False 22:09:52.674187 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2383 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 22:09:53.824544 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:09:53.836784 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 22:09:53.894755 tst mo_mt_call_osmux.py: using LAC 31831 22:09:54.025702 tst mo_mt_call_osmux.py: using RAC 211 22:09:54.158400 tst mo_mt_call_osmux.py: using CellId 31831 22:09:54.280564 tst mo_mt_call_osmux.py: using BVCI 31832 22:09:54.393290 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:09:54.404267 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:09:54.415079 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:09:54.425876 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:09:54.436601 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:09:54.447409 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 22:09:54.566555 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 22:09:54.685620 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:09:55.165344 run create_hlr_db(pid=1043): Launched 22:09:55.292167 bus /sierra_2: Setting Powered False 22:09:56.353474 run create_hlr_db(pid=1043): Terminated: ok {rc=0} 22:09:56.803952 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1045): Launched 22:09:57.134753 run osmo-hlr_10.42.42.2(pid=1046): Launched 22:09:57.261263 run osmo-stp_10.42.42.5: Starting osmo-stp 22:09:57.833472 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1048): Launched 22:09:58.165900 run osmo-stp_10.42.42.5(pid=1049): Launched 22:09:58.292611 run osmo-msc_10.42.42.6: Starting osmo-msc 22:09:58.889749 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1051): Launched 22:09:59.220124 run osmo-msc_10.42.42.6(pid=1052): Launched 22:09:59.405461 run osmo-stp_10.42.42.5(pid=1049): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1049)] 22:09:59.545761 run osmo-stp_10.42.42.5(pid=1049): stdout: | (launched: 2022-12-12_22:09:58.105334) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:09:59.685684 run osmo-stp_10.42.42.5(pid=1049): stderr: | [0;m[38;5;43m20221212220958299 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212220958299 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212220958300 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212220958300 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212220958301 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212220958301 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212220958301 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:09:59.825242 run osmo-stp_10.42.42.5(pid=1049): stdout: | (launched: 2022-12-12_22:09:58.105334) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:09:59.956778 run osmo-stp_10.42.42.5(pid=1049): stderr: | [0;m[38;5;43m20221212220958299 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212220958299 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212220958300 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212220958300 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212220958301 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212220958301 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212220958301 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:10:00.114256 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1049): Process ended prematurely: osmo-stp_10.42.42.5(pid=1049) [trial-2383↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1049)] [trial-2383↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 22:10:00.124028 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 22:10:00.152284 run osmo-hlr_10.42.42.2(pid=1046): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1046)] 22:10:00.202597 run osmo-hlr_10.42.42.2(pid=1046): stdout: | (launched: 2022-12-12_22:09:57.074585) 22:10:00.254665 run osmo-hlr_10.42.42.2(pid=1046): stderr: | [0;m[1;31m20221212220957277 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212220957277 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212220957277 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212220957277 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212220957277 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212220957277 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212220957289 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212220957298 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212220957298 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212220957298 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:10:00.326927 run osmo-msc_10.42.42.6(pid=1052): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1052)] 22:10:00.377634 run osmo-msc_10.42.42.6(pid=1052): stdout: | (launched: 2022-12-12_22:09:59.159753) 22:10:00.429737 run osmo-msc_10.42.42.6(pid=1052): stderr: | [0;m[38;5;43m20221212220959486 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212220959487 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f89a2353c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212220959487 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212220959487 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212220959487 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212220959487 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212220959489 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212220959489 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212220959489 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212220959489 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:10:00.482042 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1045): Terminating (SIGTERM) 22:10:00.523893 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1048): Terminating (SIGTERM) 22:10:00.565958 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1051): Terminating (SIGTERM) 22:10:00.608167 --- ParallelTerminationStrategy: PID 1045 died... 22:10:00.628106 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1045): Terminated: ok {rc=0} 22:10:00.674603 --- ParallelTerminationStrategy: PID 1048 died... 22:10:00.694163 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1048): Terminated: ok {rc=0} 22:10:00.740623 --- ParallelTerminationStrategy: PID 1051 died... 22:10:00.760066 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1051): Terminated: ok {rc=0} 22:10:00.849309 bus /sierra_3: Setting Powered False 22:10:01.956410 bus /sierra_3: Setting Powered False 22:10:03.076397 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 22:10:04.308831 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:10:04.315573 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 22:10:04.336326 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 22:10:04.362568 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 22:10:04.414223 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 22:10:04.435354 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 22:10:04.461510 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 22:10:05.010052 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 22:10:05.059094 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:10:05.070015 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 22:10:05.125635 tst mo_mt_call.py: using LAC 31832 22:10:05.249407 tst mo_mt_call.py: using RAC 212 22:10:05.371031 tst mo_mt_call.py: using CellId 31832 22:10:05.495599 tst mo_mt_call.py: using BVCI 31833 22:10:05.610339 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:10:05.621523 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:10:05.632126 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:10:05.642873 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:10:05.653654 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:10:05.664450 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:10:05.784193 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:10:05.904352 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:10:06.417740 run create_hlr_db(pid=1060): Launched 22:10:06.546558 bus /sierra_2: Setting Powered False 22:10:07.611017 run create_hlr_db(pid=1060): Terminated: ok {rc=0} 22:10:08.070942 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1062): Launched 22:10:08.401830 run osmo-hlr_10.42.42.2(pid=1063): Launched 22:10:08.529312 run osmo-stp_10.42.42.5: Starting osmo-stp 22:10:09.102996 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1065): Launched 22:10:09.434735 run osmo-stp_10.42.42.5(pid=1066): Launched 22:10:09.561810 run osmo-msc_10.42.42.6: Starting osmo-msc 22:10:10.159571 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1068): Launched 22:10:10.490681 run osmo-msc_10.42.42.6(pid=1069): Launched 22:10:10.674765 run osmo-stp_10.42.42.5(pid=1066): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1066)] 22:10:10.814154 run osmo-stp_10.42.42.5(pid=1066): stdout: | (launched: 2022-12-12_22:10:09.374378) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:10:10.954361 run osmo-stp_10.42.42.5(pid=1066): stderr: | [0;m[38;5;43m20221212221009568 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221009568 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221009569 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221009569 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221009570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221009570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221009570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:10:11.093762 run osmo-stp_10.42.42.5(pid=1066): stdout: | (launched: 2022-12-12_22:10:09.374378) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:10:11.225279 run osmo-stp_10.42.42.5(pid=1066): stderr: | [0;m[38;5;43m20221212221009568 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221009568 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221009569 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221009569 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221009570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221009570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221009570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:10:11.383365 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1066): Process ended prematurely: osmo-stp_10.42.42.5(pid=1066) [trial-2383↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1066)] [trial-2383↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 22:10:11.393118 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 22:10:11.421609 run osmo-hlr_10.42.42.2(pid=1063): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1063)] 22:10:11.472610 run osmo-hlr_10.42.42.2(pid=1063): stdout: | (launched: 2022-12-12_22:10:08.340908) 22:10:11.525078 run osmo-hlr_10.42.42.2(pid=1063): stderr: | [0;m[1;31m20221212221008544 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212221008544 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212221008544 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212221008544 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212221008544 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212221008544 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212221008560 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212221008570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212221008570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212221008570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:10:11.597240 run osmo-msc_10.42.42.6(pid=1069): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1069)] 22:10:11.647808 run osmo-msc_10.42.42.6(pid=1069): stdout: | (launched: 2022-12-12_22:10:10.430358) 22:10:11.700181 run osmo-msc_10.42.42.6(pid=1069): stderr: | [0;m[38;5;43m20221212221010756 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212221010756 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f50611a9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212221010756 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212221010756 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212221010756 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212221010756 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212221010758 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212221010759 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212221010759 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212221010759 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:10:11.752887 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1062): Terminating (SIGTERM) 22:10:11.795132 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1065): Terminating (SIGTERM) 22:10:11.837622 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1068): Terminating (SIGTERM) 22:10:11.879996 --- ParallelTerminationStrategy: PID 1062 died... 22:10:11.900059 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1062): Terminated: ok {rc=0} 22:10:11.947147 --- ParallelTerminationStrategy: PID 1065 died... 22:10:11.966894 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1065): Terminated: ok {rc=0} 22:10:12.013776 --- ParallelTerminationStrategy: PID 1068 died... 22:10:12.033473 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1068): Terminated: ok {rc=0} 22:10:12.122244 bus /sierra_3: Setting Powered False 22:10:13.220383 bus /sierra_3: Setting Powered False 22:10:14.336495 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2383 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 22:10:15.479725 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:10:15.491145 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 22:10:15.551659 tst mo_mt_call_osmux.py: using LAC 31833 22:10:15.682370 tst mo_mt_call_osmux.py: using RAC 213 22:10:15.810843 tst mo_mt_call_osmux.py: using CellId 31833 22:10:15.948524 tst mo_mt_call_osmux.py: using BVCI 31834 22:10:16.072124 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:10:16.084750 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:10:16.097430 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:10:16.112019 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:10:16.124499 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:10:16.138002 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:10:16.262618 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:10:16.412485 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:10:16.993068 run create_hlr_db(pid=1071): Launched 22:10:17.153584 bus /sierra_2: Setting Powered False 22:10:18.218246 run create_hlr_db(pid=1071): Terminated: ok {rc=0} 22:10:18.658971 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1073): Launched 22:10:18.966926 run osmo-hlr_10.42.42.2(pid=1074): Launched 22:10:19.084343 run osmo-stp_10.42.42.5: Starting osmo-stp 22:10:19.634977 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1076): Launched 22:10:19.943671 run osmo-stp_10.42.42.5(pid=1077): Launched 22:10:20.061065 run osmo-msc_10.42.42.6: Starting osmo-msc 22:10:20.617844 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1079): Launched 22:10:20.927726 run osmo-msc_10.42.42.6(pid=1080): Launched 22:10:21.100616 run osmo-stp_10.42.42.5(pid=1077): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1077)] 22:10:21.230639 run osmo-stp_10.42.42.5(pid=1077): stdout: | (launched: 2022-12-12_22:10:19.887519) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:10:21.361086 run osmo-stp_10.42.42.5(pid=1077): stderr: | [0;m[38;5;43m20221212221020061 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221020061 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221020061 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221020061 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221020062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221020062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221020062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:10:21.489616 run osmo-stp_10.42.42.5(pid=1077): stdout: | (launched: 2022-12-12_22:10:19.887519) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:10:21.611873 run osmo-stp_10.42.42.5(pid=1077): stderr: | [0;m[38;5;43m20221212221020061 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221020061 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221020061 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221020061 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221020062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221020062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221020062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:10:21.759071 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1077): Process ended prematurely: osmo-stp_10.42.42.5(pid=1077) [trial-2383↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1077)] [trial-2383↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 22:10:21.768148 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 22:10:21.794269 run osmo-hlr_10.42.42.2(pid=1074): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1074)] 22:10:21.841803 run osmo-hlr_10.42.42.2(pid=1074): stdout: | (launched: 2022-12-12_22:10:18.910784) 22:10:21.890961 run osmo-hlr_10.42.42.2(pid=1074): stderr: | [0;m[1;31m20221212221019088 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212221019088 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212221019089 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212221019089 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212221019089 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212221019089 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212221019101 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212221019110 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212221019110 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212221019110 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:10:21.959256 run osmo-msc_10.42.42.6(pid=1080): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1080)] 22:10:22.006349 run osmo-msc_10.42.42.6(pid=1080): stdout: | (launched: 2022-12-12_22:10:20.870913) 22:10:22.055268 run osmo-msc_10.42.42.6(pid=1080): stderr: | [0;m[38;5;43m20221212221021146 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212221021146 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8182018c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212221021146 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212221021146 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212221021146 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212221021147 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212221021148 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212221021149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212221021149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212221021149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:10:22.105238 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1073): Terminating (SIGTERM) 22:10:22.145314 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1076): Terminating (SIGTERM) 22:10:22.184847 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1079): Terminating (SIGTERM) 22:10:22.224454 --- ParallelTerminationStrategy: PID 1073 died... 22:10:22.243439 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1073): Terminated: ok {rc=0} 22:10:22.287447 --- ParallelTerminationStrategy: PID 1076 died... 22:10:22.305908 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1076): Terminated: ok {rc=0} 22:10:22.349884 --- ParallelTerminationStrategy: PID 1079 died... 22:10:22.368194 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1079): Terminated: ok {rc=0} 22:10:22.453762 bus /sierra_3: Setting Powered False 22:10:23.553823 bus /sierra_3: Setting Powered False 22:10:24.669710 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 22:10:25.905878 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:10:25.912008 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 22:10:25.932304 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 22:10:25.959167 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 22:10:26.010024 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 22:10:26.030491 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 22:10:26.057110 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 22:10:26.611872 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 22:10:26.667205 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:10:26.678820 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 22:10:26.736582 tst mo_mt_call.py: using LAC 31834 22:10:26.865888 tst mo_mt_call.py: using RAC 214 22:10:26.994419 tst mo_mt_call.py: using CellId 31834 22:10:27.122927 tst mo_mt_call.py: using BVCI 31835 22:10:27.243804 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:10:27.255358 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:10:27.266722 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:10:27.278452 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:10:27.290099 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:10:27.301697 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:10:27.418935 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:10:27.539272 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:10:28.052199 run create_hlr_db(pid=1085): Launched 22:10:28.178958 bus /sierra_2: Setting Powered False 22:10:29.243436 run create_hlr_db(pid=1085): Terminated: ok {rc=0} 22:10:29.684881 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1087): Launched 22:10:29.995063 run osmo-hlr_10.42.42.2(pid=1088): Launched 22:10:30.113918 run osmo-stp_10.42.42.5: Starting osmo-stp 22:10:30.646596 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1090): Launched 22:10:30.974317 run osmo-stp_10.42.42.5(pid=1091): Launched 22:10:31.111305 run osmo-msc_10.42.42.6: Starting osmo-msc 22:10:31.841386 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1093): Launched 22:10:32.188097 run osmo-msc_10.42.42.6(pid=1094): Launched 22:10:32.470086 run osmo-stp_10.42.42.5(pid=1091): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1091)] 22:10:32.600618 run osmo-stp_10.42.42.5(pid=1091): stdout: | (launched: 2022-12-12_22:10:30.912581) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:10:32.731060 run osmo-stp_10.42.42.5(pid=1091): stderr: | [0;m[38;5;43m20221212221031320 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221031320 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221031326 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221031327 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221031327 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221031327 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221031327 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:10:32.859998 run osmo-stp_10.42.42.5(pid=1091): stdout: | (launched: 2022-12-12_22:10:30.912581) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:10:32.982791 run osmo-stp_10.42.42.5(pid=1091): stderr: | [0;m[38;5;43m20221212221031320 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221031320 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221031326 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221031327 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221031327 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221031327 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221031327 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:10:33.130295 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1091): Process ended prematurely: osmo-stp_10.42.42.5(pid=1091) [trial-2383↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1091)] [trial-2383↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 22:10:33.138985 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 22:10:33.165324 run osmo-hlr_10.42.42.2(pid=1088): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1088)] 22:10:33.213348 run osmo-hlr_10.42.42.2(pid=1088): stdout: | (launched: 2022-12-12_22:10:29.938149) 22:10:33.263161 run osmo-hlr_10.42.42.2(pid=1088): stderr: | [0;m[1;31m20221212221030116 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212221030116 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212221030116 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212221030116 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212221030116 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212221030116 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212221030129 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212221030137 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212221030137 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212221030137 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:10:33.333548 run osmo-msc_10.42.42.6(pid=1094): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1094)] 22:10:33.381641 run osmo-msc_10.42.42.6(pid=1094): stdout: | (launched: 2022-12-12_22:10:32.125100) 22:10:33.431339 run osmo-msc_10.42.42.6(pid=1094): stderr: | [0;m[38;5;43m20221212221032512 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212221032512 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f52d15a0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212221032512 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212221032512 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212221032513 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212221032513 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212221032515 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212221032515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212221032515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212221032515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:10:33.481380 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1087): Terminating (SIGTERM) 22:10:33.521276 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1090): Terminating (SIGTERM) 22:10:33.561598 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1093): Terminating (SIGTERM) 22:10:33.601818 --- ParallelTerminationStrategy: PID 1087 died... 22:10:33.621056 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1087): Terminated: ok {rc=0} 22:10:33.665096 --- ParallelTerminationStrategy: PID 1090 died... 22:10:33.683646 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1090): Terminated: ok {rc=0} 22:10:33.727851 --- ParallelTerminationStrategy: PID 1093 died... 22:10:33.746460 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1093): Terminated: ok {rc=0} 22:10:33.831603 bus /sierra_3: Setting Powered False 22:10:34.926275 bus /sierra_3: Setting Powered False 22:10:36.041865 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2383 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 22:10:37.189087 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:10:37.200727 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 22:10:37.257328 tst mo_mt_call_osmux.py: using LAC 31835 22:10:37.378730 tst mo_mt_call_osmux.py: using RAC 215 22:10:37.502509 tst mo_mt_call_osmux.py: using CellId 31835 22:10:37.625402 tst mo_mt_call_osmux.py: using BVCI 31836 22:10:37.739101 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:10:37.750124 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:10:37.761024 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:10:37.771861 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:10:37.782665 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:10:37.793568 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:10:37.912732 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:10:38.033591 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:10:38.548001 run create_hlr_db(pid=1096): Launched 22:10:38.676278 bus /sierra_2: Setting Powered False 22:10:39.740527 run create_hlr_db(pid=1096): Terminated: ok {rc=0} 22:10:40.200064 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1098): Launched 22:10:40.531134 run osmo-hlr_10.42.42.2(pid=1099): Launched 22:10:40.658451 run osmo-stp_10.42.42.5: Starting osmo-stp 22:10:41.225993 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1101): Launched 22:10:41.555909 run osmo-stp_10.42.42.5(pid=1102): Launched 22:10:41.682961 run osmo-msc_10.42.42.6: Starting osmo-msc 22:10:42.279962 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1104): Launched 22:10:42.610995 run osmo-msc_10.42.42.6(pid=1105): Launched 22:10:42.795419 run osmo-stp_10.42.42.5(pid=1102): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1102)] 22:10:42.933984 run osmo-stp_10.42.42.5(pid=1102): stdout: | (launched: 2022-12-12_22:10:41.495853) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:10:43.073764 run osmo-stp_10.42.42.5(pid=1102): stderr: | [0;m[38;5;43m20221212221041691 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221041691 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221041691 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221041692 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221041692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221041692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221041692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:10:43.212316 run osmo-stp_10.42.42.5(pid=1102): stdout: | (launched: 2022-12-12_22:10:41.495853) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:10:43.343435 run osmo-stp_10.42.42.5(pid=1102): stderr: | [0;m[38;5;43m20221212221041691 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221041691 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221041691 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221041692 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221041692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221041692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221041692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:10:43.501186 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1102): Process ended prematurely: osmo-stp_10.42.42.5(pid=1102) [trial-2383↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1102)] [trial-2383↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 22:10:43.510775 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 22:10:43.538814 run osmo-hlr_10.42.42.2(pid=1099): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1099)] 22:10:43.589148 run osmo-hlr_10.42.42.2(pid=1099): stdout: | (launched: 2022-12-12_22:10:40.470968) 22:10:43.640825 run osmo-hlr_10.42.42.2(pid=1099): stderr: | [0;m[1;31m20221212221040672 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212221040672 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212221040672 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212221040672 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212221040672 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212221040672 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212221040685 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212221040693 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212221040693 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212221040693 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:10:43.712836 run osmo-msc_10.42.42.6(pid=1105): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1105)] 22:10:43.762944 run osmo-msc_10.42.42.6(pid=1105): stdout: | (launched: 2022-12-12_22:10:42.550980) 22:10:43.815219 run osmo-msc_10.42.42.6(pid=1105): stderr: | [0;m[38;5;43m20221212221042875 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212221042875 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fdba7a0fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212221042875 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212221042875 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212221042875 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212221042875 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212221042877 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212221042878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212221042878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212221042878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:10:43.867180 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1098): Terminating (SIGTERM) 22:10:43.909125 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1101): Terminating (SIGTERM) 22:10:43.950937 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1104): Terminating (SIGTERM) 22:10:43.993072 --- ParallelTerminationStrategy: PID 1098 died... 22:10:44.012998 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1098): Terminated: ok {rc=0} 22:10:44.059299 --- ParallelTerminationStrategy: PID 1101 died... 22:10:44.078600 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1101): Terminated: ok {rc=0} 22:10:44.125012 --- ParallelTerminationStrategy: PID 1104 died... 22:10:44.144415 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1104): Terminated: ok {rc=0} 22:10:44.232579 bus /sierra_3: Setting Powered False 22:10:45.331523 bus /sierra_3: Setting Powered False 22:10:46.449755 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 voice:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 22:10:47.685876 tst voice:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:10:47.691415 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 22:10:47.711828 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 22:10:47.738631 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 22:10:47.790984 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 22:10:47.811784 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 22:10:47.838007 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 22:10:48.384814 tst voice:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 22:10:48.434214 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:10:48.445071 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:10:48.501324 tst mo_mt_call.py: using LAC 31836 22:10:48.623522 tst mo_mt_call.py: using RAC 216 22:10:48.746456 tst mo_mt_call.py: using CellId 31836 22:10:48.870178 tst mo_mt_call.py: using BVCI 31837 22:10:48.982112 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:10:48.992926 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:10:49.003534 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:10:49.014203 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:10:49.024717 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:10:49.035343 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 22:10:49.154437 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 22:10:49.279639 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:10:49.793089 run create_hlr_db(pid=1110): Launched 22:10:49.919929 bus /sierra_2: Setting Powered False 22:10:50.985109 run create_hlr_db(pid=1110): Terminated: ok {rc=0} 22:10:51.425706 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1114): Launched 22:10:51.733693 run osmo-hlr_10.42.42.2(pid=1115): Launched 22:10:51.851699 run osmo-stp_10.42.42.5: Starting osmo-stp 22:10:52.389046 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1117): Launched 22:10:52.698544 run osmo-stp_10.42.42.5(pid=1118): Launched 22:10:52.816843 run osmo-msc_10.42.42.6: Starting osmo-msc 22:10:53.374589 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1121): Launched 22:10:53.682784 run osmo-msc_10.42.42.6(pid=1122): Launched 22:10:53.854809 run osmo-stp_10.42.42.5(pid=1118): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1118)] 22:10:53.985725 run osmo-stp_10.42.42.5(pid=1118): stdout: | (launched: 2022-12-12_22:10:52.641822) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:10:54.116289 run osmo-stp_10.42.42.5(pid=1118): stderr: | [0;m[38;5;43m20221212221052814 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221052814 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221052814 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221052814 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221052815 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221052815 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221052815 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:10:54.244845 run osmo-stp_10.42.42.5(pid=1118): stdout: | (launched: 2022-12-12_22:10:52.641822) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:10:54.367203 run osmo-stp_10.42.42.5(pid=1118): stderr: | [0;m[38;5;43m20221212221052814 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221052814 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221052814 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221052814 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221052815 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221052815 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221052815 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:10:54.513732 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1118): Process ended prematurely: osmo-stp_10.42.42.5(pid=1118) [trial-2383↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1118)] [trial-2383↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 22:10:54.522678 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 22:10:54.548760 run osmo-hlr_10.42.42.2(pid=1115): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1115)] 22:10:54.596639 run osmo-hlr_10.42.42.2(pid=1115): stdout: | (launched: 2022-12-12_22:10:51.677143) 22:10:54.646171 run osmo-hlr_10.42.42.2(pid=1115): stderr: | [0;m[1;31m20221212221051856 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212221051856 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212221051856 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212221051856 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212221051856 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212221051857 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212221051869 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212221051877 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212221051878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212221051878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:10:54.715054 run osmo-msc_10.42.42.6(pid=1122): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1122)] 22:10:54.762749 run osmo-msc_10.42.42.6(pid=1122): stdout: | (launched: 2022-12-12_22:10:53.626119) 22:10:54.811938 run osmo-msc_10.42.42.6(pid=1122): stderr: | [0;m[38;5;43m20221212221053898 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212221053899 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f72121eec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212221053899 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212221053899 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212221053899 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212221053899 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212221053901 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212221053901 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212221053902 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212221053902 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:10:54.861674 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1114): Terminating (SIGTERM) 22:10:54.901882 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1117): Terminating (SIGTERM) 22:10:54.941549 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1121): Terminating (SIGTERM) 22:10:54.981249 --- ParallelTerminationStrategy: PID 1114 died... 22:10:55.000249 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1114): Terminated: ok {rc=0} 22:10:55.044008 --- ParallelTerminationStrategy: PID 1117 died... 22:10:55.062997 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1117): Terminated: ok {rc=0} 22:10:55.106898 --- ParallelTerminationStrategy: PID 1121 died... 22:10:55.125451 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1121): Terminated: ok {rc=0} 22:10:55.208426 bus /sierra_3: Setting Powered False 22:10:56.302832 bus /sierra_3: Setting Powered False 22:10:57.417800 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2383 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 22:10:58.564220 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:10:58.575771 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:10:58.633668 tst mo_mt_call_osmux.py: using LAC 31837 22:10:58.759804 tst mo_mt_call_osmux.py: using RAC 217 22:10:58.880849 tst mo_mt_call_osmux.py: using CellId 31837 22:10:59.000844 tst mo_mt_call_osmux.py: using BVCI 31838 22:10:59.112845 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:10:59.123758 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:10:59.134414 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:10:59.145001 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:10:59.155492 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:10:59.166121 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 22:10:59.287566 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 22:10:59.408935 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:10:59.887497 run create_hlr_db(pid=1128): Launched 22:11:00.013871 bus /sierra_2: Setting Powered False 22:11:01.081244 run create_hlr_db(pid=1128): Terminated: ok {rc=0} 22:11:01.558546 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1130): Launched 22:11:01.910467 run osmo-hlr_10.42.42.2(pid=1131): Launched 22:11:02.188709 run osmo-stp_10.42.42.5: Starting osmo-stp 22:11:02.748453 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1133): Launched 22:11:03.056765 run osmo-stp_10.42.42.5(pid=1139): Launched 22:11:03.175874 run osmo-msc_10.42.42.6: Starting osmo-msc 22:11:03.733203 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1141): Launched 22:11:04.042112 run osmo-msc_10.42.42.6(pid=1142): Launched 22:11:04.215032 run osmo-stp_10.42.42.5(pid=1139): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1139)] 22:11:04.346108 run osmo-stp_10.42.42.5(pid=1139): stdout: | (launched: 2022-12-12_22:11:03.000304) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:11:04.476912 run osmo-stp_10.42.42.5(pid=1139): stderr: | [0;m[38;5;43m20221212221103172 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221103172 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221103172 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221103172 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221103173 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221103173 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221103173 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:11:04.605823 run osmo-stp_10.42.42.5(pid=1139): stdout: | (launched: 2022-12-12_22:11:03.000304) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:11:04.728437 run osmo-stp_10.42.42.5(pid=1139): stderr: | [0;m[38;5;43m20221212221103172 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221103172 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221103172 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221103172 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221103173 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221103173 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221103173 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:11:04.875439 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1139): Process ended prematurely: osmo-stp_10.42.42.5(pid=1139) [trial-2383↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1139)] [trial-2383↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 22:11:04.884312 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 22:11:04.910530 run osmo-hlr_10.42.42.2(pid=1131): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1131)] 22:11:04.958099 run osmo-hlr_10.42.42.2(pid=1131): stdout: | (launched: 2022-12-12_22:11:01.843727) 22:11:05.007132 run osmo-hlr_10.42.42.2(pid=1131): stderr: | [0;m[1;31m20221212221102134 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212221102134 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212221102134 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212221102134 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212221102134 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212221102134 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212221102146 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212221102154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212221102155 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212221102155 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:11:05.075855 run osmo-msc_10.42.42.6(pid=1142): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1142)] 22:11:05.123427 run osmo-msc_10.42.42.6(pid=1142): stdout: | (launched: 2022-12-12_22:11:03.984869) 22:11:05.172508 run osmo-msc_10.42.42.6(pid=1142): stderr: | [0;m[38;5;43m20221212221104261 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212221104261 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f855bdadc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212221104261 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212221104261 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212221104261 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212221104262 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212221104263 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212221104264 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212221104264 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212221104264 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:11:05.221996 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1130): Terminating (SIGTERM) 22:11:05.261572 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1133): Terminating (SIGTERM) 22:11:05.301192 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1141): Terminating (SIGTERM) 22:11:05.341257 --- ParallelTerminationStrategy: PID 1130 died... 22:11:05.360160 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1130): Terminated: ok {rc=0} 22:11:05.403951 --- ParallelTerminationStrategy: PID 1133 died... 22:11:05.422518 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1133): Terminated: ok {rc=0} 22:11:05.466539 --- ParallelTerminationStrategy: PID 1141 died... 22:11:05.485173 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1141): Terminated: ok {rc=0} 22:11:05.570133 bus /sierra_3: Setting Powered False 22:11:06.669453 bus /sierra_3: Setting Powered False 22:11:07.784887 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 voice:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 emergency:sysmo --------------------------------------------------------------------- 22:11:09.016339 tst emergency:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:11:09.020363 tst emergency:sysmo: Verifying 1 x bts (candidates: 11) 22:11:09.040934 tst emergency:sysmo: Verifying 6 x ip_address (candidates: 9) 22:11:09.067463 tst emergency:sysmo: Verifying 4 x modem (candidates: 12) 22:11:09.155134 tst emergency:sysmo: Reserving 1 x bts (candidates: 11) 22:11:09.175929 tst emergency:sysmo: Reserving 6 x ip_address (candidates: 9) 22:11:09.202015 tst emergency:sysmo: Reserving 4 x modem (candidates: 12) 22:11:09.778881 tst emergency:sysmo: RESERVED RESOURCES for emergency: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2383 emergency:sysmo emergency_mo_mt_call.py ---------------------------------------------- 22:11:09.783678 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 22:11:09.794401 tst emergency:sysmo: Using 1 x bts (candidates: 1) 22:11:09.829276 tst emergency_mo_mt_call.py: using LAC 31838 22:11:09.947385 tst emergency_mo_mt_call.py: using RAC 218 22:11:10.064083 tst emergency_mo_mt_call.py: using CellId 31838 22:11:10.181830 tst emergency_mo_mt_call.py: using BVCI 31839 22:11:10.290746 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 22:11:10.301291 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 22:11:10.311744 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 22:11:10.322136 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 22:11:10.332430 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 22:11:10.342738 tst emergency:sysmo: Using 1 x modem (candidates: 4) 22:11:10.461383 tst emergency:sysmo: Using 1 x modem (candidates: 4) 22:11:10.581045 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:11:11.051909 run create_hlr_db(pid=1148): Launched 22:11:11.175880 bus /sierra_2: Setting Powered False 22:11:12.235809 run create_hlr_db(pid=1148): Terminated: ok {rc=0} 22:11:12.681699 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1150): Launched 22:11:13.009086 run osmo-hlr_10.42.42.2(pid=1151): Launched 22:11:13.133764 run osmo-stp_10.42.42.5: Starting osmo-stp 22:11:13.696440 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1153): Launched 22:11:14.022001 run osmo-stp_10.42.42.5(pid=1154): Launched 22:11:14.155467 tst emergency_mo_mt_call.py: using MSISDN 8000 22:11:14.325706 run osmo-msc_10.42.42.6: Starting osmo-msc 22:11:14.909197 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1156): Launched 22:11:15.233460 run osmo-msc_10.42.42.6(pid=1157): Launched 22:11:15.416615 run osmo-stp_10.42.42.5(pid=1154): ERR: Terminated: ERROR {rc=1} [trial-2383↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1154)] 22:11:15.554482 run osmo-stp_10.42.42.5(pid=1154): stdout: | (launched: 2022-12-12_22:11:13.962755) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:11:15.693175 run osmo-stp_10.42.42.5(pid=1154): stderr: | [0;m[38;5;43m20221212221114156 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221114156 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221114156 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221114156 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221114159 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221114159 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221114159 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:11:15.830851 run osmo-stp_10.42.42.5(pid=1154): stdout: | (launched: 2022-12-12_22:11:13.962755) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:11:15.975319 run osmo-stp_10.42.42.5(pid=1154): stderr: | [0;m[38;5;43m20221212221114156 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221114156 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221114156 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221114156 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221114159 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221114159 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221114159 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:11:16.133758 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=1154): Process ended prematurely: osmo-stp_10.42.42.5(pid=1154) [trial-2383↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1154)] [trial-2383↪emergency:sysmo↪emergency_mo_mt_call.py:19] 22:11:16.143298 tst emergency_mo_mt_call.py:19: Test FAILED (6.4 sec) 22:11:16.173340 run osmo-hlr_10.42.42.2(pid=1151): ERR: Terminated: ERROR {rc=237} [trial-2383↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1151)] 22:11:16.225257 run osmo-hlr_10.42.42.2(pid=1151): stdout: | (launched: 2022-12-12_22:11:12.949675) 22:11:16.278811 run osmo-hlr_10.42.42.2(pid=1151): stderr: | [0;m[1;31m20221212221113148 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212221113148 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212221113148 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212221113148 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212221113149 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212221113149 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212221113160 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/emergency:sysmo/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212221113169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212221113169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212221113169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:11:16.353548 run osmo-msc_10.42.42.6(pid=1157): ERR: Terminated: ERROR {rc=2} [trial-2383↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1157)] 22:11:16.406484 run osmo-msc_10.42.42.6(pid=1157): stdout: | (launched: 2022-12-12_22:11:15.174084) 22:11:16.460905 run osmo-msc_10.42.42.6(pid=1157): stderr: | [0;m[38;5;43m20221212221115499 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212221115499 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4dde574c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212221115499 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212221115499 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212221115499 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212221115499 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212221115501 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212221115501 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212221115502 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212221115502 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:11:16.515983 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1150): Terminating (SIGTERM) 22:11:16.566169 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1153): Terminating (SIGTERM) 22:11:16.620506 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1156): Terminating (SIGTERM) 22:11:16.676786 --- ParallelTerminationStrategy: PID 1150 died... 22:11:16.699767 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1150): Terminated: ok {rc=0} 22:11:16.759053 --- ParallelTerminationStrategy: PID 1153 died... 22:11:16.783225 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1153): Terminated: ok {rc=0} 22:11:16.840463 --- ParallelTerminationStrategy: PID 1156 died... 22:11:16.866578 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1156): Terminated: ok {rc=0} 22:11:16.971261 bus /sierra_3: Setting Powered False 22:11:18.077827 bus /sierra_3: Setting Powered False 22:11:19.193088 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2383 emergency:sysmo emergency_preemptive_call.py ---------------------------------------------- 22:11:20.280749 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 22:11:20.291950 tst emergency:sysmo: Using 1 x bts (candidates: 1) 22:11:20.330194 tst emergency_preemptive_call.py: using LAC 31839 22:11:20.450830 tst emergency_preemptive_call.py: using RAC 219 22:11:20.571391 tst emergency_preemptive_call.py: using CellId 31839 22:11:20.694704 tst emergency_preemptive_call.py: using BVCI 31840 22:11:20.806391 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 22:11:20.817056 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 22:11:20.827488 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 22:11:20.838393 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 22:11:20.849498 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 22:11:20.860670 tst emergency:sysmo: Using 1 x modem (candidates: 4) 22:11:20.980554 tst emergency:sysmo: Using 1 x modem (candidates: 4) 22:11:21.098953 tst emergency:sysmo: Using 1 x modem (candidates: 4) 22:11:21.214613 tst emergency:sysmo: Using 1 x modem (candidates: 4) 22:11:21.328498 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:11:21.799389 run create_hlr_db(pid=1159): Launched 22:11:21.923655 bus /sierra_2: Setting Powered False 22:11:22.983381 run create_hlr_db(pid=1159): Terminated: ok {rc=0} 22:11:23.427732 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1161): Launched 22:11:23.753913 run osmo-hlr_10.42.42.2(pid=1162): Launched 22:11:23.878457 run osmo-stp_10.42.42.5: Starting osmo-stp 22:11:24.438637 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1164): Launched 22:11:24.763648 run osmo-stp_10.42.42.5(pid=1165): Launched 22:11:24.897704 tst emergency_preemptive_call.py: using MSISDN 8001 22:11:25.069009 run osmo-msc_10.42.42.6: Starting osmo-msc 22:11:25.650497 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1167): Launched 22:11:25.975228 run osmo-msc_10.42.42.6(pid=1168): Launched 22:11:26.163188 run osmo-stp_10.42.42.5(pid=1165): ERR: Terminated: ERROR {rc=1} [trial-2383↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1165)] 22:11:26.300642 run osmo-stp_10.42.42.5(pid=1165): stdout: | (launched: 2022-12-12_22:11:24.704312) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:11:26.439041 run osmo-stp_10.42.42.5(pid=1165): stderr: | [0;m[38;5;43m20221212221124898 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221124898 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221124898 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221124899 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221124899 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221124899 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221124899 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:11:26.575789 run osmo-stp_10.42.42.5(pid=1165): stdout: | (launched: 2022-12-12_22:11:24.704312) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:11:26.705387 run osmo-stp_10.42.42.5(pid=1165): stderr: | [0;m[38;5;43m20221212221124898 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221124898 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221124898 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221124899 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221124899 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221124899 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221124899 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:11:26.859976 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=1165): Process ended prematurely: osmo-stp_10.42.42.5(pid=1165) [trial-2383↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1165)] [trial-2383↪emergency:sysmo↪emergency_preemptive_call.py:32] 22:11:26.868930 tst emergency_preemptive_call.py:32: Test FAILED (6.6 sec) 22:11:26.897189 run osmo-hlr_10.42.42.2(pid=1162): ERR: Terminated: ERROR {rc=237} [trial-2383↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1162)] 22:11:26.947893 run osmo-hlr_10.42.42.2(pid=1162): stdout: | (launched: 2022-12-12_22:11:23.694638) 22:11:27.000010 run osmo-hlr_10.42.42.2(pid=1162): stderr: | [0;m[1;31m20221212221123893 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212221123893 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212221123893 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212221123893 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212221123893 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212221123893 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212221123906 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/emergency:sysmo/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212221123914 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212221123915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212221123915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:11:27.072402 run osmo-msc_10.42.42.6(pid=1168): ERR: Terminated: ERROR {rc=2} [trial-2383↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1168)] 22:11:27.122904 run osmo-msc_10.42.42.6(pid=1168): stdout: | (launched: 2022-12-12_22:11:25.916153) 22:11:27.175185 run osmo-msc_10.42.42.6(pid=1168): stderr: | [0;m[38;5;43m20221212221126239 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212221126239 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6b6ecd3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212221126239 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212221126239 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212221126239 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212221126239 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212221126241 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212221126242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212221126242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212221126242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:11:27.227486 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1161): Terminating (SIGTERM) 22:11:27.269833 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1164): Terminating (SIGTERM) 22:11:27.312030 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1167): Terminating (SIGTERM) 22:11:27.354262 --- ParallelTerminationStrategy: PID 1161 died... 22:11:27.374260 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1161): Terminated: ok {rc=0} 22:11:27.421533 --- ParallelTerminationStrategy: PID 1164 died... 22:11:27.440925 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1164): Terminated: ok {rc=0} 22:11:27.488116 --- ParallelTerminationStrategy: PID 1167 died... 22:11:27.507828 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1167): Terminated: ok {rc=0} 22:11:27.595549 bus /sierra_9: Setting Powered False 22:11:28.695416 bus /sierra_9: Setting Powered False 22:11:29.811820 bus /sierra_8: Setting Powered False 22:11:30.919806 bus /sierra_8: Setting Powered False 22:11:32.051165 bus /sierra_3: Setting Powered False 22:11:33.148139 bus /sierra_3: Setting Powered False 22:11:34.262418 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 emergency:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 gprs:sysmo --------------------------------------------------------------------- 22:11:35.519747 tst gprs:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:11:35.523944 tst gprs:sysmo: Verifying 1 x bts (candidates: 11) 22:11:35.544621 tst gprs:sysmo: Verifying 9 x ip_address (candidates: 9) 22:11:35.583410 tst gprs:sysmo: Verifying 4 x modem (candidates: 12) 22:11:35.669873 tst gprs:sysmo: Reserving 1 x bts (candidates: 11) 22:11:35.690279 tst gprs:sysmo: Reserving 9 x ip_address (candidates: 9) 22:11:35.728033 tst gprs:sysmo: Reserving 4 x modem (candidates: 12) 22:11:36.320182 tst gprs:sysmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2383 gprs:sysmo cs_paging_gprs_active.py ---------------------------------------------- 22:11:36.377354 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 22:11:36.388343 tst gprs:sysmo: Using 1 x bts (candidates: 1) 22:11:36.425220 tst cs_paging_gprs_active.py: using LAC 31840 22:11:36.555998 tst cs_paging_gprs_active.py: using RAC 220 22:11:36.688499 tst cs_paging_gprs_active.py: using CellId 31840 22:11:36.818946 tst cs_paging_gprs_active.py: using BVCI 31841 22:11:36.942161 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 22:11:36.953098 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 22:11:36.963873 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 22:11:36.975122 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 22:11:36.986400 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 22:11:36.997611 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 22:11:37.009095 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 22:11:37.020345 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 22:11:37.031988 tst gprs:sysmo: Using 1 x modem (candidates: 4) 22:11:37.150014 tst gprs:sysmo: Using 1 x modem (candidates: 4) 22:11:37.266968 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:11:37.493344 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:11:37.827203 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1174): Launched 22:11:38.115494 run iperf3-srv_10.42.42.10(pid=1176): Launched 22:11:38.240117 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:11:38.464898 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:11:38.796690 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1177): Launched 22:11:39.084892 run iperf3-srv_10.42.42.10(pid=1178): Launched 22:11:39.209304 tst cs_paging_gprs_active.py:38: start network... 22:11:39.432778 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:11:39.944824 run create_hlr_db(pid=1179): Launched 22:11:40.071387 bus /sierra_2: Setting Powered False 22:11:41.136525 run create_hlr_db(pid=1179): Terminated: ok {rc=0} 22:11:41.594920 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1181): Launched 22:11:41.926763 run osmo-hlr_10.42.42.2(pid=1182): Launched 22:11:42.053586 run osmo-stp_10.42.42.5: Starting osmo-stp 22:11:42.627045 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1184): Launched 22:11:42.958594 run osmo-stp_10.42.42.5(pid=1185): Launched 22:11:43.085671 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:11:44.659110 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1187): Launched 22:11:44.786917 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:11:45.068062 run patchelf(pid=1188): Launched 22:11:45.252733 run osmo-stp_10.42.42.5(pid=1185): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1185)] 22:11:45.392613 run osmo-stp_10.42.42.5(pid=1185): stdout: | (launched: 2022-12-12_22:11:42.898293) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:11:45.534822 run osmo-stp_10.42.42.5(pid=1185): stderr: | [0;m[38;5;43m20221212221143091 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221143091 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221143091 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221143091 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221143092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221143092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221143092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:11:45.676447 run osmo-stp_10.42.42.5(pid=1185): stdout: | (launched: 2022-12-12_22:11:42.898293) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:11:45.812421 run osmo-stp_10.42.42.5(pid=1185): stderr: | [0;m[38;5;43m20221212221143091 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221143091 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221143091 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221143091 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221143092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221143092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221143092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:11:45.996376 run patchelf(pid=1188): Terminating (SIGINT) 22:11:46.187976 run patchelf(pid=1188): Terminated: ok {rc=0} 22:11:46.326840 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=1185): Process ended prematurely: osmo-stp_10.42.42.5(pid=1185) [trial-2383↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1185)] [trial-2383↪gprs:sysmo↪cs_paging_gprs_active.py:38] 22:11:46.338117 tst cs_paging_gprs_active.py:38: Test FAILED (10.0 sec) 22:11:46.370376 run osmo-hlr_10.42.42.2(pid=1182): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:sysmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1182)] 22:11:46.423437 run osmo-hlr_10.42.42.2(pid=1182): stdout: | (launched: 2022-12-12_22:11:41.866328) 22:11:46.477976 run osmo-hlr_10.42.42.2(pid=1182): stderr: | [0;m[1;31m20221212221142066 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212221142066 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212221142066 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212221142066 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212221142066 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212221142066 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212221142079 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:sysmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212221142089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212221142090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212221142090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:11:46.533157 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1174): Terminating (SIGTERM) 22:11:46.577557 run iperf3-srv_10.42.42.10(pid=1176): Terminating (SIGTERM) 22:11:46.623392 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1177): Terminating (SIGTERM) 22:11:46.668164 run iperf3-srv_10.42.42.10(pid=1178): Terminating (SIGTERM) 22:11:46.712513 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1181): Terminating (SIGTERM) 22:11:46.757154 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1184): Terminating (SIGTERM) 22:11:46.801606 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1187): Terminating (SIGTERM) 22:11:46.846505 --- ParallelTerminationStrategy: PID 1174 died... 22:11:46.867176 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1174): Terminated: ok {rc=0} 22:11:46.917331 --- ParallelTerminationStrategy: PID 1176 died... 22:11:46.937934 run iperf3-srv_10.42.42.10(pid=1176): Terminated {rc=256} 22:11:46.987687 --- ParallelTerminationStrategy: PID 1177 died... 22:11:47.008436 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1177): Terminated: ok {rc=0} 22:11:47.058407 --- ParallelTerminationStrategy: PID 1178 died... 22:11:47.082729 run iperf3-srv_10.42.42.10(pid=1178): Terminated {rc=256} 22:11:47.139053 --- ParallelTerminationStrategy: PID 1181 died... 22:11:47.160429 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1181): Terminated: ok {rc=0} 22:11:47.207393 --- ParallelTerminationStrategy: PID 1184 died... 22:11:47.227099 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1184): Terminated: ok {rc=0} 22:11:47.273429 --- ParallelTerminationStrategy: PID 1187 died... 22:11:47.293172 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1187): Terminated: ok {rc=0} 22:11:47.377738 bus /gobi_0: Setting Powered False 22:11:48.475435 bus /gobi_0: Setting Powered False 22:11:49.593974 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:sysmo iperf3.py ---------------------------------------------- 22:11:50.747918 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 22:11:50.759717 tst gprs:sysmo: Using 1 x bts (candidates: 1) 22:11:50.796628 tst iperf3.py: using LAC 31841 22:11:50.926756 tst iperf3.py: using RAC 221 22:11:51.061799 tst iperf3.py: using CellId 31841 22:11:51.192620 tst iperf3.py: using BVCI 31842 22:11:51.306810 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 22:11:51.317667 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 22:11:51.328067 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 22:11:51.338624 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 22:11:51.348885 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 22:11:51.359220 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 22:11:51.369582 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 22:11:51.379798 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 22:11:51.390238 tst gprs:sysmo: Using 1 x modem (candidates: 4) 22:11:51.510195 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:11:51.734816 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:11:52.067196 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1189): Launched 22:11:52.355475 run iperf3-srv_10.42.42.10(pid=1190): Launched 22:11:52.481775 tst iperf3.py:8: start network... 22:11:52.704913 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:11:53.216232 run create_hlr_db(pid=1191): Launched 22:11:53.342589 bus /gobi_6: Setting Powered False 22:11:54.406863 run create_hlr_db(pid=1191): Terminated: ok {rc=0} 22:11:54.865497 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1193): Launched 22:11:55.196772 run osmo-hlr_10.42.42.2(pid=1194): Launched 22:11:55.324003 run osmo-stp_10.42.42.5: Starting osmo-stp 22:11:55.897491 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1196): Launched 22:11:56.227761 run osmo-stp_10.42.42.5(pid=1197): Launched 22:11:56.354640 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:11:56.924641 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1199): Launched 22:11:57.051005 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:11:57.330643 run patchelf(pid=1200): Launched 22:11:57.515540 run osmo-stp_10.42.42.5(pid=1197): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1197)] 22:11:57.655800 run osmo-stp_10.42.42.5(pid=1197): stdout: | (launched: 2022-12-12_22:11:56.167334) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:11:57.796596 run osmo-stp_10.42.42.5(pid=1197): stderr: | [0;m[38;5;43m20221212221156360 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221156360 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221156361 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221156361 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221156362 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221156362 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221156362 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:11:57.937937 run osmo-stp_10.42.42.5(pid=1197): stdout: | (launched: 2022-12-12_22:11:56.167334) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:11:58.073229 run osmo-stp_10.42.42.5(pid=1197): stderr: | [0;m[38;5;43m20221212221156360 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221156360 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221156361 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221156361 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221156362 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221156362 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221156362 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:11:58.234126 run patchelf(pid=1200): Terminating (SIGINT) 22:11:58.420587 run patchelf(pid=1200): Terminated: ok {rc=0} 22:11:58.555532 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1197): Process ended prematurely: osmo-stp_10.42.42.5(pid=1197) [trial-2383↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1197)] [trial-2383↪gprs:sysmo↪iperf3.py:8] 22:11:58.565721 tst iperf3.py:8: Test FAILED (7.9 sec) 22:11:58.594631 run osmo-hlr_10.42.42.2(pid=1194): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:sysmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1194)] 22:11:58.644794 run osmo-hlr_10.42.42.2(pid=1194): stdout: | (launched: 2022-12-12_22:11:55.136216) 22:11:58.696866 run osmo-hlr_10.42.42.2(pid=1194): stderr: | [0;m[1;31m20221212221155337 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212221155337 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212221155337 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212221155337 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212221155337 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212221155337 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212221155349 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:sysmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212221155358 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212221155358 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212221155358 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:11:58.749381 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1189): Terminating (SIGTERM) 22:11:58.791464 run iperf3-srv_10.42.42.10(pid=1190): Terminating (SIGTERM) 22:11:58.833705 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1193): Terminating (SIGTERM) 22:11:58.876027 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1196): Terminating (SIGTERM) 22:11:58.918374 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1199): Terminating (SIGTERM) 22:11:58.960898 --- ParallelTerminationStrategy: PID 1189 died... 22:11:58.981119 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1189): Terminated: ok {rc=0} 22:11:59.028095 --- ParallelTerminationStrategy: PID 1190 died... 22:11:59.047742 run iperf3-srv_10.42.42.10(pid=1190): Terminated {rc=256} 22:11:59.094560 --- ParallelTerminationStrategy: PID 1193 died... 22:11:59.114104 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1193): Terminated: ok {rc=0} 22:11:59.161108 --- ParallelTerminationStrategy: PID 1196 died... 22:11:59.180868 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1196): Terminated: ok {rc=0} 22:11:59.227689 --- ParallelTerminationStrategy: PID 1199 died... 22:11:59.247144 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1199): Terminated: ok {rc=0} 22:11:59.336242 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:sysmo iperf3m4.py ---------------------------------------------- 22:12:00.487230 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 22:12:00.499017 tst gprs:sysmo: Using 1 x bts (candidates: 1) 22:12:00.535941 tst iperf3m4.py: using LAC 31842 22:12:00.667700 tst iperf3m4.py: using RAC 222 22:12:00.794333 tst iperf3m4.py: using CellId 31842 22:12:00.931239 tst iperf3m4.py: using BVCI 31843 22:12:01.046051 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 22:12:01.058723 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 22:12:01.070292 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 22:12:01.081984 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 22:12:01.093005 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 22:12:01.104050 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 22:12:01.115314 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 22:12:01.126467 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 22:12:01.137582 tst gprs:sysmo: Using 1 x modem (candidates: 4) 22:12:01.253511 tst gprs:sysmo: Using 1 x modem (candidates: 4) 22:12:01.381305 tst gprs:sysmo: Using 1 x modem (candidates: 4) 22:12:01.533264 tst gprs:sysmo: Using 1 x modem (candidates: 4) 22:12:01.664776 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:12:01.896520 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:12:02.237462 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1201): Launched 22:12:02.509790 run iperf3-srv_10.42.42.10(pid=1202): Launched 22:12:02.627210 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:12:02.836447 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:12:03.149612 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1203): Launched 22:12:03.425815 run iperf3-srv_10.42.42.10(pid=1204): Launched 22:12:03.542790 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:12:03.751669 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:12:04.063755 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1205): Launched 22:12:04.334370 run iperf3-srv_10.42.42.10(pid=1206): Launched 22:12:04.451231 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:12:04.658564 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:12:04.969452 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1207): Launched 22:12:05.257896 run iperf3-srv_10.42.42.10(pid=1208): Launched 22:12:05.373792 tst iperf3m4.py:8: start network... 22:12:05.581475 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:12:06.062646 run create_hlr_db(pid=1209): Launched 22:12:06.188671 bus /gobi_6: Setting Powered False 22:12:07.250388 run create_hlr_db(pid=1209): Terminated: ok {rc=0} 22:12:07.703494 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1211): Launched 22:12:08.035177 run osmo-hlr_10.42.42.2(pid=1212): Launched 22:12:08.162416 run osmo-stp_10.42.42.5: Starting osmo-stp 22:12:08.737834 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1214): Launched 22:12:09.067585 run osmo-stp_10.42.42.5(pid=1215): Launched 22:12:09.194713 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:12:09.765996 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1217): Launched 22:12:09.893434 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:12:10.173514 run patchelf(pid=1218): Launched 22:12:10.358397 run osmo-stp_10.42.42.5(pid=1215): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1215)] 22:12:10.499533 run osmo-stp_10.42.42.5(pid=1215): stdout: | (launched: 2022-12-12_22:12:09.007297) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:12:10.642127 run osmo-stp_10.42.42.5(pid=1215): stderr: | [0;m[38;5;43m20221212221209200 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221209201 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221209201 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221209201 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221209202 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221209202 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221209202 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:12:10.784074 run osmo-stp_10.42.42.5(pid=1215): stdout: | (launched: 2022-12-12_22:12:09.007297) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:12:10.920420 run osmo-stp_10.42.42.5(pid=1215): stderr: | [0;m[38;5;43m20221212221209200 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221209201 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221209201 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221209201 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221209202 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221209202 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221209202 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:12:11.082002 run patchelf(pid=1218): Terminating (SIGINT) 22:12:11.270052 run patchelf(pid=1218): Terminated: ok {rc=0} 22:12:11.405172 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1215): Process ended prematurely: osmo-stp_10.42.42.5(pid=1215) [trial-2383↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1215)] [trial-2383↪gprs:sysmo↪iperf3m4.py:8] 22:12:11.415791 tst iperf3m4.py:8: Test FAILED (11.0 sec) 22:12:11.445716 run osmo-hlr_10.42.42.2(pid=1212): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:sysmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1212)] 22:12:11.496323 run osmo-hlr_10.42.42.2(pid=1212): stdout: | (launched: 2022-12-12_22:12:07.974478) 22:12:11.548685 run osmo-hlr_10.42.42.2(pid=1212): stderr: | [0;m[1;31m20221212221208174 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212221208174 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212221208174 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212221208174 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212221208174 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212221208174 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212221208186 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:sysmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212221208195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212221208196 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212221208196 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:12:11.601534 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1201): Terminating (SIGTERM) 22:12:11.643628 run iperf3-srv_10.42.42.10(pid=1202): Terminating (SIGTERM) 22:12:11.685781 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1203): Terminating (SIGTERM) 22:12:11.727915 run iperf3-srv_10.42.42.10(pid=1204): Terminating (SIGTERM) 22:12:11.769918 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1205): Terminating (SIGTERM) 22:12:11.811976 run iperf3-srv_10.42.42.10(pid=1206): Terminating (SIGTERM) 22:12:11.854073 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1207): Terminating (SIGTERM) 22:12:11.896216 run iperf3-srv_10.42.42.10(pid=1208): Terminating (SIGTERM) 22:12:11.938225 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1211): Terminating (SIGTERM) 22:12:11.980214 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1214): Terminating (SIGTERM) 22:12:12.022459 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1217): Terminating (SIGTERM) 22:12:12.064535 --- ParallelTerminationStrategy: PID 1201 died... 22:12:12.084706 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1201): Terminated: ok {rc=0} 22:12:12.131582 --- ParallelTerminationStrategy: PID 1202 died... 22:12:12.151291 run iperf3-srv_10.42.42.10(pid=1202): Terminated {rc=256} 22:12:12.197824 --- ParallelTerminationStrategy: PID 1203 died... 22:12:12.217358 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1203): Terminated: ok {rc=0} 22:12:12.264478 --- ParallelTerminationStrategy: PID 1204 died... 22:12:12.284055 run iperf3-srv_10.42.42.10(pid=1204): Terminated {rc=256} 22:12:12.330609 --- ParallelTerminationStrategy: PID 1205 died... 22:12:12.350184 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1205): Terminated: ok {rc=0} 22:12:12.396783 --- ParallelTerminationStrategy: PID 1206 died... 22:12:12.416751 run iperf3-srv_10.42.42.10(pid=1206): Terminated {rc=256} 22:12:12.463541 --- ParallelTerminationStrategy: PID 1207 died... 22:12:12.483128 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1207): Terminated: ok {rc=0} 22:12:12.529457 --- ParallelTerminationStrategy: PID 1208 died... 22:12:12.548815 run iperf3-srv_10.42.42.10(pid=1208): Terminated {rc=256} 22:12:12.595918 --- ParallelTerminationStrategy: PID 1211 died... 22:12:12.615635 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1211): Terminated: ok {rc=0} 22:12:12.662353 --- ParallelTerminationStrategy: PID 1214 died... 22:12:12.681891 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1214): Terminated: ok {rc=0} 22:12:12.728277 --- ParallelTerminationStrategy: PID 1217 died... 22:12:12.747760 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1217): Terminated: ok {rc=0} 22:12:12.835572 bus /gobi_4: Setting Powered False 22:12:13.935496 bus /gobi_4: Setting Powered False 22:12:15.054686 bus /gobi_1: Setting Powered False 22:12:16.159457 bus /gobi_1: Setting Powered False 22:12:17.286706 bus /gobi_0: Setting Powered False 22:12:18.385495 bus /gobi_0: Setting Powered False 22:12:19.502634 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:sysmo ping.py ---------------------------------------------- 22:12:20.607625 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 22:12:20.619218 tst gprs:sysmo: Using 1 x bts (candidates: 1) 22:12:20.657630 tst ping.py: using LAC 31843 22:12:20.780915 tst ping.py: using RAC 223 22:12:20.901333 tst ping.py: using CellId 31843 22:12:21.020657 tst ping.py: using BVCI 31844 22:12:21.133212 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 22:12:21.143585 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 22:12:21.153960 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 22:12:21.164359 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 22:12:21.174637 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 22:12:21.184891 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 22:12:21.195284 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 22:12:21.205650 tst gprs:sysmo: Using 1 x modem (candidates: 4) 22:12:21.320385 tst ping.py:19: start network... 22:12:21.525364 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:12:21.998199 run create_hlr_db(pid=1219): Launched 22:12:22.122401 bus /gobi_6: Setting Powered False 22:12:23.183082 run create_hlr_db(pid=1219): Terminated: ok {rc=0} 22:12:23.626975 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1221): Launched 22:12:23.952873 run osmo-hlr_10.42.42.2(pid=1222): Launched 22:12:24.077244 run osmo-stp_10.42.42.5: Starting osmo-stp 22:12:24.640364 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1224): Launched 22:12:24.965632 run osmo-stp_10.42.42.5(pid=1225): Launched 22:12:25.089619 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:12:25.654326 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1227): Launched 22:12:25.778874 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:12:26.054194 run patchelf(pid=1228): Launched 22:12:26.236254 run osmo-stp_10.42.42.5(pid=1225): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1225)] 22:12:26.375374 run osmo-stp_10.42.42.5(pid=1225): stdout: | (launched: 2022-12-12_22:12:24.906244) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:12:26.516313 run osmo-stp_10.42.42.5(pid=1225): stderr: | [0;m[38;5;43m20221212221225100 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221225100 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221225100 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221225100 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221225101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221225101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221225101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:12:26.656717 run osmo-stp_10.42.42.5(pid=1225): stdout: | (launched: 2022-12-12_22:12:24.906244) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:12:26.790736 run osmo-stp_10.42.42.5(pid=1225): stderr: | [0;m[38;5;43m20221212221225100 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221225100 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221225100 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221225100 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221225101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221225101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221225101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:12:26.949873 run patchelf(pid=1228): Terminating (SIGINT) 22:12:27.134830 run patchelf(pid=1228): Terminated: ok {rc=0} 22:12:27.268066 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=1225): Process ended prematurely: osmo-stp_10.42.42.5(pid=1225) [trial-2383↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1225)] [trial-2383↪gprs:sysmo↪ping.py:22] 22:12:27.277599 tst ping.py:22: Test FAILED (6.7 sec) 22:12:27.306243 run osmo-hlr_10.42.42.2(pid=1222): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:sysmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1222)] 22:12:27.356833 run osmo-hlr_10.42.42.2(pid=1222): stdout: | (launched: 2022-12-12_22:12:23.893731) 22:12:27.409148 run osmo-hlr_10.42.42.2(pid=1222): stderr: | [0;m[1;31m20221212221224093 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212221224093 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212221224093 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212221224093 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212221224093 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212221224093 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212221224104 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:sysmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212221224113 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212221224113 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212221224113 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:12:27.462552 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1221): Terminating (SIGTERM) 22:12:27.505404 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1224): Terminating (SIGTERM) 22:12:27.547972 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1227): Terminating (SIGTERM) 22:12:27.591182 --- ParallelTerminationStrategy: PID 1221 died... 22:12:27.611441 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1221): Terminated: ok {rc=0} 22:12:27.661390 --- ParallelTerminationStrategy: PID 1224 died... 22:12:27.681520 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1224): Terminated: ok {rc=0} 22:12:27.729953 --- ParallelTerminationStrategy: PID 1227 died... 22:12:27.749561 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1227): Terminated: ok {rc=0} 22:12:27.839447 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:sysmo ping_idle_ping.py ---------------------------------------------- 22:12:28.928225 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 22:12:28.940415 tst gprs:sysmo: Using 1 x bts (candidates: 1) 22:12:28.978897 tst ping_idle_ping.py: using LAC 31844 22:12:29.109196 tst ping_idle_ping.py: using RAC 224 22:12:29.236462 tst ping_idle_ping.py: using CellId 31844 22:12:29.366093 tst ping_idle_ping.py: using BVCI 31845 22:12:29.486916 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 22:12:29.497958 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 22:12:29.508797 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 22:12:29.519911 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 22:12:29.530900 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 22:12:29.542083 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 22:12:29.553303 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 22:12:29.564286 tst gprs:sysmo: Using 1 x modem (candidates: 4) 22:12:29.688498 tst ping_idle_ping.py:24: start network... 22:12:29.895137 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:12:30.366724 run create_hlr_db(pid=1230): Launched 22:12:30.491251 bus /gobi_6: Setting Powered False 22:12:31.553183 run create_hlr_db(pid=1230): Terminated: ok {rc=0} 22:12:32.019888 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1233): Launched 22:12:32.364932 run osmo-hlr_10.42.42.2(pid=1234): Launched 22:12:32.491210 run osmo-stp_10.42.42.5: Starting osmo-stp 22:12:33.054981 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1236): Launched 22:12:33.380267 run osmo-stp_10.42.42.5(pid=1237): Launched 22:12:33.505655 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:12:34.070439 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1239): Launched 22:12:34.195965 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:12:34.473395 run patchelf(pid=1240): Launched 22:12:34.655451 run osmo-stp_10.42.42.5(pid=1237): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1237)] 22:12:34.794988 run osmo-stp_10.42.42.5(pid=1237): stdout: | (launched: 2022-12-12_22:12:33.321076) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:12:34.935581 run osmo-stp_10.42.42.5(pid=1237): stderr: | [0;m[38;5;43m20221212221233512 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221233512 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221233513 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221233513 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221233513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221233514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221233514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:12:35.076105 run osmo-stp_10.42.42.5(pid=1237): stdout: | (launched: 2022-12-12_22:12:33.321076) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:12:35.210348 run osmo-stp_10.42.42.5(pid=1237): stderr: | [0;m[38;5;43m20221212221233512 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221233512 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221233513 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221233513 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221233513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221233514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221233514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:12:35.369471 run patchelf(pid=1240): Terminating (SIGINT) 22:12:35.554666 run patchelf(pid=1240): Terminated: ok {rc=0} 22:12:35.687911 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=1237): Process ended prematurely: osmo-stp_10.42.42.5(pid=1237) [trial-2383↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1237)] [trial-2383↪gprs:sysmo↪ping_idle_ping.py:27] 22:12:35.697561 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 22:12:35.726534 run osmo-hlr_10.42.42.2(pid=1234): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:sysmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1234)] 22:12:35.776756 run osmo-hlr_10.42.42.2(pid=1234): stdout: | (launched: 2022-12-12_22:12:32.305576) 22:12:35.829102 run osmo-hlr_10.42.42.2(pid=1234): stderr: | [0;m[1;31m20221212221232504 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212221232504 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212221232504 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212221232504 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212221232504 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212221232504 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212221232520 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:sysmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212221232528 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212221232528 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212221232529 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:12:35.881747 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1233): Terminating (SIGTERM) 22:12:35.923976 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1236): Terminating (SIGTERM) 22:12:35.966178 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1239): Terminating (SIGTERM) 22:12:36.008747 --- ParallelTerminationStrategy: PID 1233 died... 22:12:36.028867 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1233): Terminated: ok {rc=0} 22:12:36.075407 --- ParallelTerminationStrategy: PID 1236 died... 22:12:36.094862 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1236): Terminated: ok {rc=0} 22:12:36.141355 --- ParallelTerminationStrategy: PID 1239 died... 22:12:36.160782 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1239): Terminated: ok {rc=0} 22:12:36.249386 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2383 gprs:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 gprs:sysmo+mod-bts0-egprs --------------------------------------------------------------------- 22:12:37.537951 tst gprs:sysmo+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:12:37.544078 tst gprs:sysmo+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 22:12:37.566011 tst gprs:sysmo+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 22:12:37.605941 tst gprs:sysmo+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 22:12:37.694655 tst gprs:sysmo+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 22:12:37.715867 tst gprs:sysmo+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 22:12:37.755413 tst gprs:sysmo+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 22:12:38.348630 tst gprs:sysmo+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2383 gprs:sysmo+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 22:12:38.402379 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:12:38.413545 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:12:38.451761 tst cs_paging_gprs_active.py: using LAC 31845 22:12:38.583905 tst cs_paging_gprs_active.py: using RAC 225 22:12:38.715963 tst cs_paging_gprs_active.py: using CellId 31845 22:12:38.846681 tst cs_paging_gprs_active.py: using BVCI 31846 22:12:38.970558 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:12:38.981832 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:12:38.992802 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:12:39.004088 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:12:39.015268 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:12:39.026531 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:12:39.037930 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:12:39.049118 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:12:39.060512 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:12:39.179944 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:12:39.303530 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:12:39.529515 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:12:39.863011 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1245): Launched 22:12:40.152392 run iperf3-srv_10.42.42.10(pid=1246): Launched 22:12:40.277054 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:12:40.501828 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:12:40.834943 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1247): Launched 22:12:41.123011 run iperf3-srv_10.42.42.10(pid=1248): Launched 22:12:41.247936 tst cs_paging_gprs_active.py:38: start network... 22:12:41.472333 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:12:41.986837 run create_hlr_db(pid=1249): Launched 22:12:42.113521 bus /gobi_6: Setting Powered False 22:12:43.177986 run create_hlr_db(pid=1249): Terminated: ok {rc=0} 22:12:43.619611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1251): Launched 22:12:43.929063 run osmo-hlr_10.42.42.2(pid=1252): Launched 22:12:44.047677 run osmo-stp_10.42.42.5: Starting osmo-stp 22:12:44.587912 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1254): Launched 22:12:44.898983 run osmo-stp_10.42.42.5(pid=1255): Launched 22:12:45.018076 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:12:45.553529 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1257): Launched 22:12:45.672746 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:12:45.961680 run patchelf(pid=1258): Launched 22:12:46.169801 run osmo-stp_10.42.42.5(pid=1255): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1255)] 22:12:46.314929 run osmo-stp_10.42.42.5(pid=1255): stdout: | (launched: 2022-12-12_22:12:44.841514) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:12:46.462758 run osmo-stp_10.42.42.5(pid=1255): stderr: | [0;m[38;5;43m20221212221245012 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221245012 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221245012 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221245013 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221245015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221245015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221245015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:12:46.609848 run osmo-stp_10.42.42.5(pid=1255): stdout: | (launched: 2022-12-12_22:12:44.841514) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:12:46.752543 run osmo-stp_10.42.42.5(pid=1255): stderr: | [0;m[38;5;43m20221212221245012 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221245012 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221245012 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221245013 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221245015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221245015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221245015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:12:46.920870 run patchelf(pid=1258): Terminating (SIGINT) 22:12:47.130328 run patchelf(pid=1258): Terminated: ok {rc=0} 22:12:47.264160 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=1255): Process ended prematurely: osmo-stp_10.42.42.5(pid=1255) [trial-2383↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1255)] [trial-2383↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 22:12:47.274480 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 22:12:47.303696 run osmo-hlr_10.42.42.2(pid=1252): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1252)] 22:12:47.355240 run osmo-hlr_10.42.42.2(pid=1252): stdout: | (launched: 2022-12-12_22:12:43.872339) 22:12:47.407921 run osmo-hlr_10.42.42.2(pid=1252): stderr: | [0;m[1;31m20221212221244051 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212221244051 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212221244051 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212221244051 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212221244051 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212221244051 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212221244064 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:sysmo+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212221244072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212221244073 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212221244073 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:12:47.461565 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1245): Terminating (SIGTERM) 22:12:47.504295 run iperf3-srv_10.42.42.10(pid=1246): Terminating (SIGTERM) 22:12:47.546956 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1247): Terminating (SIGTERM) 22:12:47.589570 run iperf3-srv_10.42.42.10(pid=1248): Terminating (SIGTERM) 22:12:47.632263 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1251): Terminating (SIGTERM) 22:12:47.674849 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1254): Terminating (SIGTERM) 22:12:47.717755 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1257): Terminating (SIGTERM) 22:12:47.760598 --- ParallelTerminationStrategy: PID 1245 died... 22:12:47.780873 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1245): Terminated: ok {rc=0} 22:12:47.828032 --- ParallelTerminationStrategy: PID 1246 died... 22:12:47.847592 run iperf3-srv_10.42.42.10(pid=1246): Terminated {rc=256} 22:12:47.893990 --- ParallelTerminationStrategy: PID 1247 died... 22:12:47.913437 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1247): Terminated: ok {rc=0} 22:12:47.959841 --- ParallelTerminationStrategy: PID 1248 died... 22:12:47.979252 run iperf3-srv_10.42.42.10(pid=1248): Terminated {rc=256} 22:12:48.025658 --- ParallelTerminationStrategy: PID 1251 died... 22:12:48.045142 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1251): Terminated: ok {rc=0} 22:12:48.091663 --- ParallelTerminationStrategy: PID 1254 died... 22:12:48.111316 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1254): Terminated: ok {rc=0} 22:12:48.158065 --- ParallelTerminationStrategy: PID 1257 died... 22:12:48.177861 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1257): Terminated: ok {rc=0} 22:12:48.266473 bus /gobi_0: Setting Powered False 22:12:49.365734 bus /gobi_0: Setting Powered False 22:12:50.483959 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:sysmo+mod-bts0-egprs iperf3.py ---------------------------------------------- 22:12:51.633797 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:12:51.645683 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:12:51.684094 tst iperf3.py: using LAC 31846 22:12:51.813823 tst iperf3.py: using RAC 226 22:12:51.950855 tst iperf3.py: using CellId 31846 22:12:52.079146 tst iperf3.py: using BVCI 31847 22:12:52.200580 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:12:52.211820 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:12:52.222951 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:12:52.234385 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:12:52.245616 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:12:52.256847 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:12:52.268290 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:12:52.279563 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:12:52.291079 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:12:52.413669 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:12:52.638263 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:12:52.971223 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1259): Launched 22:12:53.260018 run iperf3-srv_10.42.42.10(pid=1260): Launched 22:12:53.384474 tst iperf3.py:8: start network... 22:12:53.608233 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:12:54.120227 run create_hlr_db(pid=1261): Launched 22:12:54.247069 bus /gobi_6: Setting Powered False 22:12:55.311535 run create_hlr_db(pid=1261): Terminated: ok {rc=0} 22:12:55.770653 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1263): Launched 22:12:56.102703 run osmo-hlr_10.42.42.2(pid=1264): Launched 22:12:56.229799 run osmo-stp_10.42.42.5: Starting osmo-stp 22:12:56.805069 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1266): Launched 22:12:57.136535 run osmo-stp_10.42.42.5(pid=1267): Launched 22:12:57.263166 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:12:57.837336 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1269): Launched 22:12:57.964395 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:12:58.246342 run patchelf(pid=1270): Launched 22:12:58.430807 run osmo-stp_10.42.42.5(pid=1267): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1267)] 22:12:58.571562 run osmo-stp_10.42.42.5(pid=1267): stdout: | (launched: 2022-12-12_22:12:57.076121) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:12:58.712595 run osmo-stp_10.42.42.5(pid=1267): stderr: | [0;m[38;5;43m20221212221257273 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221257273 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221257273 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221257273 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221257274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221257274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221257274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:12:58.854092 run osmo-stp_10.42.42.5(pid=1267): stdout: | (launched: 2022-12-12_22:12:57.076121) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:12:58.990313 run osmo-stp_10.42.42.5(pid=1267): stderr: | [0;m[38;5;43m20221212221257273 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221257273 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221257273 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221257273 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221257274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221257274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221257274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:12:59.151220 run patchelf(pid=1270): Terminating (SIGINT) 22:12:59.338066 run patchelf(pid=1270): Terminated: ok {rc=0} 22:12:59.473017 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1267): Process ended prematurely: osmo-stp_10.42.42.5(pid=1267) [trial-2383↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1267)] [trial-2383↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8] 22:12:59.483173 tst iperf3.py:8: Test FAILED (7.9 sec) 22:12:59.512391 run osmo-hlr_10.42.42.2(pid=1264): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:sysmo+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1264)] 22:12:59.562986 run osmo-hlr_10.42.42.2(pid=1264): stdout: | (launched: 2022-12-12_22:12:56.042454) 22:12:59.615505 run osmo-hlr_10.42.42.2(pid=1264): stderr: | [0;m[1;31m20221212221256245 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212221256245 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212221256245 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212221256245 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212221256245 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212221256245 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212221256256 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:sysmo+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212221256264 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212221256265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212221256265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:12:59.668201 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1259): Terminating (SIGTERM) 22:12:59.710396 run iperf3-srv_10.42.42.10(pid=1260): Terminating (SIGTERM) 22:12:59.752375 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1263): Terminating (SIGTERM) 22:12:59.794580 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1266): Terminating (SIGTERM) 22:12:59.836742 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1269): Terminating (SIGTERM) 22:12:59.879404 --- ParallelTerminationStrategy: PID 1259 died... 22:12:59.899315 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1259): Terminated: ok {rc=0} 22:12:59.946058 --- ParallelTerminationStrategy: PID 1260 died... 22:12:59.965388 run iperf3-srv_10.42.42.10(pid=1260): Terminated {rc=256} 22:13:00.011808 --- ParallelTerminationStrategy: PID 1263 died... 22:13:00.031308 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1263): Terminated: ok {rc=0} 22:13:00.077802 --- ParallelTerminationStrategy: PID 1266 died... 22:13:00.097381 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1266): Terminated: ok {rc=0} 22:13:00.144061 --- ParallelTerminationStrategy: PID 1269 died... 22:13:00.163567 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1269): Terminated: ok {rc=0} 22:13:00.251817 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:sysmo+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 22:13:01.402566 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:13:01.414462 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:13:01.452127 tst iperf3m4.py: using LAC 31847 22:13:01.591398 tst iperf3m4.py: using RAC 227 22:13:01.768805 tst iperf3m4.py: using CellId 31847 22:13:01.895655 tst iperf3m4.py: using BVCI 31848 22:13:02.012107 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:13:02.023476 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:13:02.035204 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:13:02.046960 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:13:02.059420 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:13:02.071216 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:13:02.083285 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:13:02.095073 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:13:02.106592 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:13:02.224459 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:13:02.351648 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:13:02.468728 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:13:02.589173 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:13:02.797858 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:13:03.111428 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1271): Launched 22:13:03.381187 run iperf3-srv_10.42.42.10(pid=1272): Launched 22:13:03.497560 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:13:03.704804 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:13:04.016166 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1273): Launched 22:13:04.286512 run iperf3-srv_10.42.42.10(pid=1274): Launched 22:13:04.403161 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:13:04.610767 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:13:04.921818 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1275): Launched 22:13:05.193579 run iperf3-srv_10.42.42.10(pid=1276): Launched 22:13:05.310518 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:13:05.519063 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:13:05.831491 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1277): Launched 22:13:06.101239 run iperf3-srv_10.42.42.10(pid=1278): Launched 22:13:06.218039 tst iperf3m4.py:8: start network... 22:13:06.425496 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:13:06.942180 run create_hlr_db(pid=1279): Launched 22:13:07.069504 bus /gobi_6: Setting Powered False 22:13:08.131028 run create_hlr_db(pid=1279): Terminated: ok {rc=0} 22:13:08.573190 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1281): Launched 22:13:08.883251 run osmo-hlr_10.42.42.2(pid=1282): Launched 22:13:09.000403 run osmo-stp_10.42.42.5: Starting osmo-stp 22:13:09.547147 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1284): Launched 22:13:09.857053 run osmo-stp_10.42.42.5(pid=1285): Launched 22:13:09.975981 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:13:10.509771 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1287): Launched 22:13:10.628379 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:13:10.890063 run patchelf(pid=1288): Launched 22:13:11.062205 run osmo-stp_10.42.42.5(pid=1285): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1285)] 22:13:11.193139 run osmo-stp_10.42.42.5(pid=1285): stdout: | (launched: 2022-12-12_22:13:09.799536) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:13:11.325206 run osmo-stp_10.42.42.5(pid=1285): stderr: | [0;m[38;5;43m20221212221309971 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221309972 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221309972 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221309972 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221309973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221309973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221309973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:13:11.457488 run osmo-stp_10.42.42.5(pid=1285): stdout: | (launched: 2022-12-12_22:13:09.799536) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:13:11.583869 run osmo-stp_10.42.42.5(pid=1285): stderr: | [0;m[38;5;43m20221212221309971 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221309972 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221309972 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221309972 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221309973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221309973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221309973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:13:11.733992 run patchelf(pid=1288): Terminating (SIGINT) 22:13:11.908760 run patchelf(pid=1288): Terminated: ok {rc=0} 22:13:12.034459 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1285): Process ended prematurely: osmo-stp_10.42.42.5(pid=1285) [trial-2383↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1285)] [trial-2383↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8] 22:13:12.043671 tst iperf3m4.py:8: Test FAILED (10.7 sec) 22:13:12.070975 run osmo-hlr_10.42.42.2(pid=1282): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1282)] 22:13:12.118924 run osmo-hlr_10.42.42.2(pid=1282): stdout: | (launched: 2022-12-12_22:13:08.826277) 22:13:12.168029 run osmo-hlr_10.42.42.2(pid=1282): stderr: | [0;m[1;31m20221212221309002 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212221309002 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212221309002 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212221309002 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212221309002 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212221309002 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212221309014 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:sysmo+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212221309022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212221309022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212221309023 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:13:12.217484 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1271): Terminating (SIGTERM) 22:13:12.256594 run iperf3-srv_10.42.42.10(pid=1272): Terminating (SIGTERM) 22:13:12.295664 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1273): Terminating (SIGTERM) 22:13:12.335604 run iperf3-srv_10.42.42.10(pid=1274): Terminating (SIGTERM) 22:13:12.375011 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1275): Terminating (SIGTERM) 22:13:12.414392 run iperf3-srv_10.42.42.10(pid=1276): Terminating (SIGTERM) 22:13:12.453786 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1277): Terminating (SIGTERM) 22:13:12.493307 run iperf3-srv_10.42.42.10(pid=1278): Terminating (SIGTERM) 22:13:12.532512 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1281): Terminating (SIGTERM) 22:13:12.571813 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1284): Terminating (SIGTERM) 22:13:12.611062 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1287): Terminating (SIGTERM) 22:13:12.650535 --- ParallelTerminationStrategy: PID 1271 died... 22:13:12.669490 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1271): Terminated: ok {rc=0} 22:13:12.713463 --- ParallelTerminationStrategy: PID 1272 died... 22:13:12.731973 run iperf3-srv_10.42.42.10(pid=1272): Terminated {rc=256} 22:13:12.776183 --- ParallelTerminationStrategy: PID 1273 died... 22:13:12.794637 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1273): Terminated: ok {rc=0} 22:13:12.838213 --- ParallelTerminationStrategy: PID 1274 died... 22:13:12.856636 run iperf3-srv_10.42.42.10(pid=1274): Terminated {rc=256} 22:13:12.900169 --- ParallelTerminationStrategy: PID 1275 died... 22:13:12.918643 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1275): Terminated: ok {rc=0} 22:13:12.962760 --- ParallelTerminationStrategy: PID 1276 died... 22:13:12.981315 run iperf3-srv_10.42.42.10(pid=1276): Terminated {rc=256} 22:13:13.024804 --- ParallelTerminationStrategy: PID 1277 died... 22:13:13.043765 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1277): Terminated: ok {rc=0} 22:13:13.087962 --- ParallelTerminationStrategy: PID 1278 died... 22:13:13.106554 run iperf3-srv_10.42.42.10(pid=1278): Terminated {rc=256} 22:13:13.150011 --- ParallelTerminationStrategy: PID 1281 died... 22:13:13.168546 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1281): Terminated: ok {rc=0} 22:13:13.212035 --- ParallelTerminationStrategy: PID 1284 died... 22:13:13.230486 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1284): Terminated: ok {rc=0} 22:13:13.274114 --- ParallelTerminationStrategy: PID 1287 died... 22:13:13.292592 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1287): Terminated: ok {rc=0} 22:13:13.377637 bus /gobi_4: Setting Powered False 22:13:14.477865 bus /gobi_4: Setting Powered False 22:13:15.594481 bus /gobi_1: Setting Powered False 22:13:16.694529 bus /gobi_1: Setting Powered False 22:13:17.808443 bus /gobi_0: Setting Powered False 22:13:18.904052 bus /gobi_0: Setting Powered False 22:13:20.019406 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:sysmo+mod-bts0-egprs ping.py ---------------------------------------------- 22:13:21.122797 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:13:21.134526 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:13:21.174964 tst ping.py: using LAC 31848 22:13:21.293774 tst ping.py: using RAC 228 22:13:21.419874 tst ping.py: using CellId 31848 22:13:21.547000 tst ping.py: using BVCI 31849 22:13:21.665888 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:13:21.677349 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:13:21.688534 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:13:21.700075 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:13:21.711324 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:13:21.722672 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:13:21.734352 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:13:21.745780 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:13:21.867343 tst ping.py:19: start network... 22:13:22.072075 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:13:22.542950 run create_hlr_db(pid=1289): Launched 22:13:22.667330 bus /gobi_6: Setting Powered False 22:13:23.726885 run create_hlr_db(pid=1289): Terminated: ok {rc=0} 22:13:24.150539 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1291): Launched 22:13:24.453557 run osmo-hlr_10.42.42.2(pid=1292): Launched 22:13:24.569901 run osmo-stp_10.42.42.5: Starting osmo-stp 22:13:25.106507 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1294): Launched 22:13:25.409606 run osmo-stp_10.42.42.5(pid=1295): Launched 22:13:25.526290 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:13:26.066916 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1297): Launched 22:13:26.183007 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:13:26.439250 run patchelf(pid=1298): Launched 22:13:26.608407 run osmo-stp_10.42.42.5(pid=1295): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1295)] 22:13:26.736827 run osmo-stp_10.42.42.5(pid=1295): stdout: | (launched: 2022-12-12_22:13:25.354026) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:13:26.866544 run osmo-stp_10.42.42.5(pid=1295): stderr: | [0;m[38;5;43m20221212221325525 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221325525 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221325525 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221325526 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221325528 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221325528 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221325528 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:13:26.996630 run osmo-stp_10.42.42.5(pid=1295): stdout: | (launched: 2022-12-12_22:13:25.354026) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:13:27.120830 run osmo-stp_10.42.42.5(pid=1295): stderr: | [0;m[38;5;43m20221212221325525 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221325525 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221325525 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221325526 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221325528 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221325528 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221325528 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:13:27.268476 run patchelf(pid=1298): Terminating (SIGINT) 22:13:27.440396 run patchelf(pid=1298): Terminated: ok {rc=0} 22:13:27.564008 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=1295): Process ended prematurely: osmo-stp_10.42.42.5(pid=1295) [trial-2383↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1295)] [trial-2383↪gprs:sysmo+mod-bts0-egprs↪ping.py:22] 22:13:27.572822 tst ping.py:22: Test FAILED (6.4 sec) 22:13:27.599423 run osmo-hlr_10.42.42.2(pid=1292): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:sysmo+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1292)] 22:13:27.646611 run osmo-hlr_10.42.42.2(pid=1292): stdout: | (launched: 2022-12-12_22:13:24.397820) 22:13:27.695716 run osmo-hlr_10.42.42.2(pid=1292): stderr: | [0;m[1;31m20221212221324574 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212221324575 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212221324575 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212221324575 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212221324575 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212221324575 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212221324587 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:sysmo+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212221324596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212221324596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212221324596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:13:27.745263 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1291): Terminating (SIGTERM) 22:13:27.784796 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1294): Terminating (SIGTERM) 22:13:27.824399 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1297): Terminating (SIGTERM) 22:13:27.864313 --- ParallelTerminationStrategy: PID 1291 died... 22:13:27.883504 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1291): Terminated: ok {rc=0} 22:13:27.927717 --- ParallelTerminationStrategy: PID 1294 died... 22:13:27.946520 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1294): Terminated: ok {rc=0} 22:13:27.990379 --- ParallelTerminationStrategy: PID 1297 died... 22:13:28.009107 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1297): Terminated: ok {rc=0} 22:13:28.095208 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:sysmo+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 22:13:29.184729 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:13:29.197077 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:13:29.235609 tst ping_idle_ping.py: using LAC 31849 22:13:29.357789 tst ping_idle_ping.py: using RAC 229 22:13:29.482241 tst ping_idle_ping.py: using CellId 31849 22:13:29.600847 tst ping_idle_ping.py: using BVCI 31850 22:13:29.711404 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:13:29.722131 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:13:29.732666 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:13:29.743301 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:13:29.753722 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:13:29.764079 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:13:29.774604 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:13:29.785169 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:13:29.912159 tst ping_idle_ping.py:24: start network... 22:13:30.134260 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:13:30.639855 run create_hlr_db(pid=1299): Launched 22:13:30.765459 bus /gobi_6: Setting Powered False 22:13:31.830220 run create_hlr_db(pid=1299): Terminated: ok {rc=0} 22:13:32.321425 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1301): Launched 22:13:32.651354 run osmo-hlr_10.42.42.2(pid=1302): Launched 22:13:32.776469 run osmo-stp_10.42.42.5: Starting osmo-stp 22:13:33.345500 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1304): Launched 22:13:33.684690 run osmo-stp_10.42.42.5(pid=1305): Launched 22:13:33.809436 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:13:34.375464 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1307): Launched 22:13:34.501244 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:13:34.777466 run patchelf(pid=1308): Launched 22:13:34.960337 run osmo-stp_10.42.42.5(pid=1305): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1305)] 22:13:35.099684 run osmo-stp_10.42.42.5(pid=1305): stdout: | (launched: 2022-12-12_22:13:33.625117) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:13:35.240066 run osmo-stp_10.42.42.5(pid=1305): stderr: | [0;m[38;5;43m20221212221333820 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221333820 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221333820 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221333821 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221333821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221333821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221333821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:13:35.380182 run osmo-stp_10.42.42.5(pid=1305): stdout: | (launched: 2022-12-12_22:13:33.625117) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:13:35.514794 run osmo-stp_10.42.42.5(pid=1305): stderr: | [0;m[38;5;43m20221212221333820 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221333820 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221333820 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221333821 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221333821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221333821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221333821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:13:35.674249 run patchelf(pid=1308): Terminating (SIGINT) 22:13:35.859732 run patchelf(pid=1308): Terminated: ok {rc=0} 22:13:35.993197 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=1305): Process ended prematurely: osmo-stp_10.42.42.5(pid=1305) [trial-2383↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1305)] [trial-2383↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27] 22:13:36.003001 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 22:13:36.031729 run osmo-hlr_10.42.42.2(pid=1302): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1302)] 22:13:36.082333 run osmo-hlr_10.42.42.2(pid=1302): stdout: | (launched: 2022-12-12_22:13:32.591260) 22:13:36.134510 run osmo-hlr_10.42.42.2(pid=1302): stderr: | [0;m[1;31m20221212221332792 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212221332792 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212221332792 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212221332792 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212221332792 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212221332792 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212221332804 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:sysmo+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212221332812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212221332813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212221332813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:13:36.186984 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1301): Terminating (SIGTERM) 22:13:36.229053 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1304): Terminating (SIGTERM) 22:13:36.271475 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1307): Terminating (SIGTERM) 22:13:36.314098 --- ParallelTerminationStrategy: PID 1301 died... 22:13:36.334350 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1301): Terminated: ok {rc=0} 22:13:36.381597 --- ParallelTerminationStrategy: PID 1304 died... 22:13:36.401264 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1304): Terminated: ok {rc=0} 22:13:36.448006 --- ParallelTerminationStrategy: PID 1307 died... 22:13:36.467975 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1307): Terminated: ok {rc=0} 22:13:36.556157 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2383 gprs:sysmo+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 gprs:sysmo+mod-bts0-dynts-ipa --------------------------------------------------------------------- 22:13:37.840256 tst gprs:sysmo+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:13:37.848032 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 22:13:37.870631 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 22:13:37.910424 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 22:13:37.997431 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 22:13:38.018650 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 22:13:38.058696 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 22:13:38.654656 tst gprs:sysmo+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2383 gprs:sysmo+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 22:13:38.708208 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:13:38.719699 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:13:38.776458 tst cs_paging_gprs_active.py: using LAC 31850 22:13:38.905455 tst cs_paging_gprs_active.py: using RAC 230 22:13:39.026373 tst cs_paging_gprs_active.py: using CellId 31850 22:13:39.148819 tst cs_paging_gprs_active.py: using BVCI 31851 22:13:39.263154 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:13:39.274587 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:13:39.285467 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:13:39.296306 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:13:39.306808 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:13:39.317429 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:13:39.328030 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:13:39.338495 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:13:39.349253 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:13:39.470418 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:13:39.592770 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:13:39.817977 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:13:40.150721 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1313): Launched 22:13:40.440039 run iperf3-srv_10.42.42.10(pid=1314): Launched 22:13:40.565966 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:13:40.790391 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:13:41.123693 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1315): Launched 22:13:41.412067 run iperf3-srv_10.42.42.10(pid=1316): Launched 22:13:41.537461 tst cs_paging_gprs_active.py:38: start network... 22:13:41.761423 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:13:42.276720 run create_hlr_db(pid=1317): Launched 22:13:42.404554 bus /gobi_6: Setting Powered False 22:13:43.470400 run create_hlr_db(pid=1317): Terminated: ok {rc=0} 22:13:43.914233 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1319): Launched 22:13:44.226222 run osmo-hlr_10.42.42.2(pid=1320): Launched 22:13:44.345595 run osmo-stp_10.42.42.5: Starting osmo-stp 22:13:44.879128 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1322): Launched 22:13:45.189811 run osmo-stp_10.42.42.5(pid=1323): Launched 22:13:45.308596 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:13:45.849688 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1325): Launched 22:13:46.003255 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:13:46.293485 run patchelf(pid=1326): Launched 22:13:46.496461 run osmo-stp_10.42.42.5(pid=1323): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1323)] 22:13:46.642120 run osmo-stp_10.42.42.5(pid=1323): stdout: | (launched: 2022-12-12_22:13:45.132773) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:13:46.791053 run osmo-stp_10.42.42.5(pid=1323): stderr: | [0;m[38;5;43m20221212221345308 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221345308 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221345308 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221345309 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221345309 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221345309 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221345309 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:13:46.938679 run osmo-stp_10.42.42.5(pid=1323): stdout: | (launched: 2022-12-12_22:13:45.132773) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:13:47.081180 run osmo-stp_10.42.42.5(pid=1323): stderr: | [0;m[38;5;43m20221212221345308 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221345308 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221345308 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221345309 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221345309 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221345309 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221345309 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:13:47.246926 run patchelf(pid=1326): Terminating (SIGINT) 22:13:47.436143 run patchelf(pid=1326): Terminated: ok {rc=0} 22:13:47.572266 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=1323): Process ended prematurely: osmo-stp_10.42.42.5(pid=1323) [trial-2383↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1323)] [trial-2383↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 22:13:47.582679 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 22:13:47.612537 run osmo-hlr_10.42.42.2(pid=1320): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1320)] 22:13:47.663565 run osmo-hlr_10.42.42.2(pid=1320): stdout: | (launched: 2022-12-12_22:13:44.169243) 22:13:47.716219 run osmo-hlr_10.42.42.2(pid=1320): stderr: | [0;m[1;31m20221212221344347 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212221344347 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212221344347 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212221344348 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212221344348 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212221344348 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212221344360 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:sysmo+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212221344368 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212221344369 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212221344369 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:13:47.769454 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1313): Terminating (SIGTERM) 22:13:47.811966 run iperf3-srv_10.42.42.10(pid=1314): Terminating (SIGTERM) 22:13:47.854522 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1315): Terminating (SIGTERM) 22:13:47.897144 run iperf3-srv_10.42.42.10(pid=1316): Terminating (SIGTERM) 22:13:47.939863 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1319): Terminating (SIGTERM) 22:13:47.982557 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1322): Terminating (SIGTERM) 22:13:48.025649 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1325): Terminating (SIGTERM) 22:13:48.068559 --- ParallelTerminationStrategy: PID 1313 died... 22:13:48.088832 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1313): Terminated: ok {rc=0} 22:13:48.136480 --- ParallelTerminationStrategy: PID 1314 died... 22:13:48.156256 run iperf3-srv_10.42.42.10(pid=1314): Terminated {rc=256} 22:13:48.203542 --- ParallelTerminationStrategy: PID 1315 died... 22:13:48.223299 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1315): Terminated: ok {rc=0} 22:13:48.270413 --- ParallelTerminationStrategy: PID 1316 died... 22:13:48.290191 run iperf3-srv_10.42.42.10(pid=1316): Terminated {rc=256} 22:13:48.337381 --- ParallelTerminationStrategy: PID 1319 died... 22:13:48.357231 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1319): Terminated: ok {rc=0} 22:13:48.404530 --- ParallelTerminationStrategy: PID 1322 died... 22:13:48.424336 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1322): Terminated: ok {rc=0} 22:13:48.472095 --- ParallelTerminationStrategy: PID 1325 died... 22:13:48.491823 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1325): Terminated: ok {rc=0} 22:13:48.579730 bus /gobi_0: Setting Powered False 22:13:49.679571 bus /gobi_0: Setting Powered False 22:13:50.797088 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:sysmo+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 22:13:51.947256 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:13:51.959359 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:13:52.020542 tst iperf3.py: using LAC 31851 22:13:52.153169 tst iperf3.py: using RAC 231 22:13:52.282669 tst iperf3.py: using CellId 31851 22:13:52.413872 tst iperf3.py: using BVCI 31852 22:13:52.527620 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:13:52.538775 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:13:52.549689 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:13:52.561609 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:13:52.572369 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:13:52.583102 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:13:52.593906 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:13:52.604350 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:13:52.615078 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:13:52.734413 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:13:52.959791 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:13:53.292730 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1327): Launched 22:13:53.582024 run iperf3-srv_10.42.42.10(pid=1328): Launched 22:13:53.706715 tst iperf3.py:8: start network... 22:13:53.930708 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:13:54.444311 run create_hlr_db(pid=1329): Launched 22:13:54.571553 bus /gobi_6: Setting Powered False 22:13:55.636231 run create_hlr_db(pid=1329): Terminated: ok {rc=0} 22:13:56.077382 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1331): Launched 22:13:56.389961 run osmo-hlr_10.42.42.2(pid=1332): Launched 22:13:56.508369 run osmo-stp_10.42.42.5: Starting osmo-stp 22:13:57.041847 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1334): Launched 22:13:57.350586 run osmo-stp_10.42.42.5(pid=1335): Launched 22:13:57.469349 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:13:58.004299 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1337): Launched 22:13:58.122913 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:13:58.383996 run patchelf(pid=1338): Launched 22:13:58.556638 run osmo-stp_10.42.42.5(pid=1335): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1335)] 22:13:58.687530 run osmo-stp_10.42.42.5(pid=1335): stdout: | (launched: 2022-12-12_22:13:57.293494) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:13:58.819573 run osmo-stp_10.42.42.5(pid=1335): stderr: | [0;m[38;5;43m20221212221357465 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221357465 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221357465 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221357466 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221357468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221357468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221357468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:13:58.952195 run osmo-stp_10.42.42.5(pid=1335): stdout: | (launched: 2022-12-12_22:13:57.293494) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:13:59.078441 run osmo-stp_10.42.42.5(pid=1335): stderr: | [0;m[38;5;43m20221212221357465 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221357465 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221357465 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221357466 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221357468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221357468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221357468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:13:59.228444 run patchelf(pid=1338): Terminating (SIGINT) 22:13:59.403731 run patchelf(pid=1338): Terminated: ok {rc=0} 22:13:59.530466 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1335): Process ended prematurely: osmo-stp_10.42.42.5(pid=1335) [trial-2383↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1335)] [trial-2383↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8] 22:13:59.540260 tst iperf3.py:8: Test FAILED (7.6 sec) 22:13:59.567457 run osmo-hlr_10.42.42.2(pid=1332): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1332)] 22:13:59.615059 run osmo-hlr_10.42.42.2(pid=1332): stdout: | (launched: 2022-12-12_22:13:56.332926) 22:13:59.664013 run osmo-hlr_10.42.42.2(pid=1332): stderr: | [0;m[1;31m20221212221356511 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212221356511 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212221356511 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212221356511 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212221356511 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212221356511 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212221356523 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:sysmo+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212221356532 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212221356532 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212221356532 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:13:59.713418 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1327): Terminating (SIGTERM) 22:13:59.752836 run iperf3-srv_10.42.42.10(pid=1328): Terminating (SIGTERM) 22:13:59.792098 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1331): Terminating (SIGTERM) 22:13:59.831671 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1334): Terminating (SIGTERM) 22:13:59.871287 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1337): Terminating (SIGTERM) 22:13:59.911082 --- ParallelTerminationStrategy: PID 1327 died... 22:13:59.930186 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1327): Terminated: ok {rc=0} 22:13:59.974492 --- ParallelTerminationStrategy: PID 1328 died... 22:13:59.992844 run iperf3-srv_10.42.42.10(pid=1328): Terminated {rc=256} 22:14:00.036460 --- ParallelTerminationStrategy: PID 1331 died... 22:14:00.054863 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1331): Terminated: ok {rc=0} 22:14:00.098224 --- ParallelTerminationStrategy: PID 1334 died... 22:14:00.117001 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1334): Terminated: ok {rc=0} 22:14:00.160250 --- ParallelTerminationStrategy: PID 1337 died... 22:14:00.178753 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1337): Terminated: ok {rc=0} 22:14:00.261337 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:sysmo+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 22:14:01.405105 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:14:01.416871 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:14:01.475730 tst iperf3m4.py: using LAC 31852 22:14:01.610965 tst iperf3m4.py: using RAC 232 22:14:01.743172 tst iperf3m4.py: using CellId 31852 22:14:01.878964 tst iperf3m4.py: using BVCI 31853 22:14:01.999844 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:14:02.011201 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:14:02.022740 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:14:02.034263 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:14:02.045724 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:14:02.058136 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:14:02.069833 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:14:02.080930 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:14:02.092731 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:14:02.210726 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:14:02.332914 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:14:02.455607 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:14:02.579297 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:14:02.787324 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:14:03.097742 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1339): Launched 22:14:03.368762 run iperf3-srv_10.42.42.10(pid=1340): Launched 22:14:03.485576 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:14:03.692923 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:14:04.003375 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1341): Launched 22:14:04.273132 run iperf3-srv_10.42.42.10(pid=1342): Launched 22:14:04.389092 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:14:04.595879 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:14:04.905966 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1343): Launched 22:14:05.175574 run iperf3-srv_10.42.42.10(pid=1344): Launched 22:14:05.291633 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:14:05.499186 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:14:05.810200 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1345): Launched 22:14:06.079962 run iperf3-srv_10.42.42.10(pid=1346): Launched 22:14:06.195981 tst iperf3m4.py:8: start network... 22:14:06.402850 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:14:06.882797 run create_hlr_db(pid=1347): Launched 22:14:07.009420 bus /gobi_6: Setting Powered False 22:14:08.074882 run create_hlr_db(pid=1347): Terminated: ok {rc=0} 22:14:08.535803 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1349): Launched 22:14:08.866304 run osmo-hlr_10.42.42.2(pid=1350): Launched 22:14:08.993144 run osmo-stp_10.42.42.5: Starting osmo-stp 22:14:09.565260 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1352): Launched 22:14:09.895205 run osmo-stp_10.42.42.5(pid=1353): Launched 22:14:10.021605 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:14:10.594565 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1355): Launched 22:14:10.721512 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:14:11.001733 run patchelf(pid=1356): Launched 22:14:11.187259 run osmo-stp_10.42.42.5(pid=1353): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1353)] 22:14:11.327858 run osmo-stp_10.42.42.5(pid=1353): stdout: | (launched: 2022-12-12_22:14:09.834826) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:14:11.469385 run osmo-stp_10.42.42.5(pid=1353): stderr: | [0;m[38;5;43m20221212221410027 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221410027 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221410027 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221410028 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221410028 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221410028 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221410028 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:14:11.611851 run osmo-stp_10.42.42.5(pid=1353): stdout: | (launched: 2022-12-12_22:14:09.834826) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:14:11.747700 run osmo-stp_10.42.42.5(pid=1353): stderr: | [0;m[38;5;43m20221212221410027 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221410027 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221410027 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221410028 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221410028 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221410028 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221410028 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:14:11.908736 run patchelf(pid=1356): Terminating (SIGINT) 22:14:12.095643 run patchelf(pid=1356): Terminated: ok {rc=0} 22:14:12.230114 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1353): Process ended prematurely: osmo-stp_10.42.42.5(pid=1353) [trial-2383↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1353)] [trial-2383↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8] 22:14:12.240383 tst iperf3m4.py:8: Test FAILED (10.9 sec) 22:14:12.269798 run osmo-hlr_10.42.42.2(pid=1350): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1350)] 22:14:12.320202 run osmo-hlr_10.42.42.2(pid=1350): stdout: | (launched: 2022-12-12_22:14:08.805931) 22:14:12.372284 run osmo-hlr_10.42.42.2(pid=1350): stderr: | [0;m[1;31m20221212221409004 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212221409004 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212221409004 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212221409004 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212221409004 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212221409004 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212221409021 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:sysmo+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212221409029 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212221409029 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212221409029 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:14:12.424597 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1339): Terminating (SIGTERM) 22:14:12.466926 run iperf3-srv_10.42.42.10(pid=1340): Terminating (SIGTERM) 22:14:12.509561 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1341): Terminating (SIGTERM) 22:14:12.552347 run iperf3-srv_10.42.42.10(pid=1342): Terminating (SIGTERM) 22:14:12.594780 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1343): Terminating (SIGTERM) 22:14:12.637305 run iperf3-srv_10.42.42.10(pid=1344): Terminating (SIGTERM) 22:14:12.679367 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1345): Terminating (SIGTERM) 22:14:12.721573 run iperf3-srv_10.42.42.10(pid=1346): Terminating (SIGTERM) 22:14:12.763607 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1349): Terminating (SIGTERM) 22:14:12.806130 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1352): Terminating (SIGTERM) 22:14:12.848445 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1355): Terminating (SIGTERM) 22:14:12.890741 --- ParallelTerminationStrategy: PID 1339 died... 22:14:12.910858 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1339): Terminated: ok {rc=0} 22:14:12.957968 --- ParallelTerminationStrategy: PID 1340 died... 22:14:12.977653 run iperf3-srv_10.42.42.10(pid=1340): Terminated {rc=256} 22:14:13.024032 --- ParallelTerminationStrategy: PID 1341 died... 22:14:13.043843 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1341): Terminated: ok {rc=0} 22:14:13.090691 --- ParallelTerminationStrategy: PID 1342 died... 22:14:13.110375 run iperf3-srv_10.42.42.10(pid=1342): Terminated {rc=256} 22:14:13.156940 --- ParallelTerminationStrategy: PID 1343 died... 22:14:13.176885 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1343): Terminated: ok {rc=0} 22:14:13.223979 --- ParallelTerminationStrategy: PID 1344 died... 22:14:13.243666 run iperf3-srv_10.42.42.10(pid=1344): Terminated {rc=256} 22:14:13.290180 --- ParallelTerminationStrategy: PID 1345 died... 22:14:13.309888 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1345): Terminated: ok {rc=0} 22:14:13.356784 --- ParallelTerminationStrategy: PID 1346 died... 22:14:13.377031 run iperf3-srv_10.42.42.10(pid=1346): Terminated {rc=256} 22:14:13.424231 --- ParallelTerminationStrategy: PID 1349 died... 22:14:13.444100 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1349): Terminated: ok {rc=0} 22:14:13.491429 --- ParallelTerminationStrategy: PID 1352 died... 22:14:13.511244 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1352): Terminated: ok {rc=0} 22:14:13.557962 --- ParallelTerminationStrategy: PID 1355 died... 22:14:13.577891 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1355): Terminated: ok {rc=0} 22:14:13.667281 bus /gobi_4: Setting Powered False 22:14:14.767179 bus /gobi_4: Setting Powered False 22:14:15.898443 bus /gobi_1: Setting Powered False 22:14:16.998251 bus /gobi_1: Setting Powered False 22:14:18.112773 bus /gobi_0: Setting Powered False 22:14:19.209109 bus /gobi_0: Setting Powered False 22:14:20.325403 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:sysmo+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 22:14:21.429648 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:14:21.441077 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:14:21.497207 tst ping.py: using LAC 31853 22:14:21.617989 tst ping.py: using RAC 233 22:14:21.737651 tst ping.py: using CellId 31853 22:14:21.868265 tst ping.py: using BVCI 31854 22:14:21.987124 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:14:21.998722 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:14:22.010165 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:14:22.022132 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:14:22.033999 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:14:22.045735 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:14:22.057605 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:14:22.069293 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:14:22.187530 tst ping.py:19: start network... 22:14:22.393203 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:14:22.864088 run create_hlr_db(pid=1357): Launched 22:14:22.988915 bus /gobi_6: Setting Powered False 22:14:24.049985 run create_hlr_db(pid=1357): Terminated: ok {rc=0} 22:14:24.495727 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1359): Launched 22:14:24.822396 run osmo-hlr_10.42.42.2(pid=1360): Launched 22:14:24.946887 run osmo-stp_10.42.42.5: Starting osmo-stp 22:14:25.520002 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1362): Launched 22:14:25.846285 run osmo-stp_10.42.42.5(pid=1363): Launched 22:14:25.970528 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:14:26.531438 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1365): Launched 22:14:26.656514 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:14:26.931451 run patchelf(pid=1366): Launched 22:14:27.111594 run osmo-stp_10.42.42.5(pid=1363): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1363)] 22:14:27.249772 run osmo-stp_10.42.42.5(pid=1363): stdout: | (launched: 2022-12-12_22:14:25.786966) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:14:27.389176 run osmo-stp_10.42.42.5(pid=1363): stderr: | [0;m[38;5;43m20221212221425981 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221425981 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221425981 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221425982 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221425982 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221425982 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221425982 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:14:27.528877 run osmo-stp_10.42.42.5(pid=1363): stdout: | (launched: 2022-12-12_22:14:25.786966) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:14:27.661935 run osmo-stp_10.42.42.5(pid=1363): stderr: | [0;m[38;5;43m20221212221425981 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221425981 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221425981 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221425982 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221425982 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221425982 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221425982 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:14:27.819775 run patchelf(pid=1366): Terminating (SIGINT) 22:14:28.003883 run patchelf(pid=1366): Terminated: ok {rc=0} 22:14:28.136000 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=1363): Process ended prematurely: osmo-stp_10.42.42.5(pid=1363) [trial-2383↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1363)] [trial-2383↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22] 22:14:28.145364 tst ping.py:22: Test FAILED (6.7 sec) 22:14:28.173829 run osmo-hlr_10.42.42.2(pid=1360): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1360)] 22:14:28.225059 run osmo-hlr_10.42.42.2(pid=1360): stdout: | (launched: 2022-12-12_22:14:24.762975) 22:14:28.277264 run osmo-hlr_10.42.42.2(pid=1360): stderr: | [0;m[1;31m20221212221424963 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212221424963 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212221424963 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212221424963 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212221424963 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212221424963 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212221424975 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:sysmo+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212221424984 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212221424984 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212221424984 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:14:28.329744 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1359): Terminating (SIGTERM) 22:14:28.371927 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1362): Terminating (SIGTERM) 22:14:28.414500 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1365): Terminating (SIGTERM) 22:14:28.457309 --- ParallelTerminationStrategy: PID 1359 died... 22:14:28.477475 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1359): Terminated: ok {rc=0} 22:14:28.524615 --- ParallelTerminationStrategy: PID 1362 died... 22:14:28.544420 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1362): Terminated: ok {rc=0} 22:14:28.591139 --- ParallelTerminationStrategy: PID 1365 died... 22:14:28.610743 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1365): Terminated: ok {rc=0} 22:14:28.698231 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:sysmo+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 22:14:29.786606 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:14:29.798683 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:14:29.859104 tst ping_idle_ping.py: using LAC 31854 22:14:29.980474 tst ping_idle_ping.py: using RAC 234 22:14:30.109621 tst ping_idle_ping.py: using CellId 31854 22:14:30.230493 tst ping_idle_ping.py: using BVCI 31855 22:14:30.343266 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:14:30.354602 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:14:30.365432 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:14:30.376616 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:14:30.387863 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:14:30.399071 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:14:30.410426 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:14:30.421665 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:14:30.542126 tst ping_idle_ping.py:24: start network... 22:14:30.763228 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:14:31.299347 run create_hlr_db(pid=1367): Launched 22:14:31.463767 bus /gobi_6: Setting Powered False 22:14:32.527870 run create_hlr_db(pid=1367): Terminated: ok {rc=0} 22:14:32.983953 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1369): Launched 22:14:33.310328 run osmo-hlr_10.42.42.2(pid=1370): Launched 22:14:33.435957 run osmo-stp_10.42.42.5: Starting osmo-stp 22:14:33.997724 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1372): Launched 22:14:34.323742 run osmo-stp_10.42.42.5(pid=1373): Launched 22:14:34.455301 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:14:35.019335 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1376): Launched 22:14:35.144877 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:14:35.421343 run patchelf(pid=1377): Launched 22:14:35.605021 run osmo-stp_10.42.42.5(pid=1373): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1373)] 22:14:35.744312 run osmo-stp_10.42.42.5(pid=1373): stdout: | (launched: 2022-12-12_22:14:34.264134) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:14:35.884670 run osmo-stp_10.42.42.5(pid=1373): stderr: | [0;m[38;5;43m20221212221434463 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221434463 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221434463 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221434464 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221434464 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221434464 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221434464 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:14:36.025207 run osmo-stp_10.42.42.5(pid=1373): stdout: | (launched: 2022-12-12_22:14:34.264134) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:14:36.159750 run osmo-stp_10.42.42.5(pid=1373): stderr: | [0;m[38;5;43m20221212221434463 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221434463 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221434463 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221434464 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221434464 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221434464 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221434464 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:14:36.319175 run patchelf(pid=1377): Terminating (SIGINT) 22:14:36.505298 run patchelf(pid=1377): Terminated: ok {rc=0} 22:14:36.638897 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=1373): Process ended prematurely: osmo-stp_10.42.42.5(pid=1373) [trial-2383↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1373)] [trial-2383↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 22:14:36.648930 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 22:14:36.677186 run osmo-hlr_10.42.42.2(pid=1370): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1370)] 22:14:36.727627 run osmo-hlr_10.42.42.2(pid=1370): stdout: | (launched: 2022-12-12_22:14:33.251031) 22:14:36.779564 run osmo-hlr_10.42.42.2(pid=1370): stderr: | [0;m[1;31m20221212221433449 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212221433449 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212221433449 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212221433449 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212221433449 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212221433449 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212221433460 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:sysmo+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212221433469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212221433469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212221433469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:14:36.832100 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1369): Terminating (SIGTERM) 22:14:36.874368 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1372): Terminating (SIGTERM) 22:14:36.916736 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1376): Terminating (SIGTERM) 22:14:36.959602 --- ParallelTerminationStrategy: PID 1369 died... 22:14:36.979716 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1369): Terminated: ok {rc=0} 22:14:37.026708 --- ParallelTerminationStrategy: PID 1372 died... 22:14:37.046372 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1372): Terminated: ok {rc=0} 22:14:37.093671 --- ParallelTerminationStrategy: PID 1376 died... 22:14:37.113410 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1376): Terminated: ok {rc=0} 22:14:37.201629 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2383 gprs:sysmo+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 gprs:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 22:14:38.493263 tst gprs:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:14:38.499990 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 22:14:38.521252 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 22:14:38.561953 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 22:14:38.650901 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 22:14:38.672498 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 22:14:38.711968 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 22:14:39.301590 tst gprs:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2383 gprs:sysmo+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 22:14:39.352807 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:14:39.363634 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:14:39.421374 tst cs_paging_gprs_active.py: using LAC 31855 22:14:39.545772 tst cs_paging_gprs_active.py: using RAC 235 22:14:39.670182 tst cs_paging_gprs_active.py: using CellId 31855 22:14:39.794280 tst cs_paging_gprs_active.py: using BVCI 31856 22:14:39.909572 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:14:39.920299 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:14:39.931083 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:14:39.942289 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:14:39.953540 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:14:39.964208 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:14:39.974934 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:14:39.985441 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:14:39.996104 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:14:40.117371 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:14:40.241098 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:14:40.466487 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:14:40.800248 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1381): Launched 22:14:41.089281 run iperf3-srv_10.42.42.10(pid=1382): Launched 22:14:41.214437 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:14:41.438820 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:14:41.772937 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1383): Launched 22:14:42.062244 run iperf3-srv_10.42.42.10(pid=1384): Launched 22:14:42.186843 tst cs_paging_gprs_active.py:38: start network... 22:14:42.410628 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:14:42.929641 run create_hlr_db(pid=1395): Launched 22:14:43.058592 bus /gobi_6: Setting Powered False 22:14:44.123667 run create_hlr_db(pid=1395): Terminated: ok {rc=0} 22:14:44.565509 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1397): Launched 22:14:44.878692 run osmo-hlr_10.42.42.2(pid=1398): Launched 22:14:45.006763 run osmo-stp_10.42.42.5: Starting osmo-stp 22:14:45.577641 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1400): Launched 22:14:45.923225 run osmo-stp_10.42.42.5(pid=1401): Launched 22:14:46.261321 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:14:46.866575 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1403): Launched 22:14:47.006904 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:14:47.294848 run patchelf(pid=1404): Launched 22:14:47.479883 run osmo-stp_10.42.42.5(pid=1401): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1401)] 22:14:47.620913 run osmo-stp_10.42.42.5(pid=1401): stdout: | (launched: 2022-12-12_22:14:45.851438) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:14:47.763315 run osmo-stp_10.42.42.5(pid=1401): stderr: | [0;m[38;5;43m20221212221446115 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221446115 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221446116 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221446116 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221446117 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221446117 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221446117 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:14:47.905284 run osmo-stp_10.42.42.5(pid=1401): stdout: | (launched: 2022-12-12_22:14:45.851438) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:14:48.041709 run osmo-stp_10.42.42.5(pid=1401): stderr: | [0;m[38;5;43m20221212221446115 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221446115 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221446116 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221446116 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221446117 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221446117 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221446117 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:14:48.203016 run patchelf(pid=1404): Terminating (SIGINT) 22:14:48.390411 run patchelf(pid=1404): Terminated: ok {rc=0} 22:14:48.525707 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=1401): Process ended prematurely: osmo-stp_10.42.42.5(pid=1401) [trial-2383↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1401)] [trial-2383↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 22:14:48.535946 tst cs_paging_gprs_active.py:38: Test FAILED (9.2 sec) 22:14:48.565538 run osmo-hlr_10.42.42.2(pid=1398): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1398)] 22:14:48.616085 run osmo-hlr_10.42.42.2(pid=1398): stdout: | (launched: 2022-12-12_22:14:44.820744) 22:14:48.668550 run osmo-hlr_10.42.42.2(pid=1398): stderr: | [0;m[1;31m20221212221445015 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212221445015 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212221445015 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212221445015 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212221445015 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212221445015 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212221445028 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:sysmo+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212221445037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212221445037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212221445037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:14:48.721555 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1381): Terminating (SIGTERM) 22:14:48.763905 run iperf3-srv_10.42.42.10(pid=1382): Terminating (SIGTERM) 22:14:48.806470 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1383): Terminating (SIGTERM) 22:14:48.848907 run iperf3-srv_10.42.42.10(pid=1384): Terminating (SIGTERM) 22:14:48.891320 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1397): Terminating (SIGTERM) 22:14:48.933792 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1400): Terminating (SIGTERM) 22:14:48.976065 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1403): Terminating (SIGTERM) 22:14:49.018677 --- ParallelTerminationStrategy: PID 1381 died... 22:14:49.038561 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1381): Terminated: ok {rc=0} 22:14:49.085583 --- ParallelTerminationStrategy: PID 1382 died... 22:14:49.105178 run iperf3-srv_10.42.42.10(pid=1382): Terminated {rc=256} 22:14:49.151871 --- ParallelTerminationStrategy: PID 1383 died... 22:14:49.171431 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1383): Terminated: ok {rc=0} 22:14:49.218651 --- ParallelTerminationStrategy: PID 1384 died... 22:14:49.238118 run iperf3-srv_10.42.42.10(pid=1384): Terminated {rc=256} 22:14:49.284749 --- ParallelTerminationStrategy: PID 1397 died... 22:14:49.304396 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1397): Terminated: ok {rc=0} 22:14:49.351159 --- ParallelTerminationStrategy: PID 1400 died... 22:14:49.370799 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1400): Terminated: ok {rc=0} 22:14:49.417595 --- ParallelTerminationStrategy: PID 1403 died... 22:14:49.437228 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1403): Terminated: ok {rc=0} 22:14:49.526590 bus /gobi_0: Setting Powered False 22:14:50.626650 bus /gobi_0: Setting Powered False 22:14:51.742412 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:sysmo+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 22:14:52.893294 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:14:52.905334 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:14:52.966289 tst iperf3.py: using LAC 31856 22:14:53.098131 tst iperf3.py: using RAC 236 22:14:53.230123 tst iperf3.py: using CellId 31856 22:14:53.361872 tst iperf3.py: using BVCI 31857 22:14:53.482716 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:14:53.494095 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:14:53.505582 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:14:53.517033 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:14:53.528365 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:14:53.539753 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:14:53.551366 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:14:53.562697 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:14:53.574193 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:14:53.694572 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:14:53.919297 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:14:54.253068 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1405): Launched 22:14:54.543129 run iperf3-srv_10.42.42.10(pid=1406): Launched 22:14:54.668400 tst iperf3.py:8: start network... 22:14:54.892596 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:14:55.406740 run create_hlr_db(pid=1407): Launched 22:14:55.532473 bus /gobi_6: Setting Powered False 22:14:56.597734 run create_hlr_db(pid=1407): Terminated: ok {rc=0} 22:14:57.038757 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1409): Launched 22:14:57.348628 run osmo-hlr_10.42.42.2(pid=1410): Launched 22:14:57.467834 run osmo-stp_10.42.42.5: Starting osmo-stp 22:14:58.005925 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1412): Launched 22:14:58.317126 run osmo-stp_10.42.42.5(pid=1413): Launched 22:14:58.436026 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:14:58.971984 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1415): Launched 22:14:59.091765 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:14:59.354960 run patchelf(pid=1416): Launched 22:14:59.528223 run osmo-stp_10.42.42.5(pid=1413): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1413)] 22:14:59.659327 run osmo-stp_10.42.42.5(pid=1413): stdout: | (launched: 2022-12-12_22:14:58.259722) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:14:59.792292 run osmo-stp_10.42.42.5(pid=1413): stderr: | [0;m[38;5;43m20221212221458431 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221458431 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221458431 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221458432 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221458432 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221458432 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221458432 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:14:59.925424 run osmo-stp_10.42.42.5(pid=1413): stdout: | (launched: 2022-12-12_22:14:58.259722) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:15:00.052740 run osmo-stp_10.42.42.5(pid=1413): stderr: | [0;m[38;5;43m20221212221458431 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221458431 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221458431 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221458432 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221458432 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221458432 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221458432 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:15:00.203501 run patchelf(pid=1416): Terminating (SIGINT) 22:15:00.378859 run patchelf(pid=1416): Terminated: ok {rc=0} 22:15:00.505161 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1413): Process ended prematurely: osmo-stp_10.42.42.5(pid=1413) [trial-2383↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1413)] [trial-2383↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8] 22:15:00.514592 tst iperf3.py:8: Test FAILED (7.7 sec) 22:15:00.541613 run osmo-hlr_10.42.42.2(pid=1410): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1410)] 22:15:00.589129 run osmo-hlr_10.42.42.2(pid=1410): stdout: | (launched: 2022-12-12_22:14:57.291803) 22:15:00.638454 run osmo-hlr_10.42.42.2(pid=1410): stderr: | [0;m[1;31m20221212221457467 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212221457467 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212221457467 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212221457467 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212221457467 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212221457467 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212221457479 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:sysmo+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212221457487 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212221457487 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212221457488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:15:00.688197 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1405): Terminating (SIGTERM) 22:15:00.727908 run iperf3-srv_10.42.42.10(pid=1406): Terminating (SIGTERM) 22:15:00.767765 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1409): Terminating (SIGTERM) 22:15:00.807586 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1412): Terminating (SIGTERM) 22:15:00.872706 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1415): Terminating (SIGTERM) 22:15:00.929113 --- ParallelTerminationStrategy: PID 1405 died... 22:15:00.948692 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1405): Terminated: ok {rc=0} 22:15:00.995769 --- ParallelTerminationStrategy: PID 1406 died... 22:15:01.017145 run iperf3-srv_10.42.42.10(pid=1406): Terminated {rc=256} 22:15:01.066415 --- ParallelTerminationStrategy: PID 1409 died... 22:15:01.088194 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1409): Terminated: ok {rc=0} 22:15:01.138477 --- ParallelTerminationStrategy: PID 1412 died... 22:15:01.158939 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1412): Terminated: ok {rc=0} 22:15:01.209172 --- ParallelTerminationStrategy: PID 1415 died... 22:15:01.230098 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1415): Terminated: ok {rc=0} 22:15:01.323923 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:sysmo+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 22:15:02.484387 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:15:02.496325 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:15:02.554963 tst iperf3m4.py: using LAC 31857 22:15:02.687815 tst iperf3m4.py: using RAC 237 22:15:02.818558 tst iperf3m4.py: using CellId 31857 22:15:02.949360 tst iperf3m4.py: using BVCI 31858 22:15:03.070382 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:15:03.081863 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:15:03.092911 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:15:03.104540 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:15:03.116084 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:15:03.127597 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:15:03.139165 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:15:03.150586 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:15:03.162337 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:15:03.280387 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:15:03.403819 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:15:03.523372 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:15:03.645666 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:15:03.869616 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:15:04.202653 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1420): Launched 22:15:04.492095 run iperf3-srv_10.42.42.10(pid=1421): Launched 22:15:04.617260 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:15:04.840938 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:15:05.174284 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1422): Launched 22:15:05.463237 run iperf3-srv_10.42.42.10(pid=1423): Launched 22:15:05.588874 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:15:05.812454 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:15:06.145990 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1424): Launched 22:15:06.434758 run iperf3-srv_10.42.42.10(pid=1425): Launched 22:15:06.560245 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:15:06.784769 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:15:07.119259 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1426): Launched 22:15:07.407473 run iperf3-srv_10.42.42.10(pid=1427): Launched 22:15:07.532366 tst iperf3m4.py:8: start network... 22:15:07.755597 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:15:08.269131 run create_hlr_db(pid=1428): Launched 22:15:08.395899 bus /gobi_6: Setting Powered False 22:15:09.461315 run create_hlr_db(pid=1428): Terminated: ok {rc=0} 22:15:09.902824 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1430): Launched 22:15:10.214342 run osmo-hlr_10.42.42.2(pid=1431): Launched 22:15:10.333455 run osmo-stp_10.42.42.5: Starting osmo-stp 22:15:10.873640 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1433): Launched 22:15:11.186271 run osmo-stp_10.42.42.5(pid=1434): Launched 22:15:11.305252 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:15:11.841323 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1436): Launched 22:15:11.960860 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:15:12.226297 run patchelf(pid=1437): Launched 22:15:12.399187 run osmo-stp_10.42.42.5(pid=1434): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1434)] 22:15:12.530667 run osmo-stp_10.42.42.5(pid=1434): stdout: | (launched: 2022-12-12_22:15:11.128601) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:15:12.663298 run osmo-stp_10.42.42.5(pid=1434): stderr: | [0;m[38;5;43m20221212221511300 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221511301 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221511301 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221511301 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221511302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221511302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221511302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:15:12.795788 run osmo-stp_10.42.42.5(pid=1434): stdout: | (launched: 2022-12-12_22:15:11.128601) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:15:12.923293 run osmo-stp_10.42.42.5(pid=1434): stderr: | [0;m[38;5;43m20221212221511300 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221511301 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221511301 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221511301 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221511302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221511302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221511302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:15:13.073871 run patchelf(pid=1437): Terminating (SIGINT) 22:15:13.249675 run patchelf(pid=1437): Terminated: ok {rc=0} 22:15:13.375686 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1434): Process ended prematurely: osmo-stp_10.42.42.5(pid=1434) [trial-2383↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1434)] [trial-2383↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8] 22:15:13.385277 tst iperf3m4.py:8: Test FAILED (10.9 sec) 22:15:13.412559 run osmo-hlr_10.42.42.2(pid=1431): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1431)] 22:15:13.459957 run osmo-hlr_10.42.42.2(pid=1431): stdout: | (launched: 2022-12-12_22:15:10.156891) 22:15:13.509210 run osmo-hlr_10.42.42.2(pid=1431): stderr: | [0;m[1;31m20221212221510334 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212221510334 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212221510334 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212221510334 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212221510334 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212221510334 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212221510345 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:sysmo+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212221510353 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212221510353 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212221510353 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:15:13.558762 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1420): Terminating (SIGTERM) 22:15:13.598524 run iperf3-srv_10.42.42.10(pid=1421): Terminating (SIGTERM) 22:15:13.638170 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1422): Terminating (SIGTERM) 22:15:13.677956 run iperf3-srv_10.42.42.10(pid=1423): Terminating (SIGTERM) 22:15:13.717513 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1424): Terminating (SIGTERM) 22:15:13.757088 run iperf3-srv_10.42.42.10(pid=1425): Terminating (SIGTERM) 22:15:13.796254 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1426): Terminating (SIGTERM) 22:15:13.835655 run iperf3-srv_10.42.42.10(pid=1427): Terminating (SIGTERM) 22:15:13.875019 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1430): Terminating (SIGTERM) 22:15:13.914505 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1433): Terminating (SIGTERM) 22:15:13.953872 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1436): Terminating (SIGTERM) 22:15:13.993510 --- ParallelTerminationStrategy: PID 1420 died... 22:15:14.012558 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1420): Terminated: ok {rc=0} 22:15:14.057378 --- ParallelTerminationStrategy: PID 1421 died... 22:15:14.075952 run iperf3-srv_10.42.42.10(pid=1421): Terminated {rc=256} 22:15:14.119531 --- ParallelTerminationStrategy: PID 1422 died... 22:15:14.138111 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1422): Terminated: ok {rc=0} 22:15:14.181694 --- ParallelTerminationStrategy: PID 1423 died... 22:15:14.200082 run iperf3-srv_10.42.42.10(pid=1423): Terminated {rc=256} 22:15:14.243517 --- ParallelTerminationStrategy: PID 1424 died... 22:15:14.261982 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1424): Terminated: ok {rc=0} 22:15:14.305368 --- ParallelTerminationStrategy: PID 1425 died... 22:15:14.323767 run iperf3-srv_10.42.42.10(pid=1425): Terminated {rc=256} 22:15:14.367199 --- ParallelTerminationStrategy: PID 1426 died... 22:15:14.385740 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1426): Terminated: ok {rc=0} 22:15:14.429071 --- ParallelTerminationStrategy: PID 1427 died... 22:15:14.447524 run iperf3-srv_10.42.42.10(pid=1427): Terminated {rc=256} 22:15:14.491177 --- ParallelTerminationStrategy: PID 1430 died... 22:15:14.509831 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1430): Terminated: ok {rc=0} 22:15:14.553211 --- ParallelTerminationStrategy: PID 1433 died... 22:15:14.571619 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1433): Terminated: ok {rc=0} 22:15:14.615137 --- ParallelTerminationStrategy: PID 1436 died... 22:15:14.633578 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1436): Terminated: ok {rc=0} 22:15:14.716909 bus /gobi_4: Setting Powered False 22:15:15.814320 bus /gobi_4: Setting Powered False 22:15:16.957321 bus /gobi_1: Setting Powered False 22:15:18.070991 bus /gobi_1: Setting Powered False 22:15:19.186282 bus /gobi_0: Setting Powered False 22:15:20.284857 bus /gobi_0: Setting Powered False 22:15:21.399862 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:sysmo+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 22:15:22.502010 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:15:22.514046 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:15:22.574233 tst ping.py: using LAC 31858 22:15:22.703054 tst ping.py: using RAC 238 22:15:22.832032 tst ping.py: using CellId 31858 22:15:22.959488 tst ping.py: using BVCI 31859 22:15:23.078050 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:15:23.089579 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:15:23.100619 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:15:23.112201 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:15:23.123524 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:15:23.134849 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:15:23.146561 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:15:23.158000 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:15:23.279590 tst ping.py:19: start network... 22:15:23.499326 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:15:24.002965 run create_hlr_db(pid=1438): Launched 22:15:24.127284 bus /gobi_6: Setting Powered False 22:15:25.191061 run create_hlr_db(pid=1438): Terminated: ok {rc=0} 22:15:25.626922 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1440): Launched 22:15:25.931079 run osmo-hlr_10.42.42.2(pid=1441): Launched 22:15:26.046922 run osmo-stp_10.42.42.5: Starting osmo-stp 22:15:26.575016 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1443): Launched 22:15:26.878251 run osmo-stp_10.42.42.5(pid=1444): Launched 22:15:26.993626 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:15:27.517519 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1446): Launched 22:15:27.634470 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:15:27.893281 run patchelf(pid=1447): Launched 22:15:28.062454 run osmo-stp_10.42.42.5(pid=1444): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1444)] 22:15:28.192035 run osmo-stp_10.42.42.5(pid=1444): stdout: | (launched: 2022-12-12_22:15:26.822237) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:15:28.322407 run osmo-stp_10.42.42.5(pid=1444): stderr: | [0;m[38;5;43m20221212221526993 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221526993 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221526993 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221526994 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221526994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221526994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221526994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:15:28.452704 run osmo-stp_10.42.42.5(pid=1444): stdout: | (launched: 2022-12-12_22:15:26.822237) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:15:28.576868 run osmo-stp_10.42.42.5(pid=1444): stderr: | [0;m[38;5;43m20221212221526993 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221526993 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221526993 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221526994 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221526994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221526994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221526994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:15:28.724728 run patchelf(pid=1447): Terminating (SIGINT) 22:15:28.896546 run patchelf(pid=1447): Terminated: ok {rc=0} 22:15:29.020276 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=1444): Process ended prematurely: osmo-stp_10.42.42.5(pid=1444) [trial-2383↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1444)] [trial-2383↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22] 22:15:29.029220 tst ping.py:22: Test FAILED (6.5 sec) 22:15:29.055535 run osmo-hlr_10.42.42.2(pid=1441): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1441)] 22:15:29.108160 run osmo-hlr_10.42.42.2(pid=1441): stdout: | (launched: 2022-12-12_22:15:25.874995) 22:15:29.160062 run osmo-hlr_10.42.42.2(pid=1441): stderr: | [0;m[1;31m20221212221526051 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212221526051 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212221526052 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212221526052 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212221526052 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212221526052 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212221526063 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:sysmo+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212221526072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212221526072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212221526072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:15:29.212683 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1440): Terminating (SIGTERM) 22:15:29.254779 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1443): Terminating (SIGTERM) 22:15:29.296632 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1446): Terminating (SIGTERM) 22:15:29.338849 --- ParallelTerminationStrategy: PID 1440 died... 22:15:29.359017 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1440): Terminated: ok {rc=0} 22:15:29.405730 --- ParallelTerminationStrategy: PID 1443 died... 22:15:29.425162 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1443): Terminated: ok {rc=0} 22:15:29.471964 --- ParallelTerminationStrategy: PID 1446 died... 22:15:29.491434 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1446): Terminated: ok {rc=0} 22:15:29.580774 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:sysmo+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 22:15:30.667552 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:15:30.679548 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:15:30.738774 tst ping_idle_ping.py: using LAC 31859 22:15:30.869975 tst ping_idle_ping.py: using RAC 239 22:15:31.008055 tst ping_idle_ping.py: using CellId 31859 22:15:31.141789 tst ping_idle_ping.py: using BVCI 31860 22:15:31.306051 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:15:31.321574 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:15:31.338549 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:15:31.355058 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:15:31.371658 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:15:31.387697 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:15:31.403904 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:15:31.420085 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:15:31.552486 tst ping_idle_ping.py:24: start network... 22:15:31.785344 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:15:32.305334 run create_hlr_db(pid=1448): Launched 22:15:32.430026 bus /gobi_6: Setting Powered False 22:15:33.494909 run create_hlr_db(pid=1448): Terminated: ok {rc=0} 22:15:33.960915 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1450): Launched 22:15:34.287679 run osmo-hlr_10.42.42.2(pid=1451): Launched 22:15:34.413156 run osmo-stp_10.42.42.5: Starting osmo-stp 22:15:34.975385 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1453): Launched 22:15:35.302697 run osmo-stp_10.42.42.5(pid=1454): Launched 22:15:35.428131 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:15:35.995201 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1456): Launched 22:15:36.121260 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:15:36.398551 run patchelf(pid=1457): Launched 22:15:36.581459 run osmo-stp_10.42.42.5(pid=1454): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1454)] 22:15:36.720198 run osmo-stp_10.42.42.5(pid=1454): stdout: | (launched: 2022-12-12_22:15:35.243063) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:15:36.860299 run osmo-stp_10.42.42.5(pid=1454): stderr: | [0;m[38;5;43m20221212221535436 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221535436 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221535436 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221535437 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221535437 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221535437 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221535437 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:15:37.000597 run osmo-stp_10.42.42.5(pid=1454): stdout: | (launched: 2022-12-12_22:15:35.243063) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:15:37.134728 run osmo-stp_10.42.42.5(pid=1454): stderr: | [0;m[38;5;43m20221212221535436 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221535436 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221535436 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221535437 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221535437 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221535437 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221535437 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:15:37.293717 run patchelf(pid=1457): Terminating (SIGINT) 22:15:37.478815 run patchelf(pid=1457): Terminated: ok {rc=0} 22:15:37.613059 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=1454): Process ended prematurely: osmo-stp_10.42.42.5(pid=1454) [trial-2383↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1454)] [trial-2383↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 22:15:37.622814 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 22:15:37.651541 run osmo-hlr_10.42.42.2(pid=1451): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1451)] 22:15:37.702368 run osmo-hlr_10.42.42.2(pid=1451): stdout: | (launched: 2022-12-12_22:15:34.228348) 22:15:37.754960 run osmo-hlr_10.42.42.2(pid=1451): stderr: | [0;m[1;31m20221212221534428 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212221534428 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212221534428 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212221534428 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212221534428 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212221534428 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212221534464 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:sysmo+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212221534474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212221534474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212221534474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:15:37.808332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1450): Terminating (SIGTERM) 22:15:37.850749 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1453): Terminating (SIGTERM) 22:15:37.893233 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1456): Terminating (SIGTERM) 22:15:37.935998 --- ParallelTerminationStrategy: PID 1450 died... 22:15:37.956222 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1450): Terminated: ok {rc=0} 22:15:38.003380 --- ParallelTerminationStrategy: PID 1453 died... 22:15:38.023188 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1453): Terminated: ok {rc=0} 22:15:38.070213 --- ParallelTerminationStrategy: PID 1456 died... 22:15:38.089948 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1456): Terminated: ok {rc=0} 22:15:38.178867 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2383 gprs:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 22:15:39.474495 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:15:39.482013 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 22:15:39.504184 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 22:15:39.540303 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 22:15:39.594902 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 22:15:39.616033 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 22:15:39.651741 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 22:15:40.205898 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2383 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 22:15:40.211092 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:15:40.222427 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 22:15:40.285776 tst switch_tch_pdch.py: using LAC 31860 22:15:40.418106 tst switch_tch_pdch.py: using RAC 240 22:15:40.539335 tst switch_tch_pdch.py: using CellId 31860 22:15:40.660116 tst switch_tch_pdch.py: using BVCI 31861 22:15:40.772063 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:15:40.783293 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:15:40.794260 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:15:40.805271 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:15:40.816102 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:15:40.826996 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:15:40.838134 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:15:40.849639 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:15:40.970212 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:15:41.089778 tst switch_tch_pdch.py:51: start network... 22:15:41.310592 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:15:41.815613 run create_hlr_db(pid=1461): Launched 22:15:41.940009 bus /gobi_6: Setting Powered False 22:15:43.003783 run create_hlr_db(pid=1461): Terminated: ok {rc=0} 22:15:43.438914 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1463): Launched 22:15:43.745254 run osmo-hlr_10.42.42.2(pid=1464): Launched 22:15:43.862466 run osmo-stp_10.42.42.5: Starting osmo-stp 22:15:44.387862 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1466): Launched 22:15:44.691995 run osmo-stp_10.42.42.5(pid=1467): Launched 22:15:44.807894 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:15:45.333687 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1469): Launched 22:15:45.450312 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:15:45.708297 run patchelf(pid=1470): Launched 22:15:45.900530 run osmo-stp_10.42.42.5(pid=1467): ERR: Terminated: ERROR {rc=1} [trial-2383↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1467)] 22:15:46.036913 run osmo-stp_10.42.42.5(pid=1467): stdout: | (launched: 2022-12-12_22:15:44.636228) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:15:46.170471 run osmo-stp_10.42.42.5(pid=1467): stderr: | [0;m[38;5;43m20221212221544808 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221544808 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221544808 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221544808 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221544809 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221544809 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221544809 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:15:46.304333 run osmo-stp_10.42.42.5(pid=1467): stdout: | (launched: 2022-12-12_22:15:44.636228) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:15:46.431577 run osmo-stp_10.42.42.5(pid=1467): stderr: | [0;m[38;5;43m20221212221544808 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221544808 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221544808 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221544808 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221544809 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221544809 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221544809 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:15:46.582672 run patchelf(pid=1470): Terminating (SIGINT) 22:15:46.760224 run patchelf(pid=1470): Terminated: ok {rc=0} 22:15:46.887847 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=1467): Process ended prematurely: osmo-stp_10.42.42.5(pid=1467) [trial-2383↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1467)] [trial-2383↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 22:15:46.897342 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 22:15:46.925120 run osmo-hlr_10.42.42.2(pid=1464): ERR: Terminated: ERROR {rc=237} [trial-2383↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1464)] 22:15:46.973883 run osmo-hlr_10.42.42.2(pid=1464): stdout: | (launched: 2022-12-12_22:15:43.688913) 22:15:47.024084 run osmo-hlr_10.42.42.2(pid=1464): stderr: | [0;m[1;31m20221212221543866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212221543866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212221543866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212221543866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212221543866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212221543867 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212221543879 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212221543890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212221543890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212221543890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:15:47.075169 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1463): Terminating (SIGTERM) 22:15:47.115953 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1466): Terminating (SIGTERM) 22:15:47.156333 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1469): Terminating (SIGTERM) 22:15:47.197079 --- ParallelTerminationStrategy: PID 1463 died... 22:15:47.216362 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1463): Terminated: ok {rc=0} 22:15:47.260843 --- ParallelTerminationStrategy: PID 1466 died... 22:15:47.279654 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1466): Terminated: ok {rc=0} 22:15:47.323479 --- ParallelTerminationStrategy: PID 1469 died... 22:15:47.342412 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1469): Terminated: ok {rc=0} 22:15:47.428463 bus /gobi_0: Setting Powered False 22:15:48.527316 bus /gobi_0: Setting Powered False 22:15:49.643597 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2383 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 dynts:sysmo+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 22:15:50.882179 tst dynts:sysmo+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:15:50.888211 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 22:15:50.909034 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 22:15:50.943245 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 22:15:50.995415 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 22:15:51.015930 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 22:15:51.049821 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 22:15:51.604883 tst dynts:sysmo+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2383 dynts:sysmo+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 22:15:51.609876 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:15:51.620648 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 22:15:51.676811 tst switch_tch_pdch.py: using LAC 31861 22:15:51.796717 tst switch_tch_pdch.py: using RAC 241 22:15:51.919662 tst switch_tch_pdch.py: using CellId 31861 22:15:52.037819 tst switch_tch_pdch.py: using BVCI 31862 22:15:52.147732 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:15:52.158708 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:15:52.169443 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:15:52.180188 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:15:52.190874 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:15:52.201584 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:15:52.212477 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:15:52.223243 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 22:15:52.342788 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 22:15:52.459195 tst switch_tch_pdch.py:51: start network... 22:15:52.663681 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:15:53.108774 run create_hlr_db(pid=1474): Launched 22:15:53.232482 bus /gobi_6: Setting Powered False 22:15:54.293686 run create_hlr_db(pid=1474): Terminated: ok {rc=0} 22:15:54.710874 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1476): Launched 22:15:55.037284 run osmo-hlr_10.42.42.2(pid=1477): Launched 22:15:55.162478 run osmo-stp_10.42.42.5: Starting osmo-stp 22:15:55.696370 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1479): Launched 22:15:56.022028 run osmo-stp_10.42.42.5(pid=1480): Launched 22:15:56.145875 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:15:56.681338 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1482): Launched 22:15:56.798015 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:15:57.054811 run patchelf(pid=1483): Launched 22:15:57.224018 run osmo-stp_10.42.42.5(pid=1480): ERR: Terminated: ERROR {rc=1} [trial-2383↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1480)] 22:15:57.352884 run osmo-stp_10.42.42.5(pid=1480): stdout: | (launched: 2022-12-12_22:15:55.962483) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:15:57.483742 run osmo-stp_10.42.42.5(pid=1480): stderr: | [0;m[38;5;43m20221212221556154 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221556154 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221556154 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221556155 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221556157 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221556157 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221556157 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:15:57.614500 run osmo-stp_10.42.42.5(pid=1480): stdout: | (launched: 2022-12-12_22:15:55.962483) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:15:57.738774 run osmo-stp_10.42.42.5(pid=1480): stderr: | [0;m[38;5;43m20221212221556154 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221556154 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221556154 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221556155 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221556157 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221556157 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221556157 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:15:57.886232 run patchelf(pid=1483): Terminating (SIGINT) 22:15:58.058759 run patchelf(pid=1483): Terminated: ok {rc=0} 22:15:58.182867 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=1480): Process ended prematurely: osmo-stp_10.42.42.5(pid=1480) [trial-2383↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1480)] [trial-2383↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 22:15:58.191736 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 22:15:58.218444 run osmo-hlr_10.42.42.2(pid=1477): ERR: Terminated: ERROR {rc=237} [trial-2383↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1477)] 22:15:58.266324 run osmo-hlr_10.42.42.2(pid=1477): stdout: | (launched: 2022-12-12_22:15:54.977600) 22:15:58.315945 run osmo-hlr_10.42.42.2(pid=1477): stderr: | [0;m[1;31m20221212221555178 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212221555178 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212221555178 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212221555178 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212221555178 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212221555178 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212221555191 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/dynts:sysmo+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212221555199 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212221555199 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212221555199 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:15:58.366065 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1476): Terminating (SIGTERM) 22:15:58.406607 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1479): Terminating (SIGTERM) 22:15:58.446632 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1482): Terminating (SIGTERM) 22:15:58.487114 --- ParallelTerminationStrategy: PID 1476 died... 22:15:58.506317 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1476): Terminated: ok {rc=0} 22:15:58.550386 --- ParallelTerminationStrategy: PID 1479 died... 22:15:58.569177 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1479): Terminated: ok {rc=0} 22:15:58.613750 --- ParallelTerminationStrategy: PID 1482 died... 22:15:58.632357 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1482): Terminated: ok {rc=0} 22:15:58.716717 bus /gobi_0: Setting Powered False 22:15:59.814856 bus /gobi_0: Setting Powered False 22:16:00.946974 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2383 dynts:sysmo+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 nitb_sms:oc2g --------------------------------------------------------------------- 22:16:02.210972 tst nitb_sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:16:02.214765 tst nitb_sms:oc2g: Verifying 1 x bts (candidates: 11) 22:16:02.252895 tst nitb_sms:oc2g: Verifying 1 x ip_address (candidates: 9) 22:16:02.260702 tst nitb_sms:oc2g: Verifying 2 x modem (candidates: 12) 22:16:02.315063 tst nitb_sms:oc2g: Reserving 1 x bts (candidates: 11) 22:16:02.335612 tst nitb_sms:oc2g: Reserving 1 x ip_address (candidates: 9) 22:16:02.342696 tst nitb_sms:oc2g: Reserving 2 x modem (candidates: 12) 22:16:02.880571 tst nitb_sms:oc2g: RESERVED RESOURCES for nitb_sms: bts OC-2G ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 nitb_sms:oc2g mo_mt_sms.py ---------------------------------------------- 22:16:02.887374 tst nitb_sms:oc2g: Using 1 x ip_address (candidates: 1) 22:16:02.899201 tst nitb_sms:oc2g: Using 1 x bts (candidates: 1) 22:16:02.937272 tst mo_mt_sms.py: using LAC 31862 22:16:03.065355 tst mo_mt_sms.py: using RAC 242 22:16:03.192641 tst mo_mt_sms.py: using CellId 31862 22:16:03.312701 tst mo_mt_sms.py: using BVCI 31863 22:16:03.423028 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 22:16:03.542116 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 22:16:03.662325 tst mo_mt_sms.py:9: start nitb and bts... 22:16:03.882412 run osmo-nitb_10.42.42.2: Starting osmo-nitb 22:16:04.543966 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1489): Launched 22:16:04.870628 run osmo-nitb_10.42.42.2(pid=1490): Launched 22:16:05.042719 run osmo-nitb_10.42.42.2(pid=1490): ERR: Terminated: ERROR {rc=2} [trial-2383↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1490)] 22:16:05.180045 run osmo-nitb_10.42.42.2(pid=1490): stdout: | (launched: 2022-12-12_22:16:04.810952) 22:16:05.318741 run osmo-nitb_10.42.42.2(pid=1490): stderr: | (launched: 2022-12-12_22:16:04.859310) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:16:05.457158 run osmo-nitb_10.42.42.2(pid=1490): stdout: | (launched: 2022-12-12_22:16:04.810952) 22:16:05.590211 run osmo-nitb_10.42.42.2(pid=1490): stderr: | (launched: 2022-12-12_22:16:04.859310) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fa469b2b268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=1490): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1490) [trial-2383↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1490)] 22:16:05.989134 tst osmo-nitb_10.42.42.2(pid=1490): stdout: | (launched: 2022-12-12_22:16:04.810952) 22:16:06.111680 tst osmo-nitb_10.42.42.2(pid=1490): stderr: | (launched: 2022-12-12_22:16:04.859310) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:16:06.256082 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=1490): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1490) [trial-2383↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1490)] [trial-2383↪nitb_sms:oc2g↪mo_mt_sms.py:11] 22:16:06.264280 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 22:16:06.270682 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1489): Terminating (SIGTERM) 22:16:06.478893 --- ParallelTerminationStrategy: PID 1489 died... 22:16:06.499346 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1489): Terminated: ok {rc=0} 22:16:06.583838 bus /sierra_3: Setting Powered False 22:16:07.684118 bus /sierra_3: Setting Powered False 22:16:08.804245 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 nitb_sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 sms:oc2g --------------------------------------------------------------------- 22:16:09.983460 tst sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:16:09.987742 tst sms:oc2g: Verifying 1 x bts (candidates: 11) 22:16:10.008045 tst sms:oc2g: Verifying 6 x ip_address (candidates: 9) 22:16:10.034534 tst sms:oc2g: Verifying 2 x modem (candidates: 12) 22:16:10.086873 tst sms:oc2g: Reserving 1 x bts (candidates: 11) 22:16:10.107951 tst sms:oc2g: Reserving 6 x ip_address (candidates: 9) 22:16:10.135617 tst sms:oc2g: Reserving 2 x modem (candidates: 12) 22:16:10.684118 tst sms:oc2g: RESERVED RESOURCES for sms: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 sms:oc2g mo_mt_sms.py ---------------------------------------------- 22:16:10.689231 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 22:16:10.700021 tst sms:oc2g: Using 1 x bts (candidates: 1) 22:16:10.735136 tst mo_mt_sms.py: using LAC 31863 22:16:10.864313 tst mo_mt_sms.py: using RAC 243 22:16:10.991824 tst mo_mt_sms.py: using CellId 31863 22:16:11.117577 tst mo_mt_sms.py: using BVCI 31864 22:16:11.228658 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 22:16:11.239404 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 22:16:11.249983 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 22:16:11.260915 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 22:16:11.271910 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 22:16:11.282910 tst sms:oc2g: Using 1 x modem (candidates: 2) 22:16:11.404189 tst sms:oc2g: Using 1 x modem (candidates: 2) 22:16:11.523435 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:16:11.997549 run create_hlr_db(pid=1494): Launched 22:16:12.122916 bus /sierra_2: Setting Powered False 22:16:13.186567 run create_hlr_db(pid=1494): Terminated: ok {rc=0} 22:16:13.640442 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1496): Launched 22:16:13.966169 run osmo-hlr_10.42.42.2(pid=1497): Launched 22:16:14.089918 run osmo-stp_10.42.42.5: Starting osmo-stp 22:16:14.655361 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1499): Launched 22:16:14.981561 run osmo-stp_10.42.42.5(pid=1500): Launched 22:16:15.107067 run osmo-msc_10.42.42.6: Starting osmo-msc 22:16:15.700289 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1502): Launched 22:16:16.037932 run osmo-msc_10.42.42.6(pid=1503): Launched 22:16:16.304851 run osmo-stp_10.42.42.5(pid=1500): ERR: Terminated: ERROR {rc=1} [trial-2383↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1500)] 22:16:16.655135 run osmo-stp_10.42.42.5(pid=1500): stdout: | (launched: 2022-12-12_22:16:14.921933) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:16:16.978240 run osmo-stp_10.42.42.5(pid=1500): stderr: | [0;m[38;5;43m20221212221615114 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221615114 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221615115 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221615115 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221615115 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221615116 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221615116 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:16:17.170968 run osmo-stp_10.42.42.5(pid=1500): stdout: | (launched: 2022-12-12_22:16:14.921933) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:16:17.304703 run osmo-stp_10.42.42.5(pid=1500): stderr: | [0;m[38;5;43m20221212221615114 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221615114 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221615115 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221615115 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221615115 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221615116 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221615116 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:16:17.464390 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=1500): Process ended prematurely: osmo-stp_10.42.42.5(pid=1500) [trial-2383↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1500)] [trial-2383↪sms:oc2g↪mo_mt_sms.py:16] 22:16:17.474512 tst mo_mt_sms.py:16: Test FAILED (6.8 sec) 22:16:17.505584 run osmo-hlr_10.42.42.2(pid=1497): ERR: Terminated: ERROR {rc=237} [trial-2383↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1497)] 22:16:17.558206 run osmo-hlr_10.42.42.2(pid=1497): stdout: | (launched: 2022-12-12_22:16:13.906847) 22:16:17.610508 run osmo-hlr_10.42.42.2(pid=1497): stderr: | [0;m[1;31m20221212221614105 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212221614105 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212221614105 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212221614105 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212221614105 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212221614105 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212221614117 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/sms:oc2g/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212221614126 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212221614126 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212221614126 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:16:17.683308 run osmo-msc_10.42.42.6(pid=1503): ERR: Terminated: ERROR {rc=2} [trial-2383↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1503)] 22:16:17.733791 run osmo-msc_10.42.42.6(pid=1503): stdout: | (launched: 2022-12-12_22:16:15.973842) 22:16:17.785876 run osmo-msc_10.42.42.6(pid=1503): stderr: | [0;m[38;5;43m20221212221616660 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212221616660 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f606704ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212221616660 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212221616660 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212221616661 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212221616661 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212221616664 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212221616664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212221616664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212221616664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:16:17.838279 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1496): Terminating (SIGTERM) 22:16:17.880420 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1499): Terminating (SIGTERM) 22:16:17.922685 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1502): Terminating (SIGTERM) 22:16:17.965416 --- ParallelTerminationStrategy: PID 1496 died... 22:16:17.985115 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1496): Terminated: ok {rc=0} 22:16:18.031983 --- ParallelTerminationStrategy: PID 1499 died... 22:16:18.051694 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1499): Terminated: ok {rc=0} 22:16:18.098726 --- ParallelTerminationStrategy: PID 1502 died... 22:16:18.118245 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1502): Terminated: ok {rc=0} 22:16:18.207284 bus /sierra_3: Setting Powered False 22:16:19.307771 bus /sierra_3: Setting Powered False 22:16:20.425304 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 nitb_ussd:oc2g --------------------------------------------------------------------- 22:16:21.643085 tst nitb_ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:16:21.647587 tst nitb_ussd:oc2g: Verifying 1 x bts (candidates: 11) 22:16:21.669824 tst nitb_ussd:oc2g: Verifying 1 x ip_address (candidates: 9) 22:16:21.677429 tst nitb_ussd:oc2g: Verifying 1 x modem (candidates: 12) 22:16:21.714379 tst nitb_ussd:oc2g: Reserving 1 x bts (candidates: 11) 22:16:21.735385 tst nitb_ussd:oc2g: Reserving 1 x ip_address (candidates: 9) 22:16:21.742568 tst nitb_ussd:oc2g: Reserving 1 x modem (candidates: 12) 22:16:22.261503 tst nitb_ussd:oc2g: RESERVED RESOURCES for nitb_ussd: bts OC-2G ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2383 nitb_ussd:oc2g assert_extension.py ---------------------------------------------- 22:16:22.266747 tst nitb_ussd:oc2g: Using 1 x ip_address (candidates: 1) 22:16:22.277928 tst nitb_ussd:oc2g: Using 1 x bts (candidates: 1) 22:16:22.318088 tst assert_extension.py: using LAC 31864 22:16:22.446423 tst assert_extension.py: using RAC 244 22:16:22.573027 tst assert_extension.py: using CellId 31864 22:16:22.700189 tst assert_extension.py: using BVCI 31865 22:16:22.820122 tst nitb_ussd:oc2g: Using 1 x modem (candidates: 1) 22:16:22.936942 tst assert_extension.py:10: start nitb and bts... 22:16:23.142157 run osmo-nitb_10.42.42.2: Starting osmo-nitb 22:16:23.761863 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1508): Launched 22:16:24.068846 run osmo-nitb_10.42.42.2(pid=1509): Launched 22:16:24.238457 run osmo-nitb_10.42.42.2(pid=1509): ERR: Terminated: ERROR {rc=2} [trial-2383↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1509)] 22:16:24.375407 run osmo-nitb_10.42.42.2(pid=1509): stdout: | (launched: 2022-12-12_22:16:24.012588) 22:16:24.513708 run osmo-nitb_10.42.42.2(pid=1509): stderr: | (launched: 2022-12-12_22:16:24.058156) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:16:24.652592 run osmo-nitb_10.42.42.2(pid=1509): stdout: | (launched: 2022-12-12_22:16:24.012588) 22:16:24.785089 run osmo-nitb_10.42.42.2(pid=1509): stderr: | (launched: 2022-12-12_22:16:24.058156) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fa469b2b268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=1509): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1509) [trial-2383↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1509)] 22:16:25.184476 tst osmo-nitb_10.42.42.2(pid=1509): stdout: | (launched: 2022-12-12_22:16:24.012588) 22:16:25.307679 tst osmo-nitb_10.42.42.2(pid=1509): stderr: | (launched: 2022-12-12_22:16:24.058156) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:16:25.453291 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=1509): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1509) [trial-2383↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1509)] [trial-2383↪nitb_ussd:oc2g↪assert_extension.py:12] 22:16:25.461803 tst assert_extension.py:12: Test FAILED (3.2 sec) 22:16:25.468552 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1508): Terminating (SIGTERM) 22:16:25.677385 --- ParallelTerminationStrategy: PID 1508 died... 22:16:25.697881 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1508): Terminated: ok {rc=0} 22:16:25.783082 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 nitb_ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 ussd:oc2g --------------------------------------------------------------------- 22:16:26.948860 tst ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:16:26.953297 tst ussd:oc2g: Verifying 1 x bts (candidates: 11) 22:16:26.973995 tst ussd:oc2g: Verifying 6 x ip_address (candidates: 9) 22:16:27.000356 tst ussd:oc2g: Verifying 1 x modem (candidates: 12) 22:16:27.036942 tst ussd:oc2g: Reserving 1 x bts (candidates: 11) 22:16:27.058237 tst ussd:oc2g: Reserving 6 x ip_address (candidates: 9) 22:16:27.086988 tst ussd:oc2g: Reserving 1 x modem (candidates: 12) 22:16:27.609884 tst ussd:oc2g: RESERVED RESOURCES for ussd: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2383 ussd:oc2g assert_extension.py ---------------------------------------------- 22:16:27.615978 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 22:16:27.627101 tst ussd:oc2g: Using 1 x bts (candidates: 1) 22:16:27.661055 tst assert_extension.py: using LAC 31865 22:16:27.781514 tst assert_extension.py: using RAC 245 22:16:27.902496 tst assert_extension.py: using CellId 31865 22:16:28.022625 tst assert_extension.py: using BVCI 31866 22:16:28.133717 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 22:16:28.144120 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 22:16:28.154499 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 22:16:28.164765 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 22:16:28.175120 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 22:16:28.185507 tst ussd:oc2g: Using 1 x modem (candidates: 1) 22:16:28.304520 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:16:28.810737 run create_hlr_db(pid=1513): Launched 22:16:28.935646 bus /sierra_2: Setting Powered False 22:16:29.999352 run create_hlr_db(pid=1513): Terminated: ok {rc=0} 22:16:30.435580 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1515): Launched 22:16:30.742088 run osmo-hlr_10.42.42.2(pid=1516): Launched 22:16:30.908738 run osmo-stp_10.42.42.5: Starting osmo-stp 22:16:31.572530 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1518): Launched 22:16:31.921904 run osmo-stp_10.42.42.5(pid=1519): Launched 22:16:32.112797 run osmo-msc_10.42.42.6: Starting osmo-msc 22:16:32.793655 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1521): Launched 22:16:33.120546 run osmo-msc_10.42.42.6(pid=1522): Launched 22:16:33.302499 run osmo-stp_10.42.42.5(pid=1519): ERR: Terminated: ERROR {rc=1} [trial-2383↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1519)] 22:16:33.441153 run osmo-stp_10.42.42.5(pid=1519): stdout: | (launched: 2022-12-12_22:16:31.858143) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:16:33.579931 run osmo-stp_10.42.42.5(pid=1519): stderr: | [0;m[38;5;43m20221212221632224 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221632224 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221632224 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221632225 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221632225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221632225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221632225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:16:33.717412 run osmo-stp_10.42.42.5(pid=1519): stdout: | (launched: 2022-12-12_22:16:31.858143) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:16:33.847051 run osmo-stp_10.42.42.5(pid=1519): stderr: | [0;m[38;5;43m20221212221632224 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221632224 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221632224 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221632225 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221632225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221632225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221632225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:16:34.002088 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=1519): Process ended prematurely: osmo-stp_10.42.42.5(pid=1519) [trial-2383↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1519)] [trial-2383↪ussd:oc2g↪assert_extension.py:17] 22:16:34.011184 tst assert_extension.py:17: Test FAILED (6.4 sec) 22:16:34.038927 run osmo-hlr_10.42.42.2(pid=1516): ERR: Terminated: ERROR {rc=237} [trial-2383↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1516)] 22:16:34.089568 run osmo-hlr_10.42.42.2(pid=1516): stdout: | (launched: 2022-12-12_22:16:30.686021) 22:16:34.141779 run osmo-hlr_10.42.42.2(pid=1516): stderr: | [0;m[1;31m20221212221630878 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212221630879 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212221630879 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212221630879 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212221630879 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212221630879 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212221630897 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/ussd:oc2g/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212221630914 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212221630914 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212221630914 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:16:34.214380 run osmo-msc_10.42.42.6(pid=1522): ERR: Terminated: ERROR {rc=2} [trial-2383↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1522)] 22:16:34.264836 run osmo-msc_10.42.42.6(pid=1522): stdout: | (launched: 2022-12-12_22:16:33.060409) 22:16:34.316884 run osmo-msc_10.42.42.6(pid=1522): stderr: | [0;m[38;5;43m20221212221633383 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212221633383 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f278cc14c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212221633383 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212221633383 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212221633383 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212221633383 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212221633385 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212221633385 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212221633386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212221633386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:16:34.369371 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1515): Terminating (SIGTERM) 22:16:34.411308 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1518): Terminating (SIGTERM) 22:16:34.453693 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1521): Terminating (SIGTERM) 22:16:34.495914 --- ParallelTerminationStrategy: PID 1515 died... 22:16:34.515914 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1515): Terminated: ok {rc=0} 22:16:34.562776 --- ParallelTerminationStrategy: PID 1518 died... 22:16:34.582294 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1518): Terminated: ok {rc=0} 22:16:34.628651 --- ParallelTerminationStrategy: PID 1521 died... 22:16:34.648222 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1521): Terminated: ok {rc=0} 22:16:34.736039 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 22:16:35.930800 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:16:35.937258 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 22:16:35.958561 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 22:16:35.988733 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 22:16:36.041573 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 22:16:36.062532 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 22:16:36.090267 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 22:16:36.641819 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 22:16:36.695788 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:16:36.707321 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 22:16:36.765222 tst mo_mt_call.py: using LAC 31866 22:16:36.896335 tst mo_mt_call.py: using RAC 246 22:16:37.023148 tst mo_mt_call.py: using CellId 31866 22:16:37.146144 tst mo_mt_call.py: using BVCI 31867 22:16:37.260905 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:16:37.272134 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:16:37.283131 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:16:37.294643 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:16:37.306249 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:16:37.317913 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:16:37.439456 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:16:37.561456 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:16:38.077022 run create_hlr_db(pid=1527): Launched 22:16:38.204405 bus /sierra_2: Setting Powered False 22:16:39.269865 run create_hlr_db(pid=1527): Terminated: ok {rc=0} 22:16:39.713827 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1529): Launched 22:16:40.025346 run osmo-hlr_10.42.42.2(pid=1530): Launched 22:16:40.145293 run osmo-stp_10.42.42.5: Starting osmo-stp 22:16:40.689141 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1532): Launched 22:16:41.000276 run osmo-stp_10.42.42.5(pid=1533): Launched 22:16:41.119983 run osmo-msc_10.42.42.6: Starting osmo-msc 22:16:41.683299 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1535): Launched 22:16:41.994103 run osmo-msc_10.42.42.6(pid=1536): Launched 22:16:42.168349 run osmo-stp_10.42.42.5(pid=1533): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1533)] 22:16:42.299603 run osmo-stp_10.42.42.5(pid=1533): stdout: | (launched: 2022-12-12_22:16:40.943008) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:16:42.430480 run osmo-stp_10.42.42.5(pid=1533): stderr: | [0;m[38;5;43m20221212221641116 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221641116 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221641116 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221641116 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221641117 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221641117 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221641117 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:16:42.559306 run osmo-stp_10.42.42.5(pid=1533): stdout: | (launched: 2022-12-12_22:16:40.943008) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:16:42.681804 run osmo-stp_10.42.42.5(pid=1533): stderr: | [0;m[38;5;43m20221212221641116 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221641116 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221641116 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221641116 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221641117 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221641117 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221641117 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:16:42.829695 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1533): Process ended prematurely: osmo-stp_10.42.42.5(pid=1533) [trial-2383↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1533)] [trial-2383↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 22:16:42.838729 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 22:16:42.865123 run osmo-hlr_10.42.42.2(pid=1530): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1530)] 22:16:42.912689 run osmo-hlr_10.42.42.2(pid=1530): stdout: | (launched: 2022-12-12_22:16:39.968125) 22:16:42.961870 run osmo-hlr_10.42.42.2(pid=1530): stderr: | [0;m[1;31m20221212221640145 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212221640145 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212221640145 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212221640145 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212221640145 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212221640145 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212221640157 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212221640165 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212221640166 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212221640166 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:16:43.030753 run osmo-msc_10.42.42.6(pid=1536): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1536)] 22:16:43.078138 run osmo-msc_10.42.42.6(pid=1536): stdout: | (launched: 2022-12-12_22:16:41.936927) 22:16:43.127025 run osmo-msc_10.42.42.6(pid=1536): stderr: | [0;m[38;5;43m20221212221642211 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212221642211 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0ae888bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212221642211 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212221642212 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212221642212 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212221642212 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212221642214 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212221642214 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212221642214 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212221642214 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:16:43.176310 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1529): Terminating (SIGTERM) 22:16:43.215925 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1532): Terminating (SIGTERM) 22:16:43.255587 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1535): Terminating (SIGTERM) 22:16:43.295558 --- ParallelTerminationStrategy: PID 1529 died... 22:16:43.314848 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1529): Terminated: ok {rc=0} 22:16:43.358821 --- ParallelTerminationStrategy: PID 1532 died... 22:16:43.377458 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1532): Terminated: ok {rc=0} 22:16:43.421258 --- ParallelTerminationStrategy: PID 1535 died... 22:16:43.439554 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1535): Terminated: ok {rc=0} 22:16:43.523169 bus /sierra_3: Setting Powered False 22:16:44.618660 bus /sierra_3: Setting Powered False 22:16:45.731758 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2383 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 22:16:46.907767 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:16:46.920421 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 22:16:46.979202 tst mo_mt_call_osmux.py: using LAC 31867 22:16:47.105907 tst mo_mt_call_osmux.py: using RAC 247 22:16:47.253065 tst mo_mt_call_osmux.py: using CellId 31867 22:16:47.384674 tst mo_mt_call_osmux.py: using BVCI 31868 22:16:47.508598 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:16:47.520263 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:16:47.531749 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:16:47.544054 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:16:47.556272 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:16:47.568671 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:16:47.691795 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:16:47.811430 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:16:48.295085 run create_hlr_db(pid=1538): Launched 22:16:48.422557 bus /sierra_2: Setting Powered False 22:16:49.484477 run create_hlr_db(pid=1538): Terminated: ok {rc=0} 22:16:49.917367 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1540): Launched 22:16:50.229961 run osmo-hlr_10.42.42.2(pid=1541): Launched 22:16:50.348328 run osmo-stp_10.42.42.5: Starting osmo-stp 22:16:50.881631 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1543): Launched 22:16:51.194287 run osmo-stp_10.42.42.5(pid=1544): Launched 22:16:51.313704 run osmo-msc_10.42.42.6: Starting osmo-msc 22:16:51.873672 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1546): Launched 22:16:52.185444 run osmo-msc_10.42.42.6(pid=1547): Launched 22:16:52.360743 run osmo-stp_10.42.42.5(pid=1544): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1544)] 22:16:52.492851 run osmo-stp_10.42.42.5(pid=1544): stdout: | (launched: 2022-12-12_22:16:51.136527) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:16:52.624654 run osmo-stp_10.42.42.5(pid=1544): stderr: | [0;m[38;5;43m20221212221651310 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221651310 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221651311 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221651311 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221651312 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221651312 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221651312 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:16:52.754698 run osmo-stp_10.42.42.5(pid=1544): stdout: | (launched: 2022-12-12_22:16:51.136527) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:16:52.878967 run osmo-stp_10.42.42.5(pid=1544): stderr: | [0;m[38;5;43m20221212221651310 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221651310 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221651311 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221651311 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221651312 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221651312 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221651312 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:16:53.026830 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1544): Process ended prematurely: osmo-stp_10.42.42.5(pid=1544) [trial-2383↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1544)] [trial-2383↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 22:16:53.035919 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 22:16:53.062426 run osmo-hlr_10.42.42.2(pid=1541): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1541)] 22:16:53.110135 run osmo-hlr_10.42.42.2(pid=1541): stdout: | (launched: 2022-12-12_22:16:50.171991) 22:16:53.159437 run osmo-hlr_10.42.42.2(pid=1541): stderr: | [0;m[1;31m20221212221650353 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212221650353 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212221650353 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212221650353 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212221650353 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212221650353 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212221650365 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212221650374 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212221650374 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212221650374 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:16:53.228373 run osmo-msc_10.42.42.6(pid=1547): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1547)] 22:16:53.276098 run osmo-msc_10.42.42.6(pid=1547): stdout: | (launched: 2022-12-12_22:16:52.127942) 22:16:53.325773 run osmo-msc_10.42.42.6(pid=1547): stderr: | [0;m[38;5;43m20221212221652402 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212221652402 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb6390f9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212221652402 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212221652402 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212221652402 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212221652403 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212221652404 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212221652405 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212221652405 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212221652405 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:16:53.375236 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1540): Terminating (SIGTERM) 22:16:53.414569 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1543): Terminating (SIGTERM) 22:16:53.454204 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1546): Terminating (SIGTERM) 22:16:53.494197 --- ParallelTerminationStrategy: PID 1540 died... 22:16:53.513344 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1540): Terminated: ok {rc=0} 22:16:53.557649 --- ParallelTerminationStrategy: PID 1543 died... 22:16:53.576152 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1543): Terminated: ok {rc=0} 22:16:53.620165 --- ParallelTerminationStrategy: PID 1546 died... 22:16:53.638805 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1546): Terminated: ok {rc=0} 22:16:53.724428 bus /sierra_3: Setting Powered False 22:16:54.823667 bus /sierra_3: Setting Powered False 22:16:55.939105 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 22:16:57.171342 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:16:57.178838 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 22:16:57.200565 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 22:16:57.229141 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 22:16:57.279527 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 22:16:57.300931 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 22:16:57.328554 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 22:16:57.880579 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 22:16:57.933995 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:16:57.945382 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 22:16:58.004456 tst mo_mt_call.py: using LAC 31868 22:16:58.134989 tst mo_mt_call.py: using RAC 248 22:16:58.263529 tst mo_mt_call.py: using CellId 31868 22:16:58.394194 tst mo_mt_call.py: using BVCI 31869 22:16:58.518051 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:16:58.529641 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:16:58.540746 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:16:58.552450 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:16:58.564519 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:16:58.576060 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:16:58.695610 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:16:58.813158 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:16:59.330983 run create_hlr_db(pid=1552): Launched 22:16:59.457510 bus /sierra_2: Setting Powered False 22:17:00.522905 run create_hlr_db(pid=1552): Terminated: ok {rc=0} 22:17:00.989946 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1554): Launched 22:17:01.321764 run osmo-hlr_10.42.42.2(pid=1555): Launched 22:17:01.529992 run osmo-stp_10.42.42.5: Starting osmo-stp 22:17:02.277696 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1560): Launched 22:17:02.601637 run osmo-stp_10.42.42.5(pid=1561): Launched 22:17:02.722311 run osmo-msc_10.42.42.6: Starting osmo-msc 22:17:03.323334 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1563): Launched 22:17:03.657618 run osmo-msc_10.42.42.6(pid=1564): Launched 22:17:03.846139 run osmo-stp_10.42.42.5(pid=1561): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1561)] 22:17:03.987463 run osmo-stp_10.42.42.5(pid=1561): stdout: | (launched: 2022-12-12_22:17:02.544099) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:17:04.129374 run osmo-stp_10.42.42.5(pid=1561): stderr: | [0;m[38;5;43m20221212221702719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221702719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221702719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221702720 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221702720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221702720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221702720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:17:04.269474 run osmo-stp_10.42.42.5(pid=1561): stdout: | (launched: 2022-12-12_22:17:02.544099) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:17:04.402429 run osmo-stp_10.42.42.5(pid=1561): stderr: | [0;m[38;5;43m20221212221702719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221702719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221702719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221702720 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221702720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221702720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221702720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:17:04.561917 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1561): Process ended prematurely: osmo-stp_10.42.42.5(pid=1561) [trial-2383↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1561)] [trial-2383↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 22:17:04.571804 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 22:17:04.600529 run osmo-hlr_10.42.42.2(pid=1555): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1555)] 22:17:04.651423 run osmo-hlr_10.42.42.2(pid=1555): stdout: | (launched: 2022-12-12_22:17:01.260619) 22:17:04.704198 run osmo-hlr_10.42.42.2(pid=1555): stderr: | [0;m[1;31m20221212221701621 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212221701621 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212221701621 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212221701621 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212221701621 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212221701628 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212221701664 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212221701686 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212221701687 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212221701687 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:17:04.777324 run osmo-msc_10.42.42.6(pid=1564): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1564)] 22:17:04.828271 run osmo-msc_10.42.42.6(pid=1564): stdout: | (launched: 2022-12-12_22:17:03.596715) 22:17:04.880655 run osmo-msc_10.42.42.6(pid=1564): stderr: | [0;m[38;5;43m20221212221703921 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212221703921 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3a859dcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212221703921 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212221703921 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212221703921 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212221703922 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212221703923 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212221703924 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212221703924 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212221703924 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:17:04.933618 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1554): Terminating (SIGTERM) 22:17:04.975851 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1560): Terminating (SIGTERM) 22:17:05.018096 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1563): Terminating (SIGTERM) 22:17:05.060529 --- ParallelTerminationStrategy: PID 1554 died... 22:17:05.080772 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1554): Terminated: ok {rc=0} 22:17:05.127723 --- ParallelTerminationStrategy: PID 1560 died... 22:17:05.147485 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1560): Terminated: ok {rc=0} 22:17:05.194429 --- ParallelTerminationStrategy: PID 1563 died... 22:17:05.214185 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1563): Terminated: ok {rc=0} 22:17:05.302805 bus /sierra_3: Setting Powered False 22:17:06.402892 bus /sierra_3: Setting Powered False 22:17:07.522334 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2383 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 22:17:08.670106 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:17:08.681866 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 22:17:08.742624 tst mo_mt_call_osmux.py: using LAC 31869 22:17:08.863710 tst mo_mt_call_osmux.py: using RAC 249 22:17:08.987358 tst mo_mt_call_osmux.py: using CellId 31869 22:17:09.108857 tst mo_mt_call_osmux.py: using BVCI 31870 22:17:09.221738 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:17:09.232802 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:17:09.243626 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:17:09.254442 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:17:09.265231 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:17:09.276066 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:17:09.392333 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:17:09.518068 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:17:10.034373 run create_hlr_db(pid=1566): Launched 22:17:10.162259 bus /sierra_2: Setting Powered False 22:17:11.227383 run create_hlr_db(pid=1566): Terminated: ok {rc=0} 22:17:11.670413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1568): Launched 22:17:11.981462 run osmo-hlr_10.42.42.2(pid=1569): Launched 22:17:12.101304 run osmo-stp_10.42.42.5: Starting osmo-stp 22:17:12.640314 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1571): Launched 22:17:12.950771 run osmo-stp_10.42.42.5(pid=1572): Launched 22:17:13.070295 run osmo-msc_10.42.42.6: Starting osmo-msc 22:17:13.629471 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1574): Launched 22:17:13.942387 run osmo-msc_10.42.42.6(pid=1575): Launched 22:17:14.115993 run osmo-stp_10.42.42.5(pid=1572): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1572)] 22:17:14.246838 run osmo-stp_10.42.42.5(pid=1572): stdout: | (launched: 2022-12-12_22:17:12.893403) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:17:14.377966 run osmo-stp_10.42.42.5(pid=1572): stderr: | [0;m[38;5;43m20221212221713066 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221713066 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221713066 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221713067 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221713067 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221713067 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221713067 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:17:14.506317 run osmo-stp_10.42.42.5(pid=1572): stdout: | (launched: 2022-12-12_22:17:12.893403) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:17:14.629168 run osmo-stp_10.42.42.5(pid=1572): stderr: | [0;m[38;5;43m20221212221713066 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221713066 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221713066 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221713067 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221713067 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221713067 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221713067 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:17:14.776186 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1572): Process ended prematurely: osmo-stp_10.42.42.5(pid=1572) [trial-2383↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1572)] [trial-2383↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 22:17:14.785121 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 22:17:14.811625 run osmo-hlr_10.42.42.2(pid=1569): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1569)] 22:17:14.859218 run osmo-hlr_10.42.42.2(pid=1569): stdout: | (launched: 2022-12-12_22:17:11.924098) 22:17:14.908419 run osmo-hlr_10.42.42.2(pid=1569): stderr: | [0;m[1;31m20221212221712102 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212221712102 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212221712102 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212221712102 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212221712102 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212221712102 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212221712134 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212221712144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212221712144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212221712144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:17:14.976937 run osmo-msc_10.42.42.6(pid=1575): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1575)] 22:17:15.025031 run osmo-msc_10.42.42.6(pid=1575): stdout: | (launched: 2022-12-12_22:17:13.885057) 22:17:15.074031 run osmo-msc_10.42.42.6(pid=1575): stderr: | [0;m[38;5;43m20221212221714158 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212221714159 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb10ff4fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212221714159 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212221714159 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212221714159 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212221714159 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212221714161 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212221714161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212221714161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212221714162 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:17:15.123701 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1568): Terminating (SIGTERM) 22:17:15.163311 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1571): Terminating (SIGTERM) 22:17:15.202938 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1574): Terminating (SIGTERM) 22:17:15.242900 --- ParallelTerminationStrategy: PID 1568 died... 22:17:15.262056 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1568): Terminated: ok {rc=0} 22:17:15.306415 --- ParallelTerminationStrategy: PID 1571 died... 22:17:15.324942 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1571): Terminated: ok {rc=0} 22:17:15.368881 --- ParallelTerminationStrategy: PID 1574 died... 22:17:15.387965 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1574): Terminated: ok {rc=0} 22:17:15.472712 bus /sierra_3: Setting Powered False 22:17:16.574087 bus /sierra_3: Setting Powered False 22:17:17.693380 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 22:17:18.929249 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:17:18.936190 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 22:17:18.957691 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 22:17:18.985436 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 22:17:19.037946 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 22:17:19.059130 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 22:17:19.086443 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 22:17:19.637635 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 22:17:19.691052 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:17:19.702507 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 22:17:19.759853 tst mo_mt_call.py: using LAC 31870 22:17:19.891939 tst mo_mt_call.py: using RAC 250 22:17:20.015791 tst mo_mt_call.py: using CellId 31870 22:17:20.138784 tst mo_mt_call.py: using BVCI 31871 22:17:20.254363 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:17:20.265683 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:17:20.276535 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:17:20.287634 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:17:20.299132 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:17:20.310220 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:17:20.430581 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:17:20.552689 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:17:21.068738 run create_hlr_db(pid=1580): Launched 22:17:21.196077 bus /sierra_2: Setting Powered False 22:17:22.261710 run create_hlr_db(pid=1580): Terminated: ok {rc=0} 22:17:22.704659 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1582): Launched 22:17:23.015414 run osmo-hlr_10.42.42.2(pid=1583): Launched 22:17:23.135291 run osmo-stp_10.42.42.5: Starting osmo-stp 22:17:23.683567 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1585): Launched 22:17:23.993144 run osmo-stp_10.42.42.5(pid=1586): Launched 22:17:24.113158 run osmo-msc_10.42.42.6: Starting osmo-msc 22:17:24.673933 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1588): Launched 22:17:24.984206 run osmo-msc_10.42.42.6(pid=1589): Launched 22:17:25.159722 run osmo-stp_10.42.42.5(pid=1586): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1586)] 22:17:25.290993 run osmo-stp_10.42.42.5(pid=1586): stdout: | (launched: 2022-12-12_22:17:23.935903) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:17:25.421905 run osmo-stp_10.42.42.5(pid=1586): stderr: | [0;m[38;5;43m20221212221724108 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221724108 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221724108 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221724109 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221724111 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221724111 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221724111 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:17:25.550961 run osmo-stp_10.42.42.5(pid=1586): stdout: | (launched: 2022-12-12_22:17:23.935903) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:17:25.674048 run osmo-stp_10.42.42.5(pid=1586): stderr: | [0;m[38;5;43m20221212221724108 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221724108 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221724108 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221724109 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221724111 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221724111 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221724111 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:17:25.821292 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1586): Process ended prematurely: osmo-stp_10.42.42.5(pid=1586) [trial-2383↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1586)] [trial-2383↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 22:17:25.830171 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 22:17:25.856605 run osmo-hlr_10.42.42.2(pid=1583): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1583)] 22:17:25.904487 run osmo-hlr_10.42.42.2(pid=1583): stdout: | (launched: 2022-12-12_22:17:22.958328) 22:17:25.954147 run osmo-hlr_10.42.42.2(pid=1583): stderr: | [0;m[1;31m20221212221723135 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212221723135 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212221723135 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212221723135 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212221723135 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212221723135 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212221723145 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212221723154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212221723154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212221723154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:17:26.023642 run osmo-msc_10.42.42.6(pid=1589): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1589)] 22:17:26.071922 run osmo-msc_10.42.42.6(pid=1589): stdout: | (launched: 2022-12-12_22:17:24.926698) 22:17:26.121357 run osmo-msc_10.42.42.6(pid=1589): stderr: | [0;m[38;5;43m20221212221725200 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212221725200 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5cd43e5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212221725200 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212221725201 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212221725201 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212221725201 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212221725203 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212221725203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212221725203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212221725203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:17:26.171119 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1582): Terminating (SIGTERM) 22:17:26.210786 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1585): Terminating (SIGTERM) 22:17:26.250353 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1588): Terminating (SIGTERM) 22:17:26.290222 --- ParallelTerminationStrategy: PID 1582 died... 22:17:26.309392 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1582): Terminated: ok {rc=0} 22:17:26.353446 --- ParallelTerminationStrategy: PID 1585 died... 22:17:26.372147 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1585): Terminated: ok {rc=0} 22:17:26.415958 --- ParallelTerminationStrategy: PID 1588 died... 22:17:26.434523 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1588): Terminated: ok {rc=0} 22:17:26.517614 bus /sierra_3: Setting Powered False 22:17:27.613641 bus /sierra_3: Setting Powered False 22:17:28.729204 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2383 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 22:17:29.877631 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:17:29.889148 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 22:17:29.954899 tst mo_mt_call_osmux.py: using LAC 31871 22:17:30.078697 tst mo_mt_call_osmux.py: using RAC 251 22:17:30.202814 tst mo_mt_call_osmux.py: using CellId 31871 22:17:30.327567 tst mo_mt_call_osmux.py: using BVCI 31872 22:17:30.442563 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:17:30.453651 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:17:30.464540 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:17:30.475440 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:17:30.486265 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:17:30.497129 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:17:30.616083 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:17:30.738604 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:17:31.266780 run create_hlr_db(pid=1591): Launched 22:17:31.431790 bus /sierra_2: Setting Powered False 22:17:32.496401 run create_hlr_db(pid=1591): Terminated: ok {rc=0} 22:17:32.941202 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1593): Launched 22:17:33.252730 run osmo-hlr_10.42.42.2(pid=1594): Launched 22:17:33.371865 run osmo-stp_10.42.42.5: Starting osmo-stp 22:17:33.908156 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1596): Launched 22:17:34.219202 run osmo-stp_10.42.42.5(pid=1597): Launched 22:17:34.339065 run osmo-msc_10.42.42.6: Starting osmo-msc 22:17:34.900816 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1599): Launched 22:17:35.212670 run osmo-msc_10.42.42.6(pid=1600): Launched 22:17:35.387163 run osmo-stp_10.42.42.5(pid=1597): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1597)] 22:17:35.518339 run osmo-stp_10.42.42.5(pid=1597): stdout: | (launched: 2022-12-12_22:17:34.162014) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:17:35.649627 run osmo-stp_10.42.42.5(pid=1597): stderr: | [0;m[38;5;43m20221212221734335 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221734335 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221734336 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221734336 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221734337 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221734337 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221734337 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:17:35.778918 run osmo-stp_10.42.42.5(pid=1597): stdout: | (launched: 2022-12-12_22:17:34.162014) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:17:35.901874 run osmo-stp_10.42.42.5(pid=1597): stderr: | [0;m[38;5;43m20221212221734335 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221734335 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221734336 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221734336 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221734337 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221734337 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221734337 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:17:36.049567 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1597): Process ended prematurely: osmo-stp_10.42.42.5(pid=1597) [trial-2383↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1597)] [trial-2383↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 22:17:36.058619 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 22:17:36.085231 run osmo-hlr_10.42.42.2(pid=1594): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1594)] 22:17:36.133040 run osmo-hlr_10.42.42.2(pid=1594): stdout: | (launched: 2022-12-12_22:17:33.195515) 22:17:36.182311 run osmo-hlr_10.42.42.2(pid=1594): stderr: | [0;m[1;31m20221212221733376 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212221733376 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212221733376 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212221733376 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212221733376 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212221733376 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212221733389 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212221733398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212221733398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212221733398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:17:36.251267 run osmo-msc_10.42.42.6(pid=1600): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1600)] 22:17:36.298890 run osmo-msc_10.42.42.6(pid=1600): stdout: | (launched: 2022-12-12_22:17:35.155012) 22:17:36.348243 run osmo-msc_10.42.42.6(pid=1600): stderr: | [0;m[38;5;43m20221212221735430 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212221735430 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1a2ac2cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212221735430 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212221735430 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212221735431 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212221735431 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212221735432 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212221735433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212221735433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212221735433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:17:36.397702 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1593): Terminating (SIGTERM) 22:17:36.437377 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1596): Terminating (SIGTERM) 22:17:36.476940 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1599): Terminating (SIGTERM) 22:17:36.516891 --- ParallelTerminationStrategy: PID 1593 died... 22:17:36.536027 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1593): Terminated: ok {rc=0} 22:17:36.580006 --- ParallelTerminationStrategy: PID 1596 died... 22:17:36.598775 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1596): Terminated: ok {rc=0} 22:17:36.642783 --- ParallelTerminationStrategy: PID 1599 died... 22:17:36.661319 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1599): Terminated: ok {rc=0} 22:17:36.746695 bus /sierra_3: Setting Powered False 22:17:37.847238 bus /sierra_3: Setting Powered False 22:17:38.962600 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 22:17:40.196679 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:17:40.203149 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 22:17:40.223597 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 22:17:40.250399 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 22:17:40.302504 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 22:17:40.324166 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 22:17:40.350604 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 22:17:40.897633 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 22:17:40.947358 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:17:40.958542 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 22:17:41.019071 tst mo_mt_call.py: using LAC 31872 22:17:41.141142 tst mo_mt_call.py: using RAC 252 22:17:41.262320 tst mo_mt_call.py: using CellId 31872 22:17:41.384879 tst mo_mt_call.py: using BVCI 31873 22:17:41.498180 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:17:41.509212 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:17:41.519919 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:17:41.530750 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:17:41.541523 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:17:41.552285 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 22:17:41.672270 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 22:17:41.792784 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:17:42.274781 run create_hlr_db(pid=1605): Launched 22:17:42.402086 bus /sierra_2: Setting Powered False 22:17:43.463451 run create_hlr_db(pid=1605): Terminated: ok {rc=0} 22:17:43.916867 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1607): Launched 22:17:44.250210 run osmo-hlr_10.42.42.2(pid=1608): Launched 22:17:44.378261 run osmo-stp_10.42.42.5: Starting osmo-stp 22:17:44.956748 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1610): Launched 22:17:45.289697 run osmo-stp_10.42.42.5(pid=1611): Launched 22:17:45.418213 run osmo-msc_10.42.42.6: Starting osmo-msc 22:17:46.048647 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1613): Launched 22:17:46.383575 run osmo-msc_10.42.42.6(pid=1614): Launched 22:17:46.726863 run osmo-stp_10.42.42.5(pid=1611): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1611)] 22:17:47.050647 run osmo-stp_10.42.42.5(pid=1611): stdout: | (launched: 2022-12-12_22:17:45.228396) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:17:47.242084 run osmo-stp_10.42.42.5(pid=1611): stderr: | [0;m[38;5;43m20221212221745423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221745423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221745423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221745424 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221745424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221745424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221745424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:17:47.374366 run osmo-stp_10.42.42.5(pid=1611): stdout: | (launched: 2022-12-12_22:17:45.228396) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:17:47.497543 run osmo-stp_10.42.42.5(pid=1611): stderr: | [0;m[38;5;43m20221212221745423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221745423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221745423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221745424 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221745424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221745424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221745424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:17:47.645449 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1611): Process ended prematurely: osmo-stp_10.42.42.5(pid=1611) [trial-2383↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1611)] [trial-2383↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 22:17:47.654563 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 22:17:47.681345 run osmo-hlr_10.42.42.2(pid=1608): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1608)] 22:17:47.729650 run osmo-hlr_10.42.42.2(pid=1608): stdout: | (launched: 2022-12-12_22:17:44.189669) 22:17:47.779194 run osmo-hlr_10.42.42.2(pid=1608): stderr: | [0;m[1;31m20221212221744389 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212221744390 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212221744390 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212221744390 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212221744390 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212221744390 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212221744404 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212221744414 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212221744414 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212221744414 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:17:47.849021 run osmo-msc_10.42.42.6(pid=1614): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1614)] 22:17:47.896806 run osmo-msc_10.42.42.6(pid=1614): stdout: | (launched: 2022-12-12_22:17:46.321380) 22:17:47.946164 run osmo-msc_10.42.42.6(pid=1614): stderr: | [0;m[38;5;43m20221212221746842 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212221746842 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff098f6ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212221746842 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212221746842 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212221746842 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212221746843 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212221746844 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212221746846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212221746847 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212221746848 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:17:47.995918 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1607): Terminating (SIGTERM) 22:17:48.035637 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1610): Terminating (SIGTERM) 22:17:48.075396 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1613): Terminating (SIGTERM) 22:17:48.116576 --- ParallelTerminationStrategy: PID 1607 died... 22:17:48.135778 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1607): Terminated: ok {rc=0} 22:17:48.179740 --- ParallelTerminationStrategy: PID 1610 died... 22:17:48.198282 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1610): Terminated: ok {rc=0} 22:17:48.242274 --- ParallelTerminationStrategy: PID 1613 died... 22:17:48.260808 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1613): Terminated: ok {rc=0} 22:17:48.344208 bus /sierra_3: Setting Powered False 22:17:49.441943 bus /sierra_3: Setting Powered False 22:17:50.560465 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2383 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 22:17:51.708482 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:17:51.720076 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 22:17:51.777033 tst mo_mt_call_osmux.py: using LAC 31873 22:17:51.900876 tst mo_mt_call_osmux.py: using RAC 253 22:17:52.025486 tst mo_mt_call_osmux.py: using CellId 31873 22:17:52.149564 tst mo_mt_call_osmux.py: using BVCI 31874 22:17:52.263619 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:17:52.274678 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:17:52.285503 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:17:52.296238 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:17:52.307468 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:17:52.318312 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 22:17:52.437072 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 22:17:52.554176 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:17:53.038875 run create_hlr_db(pid=1616): Launched 22:17:53.165587 bus /sierra_2: Setting Powered False 22:17:54.227326 run create_hlr_db(pid=1616): Terminated: ok {rc=0} 22:17:54.681501 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1618): Launched 22:17:55.017338 run osmo-hlr_10.42.42.2(pid=1619): Launched 22:17:55.145475 run osmo-stp_10.42.42.5: Starting osmo-stp 22:17:55.719248 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1621): Launched 22:17:56.050703 run osmo-stp_10.42.42.5(pid=1622): Launched 22:17:56.177341 run osmo-msc_10.42.42.6: Starting osmo-msc 22:17:56.785821 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1624): Launched 22:17:57.119128 run osmo-msc_10.42.42.6(pid=1625): Launched 22:17:57.304790 run osmo-stp_10.42.42.5(pid=1622): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1622)] 22:17:57.444856 run osmo-stp_10.42.42.5(pid=1622): stdout: | (launched: 2022-12-12_22:17:55.989987) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:17:57.587862 run osmo-stp_10.42.42.5(pid=1622): stderr: | [0;m[38;5;43m20221212221756184 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221756184 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221756185 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221756185 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221756185 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221756186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221756186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:17:57.727912 run osmo-stp_10.42.42.5(pid=1622): stdout: | (launched: 2022-12-12_22:17:55.989987) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:17:57.860305 run osmo-stp_10.42.42.5(pid=1622): stderr: | [0;m[38;5;43m20221212221756184 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221756184 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221756185 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221756185 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221756185 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221756186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221756186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:17:58.019306 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1622): Process ended prematurely: osmo-stp_10.42.42.5(pid=1622) [trial-2383↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1622)] [trial-2383↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 22:17:58.028785 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 22:17:58.057389 run osmo-hlr_10.42.42.2(pid=1619): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1619)] 22:17:58.108394 run osmo-hlr_10.42.42.2(pid=1619): stdout: | (launched: 2022-12-12_22:17:54.956056) 22:17:58.161124 run osmo-hlr_10.42.42.2(pid=1619): stderr: | [0;m[1;31m20221212221755156 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212221755156 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212221755156 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212221755157 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212221755157 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212221755157 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212221755169 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212221755178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212221755178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212221755178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:17:58.234151 run osmo-msc_10.42.42.6(pid=1625): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1625)] 22:17:58.284850 run osmo-msc_10.42.42.6(pid=1625): stdout: | (launched: 2022-12-12_22:17:57.058331) 22:17:58.337418 run osmo-msc_10.42.42.6(pid=1625): stderr: | [0;m[38;5;43m20221212221757382 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212221757382 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1f12f45c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212221757382 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212221757383 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212221757383 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212221757383 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212221757384 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212221757385 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212221757385 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212221757385 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:17:58.390439 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1618): Terminating (SIGTERM) 22:17:58.432733 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1621): Terminating (SIGTERM) 22:17:58.474928 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1624): Terminating (SIGTERM) 22:17:58.517403 --- ParallelTerminationStrategy: PID 1618 died... 22:17:58.537680 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1618): Terminated: ok {rc=0} 22:17:58.584933 --- ParallelTerminationStrategy: PID 1621 died... 22:17:58.605091 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1621): Terminated: ok {rc=0} 22:17:58.652101 --- ParallelTerminationStrategy: PID 1624 died... 22:17:58.671800 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1624): Terminated: ok {rc=0} 22:17:58.760271 bus /sierra_3: Setting Powered False 22:17:59.859022 bus /sierra_3: Setting Powered False 22:18:00.986164 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 22:18:02.225946 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:18:02.233926 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 22:18:02.254970 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 22:18:02.281480 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 22:18:02.331636 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 22:18:02.352245 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 22:18:02.378966 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 22:18:02.930196 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 22:18:02.979916 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:18:02.991080 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 22:18:03.045747 tst mo_mt_call.py: using LAC 31874 22:18:03.166734 tst mo_mt_call.py: using RAC 254 22:18:03.290063 tst mo_mt_call.py: using CellId 31874 22:18:03.410454 tst mo_mt_call.py: using BVCI 31875 22:18:03.525596 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:18:03.536573 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:18:03.547373 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:18:03.558245 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:18:03.569049 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:18:03.579857 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:18:03.700771 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:18:03.823054 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:18:04.341308 run create_hlr_db(pid=1630): Launched 22:18:04.469343 bus /sierra_2: Setting Powered False 22:18:05.534469 run create_hlr_db(pid=1630): Terminated: ok {rc=0} 22:18:05.979931 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1632): Launched 22:18:06.291495 run osmo-hlr_10.42.42.2(pid=1633): Launched 22:18:06.410368 run osmo-stp_10.42.42.5: Starting osmo-stp 22:18:06.948211 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1635): Launched 22:18:07.260307 run osmo-stp_10.42.42.5(pid=1636): Launched 22:18:07.379652 run osmo-msc_10.42.42.6: Starting osmo-msc 22:18:07.942895 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1638): Launched 22:18:08.254342 run osmo-msc_10.42.42.6(pid=1639): Launched 22:18:08.429310 run osmo-stp_10.42.42.5(pid=1636): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1636)] 22:18:08.560940 run osmo-stp_10.42.42.5(pid=1636): stdout: | (launched: 2022-12-12_22:18:07.203073) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:18:08.692470 run osmo-stp_10.42.42.5(pid=1636): stderr: | [0;m[38;5;43m20221212221807376 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221807376 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221807377 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221807377 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221807377 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221807378 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221807378 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:18:08.822100 run osmo-stp_10.42.42.5(pid=1636): stdout: | (launched: 2022-12-12_22:18:07.203073) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:18:08.945627 run osmo-stp_10.42.42.5(pid=1636): stderr: | [0;m[38;5;43m20221212221807376 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221807376 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221807377 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221807377 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221807377 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221807378 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221807378 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:18:09.094213 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1636): Process ended prematurely: osmo-stp_10.42.42.5(pid=1636) [trial-2383↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1636)] [trial-2383↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 22:18:09.103016 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 22:18:09.129428 run osmo-hlr_10.42.42.2(pid=1633): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1633)] 22:18:09.176882 run osmo-hlr_10.42.42.2(pid=1633): stdout: | (launched: 2022-12-12_22:18:06.234368) 22:18:09.226038 run osmo-hlr_10.42.42.2(pid=1633): stderr: | [0;m[1;31m20221212221806415 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212221806415 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212221806415 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212221806415 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212221806415 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212221806415 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212221806427 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212221806438 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212221806438 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212221806438 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:18:09.294858 run osmo-msc_10.42.42.6(pid=1639): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1639)] 22:18:09.342252 run osmo-msc_10.42.42.6(pid=1639): stdout: | (launched: 2022-12-12_22:18:08.196820) 22:18:09.391257 run osmo-msc_10.42.42.6(pid=1639): stderr: | [0;m[38;5;43m20221212221808472 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212221808472 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3d9a734c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212221808472 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212221808472 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212221808473 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212221808473 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212221808475 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212221808475 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212221808475 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212221808475 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:18:09.441266 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1632): Terminating (SIGTERM) 22:18:09.480745 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1635): Terminating (SIGTERM) 22:18:09.520200 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1638): Terminating (SIGTERM) 22:18:09.559905 --- ParallelTerminationStrategy: PID 1632 died... 22:18:09.579106 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1632): Terminated: ok {rc=0} 22:18:09.622926 --- ParallelTerminationStrategy: PID 1635 died... 22:18:09.641376 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1635): Terminated: ok {rc=0} 22:18:09.685361 --- ParallelTerminationStrategy: PID 1638 died... 22:18:09.703909 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1638): Terminated: ok {rc=0} 22:18:09.787483 bus /sierra_3: Setting Powered False 22:18:10.883971 bus /sierra_3: Setting Powered False 22:18:11.998166 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2383 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 22:18:13.148784 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:18:13.161316 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 22:18:13.219644 tst mo_mt_call_osmux.py: using LAC 31875 22:18:13.352130 tst mo_mt_call_osmux.py: using RAC 255 22:18:13.482651 tst mo_mt_call_osmux.py: using CellId 31875 22:18:13.615294 tst mo_mt_call_osmux.py: using BVCI 31876 22:18:13.736697 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:18:13.748416 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:18:13.759841 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:18:13.771589 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:18:13.783220 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:18:13.794988 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:18:13.913273 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:18:14.032105 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:18:14.547393 run create_hlr_db(pid=1641): Launched 22:18:14.674136 bus /sierra_2: Setting Powered False 22:18:15.738876 run create_hlr_db(pid=1641): Terminated: ok {rc=0} 22:18:16.209406 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1643): Launched 22:18:16.545621 run osmo-hlr_10.42.42.2(pid=1644): Launched 22:18:16.789095 run osmo-stp_10.42.42.5: Starting osmo-stp 22:18:17.499679 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1646): Launched 22:18:17.810782 run osmo-stp_10.42.42.5(pid=1647): Launched 22:18:17.929927 run osmo-msc_10.42.42.6: Starting osmo-msc 22:18:18.491391 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1649): Launched 22:18:18.802691 run osmo-msc_10.42.42.6(pid=1650): Launched 22:18:18.978733 run osmo-stp_10.42.42.5(pid=1647): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1647)] 22:18:19.109954 run osmo-stp_10.42.42.5(pid=1647): stdout: | (launched: 2022-12-12_22:18:17.753482) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:18:19.241299 run osmo-stp_10.42.42.5(pid=1647): stderr: | [0;m[38;5;43m20221212221817925 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221817925 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221817925 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221817926 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221817928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221817928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221817928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:18:19.371005 run osmo-stp_10.42.42.5(pid=1647): stdout: | (launched: 2022-12-12_22:18:17.753482) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:18:19.494447 run osmo-stp_10.42.42.5(pid=1647): stderr: | [0;m[38;5;43m20221212221817925 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221817925 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221817925 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221817926 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221817928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221817928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221817928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:18:19.642873 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1647): Process ended prematurely: osmo-stp_10.42.42.5(pid=1647) [trial-2383↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1647)] [trial-2383↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 22:18:19.651777 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 22:18:19.678209 run osmo-hlr_10.42.42.2(pid=1644): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1644)] 22:18:19.725885 run osmo-hlr_10.42.42.2(pid=1644): stdout: | (launched: 2022-12-12_22:18:16.482216) 22:18:19.775387 run osmo-hlr_10.42.42.2(pid=1644): stderr: | [0;m[1;31m20221212221816820 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212221816820 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212221816820 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212221816820 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212221816820 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212221816820 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212221816834 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212221816848 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212221816848 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212221816849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:18:19.844348 run osmo-msc_10.42.42.6(pid=1650): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1650)] 22:18:19.892013 run osmo-msc_10.42.42.6(pid=1650): stdout: | (launched: 2022-12-12_22:18:18.745073) 22:18:19.941234 run osmo-msc_10.42.42.6(pid=1650): stderr: | [0;m[38;5;43m20221212221819022 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212221819022 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ffa6797fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212221819022 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212221819022 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212221819022 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212221819022 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212221819024 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212221819024 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212221819025 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212221819025 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:18:19.990964 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1643): Terminating (SIGTERM) 22:18:20.030600 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1646): Terminating (SIGTERM) 22:18:20.070177 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1649): Terminating (SIGTERM) 22:18:20.110095 --- ParallelTerminationStrategy: PID 1643 died... 22:18:20.129125 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1643): Terminated: ok {rc=0} 22:18:20.173263 --- ParallelTerminationStrategy: PID 1646 died... 22:18:20.191831 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1646): Terminated: ok {rc=0} 22:18:20.236232 --- ParallelTerminationStrategy: PID 1649 died... 22:18:20.255162 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1649): Terminated: ok {rc=0} 22:18:20.340393 bus /sierra_3: Setting Powered False 22:18:21.440443 bus /sierra_3: Setting Powered False 22:18:22.555309 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 22:18:23.794996 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:18:23.802382 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 22:18:23.822831 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 22:18:23.849531 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 22:18:23.899580 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 22:18:23.921235 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 22:18:23.948031 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 22:18:24.497784 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 22:18:24.547157 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:18:24.558345 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 22:18:24.614816 tst mo_mt_call.py: using LAC 31876 22:18:24.739284 tst mo_mt_call.py: using RAC 1 22:18:24.863913 tst mo_mt_call.py: using CellId 31876 22:18:24.988199 tst mo_mt_call.py: using BVCI 31877 22:18:25.103456 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:18:25.114557 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:18:25.125391 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:18:25.136209 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:18:25.147007 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:18:25.157881 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:18:25.275990 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:18:25.398528 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:18:25.915284 run create_hlr_db(pid=1657): Launched 22:18:26.043321 bus /sierra_2: Setting Powered False 22:18:27.108705 run create_hlr_db(pid=1657): Terminated: ok {rc=0} 22:18:27.552391 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1659): Launched 22:18:27.864795 run osmo-hlr_10.42.42.2(pid=1660): Launched 22:18:27.984460 run osmo-stp_10.42.42.5: Starting osmo-stp 22:18:28.538313 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1662): Launched 22:18:28.849444 run osmo-stp_10.42.42.5(pid=1663): Launched 22:18:28.969448 run osmo-msc_10.42.42.6: Starting osmo-msc 22:18:29.535747 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1665): Launched 22:18:29.848894 run osmo-msc_10.42.42.6(pid=1666): Launched 22:18:30.024057 run osmo-stp_10.42.42.5(pid=1663): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1663)] 22:18:30.155373 run osmo-stp_10.42.42.5(pid=1663): stdout: | (launched: 2022-12-12_22:18:28.791850) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:18:30.287090 run osmo-stp_10.42.42.5(pid=1663): stderr: | [0;m[38;5;43m20221212221828965 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221828966 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221828966 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221828966 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221828967 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221828967 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221828967 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:18:30.416682 run osmo-stp_10.42.42.5(pid=1663): stdout: | (launched: 2022-12-12_22:18:28.791850) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:18:30.540366 run osmo-stp_10.42.42.5(pid=1663): stderr: | [0;m[38;5;43m20221212221828965 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221828966 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221828966 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221828966 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221828967 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221828967 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221828967 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:18:30.688878 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1663): Process ended prematurely: osmo-stp_10.42.42.5(pid=1663) [trial-2383↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1663)] [trial-2383↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 22:18:30.697977 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 22:18:30.724744 run osmo-hlr_10.42.42.2(pid=1660): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1660)] 22:18:30.772709 run osmo-hlr_10.42.42.2(pid=1660): stdout: | (launched: 2022-12-12_22:18:27.807737) 22:18:30.821947 run osmo-hlr_10.42.42.2(pid=1660): stderr: | [0;m[1;31m20221212221827989 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212221827989 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212221827989 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212221827989 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212221827989 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212221827989 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212221828001 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212221828010 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212221828010 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212221828010 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:18:30.897642 run osmo-msc_10.42.42.6(pid=1666): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1666)] 22:18:30.946407 run osmo-msc_10.42.42.6(pid=1666): stdout: | (launched: 2022-12-12_22:18:29.791290) 22:18:30.996697 run osmo-msc_10.42.42.6(pid=1666): stderr: | [0;m[38;5;43m20221212221830068 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212221830068 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9d5e304c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212221830068 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212221830068 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212221830069 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212221830069 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212221830071 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212221830071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212221830071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212221830071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:18:31.048065 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1659): Terminating (SIGTERM) 22:18:31.088636 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1662): Terminating (SIGTERM) 22:18:31.129398 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1665): Terminating (SIGTERM) 22:18:31.170461 --- ParallelTerminationStrategy: PID 1659 died... 22:18:31.189479 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1659): Terminated: ok {rc=0} 22:18:31.234344 --- ParallelTerminationStrategy: PID 1662 died... 22:18:31.253630 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1662): Terminated: ok {rc=0} 22:18:31.298666 --- ParallelTerminationStrategy: PID 1665 died... 22:18:31.317846 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1665): Terminated: ok {rc=0} 22:18:31.403673 bus /sierra_3: Setting Powered False 22:18:32.499307 bus /sierra_3: Setting Powered False 22:18:33.615215 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2383 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 22:18:34.771108 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:18:34.783215 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 22:18:34.842224 tst mo_mt_call_osmux.py: using LAC 31877 22:18:34.973201 tst mo_mt_call_osmux.py: using RAC 2 22:18:35.105307 tst mo_mt_call_osmux.py: using CellId 31877 22:18:35.240573 tst mo_mt_call_osmux.py: using BVCI 31878 22:18:35.364719 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:18:35.376350 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:18:35.387718 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:18:35.399477 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:18:35.411204 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:18:35.422848 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:18:35.544369 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:18:35.666775 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:18:36.150928 run create_hlr_db(pid=1668): Launched 22:18:36.278878 bus /sierra_2: Setting Powered False 22:18:37.340493 run create_hlr_db(pid=1668): Terminated: ok {rc=0} 22:18:37.794125 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1670): Launched 22:18:38.127849 run osmo-hlr_10.42.42.2(pid=1671): Launched 22:18:38.255588 run osmo-stp_10.42.42.5: Starting osmo-stp 22:18:38.832313 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1673): Launched 22:18:39.165395 run osmo-stp_10.42.42.5(pid=1674): Launched 22:18:39.294102 run osmo-msc_10.42.42.6: Starting osmo-msc 22:18:39.900576 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1676): Launched 22:18:40.239676 run osmo-msc_10.42.42.6(pid=1677): Launched 22:18:40.426096 run osmo-stp_10.42.42.5(pid=1674): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1674)] 22:18:40.565886 run osmo-stp_10.42.42.5(pid=1674): stdout: | (launched: 2022-12-12_22:18:39.104451) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:18:40.707557 run osmo-stp_10.42.42.5(pid=1674): stderr: | [0;m[38;5;43m20221212221839301 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221839301 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221839302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221839302 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221839302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221839303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221839303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:18:40.847082 run osmo-stp_10.42.42.5(pid=1674): stdout: | (launched: 2022-12-12_22:18:39.104451) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:18:40.979155 run osmo-stp_10.42.42.5(pid=1674): stderr: | [0;m[38;5;43m20221212221839301 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221839301 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221839302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221839302 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221839302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221839303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221839303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:18:41.137160 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1674): Process ended prematurely: osmo-stp_10.42.42.5(pid=1674) [trial-2383↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1674)] [trial-2383↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 22:18:41.146945 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 22:18:41.175393 run osmo-hlr_10.42.42.2(pid=1671): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1671)] 22:18:41.226376 run osmo-hlr_10.42.42.2(pid=1671): stdout: | (launched: 2022-12-12_22:18:38.067179) 22:18:41.278713 run osmo-hlr_10.42.42.2(pid=1671): stderr: | [0;m[1;31m20221212221838264 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212221838264 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212221838264 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212221838264 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212221838265 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212221838265 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212221838282 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212221838291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212221838292 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212221838292 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:18:41.351640 run osmo-msc_10.42.42.6(pid=1677): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1677)] 22:18:41.402015 run osmo-msc_10.42.42.6(pid=1677): stdout: | (launched: 2022-12-12_22:18:40.178473) 22:18:41.454108 run osmo-msc_10.42.42.6(pid=1677): stderr: | [0;m[38;5;43m20221212221840505 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212221840505 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5df2114c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212221840505 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212221840505 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212221840505 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212221840506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212221840507 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212221840508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212221840508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212221840508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:18:41.506376 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1670): Terminating (SIGTERM) 22:18:41.548469 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1673): Terminating (SIGTERM) 22:18:41.590965 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1676): Terminating (SIGTERM) 22:18:41.633983 --- ParallelTerminationStrategy: PID 1670 died... 22:18:41.654278 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1670): Terminated: ok {rc=0} 22:18:41.701614 --- ParallelTerminationStrategy: PID 1673 died... 22:18:41.721515 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1673): Terminated: ok {rc=0} 22:18:41.768407 --- ParallelTerminationStrategy: PID 1676 died... 22:18:41.788119 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1676): Terminated: ok {rc=0} 22:18:41.877322 bus /sierra_3: Setting Powered False 22:18:42.977635 bus /sierra_3: Setting Powered False 22:18:44.094528 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 voice:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 22:18:45.334834 tst voice:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:18:45.341549 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 22:18:45.363442 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 22:18:45.390562 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 22:18:45.447101 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 22:18:45.468589 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 22:18:45.495980 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 22:18:46.077503 tst voice:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 22:18:46.138033 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:18:46.150286 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:18:46.209167 tst mo_mt_call.py: using LAC 31878 22:18:46.342708 tst mo_mt_call.py: using RAC 3 22:18:46.477652 tst mo_mt_call.py: using CellId 31878 22:18:46.634135 tst mo_mt_call.py: using BVCI 31879 22:18:46.754474 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:18:46.765970 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:18:46.777973 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:18:46.790046 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:18:46.802043 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:18:46.813993 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 22:18:46.934642 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 22:18:47.056237 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:18:47.545106 run create_hlr_db(pid=1682): Launched 22:18:47.672911 bus /sierra_2: Setting Powered False 22:18:48.734320 run create_hlr_db(pid=1682): Terminated: ok {rc=0} 22:18:49.187781 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1684): Launched 22:18:49.522572 run osmo-hlr_10.42.42.2(pid=1685): Launched 22:18:49.651568 run osmo-stp_10.42.42.5: Starting osmo-stp 22:18:50.231802 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1687): Launched 22:18:50.565404 run osmo-stp_10.42.42.5(pid=1688): Launched 22:18:50.694490 run osmo-msc_10.42.42.6: Starting osmo-msc 22:18:51.299171 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1690): Launched 22:18:51.632800 run osmo-msc_10.42.42.6(pid=1691): Launched 22:18:51.818890 run osmo-stp_10.42.42.5(pid=1688): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1688)] 22:18:51.959729 run osmo-stp_10.42.42.5(pid=1688): stdout: | (launched: 2022-12-12_22:18:50.504204) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:18:52.101309 run osmo-stp_10.42.42.5(pid=1688): stderr: | [0;m[38;5;43m20221212221850698 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221850699 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221850699 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221850699 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221850700 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221850700 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221850700 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:18:52.240937 run osmo-stp_10.42.42.5(pid=1688): stdout: | (launched: 2022-12-12_22:18:50.504204) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:18:52.373597 run osmo-stp_10.42.42.5(pid=1688): stderr: | [0;m[38;5;43m20221212221850698 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221850699 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221850699 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221850699 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221850700 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221850700 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221850700 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:18:52.532039 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1688): Process ended prematurely: osmo-stp_10.42.42.5(pid=1688) [trial-2383↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1688)] [trial-2383↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 22:18:52.541676 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 22:18:52.569880 run osmo-hlr_10.42.42.2(pid=1685): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1685)] 22:18:52.620680 run osmo-hlr_10.42.42.2(pid=1685): stdout: | (launched: 2022-12-12_22:18:49.460484) 22:18:52.673241 run osmo-hlr_10.42.42.2(pid=1685): stderr: | [0;m[1;31m20221212221849661 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212221849661 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212221849661 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212221849661 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212221849661 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212221849661 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212221849678 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212221849688 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212221849688 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212221849688 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:18:52.745686 run osmo-msc_10.42.42.6(pid=1691): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1691)] 22:18:52.796021 run osmo-msc_10.42.42.6(pid=1691): stdout: | (launched: 2022-12-12_22:18:51.571298) 22:18:52.848211 run osmo-msc_10.42.42.6(pid=1691): stderr: | [0;m[38;5;43m20221212221851896 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212221851896 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0d7925dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212221851896 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212221851896 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212221851896 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212221851898 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212221851899 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212221851900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212221851900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212221851900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:18:52.900785 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1684): Terminating (SIGTERM) 22:18:52.943152 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1687): Terminating (SIGTERM) 22:18:52.985482 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1690): Terminating (SIGTERM) 22:18:53.028380 --- ParallelTerminationStrategy: PID 1684 died... 22:18:53.048857 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1684): Terminated: ok {rc=0} 22:18:53.096074 --- ParallelTerminationStrategy: PID 1687 died... 22:18:53.115937 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1687): Terminated: ok {rc=0} 22:18:53.163486 --- ParallelTerminationStrategy: PID 1690 died... 22:18:53.183377 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1690): Terminated: ok {rc=0} 22:18:53.273310 bus /sierra_3: Setting Powered False 22:18:54.372719 bus /sierra_3: Setting Powered False 22:18:55.491192 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2383 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 22:18:56.642659 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:18:56.654777 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:18:56.714572 tst mo_mt_call_osmux.py: using LAC 31879 22:18:56.846293 tst mo_mt_call_osmux.py: using RAC 4 22:18:56.976641 tst mo_mt_call_osmux.py: using CellId 31879 22:18:57.106799 tst mo_mt_call_osmux.py: using BVCI 31880 22:18:57.230236 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:18:57.241664 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:18:57.252650 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:18:57.264152 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:18:57.275665 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:18:57.287136 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 22:18:57.403614 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 22:18:57.525067 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:18:58.041717 run create_hlr_db(pid=1693): Launched 22:18:58.168694 bus /sierra_2: Setting Powered False 22:18:59.234244 run create_hlr_db(pid=1693): Terminated: ok {rc=0} 22:18:59.680754 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1695): Launched 22:18:59.996053 run osmo-hlr_10.42.42.2(pid=1696): Launched 22:19:00.115385 run osmo-stp_10.42.42.5: Starting osmo-stp 22:19:00.652671 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1698): Launched 22:19:00.975732 run osmo-stp_10.42.42.5(pid=1699): Launched 22:19:01.319018 run osmo-msc_10.42.42.6: Starting osmo-msc 22:19:01.989692 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1701): Launched 22:19:02.325718 run osmo-msc_10.42.42.6(pid=1702): Launched 22:19:02.585341 run osmo-stp_10.42.42.5(pid=1699): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1699)] 22:19:02.727767 run osmo-stp_10.42.42.5(pid=1699): stdout: | (launched: 2022-12-12_22:19:00.914859) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:19:02.870174 run osmo-stp_10.42.42.5(pid=1699): stderr: | [0;m[38;5;43m20221212221901140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221901140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221901141 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221901142 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221901143 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221901143 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221901144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:19:03.010588 run osmo-stp_10.42.42.5(pid=1699): stdout: | (launched: 2022-12-12_22:19:00.914859) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:19:03.143589 run osmo-stp_10.42.42.5(pid=1699): stderr: | [0;m[38;5;43m20221212221901140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221901140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221901141 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221901142 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221901143 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221901143 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221901144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:19:03.303191 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1699): Process ended prematurely: osmo-stp_10.42.42.5(pid=1699) [trial-2383↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1699)] [trial-2383↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 22:19:03.313053 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 22:19:03.343251 run osmo-hlr_10.42.42.2(pid=1696): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1696)] 22:19:03.394919 run osmo-hlr_10.42.42.2(pid=1696): stdout: | (launched: 2022-12-12_22:18:59.938339) 22:19:03.448286 run osmo-hlr_10.42.42.2(pid=1696): stderr: | [0;m[1;31m20221212221900121 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212221900121 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212221900121 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212221900121 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212221900121 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212221900121 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212221900134 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212221900142 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212221900143 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212221900143 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:19:03.522465 run osmo-msc_10.42.42.6(pid=1702): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1702)] 22:19:03.573760 run osmo-msc_10.42.42.6(pid=1702): stdout: | (launched: 2022-12-12_22:19:02.258085) 22:19:03.626777 run osmo-msc_10.42.42.6(pid=1702): stderr: | [0;m[38;5;43m20221212221902617 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212221902618 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fcef2918c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212221902618 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212221902618 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212221902618 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212221902618 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212221902620 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212221902620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212221902620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212221902620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:19:03.680647 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1695): Terminating (SIGTERM) 22:19:03.723676 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1698): Terminating (SIGTERM) 22:19:03.766959 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1701): Terminating (SIGTERM) 22:19:03.810442 --- ParallelTerminationStrategy: PID 1695 died... 22:19:03.830842 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1695): Terminated: ok {rc=0} 22:19:03.878974 --- ParallelTerminationStrategy: PID 1698 died... 22:19:03.898755 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1698): Terminated: ok {rc=0} 22:19:03.946469 --- ParallelTerminationStrategy: PID 1701 died... 22:19:03.966088 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1701): Terminated: ok {rc=0} 22:19:04.055301 bus /sierra_3: Setting Powered False 22:19:05.154620 bus /sierra_3: Setting Powered False 22:19:06.270653 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 voice:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 emergency:oc2g --------------------------------------------------------------------- 22:19:07.504040 tst emergency:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:19:07.508799 tst emergency:oc2g: Verifying 1 x bts (candidates: 11) 22:19:07.530130 tst emergency:oc2g: Verifying 6 x ip_address (candidates: 9) 22:19:07.559146 tst emergency:oc2g: Verifying 4 x modem (candidates: 12) 22:19:07.644621 tst emergency:oc2g: Reserving 1 x bts (candidates: 11) 22:19:07.665612 tst emergency:oc2g: Reserving 6 x ip_address (candidates: 9) 22:19:07.693406 tst emergency:oc2g: Reserving 4 x modem (candidates: 12) 22:19:08.277698 tst emergency:oc2g: RESERVED RESOURCES for emergency: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2383 emergency:oc2g emergency_mo_mt_call.py ---------------------------------------------- 22:19:08.284333 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 22:19:08.295983 tst emergency:oc2g: Using 1 x bts (candidates: 1) 22:19:08.331864 tst emergency_mo_mt_call.py: using LAC 31880 22:19:08.452783 tst emergency_mo_mt_call.py: using RAC 5 22:19:08.574990 tst emergency_mo_mt_call.py: using CellId 31880 22:19:08.696879 tst emergency_mo_mt_call.py: using BVCI 31881 22:19:08.808855 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 22:19:08.819512 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 22:19:08.829992 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 22:19:08.840485 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 22:19:08.851052 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 22:19:08.861701 tst emergency:oc2g: Using 1 x modem (candidates: 4) 22:19:08.977886 tst emergency:oc2g: Using 1 x modem (candidates: 4) 22:19:09.097476 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:19:09.570972 run create_hlr_db(pid=1707): Launched 22:19:09.695509 bus /sierra_2: Setting Powered False 22:19:10.755833 run create_hlr_db(pid=1707): Terminated: ok {rc=0} 22:19:11.201632 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1709): Launched 22:19:11.530624 run osmo-hlr_10.42.42.2(pid=1710): Launched 22:19:11.656453 run osmo-stp_10.42.42.5: Starting osmo-stp 22:19:12.223623 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1712): Launched 22:19:12.550220 run osmo-stp_10.42.42.5(pid=1713): Launched 22:19:12.686787 tst emergency_mo_mt_call.py: using MSISDN 8002 22:19:12.854621 run osmo-msc_10.42.42.6: Starting osmo-msc 22:19:13.441727 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1715): Launched 22:19:13.769485 run osmo-msc_10.42.42.6(pid=1716): Launched 22:19:13.953110 run osmo-stp_10.42.42.5(pid=1713): ERR: Terminated: ERROR {rc=1} [trial-2383↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1713)] 22:19:14.091931 run osmo-stp_10.42.42.5(pid=1713): stdout: | (launched: 2022-12-12_22:19:12.490478) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:19:14.231650 run osmo-stp_10.42.42.5(pid=1713): stderr: | [0;m[38;5;43m20221212221912686 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221912687 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221912687 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221912687 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221912688 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221912688 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221912688 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:19:14.370328 run osmo-stp_10.42.42.5(pid=1713): stdout: | (launched: 2022-12-12_22:19:12.490478) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:19:14.501161 run osmo-stp_10.42.42.5(pid=1713): stderr: | [0;m[38;5;43m20221212221912686 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221912687 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221912687 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221912687 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221912688 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221912688 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221912688 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:19:14.658006 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=1713): Process ended prematurely: osmo-stp_10.42.42.5(pid=1713) [trial-2383↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1713)] [trial-2383↪emergency:oc2g↪emergency_mo_mt_call.py:19] 22:19:14.667276 tst emergency_mo_mt_call.py:19: Test FAILED (6.4 sec) 22:19:14.695974 run osmo-hlr_10.42.42.2(pid=1710): ERR: Terminated: ERROR {rc=237} [trial-2383↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1710)] 22:19:14.746572 run osmo-hlr_10.42.42.2(pid=1710): stdout: | (launched: 2022-12-12_22:19:11.470428) 22:19:14.798846 run osmo-hlr_10.42.42.2(pid=1710): stderr: | [0;m[1;31m20221212221911671 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212221911672 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212221911672 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212221911672 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212221911672 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212221911672 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212221911685 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/emergency:oc2g/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212221911693 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212221911693 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212221911693 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:19:14.872125 run osmo-msc_10.42.42.6(pid=1716): ERR: Terminated: ERROR {rc=2} [trial-2383↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1716)] 22:19:14.922914 run osmo-msc_10.42.42.6(pid=1716): stdout: | (launched: 2022-12-12_22:19:13.709661) 22:19:14.974836 run osmo-msc_10.42.42.6(pid=1716): stderr: | [0;m[38;5;43m20221212221914031 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212221914032 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa4bd2b8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212221914032 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212221914032 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212221914032 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212221914032 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212221914034 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212221914034 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212221914035 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212221914035 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:19:15.027847 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1709): Terminating (SIGTERM) 22:19:15.069989 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1712): Terminating (SIGTERM) 22:19:15.112475 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1715): Terminating (SIGTERM) 22:19:15.155922 --- ParallelTerminationStrategy: PID 1709 died... 22:19:15.175967 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1709): Terminated: ok {rc=0} 22:19:15.223136 --- ParallelTerminationStrategy: PID 1712 died... 22:19:15.242912 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1712): Terminated: ok {rc=0} 22:19:15.289680 --- ParallelTerminationStrategy: PID 1715 died... 22:19:15.309582 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1715): Terminated: ok {rc=0} 22:19:15.398253 bus /sierra_3: Setting Powered False 22:19:16.505052 bus /sierra_3: Setting Powered False 22:19:17.636477 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2383 emergency:oc2g emergency_preemptive_call.py ---------------------------------------------- 22:19:18.725393 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 22:19:18.736876 tst emergency:oc2g: Using 1 x bts (candidates: 1) 22:19:18.774743 tst emergency_preemptive_call.py: using LAC 31881 22:19:18.901341 tst emergency_preemptive_call.py: using RAC 6 22:19:19.033405 tst emergency_preemptive_call.py: using CellId 31881 22:19:19.153087 tst emergency_preemptive_call.py: using BVCI 31882 22:19:19.264015 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 22:19:19.274787 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 22:19:19.285448 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 22:19:19.295860 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 22:19:19.306205 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 22:19:19.316468 tst emergency:oc2g: Using 1 x modem (candidates: 4) 22:19:19.436103 tst emergency:oc2g: Using 1 x modem (candidates: 4) 22:19:19.555755 tst emergency:oc2g: Using 1 x modem (candidates: 4) 22:19:19.675256 tst emergency:oc2g: Using 1 x modem (candidates: 4) 22:19:19.791119 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:19:20.268672 run create_hlr_db(pid=1718): Launched 22:19:20.394332 bus /sierra_2: Setting Powered False 22:19:21.455501 run create_hlr_db(pid=1718): Terminated: ok {rc=0} 22:19:21.903627 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1720): Launched 22:19:22.232625 run osmo-hlr_10.42.42.2(pid=1721): Launched 22:19:22.357722 run osmo-stp_10.42.42.5: Starting osmo-stp 22:19:22.924007 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1723): Launched 22:19:23.251282 run osmo-stp_10.42.42.5(pid=1724): Launched 22:19:23.385976 tst emergency_preemptive_call.py: using MSISDN 8003 22:19:23.558501 run osmo-msc_10.42.42.6: Starting osmo-msc 22:19:24.145627 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1726): Launched 22:19:24.472763 run osmo-msc_10.42.42.6(pid=1727): Launched 22:19:24.655757 run osmo-stp_10.42.42.5(pid=1724): ERR: Terminated: ERROR {rc=1} [trial-2383↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1724)] 22:19:24.793497 run osmo-stp_10.42.42.5(pid=1724): stdout: | (launched: 2022-12-12_22:19:23.191494) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:19:24.931664 run osmo-stp_10.42.42.5(pid=1724): stderr: | [0;m[38;5;43m20221212221923385 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221923385 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221923385 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221923386 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221923386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221923386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221923386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:19:25.069274 run osmo-stp_10.42.42.5(pid=1724): stdout: | (launched: 2022-12-12_22:19:23.191494) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:19:25.199038 run osmo-stp_10.42.42.5(pid=1724): stderr: | [0;m[38;5;43m20221212221923385 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221923385 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221923385 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221923386 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221923386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221923386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221923386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:19:25.354442 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=1724): Process ended prematurely: osmo-stp_10.42.42.5(pid=1724) [trial-2383↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1724)] [trial-2383↪emergency:oc2g↪emergency_preemptive_call.py:32] 22:19:25.363758 tst emergency_preemptive_call.py:32: Test FAILED (6.6 sec) 22:19:25.392542 run osmo-hlr_10.42.42.2(pid=1721): ERR: Terminated: ERROR {rc=237} [trial-2383↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1721)] 22:19:25.443330 run osmo-hlr_10.42.42.2(pid=1721): stdout: | (launched: 2022-12-12_22:19:22.172718) 22:19:25.495638 run osmo-hlr_10.42.42.2(pid=1721): stderr: | [0;m[1;31m20221212221922375 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212221922375 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212221922375 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212221922375 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212221922375 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212221922375 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212221922387 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/emergency:oc2g/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212221922396 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212221922396 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212221922396 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:19:25.568567 run osmo-msc_10.42.42.6(pid=1727): ERR: Terminated: ERROR {rc=2} [trial-2383↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1727)] 22:19:25.619051 run osmo-msc_10.42.42.6(pid=1727): stdout: | (launched: 2022-12-12_22:19:24.412653) 22:19:25.671707 run osmo-msc_10.42.42.6(pid=1727): stderr: | [0;m[38;5;43m20221212221924738 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212221924739 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7faa219a2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212221924739 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212221924739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212221924739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212221924739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212221924741 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212221924741 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212221924742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212221924742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:19:25.724460 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1720): Terminating (SIGTERM) 22:19:25.766753 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1723): Terminating (SIGTERM) 22:19:25.809096 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1726): Terminating (SIGTERM) 22:19:25.851549 --- ParallelTerminationStrategy: PID 1720 died... 22:19:25.871713 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1720): Terminated: ok {rc=0} 22:19:25.918607 --- ParallelTerminationStrategy: PID 1723 died... 22:19:25.938369 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1723): Terminated: ok {rc=0} 22:19:25.985761 --- ParallelTerminationStrategy: PID 1726 died... 22:19:26.005615 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1726): Terminated: ok {rc=0} 22:19:26.094588 bus /sierra_9: Setting Powered False 22:19:27.194448 bus /sierra_9: Setting Powered False 22:19:28.310872 bus /sierra_8: Setting Powered False 22:19:29.405676 bus /sierra_8: Setting Powered False 22:19:30.520940 bus /sierra_3: Setting Powered False 22:19:31.618269 bus /sierra_3: Setting Powered False 22:19:32.735545 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 emergency:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 gprs:oc2g --------------------------------------------------------------------- 22:19:34.000799 tst gprs:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:19:34.005629 tst gprs:oc2g: Verifying 1 x bts (candidates: 11) 22:19:34.027507 tst gprs:oc2g: Verifying 9 x ip_address (candidates: 9) 22:19:34.067899 tst gprs:oc2g: Verifying 4 x modem (candidates: 12) 22:19:34.158450 tst gprs:oc2g: Reserving 1 x bts (candidates: 11) 22:19:34.179980 tst gprs:oc2g: Reserving 9 x ip_address (candidates: 9) 22:19:34.219631 tst gprs:oc2g: Reserving 4 x modem (candidates: 12) 22:19:34.807157 tst gprs:oc2g: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2383 gprs:oc2g cs_paging_gprs_active.py ---------------------------------------------- 22:19:34.862737 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 22:19:34.873938 tst gprs:oc2g: Using 1 x bts (candidates: 1) 22:19:34.910706 tst cs_paging_gprs_active.py: using LAC 31882 22:19:35.043178 tst cs_paging_gprs_active.py: using RAC 7 22:19:35.169254 tst cs_paging_gprs_active.py: using CellId 31882 22:19:35.292300 tst cs_paging_gprs_active.py: using BVCI 31883 22:19:35.407208 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 22:19:35.417701 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 22:19:35.427936 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 22:19:35.438216 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 22:19:35.448395 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 22:19:35.458661 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 22:19:35.468906 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 22:19:35.479165 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 22:19:35.489562 tst gprs:oc2g: Using 1 x modem (candidates: 4) 22:19:35.607105 tst gprs:oc2g: Using 1 x modem (candidates: 4) 22:19:35.730657 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:19:35.956134 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:19:36.291547 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1733): Launched 22:19:36.582575 run iperf3-srv_10.42.42.10(pid=1734): Launched 22:19:36.708449 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:19:36.934049 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:19:37.269421 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1735): Launched 22:19:37.561593 run iperf3-srv_10.42.42.10(pid=1736): Launched 22:19:37.688480 tst cs_paging_gprs_active.py:38: start network... 22:19:37.916048 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:19:38.435265 run create_hlr_db(pid=1737): Launched 22:19:38.563247 bus /sierra_2: Setting Powered False 22:19:39.629204 run create_hlr_db(pid=1737): Terminated: ok {rc=0} 22:19:40.073259 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1739): Launched 22:19:40.387414 run osmo-hlr_10.42.42.2(pid=1740): Launched 22:19:40.505915 run osmo-stp_10.42.42.5: Starting osmo-stp 22:19:41.058234 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1742): Launched 22:19:41.370602 run osmo-stp_10.42.42.5(pid=1743): Launched 22:19:41.489073 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:19:42.025549 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1745): Launched 22:19:42.145318 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:19:42.410658 run patchelf(pid=1746): Launched 22:19:42.583320 run osmo-stp_10.42.42.5(pid=1743): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1743)] 22:19:42.714702 run osmo-stp_10.42.42.5(pid=1743): stdout: | (launched: 2022-12-12_22:19:41.312745) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:19:42.847400 run osmo-stp_10.42.42.5(pid=1743): stderr: | [0;m[38;5;43m20221212221941487 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221941487 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221941487 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221941487 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221941488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221941488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221941488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:19:42.980008 run osmo-stp_10.42.42.5(pid=1743): stdout: | (launched: 2022-12-12_22:19:41.312745) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:19:43.107418 run osmo-stp_10.42.42.5(pid=1743): stderr: | [0;m[38;5;43m20221212221941487 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221941487 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221941487 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221941487 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221941488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221941488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221941488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:19:43.258239 run patchelf(pid=1746): Terminating (SIGINT) 22:19:43.434152 run patchelf(pid=1746): Terminated: ok {rc=0} 22:19:43.560683 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=1743): Process ended prematurely: osmo-stp_10.42.42.5(pid=1743) [trial-2383↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1743)] [trial-2383↪gprs:oc2g↪cs_paging_gprs_active.py:38] 22:19:43.570166 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 22:19:43.597394 run osmo-hlr_10.42.42.2(pid=1740): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:oc2g↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1740)] 22:19:43.645357 run osmo-hlr_10.42.42.2(pid=1740): stdout: | (launched: 2022-12-12_22:19:40.329971) 22:19:43.695078 run osmo-hlr_10.42.42.2(pid=1740): stderr: | [0;m[1;31m20221212221940510 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212221940510 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212221940510 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212221940510 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212221940510 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212221940511 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212221940523 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:oc2g/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212221940534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212221940534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212221940534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:19:43.745279 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1733): Terminating (SIGTERM) 22:19:43.784927 run iperf3-srv_10.42.42.10(pid=1734): Terminating (SIGTERM) 22:19:43.824536 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1735): Terminating (SIGTERM) 22:19:43.864049 run iperf3-srv_10.42.42.10(pid=1736): Terminating (SIGTERM) 22:19:43.903508 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1739): Terminating (SIGTERM) 22:19:43.943127 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1742): Terminating (SIGTERM) 22:19:43.982608 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1745): Terminating (SIGTERM) 22:19:44.022443 --- ParallelTerminationStrategy: PID 1733 died... 22:19:44.041641 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1733): Terminated: ok {rc=0} 22:19:44.085401 --- ParallelTerminationStrategy: PID 1734 died... 22:19:44.103739 run iperf3-srv_10.42.42.10(pid=1734): Terminated {rc=256} 22:19:44.147775 --- ParallelTerminationStrategy: PID 1735 died... 22:19:44.166177 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1735): Terminated: ok {rc=0} 22:19:44.210040 --- ParallelTerminationStrategy: PID 1736 died... 22:19:44.228302 run iperf3-srv_10.42.42.10(pid=1736): Terminated {rc=256} 22:19:44.271402 --- ParallelTerminationStrategy: PID 1739 died... 22:19:44.289821 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1739): Terminated: ok {rc=0} 22:19:44.333106 --- ParallelTerminationStrategy: PID 1742 died... 22:19:44.351680 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1742): Terminated: ok {rc=0} 22:19:44.394811 --- ParallelTerminationStrategy: PID 1745 died... 22:19:44.413230 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1745): Terminated: ok {rc=0} 22:19:44.495876 bus /gobi_0: Setting Powered False 22:19:45.593592 bus /gobi_0: Setting Powered False 22:19:46.713267 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:oc2g iperf3.py ---------------------------------------------- 22:19:47.857255 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 22:19:47.868100 tst gprs:oc2g: Using 1 x bts (candidates: 1) 22:19:47.903266 tst iperf3.py: using LAC 31883 22:19:48.025858 tst iperf3.py: using RAC 8 22:19:48.147963 tst iperf3.py: using CellId 31883 22:19:48.272682 tst iperf3.py: using BVCI 31884 22:19:48.385919 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 22:19:48.396293 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 22:19:48.406649 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 22:19:48.416834 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 22:19:48.427469 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 22:19:48.437762 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 22:19:48.448074 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 22:19:48.458341 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 22:19:48.468616 tst gprs:oc2g: Using 1 x modem (candidates: 4) 22:19:48.587079 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:19:48.813695 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:19:49.149069 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1747): Launched 22:19:49.440354 run iperf3-srv_10.42.42.10(pid=1748): Launched 22:19:49.566436 tst iperf3.py:8: start network... 22:19:49.793156 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:19:50.311650 run create_hlr_db(pid=1749): Launched 22:19:50.439650 bus /gobi_6: Setting Powered False 22:19:51.501794 run create_hlr_db(pid=1749): Terminated: ok {rc=0} 22:19:51.938853 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1751): Launched 22:19:52.251027 run osmo-hlr_10.42.42.2(pid=1752): Launched 22:19:52.370917 run osmo-stp_10.42.42.5: Starting osmo-stp 22:19:52.950981 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1754): Launched 22:19:53.285714 run osmo-stp_10.42.42.5(pid=1755): Launched 22:19:53.412933 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:19:53.990446 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1757): Launched 22:19:54.118169 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:19:54.399997 run patchelf(pid=1758): Launched 22:19:54.585653 run osmo-stp_10.42.42.5(pid=1755): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1755)] 22:19:54.726956 run osmo-stp_10.42.42.5(pid=1755): stdout: | (launched: 2022-12-12_22:19:53.224481) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:19:54.868692 run osmo-stp_10.42.42.5(pid=1755): stderr: | [0;m[38;5;43m20221212221953419 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221953419 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221953419 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221953420 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221953420 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221953420 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221953420 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:19:55.010926 run osmo-stp_10.42.42.5(pid=1755): stdout: | (launched: 2022-12-12_22:19:53.224481) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:19:55.147396 run osmo-stp_10.42.42.5(pid=1755): stderr: | [0;m[38;5;43m20221212221953419 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212221953419 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212221953419 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212221953420 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212221953420 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212221953420 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212221953420 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:19:55.308840 run patchelf(pid=1758): Terminating (SIGINT) 22:19:55.496579 run patchelf(pid=1758): Terminated: ok {rc=0} 22:19:55.631758 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1755): Process ended prematurely: osmo-stp_10.42.42.5(pid=1755) [trial-2383↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1755)] [trial-2383↪gprs:oc2g↪iperf3.py:8] 22:19:55.642000 tst iperf3.py:8: Test FAILED (7.8 sec) 22:19:55.671237 run osmo-hlr_10.42.42.2(pid=1752): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:oc2g↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1752)] 22:19:55.721900 run osmo-hlr_10.42.42.2(pid=1752): stdout: | (launched: 2022-12-12_22:19:52.193445) 22:19:55.773931 run osmo-hlr_10.42.42.2(pid=1752): stderr: | [0;m[1;31m20221212221952371 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212221952371 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212221952371 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212221952371 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212221952371 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212221952371 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212221952383 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:oc2g/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212221952392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212221952392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212221952392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:19:55.826353 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1747): Terminating (SIGTERM) 22:19:55.868282 run iperf3-srv_10.42.42.10(pid=1748): Terminating (SIGTERM) 22:19:55.910330 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1751): Terminating (SIGTERM) 22:19:55.952349 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1754): Terminating (SIGTERM) 22:19:55.994259 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1757): Terminating (SIGTERM) 22:19:56.036569 --- ParallelTerminationStrategy: PID 1747 died... 22:19:56.056884 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1747): Terminated: ok {rc=0} 22:19:56.103698 --- ParallelTerminationStrategy: PID 1748 died... 22:19:56.123256 run iperf3-srv_10.42.42.10(pid=1748): Terminated {rc=256} 22:19:56.169657 --- ParallelTerminationStrategy: PID 1751 died... 22:19:56.189226 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1751): Terminated: ok {rc=0} 22:19:56.235766 --- ParallelTerminationStrategy: PID 1754 died... 22:19:56.255203 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1754): Terminated: ok {rc=0} 22:19:56.301737 --- ParallelTerminationStrategy: PID 1757 died... 22:19:56.321476 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1757): Terminated: ok {rc=0} 22:19:56.410050 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:oc2g iperf3m4.py ---------------------------------------------- 22:19:57.561385 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 22:19:57.573074 tst gprs:oc2g: Using 1 x bts (candidates: 1) 22:19:57.610712 tst iperf3m4.py: using LAC 31884 22:19:57.743422 tst iperf3m4.py: using RAC 9 22:19:57.876292 tst iperf3m4.py: using CellId 31884 22:19:58.007465 tst iperf3m4.py: using BVCI 31885 22:19:58.131701 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 22:19:58.142709 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 22:19:58.153618 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 22:19:58.164621 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 22:19:58.175617 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 22:19:58.186670 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 22:19:58.198127 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 22:19:58.209344 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 22:19:58.220693 tst gprs:oc2g: Using 1 x modem (candidates: 4) 22:19:58.343105 tst gprs:oc2g: Using 1 x modem (candidates: 4) 22:19:58.462284 tst gprs:oc2g: Using 1 x modem (candidates: 4) 22:19:58.582505 tst gprs:oc2g: Using 1 x modem (candidates: 4) 22:19:58.699952 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:19:58.910760 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:19:59.225605 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1759): Launched 22:19:59.499343 run iperf3-srv_10.42.42.10(pid=1760): Launched 22:19:59.617079 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:19:59.826238 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:20:00.139043 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1761): Launched 22:20:00.411861 run iperf3-srv_10.42.42.10(pid=1762): Launched 22:20:00.529248 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:20:00.737878 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:20:01.095461 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1763): Launched 22:20:01.393679 run iperf3-srv_10.42.42.10(pid=1764): Launched 22:20:01.521819 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:20:01.744476 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:20:02.069539 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1768): Launched 22:20:02.354706 run iperf3-srv_10.42.42.10(pid=1769): Launched 22:20:02.471218 tst iperf3m4.py:8: start network... 22:20:02.679173 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:20:03.161690 run create_hlr_db(pid=1770): Launched 22:20:03.289567 bus /gobi_6: Setting Powered False 22:20:04.351535 run create_hlr_db(pid=1770): Terminated: ok {rc=0} 22:20:04.806254 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1772): Launched 22:20:05.141132 run osmo-hlr_10.42.42.2(pid=1773): Launched 22:20:05.269383 run osmo-stp_10.42.42.5: Starting osmo-stp 22:20:05.842214 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1775): Launched 22:20:06.177082 run osmo-stp_10.42.42.5(pid=1776): Launched 22:20:06.304872 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:20:06.884286 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1778): Launched 22:20:07.012072 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:20:07.294574 run patchelf(pid=1780): Launched 22:20:07.480193 run osmo-stp_10.42.42.5(pid=1776): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1776)] 22:20:07.621095 run osmo-stp_10.42.42.5(pid=1776): stdout: | (launched: 2022-12-12_22:20:06.115543) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:20:07.764201 run osmo-stp_10.42.42.5(pid=1776): stderr: | [0;m[38;5;43m20221212222006312 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222006312 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222006312 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222006313 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222006314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222006314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222006314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:20:07.906726 run osmo-stp_10.42.42.5(pid=1776): stdout: | (launched: 2022-12-12_22:20:06.115543) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:20:08.043247 run osmo-stp_10.42.42.5(pid=1776): stderr: | [0;m[38;5;43m20221212222006312 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222006312 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222006312 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222006313 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222006314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222006314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222006314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:20:08.205167 run patchelf(pid=1780): Terminating (SIGINT) 22:20:08.393743 run patchelf(pid=1780): Terminated: ok {rc=0} 22:20:08.529355 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1776): Process ended prematurely: osmo-stp_10.42.42.5(pid=1776) [trial-2383↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1776)] [trial-2383↪gprs:oc2g↪iperf3m4.py:8] 22:20:08.539529 tst iperf3m4.py:8: Test FAILED (11.0 sec) 22:20:08.569197 run osmo-hlr_10.42.42.2(pid=1773): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:oc2g↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1773)] 22:20:08.619585 run osmo-hlr_10.42.42.2(pid=1773): stdout: | (launched: 2022-12-12_22:20:05.079828) 22:20:08.672398 run osmo-hlr_10.42.42.2(pid=1773): stderr: | [0;m[1;31m20221212222005282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212222005282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212222005282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212222005282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212222005282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212222005282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212222005294 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:oc2g/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212222005303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212222005303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212222005303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:20:08.725259 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1759): Terminating (SIGTERM) 22:20:08.767548 run iperf3-srv_10.42.42.10(pid=1760): Terminating (SIGTERM) 22:20:08.809634 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1761): Terminating (SIGTERM) 22:20:08.851887 run iperf3-srv_10.42.42.10(pid=1762): Terminating (SIGTERM) 22:20:08.894006 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1763): Terminating (SIGTERM) 22:20:08.936137 run iperf3-srv_10.42.42.10(pid=1764): Terminating (SIGTERM) 22:20:08.978300 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1768): Terminating (SIGTERM) 22:20:09.020597 run iperf3-srv_10.42.42.10(pid=1769): Terminating (SIGTERM) 22:20:09.062691 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1772): Terminating (SIGTERM) 22:20:09.105074 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1775): Terminating (SIGTERM) 22:20:09.147315 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1778): Terminating (SIGTERM) 22:20:09.189863 --- ParallelTerminationStrategy: PID 1759 died... 22:20:09.210009 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1759): Terminated: ok {rc=0} 22:20:09.257184 --- ParallelTerminationStrategy: PID 1760 died... 22:20:09.276846 run iperf3-srv_10.42.42.10(pid=1760): Terminated {rc=256} 22:20:09.323749 --- ParallelTerminationStrategy: PID 1761 died... 22:20:09.343521 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1761): Terminated: ok {rc=0} 22:20:09.390203 --- ParallelTerminationStrategy: PID 1762 died... 22:20:09.409894 run iperf3-srv_10.42.42.10(pid=1762): Terminated {rc=256} 22:20:09.456401 --- ParallelTerminationStrategy: PID 1763 died... 22:20:09.476066 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1763): Terminated: ok {rc=0} 22:20:09.522933 --- ParallelTerminationStrategy: PID 1764 died... 22:20:09.542638 run iperf3-srv_10.42.42.10(pid=1764): Terminated {rc=256} 22:20:09.589374 --- ParallelTerminationStrategy: PID 1768 died... 22:20:09.609191 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1768): Terminated: ok {rc=0} 22:20:09.655906 --- ParallelTerminationStrategy: PID 1769 died... 22:20:09.675979 run iperf3-srv_10.42.42.10(pid=1769): Terminated {rc=256} 22:20:09.722840 --- ParallelTerminationStrategy: PID 1772 died... 22:20:09.742753 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1772): Terminated: ok {rc=0} 22:20:09.789703 --- ParallelTerminationStrategy: PID 1775 died... 22:20:09.809553 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1775): Terminated: ok {rc=0} 22:20:09.856414 --- ParallelTerminationStrategy: PID 1778 died... 22:20:09.876118 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1778): Terminated: ok {rc=0} 22:20:09.964718 bus /gobi_4: Setting Powered False 22:20:11.063840 bus /gobi_4: Setting Powered False 22:20:12.180669 bus /gobi_1: Setting Powered False 22:20:13.279001 bus /gobi_1: Setting Powered False 22:20:14.394806 bus /gobi_0: Setting Powered False 22:20:15.492425 bus /gobi_0: Setting Powered False 22:20:16.613643 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:oc2g ping.py ---------------------------------------------- 22:20:17.718122 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 22:20:17.729818 tst gprs:oc2g: Using 1 x bts (candidates: 1) 22:20:17.767127 tst ping.py: using LAC 31885 22:20:17.897203 tst ping.py: using RAC 10 22:20:18.024802 tst ping.py: using CellId 31885 22:20:18.154439 tst ping.py: using BVCI 31886 22:20:18.275549 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 22:20:18.286555 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 22:20:18.297428 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 22:20:18.308495 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 22:20:18.320063 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 22:20:18.331035 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 22:20:18.342319 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 22:20:18.353641 tst gprs:oc2g: Using 1 x modem (candidates: 4) 22:20:18.472125 tst ping.py:19: start network... 22:20:18.693932 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:20:19.200759 run create_hlr_db(pid=1781): Launched 22:20:19.325401 bus /gobi_6: Setting Powered False 22:20:20.390439 run create_hlr_db(pid=1781): Terminated: ok {rc=0} 22:20:20.828472 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1783): Launched 22:20:21.136353 run osmo-hlr_10.42.42.2(pid=1784): Launched 22:20:21.253918 run osmo-stp_10.42.42.5: Starting osmo-stp 22:20:21.799677 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1786): Launched 22:20:22.107449 run osmo-stp_10.42.42.5(pid=1787): Launched 22:20:22.224461 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:20:22.753243 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1789): Launched 22:20:22.870996 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:20:23.130470 run patchelf(pid=1790): Launched 22:20:23.301073 run osmo-stp_10.42.42.5(pid=1787): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1787)] 22:20:23.430989 run osmo-stp_10.42.42.5(pid=1787): stdout: | (launched: 2022-12-12_22:20:22.050539) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:20:23.561628 run osmo-stp_10.42.42.5(pid=1787): stderr: | [0;m[38;5;43m20221212222022221 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222022222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222022222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222022222 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222022224 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222022225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222022225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:20:23.693076 run osmo-stp_10.42.42.5(pid=1787): stdout: | (launched: 2022-12-12_22:20:22.050539) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:20:23.818557 run osmo-stp_10.42.42.5(pid=1787): stderr: | [0;m[38;5;43m20221212222022221 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222022222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222022222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222022222 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222022224 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222022225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222022225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:20:23.966784 run patchelf(pid=1790): Terminating (SIGINT) 22:20:24.140237 run patchelf(pid=1790): Terminated: ok {rc=0} 22:20:24.264766 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=1787): Process ended prematurely: osmo-stp_10.42.42.5(pid=1787) [trial-2383↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1787)] [trial-2383↪gprs:oc2g↪ping.py:22] 22:20:24.273724 tst ping.py:22: Test FAILED (6.5 sec) 22:20:24.300447 run osmo-hlr_10.42.42.2(pid=1784): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:oc2g↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1784)] 22:20:24.347816 run osmo-hlr_10.42.42.2(pid=1784): stdout: | (launched: 2022-12-12_22:20:21.079283) 22:20:24.397155 run osmo-hlr_10.42.42.2(pid=1784): stderr: | [0;m[1;31m20221212222021259 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212222021259 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212222021259 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212222021259 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212222021259 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212222021259 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212222021271 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:oc2g/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212222021280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212222021280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212222021280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:20:24.446917 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1783): Terminating (SIGTERM) 22:20:24.486699 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1786): Terminating (SIGTERM) 22:20:24.526906 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1789): Terminating (SIGTERM) 22:20:24.567094 --- ParallelTerminationStrategy: PID 1783 died... 22:20:24.586444 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1783): Terminated: ok {rc=0} 22:20:24.630504 --- ParallelTerminationStrategy: PID 1786 died... 22:20:24.649317 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1786): Terminated: ok {rc=0} 22:20:24.693343 --- ParallelTerminationStrategy: PID 1789 died... 22:20:24.711966 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1789): Terminated: ok {rc=0} 22:20:24.797596 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:oc2g ping_idle_ping.py ---------------------------------------------- 22:20:25.887029 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 22:20:25.898644 tst gprs:oc2g: Using 1 x bts (candidates: 1) 22:20:25.935758 tst ping_idle_ping.py: using LAC 31886 22:20:26.058095 tst ping_idle_ping.py: using RAC 11 22:20:26.179980 tst ping_idle_ping.py: using CellId 31886 22:20:26.305695 tst ping_idle_ping.py: using BVCI 31887 22:20:26.417815 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 22:20:26.428312 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 22:20:26.438776 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 22:20:26.449180 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 22:20:26.459507 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 22:20:26.469828 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 22:20:26.480151 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 22:20:26.490494 tst gprs:oc2g: Using 1 x modem (candidates: 4) 22:20:26.606589 tst ping_idle_ping.py:24: start network... 22:20:26.812218 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:20:27.288848 run create_hlr_db(pid=1791): Launched 22:20:27.414101 bus /gobi_6: Setting Powered False 22:20:28.475684 run create_hlr_db(pid=1791): Terminated: ok {rc=0} 22:20:28.924869 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1793): Launched 22:20:29.254694 run osmo-hlr_10.42.42.2(pid=1794): Launched 22:20:29.380779 run osmo-stp_10.42.42.5: Starting osmo-stp 22:20:29.951379 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1796): Launched 22:20:30.280473 run osmo-stp_10.42.42.5(pid=1797): Launched 22:20:30.406280 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:20:31.003279 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1799): Launched 22:20:31.178649 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:20:31.489373 run patchelf(pid=1800): Launched 22:20:31.681773 run osmo-stp_10.42.42.5(pid=1797): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1797)] 22:20:31.815823 run osmo-stp_10.42.42.5(pid=1797): stdout: | (launched: 2022-12-12_22:20:30.220250) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:20:31.965249 run osmo-stp_10.42.42.5(pid=1797): stderr: | [0;m[38;5;43m20221212222030416 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222030416 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222030416 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222030417 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222030417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222030417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222030417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:20:32.099718 run osmo-stp_10.42.42.5(pid=1797): stdout: | (launched: 2022-12-12_22:20:30.220250) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:20:32.228026 run osmo-stp_10.42.42.5(pid=1797): stderr: | [0;m[38;5;43m20221212222030416 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222030416 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222030416 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222030417 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222030417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222030417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222030417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:20:32.377677 run patchelf(pid=1800): Terminating (SIGINT) 22:20:32.552283 run patchelf(pid=1800): Terminated: ok {rc=0} 22:20:32.678189 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=1797): Process ended prematurely: osmo-stp_10.42.42.5(pid=1797) [trial-2383↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1797)] [trial-2383↪gprs:oc2g↪ping_idle_ping.py:27] 22:20:32.687358 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 22:20:32.714702 run osmo-hlr_10.42.42.2(pid=1794): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:oc2g↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1794)] 22:20:32.762517 run osmo-hlr_10.42.42.2(pid=1794): stdout: | (launched: 2022-12-12_22:20:29.194518) 22:20:32.811795 run osmo-hlr_10.42.42.2(pid=1794): stderr: | [0;m[1;31m20221212222029395 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212222029395 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212222029395 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212222029395 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212222029395 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212222029395 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212222029408 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:oc2g/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212222029417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212222029417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212222029417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:20:32.861480 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1793): Terminating (SIGTERM) 22:20:32.901351 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1796): Terminating (SIGTERM) 22:20:32.941915 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1799): Terminating (SIGTERM) 22:20:32.982363 --- ParallelTerminationStrategy: PID 1793 died... 22:20:33.001645 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1793): Terminated: ok {rc=0} 22:20:33.046054 --- ParallelTerminationStrategy: PID 1796 died... 22:20:33.065095 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1796): Terminated: ok {rc=0} 22:20:33.109277 --- ParallelTerminationStrategy: PID 1799 died... 22:20:33.128247 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1799): Terminated: ok {rc=0} 22:20:33.214819 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2383 gprs:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 gprs:oc2g+mod-bts0-egprs --------------------------------------------------------------------- 22:20:34.514375 tst gprs:oc2g+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:20:34.520084 tst gprs:oc2g+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 22:20:34.542310 tst gprs:oc2g+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 22:20:34.583023 tst gprs:oc2g+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 22:20:34.667442 tst gprs:oc2g+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 22:20:34.687896 tst gprs:oc2g+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 22:20:34.725793 tst gprs:oc2g+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 22:20:35.317654 tst gprs:oc2g+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2383 gprs:oc2g+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 22:20:35.366578 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:20:35.377427 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:20:35.412761 tst cs_paging_gprs_active.py: using LAC 31887 22:20:35.538625 tst cs_paging_gprs_active.py: using RAC 12 22:20:35.658569 tst cs_paging_gprs_active.py: using CellId 31887 22:20:35.779187 tst cs_paging_gprs_active.py: using BVCI 31888 22:20:35.890610 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:20:35.901369 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:20:35.911795 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:20:35.922172 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:20:35.933057 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:20:35.943490 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:20:35.954245 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:20:35.964652 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:20:35.975283 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:20:36.094511 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:20:36.210271 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:20:36.417673 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:20:36.727526 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1805): Launched 22:20:36.995113 run iperf3-srv_10.42.42.10(pid=1806): Launched 22:20:37.111625 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:20:37.316520 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:20:37.623930 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1807): Launched 22:20:37.892024 run iperf3-srv_10.42.42.10(pid=1808): Launched 22:20:38.007103 tst cs_paging_gprs_active.py:38: start network... 22:20:38.211856 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:20:38.688346 run create_hlr_db(pid=1809): Launched 22:20:38.813173 bus /gobi_6: Setting Powered False 22:20:39.874115 run create_hlr_db(pid=1809): Terminated: ok {rc=0} 22:20:40.320558 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1811): Launched 22:20:40.647759 run osmo-hlr_10.42.42.2(pid=1812): Launched 22:20:40.774663 run osmo-stp_10.42.42.5: Starting osmo-stp 22:20:41.341757 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1815): Launched 22:20:41.669926 run osmo-stp_10.42.42.5(pid=1816): Launched 22:20:41.795147 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:20:42.359171 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1818): Launched 22:20:42.484208 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:20:42.761997 run patchelf(pid=1820): Launched 22:20:42.943243 run osmo-stp_10.42.42.5(pid=1816): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1816)] 22:20:43.081870 run osmo-stp_10.42.42.5(pid=1816): stdout: | (launched: 2022-12-12_22:20:41.609893) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:20:43.222297 run osmo-stp_10.42.42.5(pid=1816): stderr: | [0;m[38;5;43m20221212222041802 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222041802 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222041802 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222041802 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222041803 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222041803 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222041803 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:20:43.362076 run osmo-stp_10.42.42.5(pid=1816): stdout: | (launched: 2022-12-12_22:20:41.609893) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:20:43.496257 run osmo-stp_10.42.42.5(pid=1816): stderr: | [0;m[38;5;43m20221212222041802 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222041802 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222041802 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222041802 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222041803 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222041803 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222041803 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:20:43.655333 run patchelf(pid=1820): Terminating (SIGINT) 22:20:43.839712 run patchelf(pid=1820): Terminated: ok {rc=0} 22:20:43.972249 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=1816): Process ended prematurely: osmo-stp_10.42.42.5(pid=1816) [trial-2383↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1816)] [trial-2383↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 22:20:43.982569 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 22:20:44.011228 run osmo-hlr_10.42.42.2(pid=1812): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1812)] 22:20:44.061744 run osmo-hlr_10.42.42.2(pid=1812): stdout: | (launched: 2022-12-12_22:20:40.587971) 22:20:44.113713 run osmo-hlr_10.42.42.2(pid=1812): stderr: | [0;m[1;31m20221212222040788 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212222040789 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212222040789 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212222040789 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212222040789 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212222040789 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212222040801 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:oc2g+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212222040809 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212222040810 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212222040810 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:20:44.166017 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1805): Terminating (SIGTERM) 22:20:44.208141 run iperf3-srv_10.42.42.10(pid=1806): Terminating (SIGTERM) 22:20:44.250183 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1807): Terminating (SIGTERM) 22:20:44.292278 run iperf3-srv_10.42.42.10(pid=1808): Terminating (SIGTERM) 22:20:44.334260 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1811): Terminating (SIGTERM) 22:20:44.376398 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1815): Terminating (SIGTERM) 22:20:44.418197 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1818): Terminating (SIGTERM) 22:20:44.460164 --- ParallelTerminationStrategy: PID 1805 died... 22:20:44.480185 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1805): Terminated: ok {rc=0} 22:20:44.526609 --- ParallelTerminationStrategy: PID 1806 died... 22:20:44.545712 run iperf3-srv_10.42.42.10(pid=1806): Terminated {rc=256} 22:20:44.591735 --- ParallelTerminationStrategy: PID 1807 died... 22:20:44.611005 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1807): Terminated: ok {rc=0} 22:20:44.657147 --- ParallelTerminationStrategy: PID 1808 died... 22:20:44.676449 run iperf3-srv_10.42.42.10(pid=1808): Terminated {rc=256} 22:20:44.722679 --- ParallelTerminationStrategy: PID 1811 died... 22:20:44.742107 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1811): Terminated: ok {rc=0} 22:20:44.788019 --- ParallelTerminationStrategy: PID 1815 died... 22:20:44.807363 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1815): Terminated: ok {rc=0} 22:20:44.853906 --- ParallelTerminationStrategy: PID 1818 died... 22:20:44.873472 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1818): Terminated: ok {rc=0} 22:20:44.960939 bus /gobi_0: Setting Powered False 22:20:46.059621 bus /gobi_0: Setting Powered False 22:20:47.178826 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:oc2g+mod-bts0-egprs iperf3.py ---------------------------------------------- 22:20:48.326777 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:20:48.338224 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:20:48.376572 tst iperf3.py: using LAC 31888 22:20:48.498787 tst iperf3.py: using RAC 13 22:20:48.622650 tst iperf3.py: using CellId 31888 22:20:48.743446 tst iperf3.py: using BVCI 31889 22:20:48.856673 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:20:48.867548 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:20:48.878435 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:20:48.889643 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:20:48.900609 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:20:48.911675 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:20:48.922836 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:20:48.934014 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:20:48.945303 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:20:49.063421 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:20:49.269743 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:20:49.577499 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1821): Launched 22:20:49.845908 run iperf3-srv_10.42.42.10(pid=1822): Launched 22:20:49.960357 tst iperf3.py:8: start network... 22:20:50.164560 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:20:50.637473 run create_hlr_db(pid=1823): Launched 22:20:50.763771 bus /gobi_6: Setting Powered False 22:20:51.823690 run create_hlr_db(pid=1823): Terminated: ok {rc=0} 22:20:52.267108 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1825): Launched 22:20:52.592715 run osmo-hlr_10.42.42.2(pid=1826): Launched 22:20:52.718008 run osmo-stp_10.42.42.5: Starting osmo-stp 22:20:53.282403 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1828): Launched 22:20:53.608472 run osmo-stp_10.42.42.5(pid=1829): Launched 22:20:53.734657 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:20:54.297212 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1831): Launched 22:20:54.422330 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:20:54.698587 run patchelf(pid=1832): Launched 22:20:54.880813 run osmo-stp_10.42.42.5(pid=1829): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1829)] 22:20:55.019205 run osmo-stp_10.42.42.5(pid=1829): stdout: | (launched: 2022-12-12_22:20:53.548839) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:20:55.159504 run osmo-stp_10.42.42.5(pid=1829): stderr: | [0;m[38;5;43m20221212222053744 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222053744 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222053745 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222053745 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222053745 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222053745 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222053746 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:20:55.299494 run osmo-stp_10.42.42.5(pid=1829): stdout: | (launched: 2022-12-12_22:20:53.548839) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:20:55.433715 run osmo-stp_10.42.42.5(pid=1829): stderr: | [0;m[38;5;43m20221212222053744 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222053744 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222053745 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222053745 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222053745 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222053745 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222053746 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:20:55.592418 run patchelf(pid=1832): Terminating (SIGINT) 22:20:55.776843 run patchelf(pid=1832): Terminated: ok {rc=0} 22:20:55.909279 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1829): Process ended prematurely: osmo-stp_10.42.42.5(pid=1829) [trial-2383↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1829)] [trial-2383↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8] 22:20:55.919503 tst iperf3.py:8: Test FAILED (7.6 sec) 22:20:55.948411 run osmo-hlr_10.42.42.2(pid=1826): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:oc2g+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1826)] 22:20:55.998572 run osmo-hlr_10.42.42.2(pid=1826): stdout: | (launched: 2022-12-12_22:20:52.533328) 22:20:56.050463 run osmo-hlr_10.42.42.2(pid=1826): stderr: | [0;m[1;31m20221212222052735 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212222052735 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212222052735 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212222052735 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212222052735 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212222052735 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212222052747 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:oc2g+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212222052755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212222052755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212222052755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:20:56.102815 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1821): Terminating (SIGTERM) 22:20:56.144784 run iperf3-srv_10.42.42.10(pid=1822): Terminating (SIGTERM) 22:20:56.186807 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1825): Terminating (SIGTERM) 22:20:56.228901 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1828): Terminating (SIGTERM) 22:20:56.270856 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1831): Terminating (SIGTERM) 22:20:56.313143 --- ParallelTerminationStrategy: PID 1821 died... 22:20:56.333099 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1821): Terminated: ok {rc=0} 22:20:56.379990 --- ParallelTerminationStrategy: PID 1822 died... 22:20:56.399404 run iperf3-srv_10.42.42.10(pid=1822): Terminated {rc=256} 22:20:56.445990 --- ParallelTerminationStrategy: PID 1825 died... 22:20:56.465347 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1825): Terminated: ok {rc=0} 22:20:56.512250 --- ParallelTerminationStrategy: PID 1828 died... 22:20:56.531831 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1828): Terminated: ok {rc=0} 22:20:56.578924 --- ParallelTerminationStrategy: PID 1831 died... 22:20:56.598482 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1831): Terminated: ok {rc=0} 22:20:56.686691 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:oc2g+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 22:20:57.839727 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:20:57.851516 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:20:57.888787 tst iperf3m4.py: using LAC 31889 22:20:58.015188 tst iperf3m4.py: using RAC 14 22:20:58.142201 tst iperf3m4.py: using CellId 31889 22:20:58.269373 tst iperf3m4.py: using BVCI 31890 22:20:58.382436 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:20:58.393323 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:20:58.404058 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:20:58.415197 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:20:58.426389 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:20:58.437609 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:20:58.448767 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:20:58.460018 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:20:58.471110 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:20:58.595934 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:20:58.717555 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:20:58.837417 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:20:58.957148 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:20:59.176776 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:20:59.505621 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1833): Launched 22:20:59.790561 run iperf3-srv_10.42.42.10(pid=1834): Launched 22:20:59.913183 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:21:00.132689 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:21:00.459952 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1835): Launched 22:21:00.743848 run iperf3-srv_10.42.42.10(pid=1836): Launched 22:21:00.874334 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:21:01.111207 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:21:01.449790 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1837): Launched 22:21:01.754260 run iperf3-srv_10.42.42.10(pid=1838): Launched 22:21:01.892377 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:21:02.115759 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:21:02.445110 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1839): Launched 22:21:02.729743 run iperf3-srv_10.42.42.10(pid=1840): Launched 22:21:02.853465 tst iperf3m4.py:8: start network... 22:21:03.073040 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:21:03.581214 run create_hlr_db(pid=1841): Launched 22:21:03.706297 bus /gobi_6: Setting Powered False 22:21:04.770548 run create_hlr_db(pid=1841): Terminated: ok {rc=0} 22:21:05.207526 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1843): Launched 22:21:05.514980 run osmo-hlr_10.42.42.2(pid=1844): Launched 22:21:05.632018 run osmo-stp_10.42.42.5: Starting osmo-stp 22:21:06.158318 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1846): Launched 22:21:06.464035 run osmo-stp_10.42.42.5(pid=1847): Launched 22:21:06.583102 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:21:07.113460 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1849): Launched 22:21:07.241978 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:21:07.520166 run patchelf(pid=1850): Launched 22:21:07.702263 run osmo-stp_10.42.42.5(pid=1847): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1847)] 22:21:07.840443 run osmo-stp_10.42.42.5(pid=1847): stdout: | (launched: 2022-12-12_22:21:06.407848) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:21:07.979910 run osmo-stp_10.42.42.5(pid=1847): stderr: | [0;m[38;5;43m20221212222106581 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222106581 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222106581 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222106582 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222106582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222106582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222106582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:21:08.119439 run osmo-stp_10.42.42.5(pid=1847): stdout: | (launched: 2022-12-12_22:21:06.407848) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:21:08.253287 run osmo-stp_10.42.42.5(pid=1847): stderr: | [0;m[38;5;43m20221212222106581 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222106581 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222106581 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222106582 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222106582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222106582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222106582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:21:08.411804 run patchelf(pid=1850): Terminating (SIGINT) 22:21:08.596450 run patchelf(pid=1850): Terminated: ok {rc=0} 22:21:08.729889 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1847): Process ended prematurely: osmo-stp_10.42.42.5(pid=1847) [trial-2383↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1847)] [trial-2383↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8] 22:21:08.740265 tst iperf3m4.py:8: Test FAILED (10.9 sec) 22:21:08.769470 run osmo-hlr_10.42.42.2(pid=1844): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1844)] 22:21:08.819831 run osmo-hlr_10.42.42.2(pid=1844): stdout: | (launched: 2022-12-12_22:21:05.457698) 22:21:08.872093 run osmo-hlr_10.42.42.2(pid=1844): stderr: | [0;m[1;31m20221212222105637 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212222105637 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212222105637 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212222105637 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212222105637 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212222105637 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212222105652 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:oc2g+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212222105661 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212222105662 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212222105662 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:21:08.924699 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1833): Terminating (SIGTERM) 22:21:08.966793 run iperf3-srv_10.42.42.10(pid=1834): Terminating (SIGTERM) 22:21:09.008732 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1835): Terminating (SIGTERM) 22:21:09.051274 run iperf3-srv_10.42.42.10(pid=1836): Terminating (SIGTERM) 22:21:09.093241 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1837): Terminating (SIGTERM) 22:21:09.135400 run iperf3-srv_10.42.42.10(pid=1838): Terminating (SIGTERM) 22:21:09.177282 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1839): Terminating (SIGTERM) 22:21:09.219436 run iperf3-srv_10.42.42.10(pid=1840): Terminating (SIGTERM) 22:21:09.261246 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1843): Terminating (SIGTERM) 22:21:09.303279 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1846): Terminating (SIGTERM) 22:21:09.345223 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1849): Terminating (SIGTERM) 22:21:09.387428 --- ParallelTerminationStrategy: PID 1833 died... 22:21:09.407411 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1833): Terminated: ok {rc=0} 22:21:09.455134 --- ParallelTerminationStrategy: PID 1834 died... 22:21:09.474657 run iperf3-srv_10.42.42.10(pid=1834): Terminated {rc=256} 22:21:09.521494 --- ParallelTerminationStrategy: PID 1835 died... 22:21:09.541072 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1835): Terminated: ok {rc=0} 22:21:09.587906 --- ParallelTerminationStrategy: PID 1836 died... 22:21:09.607508 run iperf3-srv_10.42.42.10(pid=1836): Terminated {rc=256} 22:21:09.654472 --- ParallelTerminationStrategy: PID 1837 died... 22:21:09.673952 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1837): Terminated: ok {rc=0} 22:21:09.721192 --- ParallelTerminationStrategy: PID 1838 died... 22:21:09.740705 run iperf3-srv_10.42.42.10(pid=1838): Terminated {rc=256} 22:21:09.787454 --- ParallelTerminationStrategy: PID 1839 died... 22:21:09.806940 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1839): Terminated: ok {rc=0} 22:21:09.853520 --- ParallelTerminationStrategy: PID 1840 died... 22:21:09.873069 run iperf3-srv_10.42.42.10(pid=1840): Terminated {rc=256} 22:21:09.919453 --- ParallelTerminationStrategy: PID 1843 died... 22:21:09.938877 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1843): Terminated: ok {rc=0} 22:21:09.985296 --- ParallelTerminationStrategy: PID 1846 died... 22:21:10.004774 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1846): Terminated: ok {rc=0} 22:21:10.051280 --- ParallelTerminationStrategy: PID 1849 died... 22:21:10.070800 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1849): Terminated: ok {rc=0} 22:21:10.159205 bus /gobi_4: Setting Powered False 22:21:11.259108 bus /gobi_4: Setting Powered False 22:21:12.376733 bus /gobi_1: Setting Powered False 22:21:13.476555 bus /gobi_1: Setting Powered False 22:21:14.593374 bus /gobi_0: Setting Powered False 22:21:15.690545 bus /gobi_0: Setting Powered False 22:21:16.804830 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:oc2g+mod-bts0-egprs ping.py ---------------------------------------------- 22:21:17.904798 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:21:17.915983 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:21:17.953031 tst ping.py: using LAC 31890 22:21:18.071671 tst ping.py: using RAC 15 22:21:18.191458 tst ping.py: using CellId 31890 22:21:18.318449 tst ping.py: using BVCI 31891 22:21:18.438072 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:21:18.449354 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:21:18.460389 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:21:18.472219 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:21:18.483948 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:21:18.495626 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:21:18.507595 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:21:18.519435 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:21:18.637325 tst ping.py:19: start network... 22:21:18.838794 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:21:19.304072 run create_hlr_db(pid=1852): Launched 22:21:19.427171 bus /gobi_6: Setting Powered False 22:21:20.486868 run create_hlr_db(pid=1852): Terminated: ok {rc=0} 22:21:20.924802 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1854): Launched 22:21:21.245913 run osmo-hlr_10.42.42.2(pid=1855): Launched 22:21:21.367451 run osmo-stp_10.42.42.5: Starting osmo-stp 22:21:21.929614 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1857): Launched 22:21:22.258005 run osmo-stp_10.42.42.5(pid=1858): Launched 22:21:22.381177 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:21:22.939147 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1860): Launched 22:21:23.063110 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:21:23.324756 run patchelf(pid=1861): Launched 22:21:23.492484 run osmo-stp_10.42.42.5(pid=1858): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1858)] 22:21:23.621190 run osmo-stp_10.42.42.5(pid=1858): stdout: | (launched: 2022-12-12_22:21:22.199289) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:21:23.750629 run osmo-stp_10.42.42.5(pid=1858): stderr: | [0;m[38;5;43m20221212222122391 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222122391 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222122392 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222122392 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222122394 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222122394 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222122395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:21:23.879902 run osmo-stp_10.42.42.5(pid=1858): stdout: | (launched: 2022-12-12_22:21:22.199289) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:21:24.003119 run osmo-stp_10.42.42.5(pid=1858): stderr: | [0;m[38;5;43m20221212222122391 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222122391 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222122392 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222122392 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222122394 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222122394 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222122395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:21:24.149368 run patchelf(pid=1861): Terminating (SIGINT) 22:21:24.320578 run patchelf(pid=1861): Terminated: ok {rc=0} 22:21:24.443565 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=1858): Process ended prematurely: osmo-stp_10.42.42.5(pid=1858) [trial-2383↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1858)] [trial-2383↪gprs:oc2g+mod-bts0-egprs↪ping.py:22] 22:21:24.452470 tst ping.py:22: Test FAILED (6.5 sec) 22:21:24.479060 run osmo-hlr_10.42.42.2(pid=1855): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:oc2g+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1855)] 22:21:24.526727 run osmo-hlr_10.42.42.2(pid=1855): stdout: | (launched: 2022-12-12_22:21:21.187127) 22:21:24.576321 run osmo-hlr_10.42.42.2(pid=1855): stderr: | [0;m[1;31m20221212222121385 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212222121385 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212222121386 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212222121386 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212222121386 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212222121386 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212222121398 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:oc2g+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212222121408 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212222121409 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212222121409 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:21:24.625873 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1854): Terminating (SIGTERM) 22:21:24.665934 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1857): Terminating (SIGTERM) 22:21:24.705805 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1860): Terminating (SIGTERM) 22:21:24.745870 --- ParallelTerminationStrategy: PID 1854 died... 22:21:24.765112 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1854): Terminated: ok {rc=0} 22:21:24.809156 --- ParallelTerminationStrategy: PID 1857 died... 22:21:24.827993 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1857): Terminated: ok {rc=0} 22:21:24.871716 --- ParallelTerminationStrategy: PID 1860 died... 22:21:24.890197 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1860): Terminated: ok {rc=0} 22:21:24.975078 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:oc2g+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 22:21:26.064629 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:21:26.076574 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:21:26.118471 tst ping_idle_ping.py: using LAC 31891 22:21:26.237469 tst ping_idle_ping.py: using RAC 16 22:21:26.356234 tst ping_idle_ping.py: using CellId 31891 22:21:26.473133 tst ping_idle_ping.py: using BVCI 31892 22:21:26.582615 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:21:26.593342 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:21:26.604014 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:21:26.614669 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:21:26.625149 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:21:26.635547 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:21:26.646124 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:21:26.656677 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:21:26.775435 tst ping_idle_ping.py:24: start network... 22:21:26.992990 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:21:27.494889 run create_hlr_db(pid=1862): Launched 22:21:27.618322 bus /gobi_6: Setting Powered False 22:21:28.681607 run create_hlr_db(pid=1862): Terminated: ok {rc=0} 22:21:29.132428 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1864): Launched 22:21:29.455977 run osmo-hlr_10.42.42.2(pid=1865): Launched 22:21:29.579997 run osmo-stp_10.42.42.5: Starting osmo-stp 22:21:30.138882 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1867): Launched 22:21:30.462262 run osmo-stp_10.42.42.5(pid=1868): Launched 22:21:30.586160 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:21:31.160726 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1870): Launched 22:21:31.287562 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:21:31.559270 run patchelf(pid=1871): Launched 22:21:31.747559 run osmo-stp_10.42.42.5(pid=1868): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1868)] 22:21:31.879256 run osmo-stp_10.42.42.5(pid=1868): stdout: | (launched: 2022-12-12_22:21:30.403189) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:21:32.013971 run osmo-stp_10.42.42.5(pid=1868): stderr: | [0;m[38;5;43m20221212222130596 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222130596 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222130596 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222130596 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222130597 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222130597 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222130597 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:21:32.149443 run osmo-stp_10.42.42.5(pid=1868): stdout: | (launched: 2022-12-12_22:21:30.403189) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:21:32.274916 run osmo-stp_10.42.42.5(pid=1868): stderr: | [0;m[38;5;43m20221212222130596 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222130596 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222130596 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222130596 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222130597 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222130597 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222130597 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:21:32.422016 run patchelf(pid=1871): Terminating (SIGINT) 22:21:32.594282 run patchelf(pid=1871): Terminated: ok {rc=0} 22:21:32.717843 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=1868): Process ended prematurely: osmo-stp_10.42.42.5(pid=1868) [trial-2383↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1868)] [trial-2383↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27] 22:21:32.727006 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 22:21:32.753809 run osmo-hlr_10.42.42.2(pid=1865): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1865)] 22:21:32.801522 run osmo-hlr_10.42.42.2(pid=1865): stdout: | (launched: 2022-12-12_22:21:29.396629) 22:21:32.851334 run osmo-hlr_10.42.42.2(pid=1865): stderr: | [0;m[1;31m20221212222129598 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212222129598 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212222129598 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212222129598 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212222129598 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212222129598 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212222129610 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:oc2g+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212222129618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212222129619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212222129619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:21:32.901452 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1864): Terminating (SIGTERM) 22:21:32.941972 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1867): Terminating (SIGTERM) 22:21:32.981770 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1870): Terminating (SIGTERM) 22:21:33.021756 --- ParallelTerminationStrategy: PID 1864 died... 22:21:33.041378 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1864): Terminated: ok {rc=0} 22:21:33.086365 --- ParallelTerminationStrategy: PID 1867 died... 22:21:33.105064 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1867): Terminated: ok {rc=0} 22:21:33.150271 --- ParallelTerminationStrategy: PID 1870 died... 22:21:33.168845 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1870): Terminated: ok {rc=0} 22:21:33.255117 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2383 gprs:oc2g+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 gprs:oc2g+mod-bts0-dynts-ipa --------------------------------------------------------------------- 22:21:34.570826 tst gprs:oc2g+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:21:34.578763 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 22:21:34.603816 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 22:21:34.644260 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 22:21:34.739654 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 22:21:34.762671 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 22:21:34.802362 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 22:21:35.388306 tst gprs:oc2g+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2383 gprs:oc2g+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 22:21:35.441459 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:21:35.452660 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:21:35.510533 tst cs_paging_gprs_active.py: using LAC 31892 22:21:35.635052 tst cs_paging_gprs_active.py: using RAC 17 22:21:35.758467 tst cs_paging_gprs_active.py: using CellId 31892 22:21:35.881336 tst cs_paging_gprs_active.py: using BVCI 31893 22:21:35.993294 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:21:36.004067 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:21:36.014682 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:21:36.025252 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:21:36.035679 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:21:36.046279 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:21:36.056934 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:21:36.067463 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:21:36.078166 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:21:36.193988 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:21:36.313819 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:21:36.535593 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:21:36.865368 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1876): Launched 22:21:37.153279 run iperf3-srv_10.42.42.10(pid=1877): Launched 22:21:37.276201 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:21:37.497293 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:21:37.827278 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1878): Launched 22:21:38.113631 run iperf3-srv_10.42.42.10(pid=1879): Launched 22:21:38.237646 tst cs_paging_gprs_active.py:38: start network... 22:21:38.460353 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:21:38.972362 run create_hlr_db(pid=1883): Launched 22:21:39.098473 bus /gobi_6: Setting Powered False 22:21:40.163015 run create_hlr_db(pid=1883): Terminated: ok {rc=0} 22:21:40.600113 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1885): Launched 22:21:40.908699 run osmo-hlr_10.42.42.2(pid=1886): Launched 22:21:41.026196 run osmo-stp_10.42.42.5: Starting osmo-stp 22:21:41.556137 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1888): Launched 22:21:41.864233 run osmo-stp_10.42.42.5(pid=1889): Launched 22:21:41.982646 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:21:42.513904 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1891): Launched 22:21:42.640888 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:21:42.919974 run patchelf(pid=1892): Launched 22:21:43.102704 run osmo-stp_10.42.42.5(pid=1889): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1889)] 22:21:43.241722 run osmo-stp_10.42.42.5(pid=1889): stdout: | (launched: 2022-12-12_22:21:41.807546) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:21:43.382316 run osmo-stp_10.42.42.5(pid=1889): stderr: | [0;m[38;5;43m20221212222141981 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222141982 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222141982 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222141982 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222141983 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222141983 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222141983 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:21:43.522812 run osmo-stp_10.42.42.5(pid=1889): stdout: | (launched: 2022-12-12_22:21:41.807546) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:21:43.657372 run osmo-stp_10.42.42.5(pid=1889): stderr: | [0;m[38;5;43m20221212222141981 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222141982 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222141982 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222141982 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222141983 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222141983 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222141983 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:21:43.818119 run patchelf(pid=1892): Terminating (SIGINT) 22:21:44.002734 run patchelf(pid=1892): Terminated: ok {rc=0} 22:21:44.136003 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=1889): Process ended prematurely: osmo-stp_10.42.42.5(pid=1889) [trial-2383↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1889)] [trial-2383↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 22:21:44.146260 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 22:21:44.175209 run osmo-hlr_10.42.42.2(pid=1886): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1886)] 22:21:44.225872 run osmo-hlr_10.42.42.2(pid=1886): stdout: | (launched: 2022-12-12_22:21:40.852182) 22:21:44.277660 run osmo-hlr_10.42.42.2(pid=1886): stderr: | [0;m[1;31m20221212222141029 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212222141029 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212222141029 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212222141029 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212222141029 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212222141029 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212222141042 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:oc2g+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212222141053 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212222141053 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212222141053 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:21:44.329838 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1876): Terminating (SIGTERM) 22:21:44.371824 run iperf3-srv_10.42.42.10(pid=1877): Terminating (SIGTERM) 22:21:44.413751 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1878): Terminating (SIGTERM) 22:21:44.455787 run iperf3-srv_10.42.42.10(pid=1879): Terminating (SIGTERM) 22:21:44.497642 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1885): Terminating (SIGTERM) 22:21:44.539414 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1888): Terminating (SIGTERM) 22:21:44.581491 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1891): Terminating (SIGTERM) 22:21:44.623528 --- ParallelTerminationStrategy: PID 1876 died... 22:21:44.643288 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1876): Terminated: ok {rc=0} 22:21:44.689740 --- ParallelTerminationStrategy: PID 1877 died... 22:21:44.709259 run iperf3-srv_10.42.42.10(pid=1877): Terminated {rc=256} 22:21:44.755771 --- ParallelTerminationStrategy: PID 1878 died... 22:21:44.775106 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1878): Terminated: ok {rc=0} 22:21:44.821173 --- ParallelTerminationStrategy: PID 1879 died... 22:21:44.840352 run iperf3-srv_10.42.42.10(pid=1879): Terminated {rc=256} 22:21:44.886328 --- ParallelTerminationStrategy: PID 1885 died... 22:21:44.905650 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1885): Terminated: ok {rc=0} 22:21:44.952470 --- ParallelTerminationStrategy: PID 1888 died... 22:21:44.971875 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1888): Terminated: ok {rc=0} 22:21:45.018130 --- ParallelTerminationStrategy: PID 1891 died... 22:21:45.037543 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1891): Terminated: ok {rc=0} 22:21:45.125339 bus /gobi_0: Setting Powered False 22:21:46.229499 bus /gobi_0: Setting Powered False 22:21:47.355512 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:oc2g+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 22:21:48.505337 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:21:48.517261 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:21:48.578414 tst iperf3.py: using LAC 31893 22:21:48.707417 tst iperf3.py: using RAC 18 22:21:48.836507 tst iperf3.py: using CellId 31893 22:21:48.964620 tst iperf3.py: using BVCI 31894 22:21:49.084013 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:21:49.095449 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:21:49.106494 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:21:49.118031 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:21:49.129387 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:21:49.140640 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:21:49.152183 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:21:49.163470 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:21:49.175001 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:21:49.294660 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:21:49.514957 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:21:49.843896 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1893): Launched 22:21:50.128477 run iperf3-srv_10.42.42.10(pid=1894): Launched 22:21:50.251448 tst iperf3.py:8: start network... 22:21:50.471407 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:21:50.978554 run create_hlr_db(pid=1895): Launched 22:21:51.103891 bus /gobi_6: Setting Powered False 22:21:52.167547 run create_hlr_db(pid=1895): Terminated: ok {rc=0} 22:21:52.605150 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1897): Launched 22:21:52.913785 run osmo-hlr_10.42.42.2(pid=1898): Launched 22:21:53.031587 run osmo-stp_10.42.42.5: Starting osmo-stp 22:21:53.577247 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1900): Launched 22:21:53.884054 run osmo-stp_10.42.42.5(pid=1901): Launched 22:21:54.000904 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:21:54.529586 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1903): Launched 22:21:54.646829 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:21:54.906812 run patchelf(pid=1904): Launched 22:21:55.076730 run osmo-stp_10.42.42.5(pid=1901): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1901)] 22:21:55.206510 run osmo-stp_10.42.42.5(pid=1901): stdout: | (launched: 2022-12-12_22:21:53.826846) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:21:55.337805 run osmo-stp_10.42.42.5(pid=1901): stderr: | [0;m[38;5;43m20221212222153999 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222153999 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222154000 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222154000 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222154002 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222154002 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222154003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:21:55.468637 run osmo-stp_10.42.42.5(pid=1901): stdout: | (launched: 2022-12-12_22:21:53.826846) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:21:55.593381 run osmo-stp_10.42.42.5(pid=1901): stderr: | [0;m[38;5;43m20221212222153999 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222153999 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222154000 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222154000 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222154002 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222154002 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222154003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:21:55.741442 run patchelf(pid=1904): Terminating (SIGINT) 22:21:55.914794 run patchelf(pid=1904): Terminated: ok {rc=0} 22:21:56.039655 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1901): Process ended prematurely: osmo-stp_10.42.42.5(pid=1901) [trial-2383↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1901)] [trial-2383↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8] 22:21:56.049074 tst iperf3.py:8: Test FAILED (7.6 sec) 22:21:56.075836 run osmo-hlr_10.42.42.2(pid=1898): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1898)] 22:21:56.123285 run osmo-hlr_10.42.42.2(pid=1898): stdout: | (launched: 2022-12-12_22:21:52.856103) 22:21:56.172940 run osmo-hlr_10.42.42.2(pid=1898): stderr: | [0;m[1;31m20221212222153033 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212222153034 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212222153034 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212222153034 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212222153034 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212222153034 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212222153046 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:oc2g+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212222153054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212222153054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212222153054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:21:56.222468 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1893): Terminating (SIGTERM) 22:21:56.261967 run iperf3-srv_10.42.42.10(pid=1894): Terminating (SIGTERM) 22:21:56.301290 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1897): Terminating (SIGTERM) 22:21:56.341196 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1900): Terminating (SIGTERM) 22:21:56.380570 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1903): Terminating (SIGTERM) 22:21:56.420042 --- ParallelTerminationStrategy: PID 1893 died... 22:21:56.438993 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1893): Terminated: ok {rc=0} 22:21:56.482495 --- ParallelTerminationStrategy: PID 1894 died... 22:21:56.500876 run iperf3-srv_10.42.42.10(pid=1894): Terminated {rc=256} 22:21:56.544376 --- ParallelTerminationStrategy: PID 1897 died... 22:21:56.562788 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1897): Terminated: ok {rc=0} 22:21:56.605928 --- ParallelTerminationStrategy: PID 1900 died... 22:21:56.624245 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1900): Terminated: ok {rc=0} 22:21:56.667582 --- ParallelTerminationStrategy: PID 1903 died... 22:21:56.686037 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1903): Terminated: ok {rc=0} 22:21:56.771506 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:oc2g+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 22:21:57.918894 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:21:57.930303 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:21:57.987207 tst iperf3m4.py: using LAC 31894 22:21:58.109076 tst iperf3m4.py: using RAC 19 22:21:58.231007 tst iperf3m4.py: using CellId 31894 22:21:58.354000 tst iperf3m4.py: using BVCI 31895 22:21:58.466674 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:21:58.477588 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:21:58.488216 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:21:58.498905 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:21:58.509549 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:21:58.520034 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:21:58.530869 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:21:58.541391 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:21:58.552022 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:21:58.671636 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:21:58.792595 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:21:58.915458 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:21:59.037839 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:21:59.259124 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:21:59.588822 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1905): Launched 22:21:59.874669 run iperf3-srv_10.42.42.10(pid=1906): Launched 22:21:59.998023 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:22:00.219177 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:22:00.549345 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1907): Launched 22:22:00.843765 run iperf3-srv_10.42.42.10(pid=1908): Launched 22:22:00.985216 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:22:01.205075 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:22:01.531893 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1909): Launched 22:22:01.822403 run iperf3-srv_10.42.42.10(pid=1910): Launched 22:22:01.989473 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:22:02.221623 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:22:02.532422 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1911): Launched 22:22:02.801303 run iperf3-srv_10.42.42.10(pid=1912): Launched 22:22:02.916642 tst iperf3m4.py:8: start network... 22:22:03.122934 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:22:03.600737 run create_hlr_db(pid=1913): Launched 22:22:03.726311 bus /gobi_6: Setting Powered False 22:22:04.786693 run create_hlr_db(pid=1913): Terminated: ok {rc=0} 22:22:05.214013 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1915): Launched 22:22:05.522195 run osmo-hlr_10.42.42.2(pid=1916): Launched 22:22:05.638564 run osmo-stp_10.42.42.5: Starting osmo-stp 22:22:06.167867 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1918): Launched 22:22:06.475443 run osmo-stp_10.42.42.5(pid=1919): Launched 22:22:06.593791 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:22:07.125982 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1921): Launched 22:22:07.243336 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:22:07.503698 run patchelf(pid=1922): Launched 22:22:07.675089 run osmo-stp_10.42.42.5(pid=1919): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1919)] 22:22:07.805144 run osmo-stp_10.42.42.5(pid=1919): stdout: | (launched: 2022-12-12_22:22:06.418455) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:22:07.936346 run osmo-stp_10.42.42.5(pid=1919): stderr: | [0;m[38;5;43m20221212222206591 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222206591 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222206591 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222206592 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222206594 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222206594 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222206594 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:22:08.067563 run osmo-stp_10.42.42.5(pid=1919): stdout: | (launched: 2022-12-12_22:22:06.418455) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:22:08.193495 run osmo-stp_10.42.42.5(pid=1919): stderr: | [0;m[38;5;43m20221212222206591 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222206591 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222206591 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222206592 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222206594 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222206594 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222206594 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:22:08.342533 run patchelf(pid=1922): Terminating (SIGINT) 22:22:08.516421 run patchelf(pid=1922): Terminated: ok {rc=0} 22:22:08.641680 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1919): Process ended prematurely: osmo-stp_10.42.42.5(pid=1919) [trial-2383↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1919)] [trial-2383↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8] 22:22:08.651024 tst iperf3m4.py:8: Test FAILED (10.8 sec) 22:22:08.678227 run osmo-hlr_10.42.42.2(pid=1916): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1916)] 22:22:08.725785 run osmo-hlr_10.42.42.2(pid=1916): stdout: | (launched: 2022-12-12_22:22:05.465493) 22:22:08.775081 run osmo-hlr_10.42.42.2(pid=1916): stderr: | [0;m[1;31m20221212222205641 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212222205641 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212222205641 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212222205641 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212222205641 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212222205641 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212222205654 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:oc2g+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212222205664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212222205664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212222205664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:22:08.825030 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1905): Terminating (SIGTERM) 22:22:08.864794 run iperf3-srv_10.42.42.10(pid=1906): Terminating (SIGTERM) 22:22:08.904466 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1907): Terminating (SIGTERM) 22:22:08.944204 run iperf3-srv_10.42.42.10(pid=1908): Terminating (SIGTERM) 22:22:08.983793 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1909): Terminating (SIGTERM) 22:22:09.023675 run iperf3-srv_10.42.42.10(pid=1910): Terminating (SIGTERM) 22:22:09.063281 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1911): Terminating (SIGTERM) 22:22:09.103148 run iperf3-srv_10.42.42.10(pid=1912): Terminating (SIGTERM) 22:22:09.142526 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1915): Terminating (SIGTERM) 22:22:09.182177 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1918): Terminating (SIGTERM) 22:22:09.222016 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1921): Terminating (SIGTERM) 22:22:09.261918 --- ParallelTerminationStrategy: PID 1905 died... 22:22:09.280997 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1905): Terminated: ok {rc=0} 22:22:09.325183 --- ParallelTerminationStrategy: PID 1906 died... 22:22:09.343800 run iperf3-srv_10.42.42.10(pid=1906): Terminated {rc=256} 22:22:09.387650 --- ParallelTerminationStrategy: PID 1907 died... 22:22:09.406201 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1907): Terminated: ok {rc=0} 22:22:09.449872 --- ParallelTerminationStrategy: PID 1908 died... 22:22:09.468332 run iperf3-srv_10.42.42.10(pid=1908): Terminated {rc=256} 22:22:09.512055 --- ParallelTerminationStrategy: PID 1909 died... 22:22:09.530630 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1909): Terminated: ok {rc=0} 22:22:09.574145 --- ParallelTerminationStrategy: PID 1910 died... 22:22:09.592561 run iperf3-srv_10.42.42.10(pid=1910): Terminated {rc=256} 22:22:09.636733 --- ParallelTerminationStrategy: PID 1911 died... 22:22:09.655169 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1911): Terminated: ok {rc=0} 22:22:09.698585 --- ParallelTerminationStrategy: PID 1912 died... 22:22:09.717052 run iperf3-srv_10.42.42.10(pid=1912): Terminated {rc=256} 22:22:09.760163 --- ParallelTerminationStrategy: PID 1915 died... 22:22:09.778506 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1915): Terminated: ok {rc=0} 22:22:09.822391 --- ParallelTerminationStrategy: PID 1918 died... 22:22:09.840791 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1918): Terminated: ok {rc=0} 22:22:09.884287 --- ParallelTerminationStrategy: PID 1921 died... 22:22:09.902942 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1921): Terminated: ok {rc=0} 22:22:09.987956 bus /gobi_4: Setting Powered False 22:22:11.088480 bus /gobi_4: Setting Powered False 22:22:12.204563 bus /gobi_1: Setting Powered False 22:22:13.299278 bus /gobi_1: Setting Powered False 22:22:14.412077 bus /gobi_0: Setting Powered False 22:22:15.509312 bus /gobi_0: Setting Powered False 22:22:16.629740 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:oc2g+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 22:22:17.735693 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:22:17.747711 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:22:17.806619 tst ping.py: using LAC 31895 22:22:17.927654 tst ping.py: using RAC 20 22:22:18.046132 tst ping.py: using CellId 31895 22:22:18.165775 tst ping.py: using BVCI 31896 22:22:18.285084 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:22:18.296390 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:22:18.307496 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:22:18.319017 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:22:18.330349 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:22:18.341789 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:22:18.353574 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:22:18.364806 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:22:18.480287 tst ping.py:19: start network... 22:22:18.681947 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:22:19.147270 run create_hlr_db(pid=1923): Launched 22:22:19.262683 bus /gobi_6: Setting Powered False 22:22:20.322142 run create_hlr_db(pid=1923): Terminated: ok {rc=0} 22:22:20.761958 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1925): Launched 22:22:21.083605 run osmo-hlr_10.42.42.2(pid=1926): Launched 22:22:21.207202 run osmo-stp_10.42.42.5: Starting osmo-stp 22:22:21.738117 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1928): Launched 22:22:22.037207 run osmo-stp_10.42.42.5(pid=1931): Launched 22:22:22.150977 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:22:22.669470 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1933): Launched 22:22:22.785332 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:22:23.040572 run patchelf(pid=1934): Launched 22:22:23.207770 run osmo-stp_10.42.42.5(pid=1931): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1931)] 22:22:23.335586 run osmo-stp_10.42.42.5(pid=1931): stdout: | (launched: 2022-12-12_22:22:21.981690) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:22:23.464634 run osmo-stp_10.42.42.5(pid=1931): stderr: | [0;m[38;5;43m20221212222222153 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222222153 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222222153 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222222154 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222222154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222222154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222222154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:22:23.593788 run osmo-stp_10.42.42.5(pid=1931): stdout: | (launched: 2022-12-12_22:22:21.981690) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:22:23.716443 run osmo-stp_10.42.42.5(pid=1931): stderr: | [0;m[38;5;43m20221212222222153 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222222153 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222222153 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222222154 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222222154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222222154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222222154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:22:23.862654 run patchelf(pid=1934): Terminating (SIGINT) 22:22:24.033079 run patchelf(pid=1934): Terminated: ok {rc=0} 22:22:24.155659 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=1931): Process ended prematurely: osmo-stp_10.42.42.5(pid=1931) [trial-2383↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1931)] [trial-2383↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22] 22:22:24.164353 tst ping.py:22: Test FAILED (6.4 sec) 22:22:24.190711 run osmo-hlr_10.42.42.2(pid=1926): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1926)] 22:22:24.238062 run osmo-hlr_10.42.42.2(pid=1926): stdout: | (launched: 2022-12-12_22:22:21.024897) 22:22:24.286990 run osmo-hlr_10.42.42.2(pid=1926): stderr: | [0;m[1;31m20221212222221223 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212222221223 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212222221223 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212222221223 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212222221223 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212222221223 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212222221235 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:oc2g+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212222221243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212222221243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212222221243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:22:24.336519 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1925): Terminating (SIGTERM) 22:22:24.376295 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1928): Terminating (SIGTERM) 22:22:24.416114 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1933): Terminating (SIGTERM) 22:22:24.456236 --- ParallelTerminationStrategy: PID 1925 died... 22:22:24.475376 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1925): Terminated: ok {rc=0} 22:22:24.519393 --- ParallelTerminationStrategy: PID 1928 died... 22:22:24.538043 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1928): Terminated: ok {rc=0} 22:22:24.581737 --- ParallelTerminationStrategy: PID 1933 died... 22:22:24.600416 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1933): Terminated: ok {rc=0} 22:22:24.685993 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:oc2g+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 22:22:25.776039 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:22:25.787972 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:22:25.845399 tst ping_idle_ping.py: using LAC 31896 22:22:25.964326 tst ping_idle_ping.py: using RAC 21 22:22:26.082231 tst ping_idle_ping.py: using CellId 31896 22:22:26.202058 tst ping_idle_ping.py: using BVCI 31897 22:22:26.310935 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:22:26.321798 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:22:26.332575 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:22:26.343150 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:22:26.353676 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:22:26.364137 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:22:26.374921 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:22:26.385587 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:22:26.506437 tst ping_idle_ping.py:24: start network... 22:22:26.709941 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:22:27.177995 run create_hlr_db(pid=1935): Launched 22:22:27.291804 bus /gobi_6: Setting Powered False 22:22:28.351438 run create_hlr_db(pid=1935): Terminated: ok {rc=0} 22:22:28.771403 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1937): Launched 22:22:29.072063 run osmo-hlr_10.42.42.2(pid=1938): Launched 22:22:29.187888 run osmo-stp_10.42.42.5: Starting osmo-stp 22:22:29.721395 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1940): Launched 22:22:30.024379 run osmo-stp_10.42.42.5(pid=1941): Launched 22:22:30.140762 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:22:30.661459 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1943): Launched 22:22:30.777614 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:22:31.083026 run patchelf(pid=1944): Launched 22:22:31.272458 run osmo-stp_10.42.42.5(pid=1941): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1941)] 22:22:31.413172 run osmo-stp_10.42.42.5(pid=1941): stdout: | (launched: 2022-12-12_22:22:29.968727) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:22:31.556376 run osmo-stp_10.42.42.5(pid=1941): stderr: | [0;m[38;5;43m20221212222230138 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222230138 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222230138 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222230138 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222230141 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222230141 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222230141 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:22:31.697360 run osmo-stp_10.42.42.5(pid=1941): stdout: | (launched: 2022-12-12_22:22:29.968727) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:22:31.833579 run osmo-stp_10.42.42.5(pid=1941): stderr: | [0;m[38;5;43m20221212222230138 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222230138 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222230138 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222230138 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222230141 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222230141 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222230141 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:22:31.994209 run patchelf(pid=1944): Terminating (SIGINT) 22:22:32.179573 run patchelf(pid=1944): Terminated: ok {rc=0} 22:22:32.310602 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=1941): Process ended prematurely: osmo-stp_10.42.42.5(pid=1941) [trial-2383↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1941)] [trial-2383↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 22:22:32.320019 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 22:22:32.348212 run osmo-hlr_10.42.42.2(pid=1938): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1938)] 22:22:32.398168 run osmo-hlr_10.42.42.2(pid=1938): stdout: | (launched: 2022-12-12_22:22:29.017097) 22:22:32.449927 run osmo-hlr_10.42.42.2(pid=1938): stderr: | [0;m[1;31m20221212222229193 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212222229193 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212222229193 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212222229193 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212222229193 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212222229193 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212222229205 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:oc2g+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212222229214 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212222229214 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212222229214 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:22:32.502195 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1937): Terminating (SIGTERM) 22:22:32.543856 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1940): Terminating (SIGTERM) 22:22:32.585634 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1943): Terminating (SIGTERM) 22:22:32.627641 --- ParallelTerminationStrategy: PID 1937 died... 22:22:32.647480 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1937): Terminated: ok {rc=0} 22:22:32.693696 --- ParallelTerminationStrategy: PID 1940 died... 22:22:32.713421 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1940): Terminated: ok {rc=0} 22:22:32.759992 --- ParallelTerminationStrategy: PID 1943 died... 22:22:32.779549 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1943): Terminated: ok {rc=0} 22:22:32.867373 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2383 gprs:oc2g+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 gprs:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 22:22:34.160144 tst gprs:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:22:34.166030 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 22:22:34.186693 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 22:22:34.225137 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 22:22:34.311404 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 22:22:34.332834 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 22:22:34.371654 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 22:22:34.960383 tst gprs:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2383 gprs:oc2g+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 22:22:35.009630 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:22:35.020265 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:22:35.076111 tst cs_paging_gprs_active.py: using LAC 31897 22:22:35.197282 tst cs_paging_gprs_active.py: using RAC 22 22:22:35.316540 tst cs_paging_gprs_active.py: using CellId 31897 22:22:35.436061 tst cs_paging_gprs_active.py: using BVCI 31898 22:22:35.549606 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:22:35.560384 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:22:35.570914 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:22:35.581781 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:22:35.592422 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:22:35.603183 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:22:35.614073 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:22:35.624804 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:22:35.636117 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:22:35.752804 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:22:35.870841 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:22:36.076746 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:22:36.384205 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1948): Launched 22:22:36.650452 run iperf3-srv_10.42.42.10(pid=1949): Launched 22:22:36.765323 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:22:36.970057 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:22:37.276378 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1950): Launched 22:22:37.543094 run iperf3-srv_10.42.42.10(pid=1951): Launched 22:22:37.658674 tst cs_paging_gprs_active.py:38: start network... 22:22:37.863823 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:22:38.337675 run create_hlr_db(pid=1952): Launched 22:22:38.454664 bus /gobi_6: Setting Powered False 22:22:39.515470 run create_hlr_db(pid=1952): Terminated: ok {rc=0} 22:22:39.961798 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1954): Launched 22:22:40.289458 run osmo-hlr_10.42.42.2(pid=1955): Launched 22:22:40.415157 run osmo-stp_10.42.42.5: Starting osmo-stp 22:22:40.978171 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1957): Launched 22:22:41.305098 run osmo-stp_10.42.42.5(pid=1958): Launched 22:22:41.430079 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:22:41.995242 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1960): Launched 22:22:42.120099 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:22:42.395051 run patchelf(pid=1961): Launched 22:22:42.575987 run osmo-stp_10.42.42.5(pid=1958): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1958)] 22:22:42.713909 run osmo-stp_10.42.42.5(pid=1958): stdout: | (launched: 2022-12-12_22:22:41.245687) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:22:42.853810 run osmo-stp_10.42.42.5(pid=1958): stderr: | [0;m[38;5;43m20221212222241439 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222241439 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222241439 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222241440 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222241442 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222241442 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222241442 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:22:42.993147 run osmo-stp_10.42.42.5(pid=1958): stdout: | (launched: 2022-12-12_22:22:41.245687) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:22:43.126618 run osmo-stp_10.42.42.5(pid=1958): stderr: | [0;m[38;5;43m20221212222241439 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222241439 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222241439 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222241440 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222241442 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222241442 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222241442 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:22:43.284266 run patchelf(pid=1961): Terminating (SIGINT) 22:22:43.467801 run patchelf(pid=1961): Terminated: ok {rc=0} 22:22:43.600536 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=1958): Process ended prematurely: osmo-stp_10.42.42.5(pid=1958) [trial-2383↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1958)] [trial-2383↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 22:22:43.610787 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 22:22:43.639192 run osmo-hlr_10.42.42.2(pid=1955): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1955)] 22:22:43.688647 run osmo-hlr_10.42.42.2(pid=1955): stdout: | (launched: 2022-12-12_22:22:40.230041) 22:22:43.740225 run osmo-hlr_10.42.42.2(pid=1955): stderr: | [0;m[1;31m20221212222240432 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212222240432 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212222240432 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212222240432 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212222240432 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212222240432 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212222240444 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:oc2g+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212222240452 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212222240452 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212222240452 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:22:43.792230 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1948): Terminating (SIGTERM) 22:22:43.833676 run iperf3-srv_10.42.42.10(pid=1949): Terminating (SIGTERM) 22:22:43.874931 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1950): Terminating (SIGTERM) 22:22:43.916267 run iperf3-srv_10.42.42.10(pid=1951): Terminating (SIGTERM) 22:22:43.957716 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1954): Terminating (SIGTERM) 22:22:43.999142 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1957): Terminating (SIGTERM) 22:22:44.040347 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1960): Terminating (SIGTERM) 22:22:44.081869 --- ParallelTerminationStrategy: PID 1948 died... 22:22:44.101752 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1948): Terminated: ok {rc=0} 22:22:44.147215 --- ParallelTerminationStrategy: PID 1949 died... 22:22:44.166368 run iperf3-srv_10.42.42.10(pid=1949): Terminated {rc=256} 22:22:44.211498 --- ParallelTerminationStrategy: PID 1950 died... 22:22:44.230669 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1950): Terminated: ok {rc=0} 22:22:44.275870 --- ParallelTerminationStrategy: PID 1951 died... 22:22:44.295001 run iperf3-srv_10.42.42.10(pid=1951): Terminated {rc=256} 22:22:44.340779 --- ParallelTerminationStrategy: PID 1954 died... 22:22:44.360171 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1954): Terminated: ok {rc=0} 22:22:44.406085 --- ParallelTerminationStrategy: PID 1957 died... 22:22:44.426036 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1957): Terminated: ok {rc=0} 22:22:44.472093 --- ParallelTerminationStrategy: PID 1960 died... 22:22:44.491299 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1960): Terminated: ok {rc=0} 22:22:44.577649 bus /gobi_0: Setting Powered False 22:22:45.676484 bus /gobi_0: Setting Powered False 22:22:46.796563 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:oc2g+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 22:22:47.958474 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:22:47.970322 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:22:48.031199 tst iperf3.py: using LAC 31898 22:22:48.160290 tst iperf3.py: using RAC 23 22:22:48.287315 tst iperf3.py: using CellId 31898 22:22:48.416044 tst iperf3.py: using BVCI 31899 22:22:48.534600 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:22:48.546058 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:22:48.557183 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:22:48.568187 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:22:48.579202 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:22:48.590206 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:22:48.601478 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:22:48.612373 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:22:48.623530 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:22:48.739954 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:22:48.946753 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:22:49.253654 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1962): Launched 22:22:49.520202 run iperf3-srv_10.42.42.10(pid=1963): Launched 22:22:49.635549 tst iperf3.py:8: start network... 22:22:49.841433 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:22:50.315412 run create_hlr_db(pid=1965): Launched 22:22:50.433098 bus /gobi_6: Setting Powered False 22:22:51.492096 run create_hlr_db(pid=1965): Terminated: ok {rc=0} 22:22:51.939070 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1967): Launched 22:22:52.270251 run osmo-hlr_10.42.42.2(pid=1968): Launched 22:22:52.394263 run osmo-stp_10.42.42.5: Starting osmo-stp 22:22:52.951995 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1970): Launched 22:22:53.273322 run osmo-stp_10.42.42.5(pid=1971): Launched 22:22:53.397662 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:22:53.956312 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1973): Launched 22:22:54.079590 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:22:54.352070 run patchelf(pid=1974): Launched 22:22:54.531395 run osmo-stp_10.42.42.5(pid=1971): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1971)] 22:22:54.668010 run osmo-stp_10.42.42.5(pid=1971): stdout: | (launched: 2022-12-12_22:22:53.215167) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:22:54.806326 run osmo-stp_10.42.42.5(pid=1971): stderr: | [0;m[38;5;43m20221212222253407 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222253407 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222253407 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222253408 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222253408 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222253408 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222253408 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:22:54.944455 run osmo-stp_10.42.42.5(pid=1971): stdout: | (launched: 2022-12-12_22:22:53.215167) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:22:55.076360 run osmo-stp_10.42.42.5(pid=1971): stderr: | [0;m[38;5;43m20221212222253407 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222253407 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222253407 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222253408 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222253408 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222253408 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222253408 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:22:55.232825 run patchelf(pid=1974): Terminating (SIGINT) 22:22:55.416639 run patchelf(pid=1974): Terminated: ok {rc=0} 22:22:55.548220 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1971): Process ended prematurely: osmo-stp_10.42.42.5(pid=1971) [trial-2383↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1971)] [trial-2383↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8] 22:22:55.558326 tst iperf3.py:8: Test FAILED (7.6 sec) 22:22:55.586280 run osmo-hlr_10.42.42.2(pid=1968): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1968)] 22:22:55.635669 run osmo-hlr_10.42.42.2(pid=1968): stdout: | (launched: 2022-12-12_22:22:52.211914) 22:22:55.686814 run osmo-hlr_10.42.42.2(pid=1968): stderr: | [0;m[1;31m20221212222252411 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212222252411 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212222252411 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212222252411 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212222252411 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212222252411 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212222252423 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:oc2g+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212222252434 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212222252434 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212222252434 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:22:55.738837 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1962): Terminating (SIGTERM) 22:22:55.780359 run iperf3-srv_10.42.42.10(pid=1963): Terminating (SIGTERM) 22:22:55.821624 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1967): Terminating (SIGTERM) 22:22:55.862764 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1970): Terminating (SIGTERM) 22:22:55.904006 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1973): Terminating (SIGTERM) 22:22:55.945396 --- ParallelTerminationStrategy: PID 1962 died... 22:22:55.965181 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1962): Terminated: ok {rc=0} 22:22:56.010795 --- ParallelTerminationStrategy: PID 1963 died... 22:22:56.030160 run iperf3-srv_10.42.42.10(pid=1963): Terminated {rc=256} 22:22:56.075935 --- ParallelTerminationStrategy: PID 1967 died... 22:22:56.095177 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1967): Terminated: ok {rc=0} 22:22:56.140530 --- ParallelTerminationStrategy: PID 1970 died... 22:22:56.159887 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1970): Terminated: ok {rc=0} 22:22:56.205307 --- ParallelTerminationStrategy: PID 1973 died... 22:22:56.224534 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1973): Terminated: ok {rc=0} 22:22:56.311686 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:oc2g+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 22:22:57.457928 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:22:57.469939 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:22:57.528440 tst iperf3m4.py: using LAC 31899 22:22:57.649959 tst iperf3m4.py: using RAC 24 22:22:57.770087 tst iperf3m4.py: using CellId 31899 22:22:57.891362 tst iperf3m4.py: using BVCI 31900 22:22:58.003749 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:22:58.014578 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:22:58.025193 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:22:58.036203 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:22:58.047109 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:22:58.058109 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:22:58.069213 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:22:58.079876 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:22:58.091027 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:22:58.206599 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:22:58.330836 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:22:58.447353 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:22:58.564012 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:22:58.783629 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:22:59.107035 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1975): Launched 22:22:59.387076 run iperf3-srv_10.42.42.10(pid=1976): Launched 22:22:59.508661 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:22:59.726724 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:23:00.051160 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1977): Launched 22:23:00.331554 run iperf3-srv_10.42.42.10(pid=1978): Launched 22:23:00.453457 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:23:00.671287 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:23:01.017759 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1979): Launched 22:23:01.312766 run iperf3-srv_10.42.42.10(pid=1980): Launched 22:23:01.444135 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:23:01.655178 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:23:02.012674 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1981): Launched 22:23:02.285099 run iperf3-srv_10.42.42.10(pid=1982): Launched 22:23:02.399596 tst iperf3m4.py:8: start network... 22:23:02.602739 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:23:03.070974 run create_hlr_db(pid=1983): Launched 22:23:03.187547 bus /gobi_6: Setting Powered False 22:23:04.247216 run create_hlr_db(pid=1983): Terminated: ok {rc=0} 22:23:04.667202 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1985): Launched 22:23:04.968287 run osmo-hlr_10.42.42.2(pid=1986): Launched 22:23:05.083666 run osmo-stp_10.42.42.5: Starting osmo-stp 22:23:05.604743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1988): Launched 22:23:05.908299 run osmo-stp_10.42.42.5(pid=1989): Launched 22:23:06.024162 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:23:06.548131 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1991): Launched 22:23:06.664079 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:23:06.919851 run patchelf(pid=1992): Launched 22:23:07.089952 run osmo-stp_10.42.42.5(pid=1989): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1989)] 22:23:07.219113 run osmo-stp_10.42.42.5(pid=1989): stdout: | (launched: 2022-12-12_22:23:05.852876) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:23:07.349085 run osmo-stp_10.42.42.5(pid=1989): stderr: | [0;m[38;5;43m20221212222306024 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222306024 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222306024 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222306025 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222306025 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222306025 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222306025 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:23:07.479384 run osmo-stp_10.42.42.5(pid=1989): stdout: | (launched: 2022-12-12_22:23:05.852876) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:23:07.603907 run osmo-stp_10.42.42.5(pid=1989): stderr: | [0;m[38;5;43m20221212222306024 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222306024 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222306024 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222306025 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222306025 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222306025 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222306025 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:23:07.751558 run patchelf(pid=1992): Terminating (SIGINT) 22:23:07.924204 run patchelf(pid=1992): Terminated: ok {rc=0} 22:23:08.048396 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1989): Process ended prematurely: osmo-stp_10.42.42.5(pid=1989) [trial-2383↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1989)] [trial-2383↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8] 22:23:08.057784 tst iperf3m4.py:8: Test FAILED (10.6 sec) 22:23:08.085261 run osmo-hlr_10.42.42.2(pid=1986): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1986)] 22:23:08.133717 run osmo-hlr_10.42.42.2(pid=1986): stdout: | (launched: 2022-12-12_22:23:04.913526) 22:23:08.182986 run osmo-hlr_10.42.42.2(pid=1986): stderr: | [0;m[1;31m20221212222305087 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212222305087 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212222305087 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212222305087 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212222305087 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212222305087 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212222305103 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:oc2g+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212222305115 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212222305115 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212222305115 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:23:08.232632 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1975): Terminating (SIGTERM) 22:23:08.272407 run iperf3-srv_10.42.42.10(pid=1976): Terminating (SIGTERM) 22:23:08.313427 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1977): Terminating (SIGTERM) 22:23:08.356085 run iperf3-srv_10.42.42.10(pid=1978): Terminating (SIGTERM) 22:23:08.397464 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1979): Terminating (SIGTERM) 22:23:08.438814 run iperf3-srv_10.42.42.10(pid=1980): Terminating (SIGTERM) 22:23:08.479816 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1981): Terminating (SIGTERM) 22:23:08.521059 run iperf3-srv_10.42.42.10(pid=1982): Terminating (SIGTERM) 22:23:08.562298 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1985): Terminating (SIGTERM) 22:23:08.603362 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1988): Terminating (SIGTERM) 22:23:08.644427 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1991): Terminating (SIGTERM) 22:23:08.685834 --- ParallelTerminationStrategy: PID 1975 died... 22:23:08.705554 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1975): Terminated: ok {rc=0} 22:23:08.751196 --- ParallelTerminationStrategy: PID 1976 died... 22:23:08.770602 run iperf3-srv_10.42.42.10(pid=1976): Terminated {rc=256} 22:23:08.815779 --- ParallelTerminationStrategy: PID 1977 died... 22:23:08.834991 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1977): Terminated: ok {rc=0} 22:23:08.880068 --- ParallelTerminationStrategy: PID 1978 died... 22:23:08.899364 run iperf3-srv_10.42.42.10(pid=1978): Terminated {rc=256} 22:23:08.944318 --- ParallelTerminationStrategy: PID 1979 died... 22:23:08.963645 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1979): Terminated: ok {rc=0} 22:23:09.009162 --- ParallelTerminationStrategy: PID 1980 died... 22:23:09.028750 run iperf3-srv_10.42.42.10(pid=1980): Terminated {rc=256} 22:23:09.074241 --- ParallelTerminationStrategy: PID 1981 died... 22:23:09.093544 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1981): Terminated: ok {rc=0} 22:23:09.138850 --- ParallelTerminationStrategy: PID 1982 died... 22:23:09.158300 run iperf3-srv_10.42.42.10(pid=1982): Terminated {rc=256} 22:23:09.203344 --- ParallelTerminationStrategy: PID 1985 died... 22:23:09.222530 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1985): Terminated: ok {rc=0} 22:23:09.268397 --- ParallelTerminationStrategy: PID 1988 died... 22:23:09.287660 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1988): Terminated: ok {rc=0} 22:23:09.333203 --- ParallelTerminationStrategy: PID 1991 died... 22:23:09.352580 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1991): Terminated: ok {rc=0} 22:23:09.439095 bus /gobi_4: Setting Powered False 22:23:10.538066 bus /gobi_4: Setting Powered False 22:23:11.653150 bus /gobi_1: Setting Powered False 22:23:12.752356 bus /gobi_1: Setting Powered False 22:23:13.868830 bus /gobi_0: Setting Powered False 22:23:14.965859 bus /gobi_0: Setting Powered False 22:23:16.083370 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:oc2g+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 22:23:17.192775 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:23:17.205345 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:23:17.265412 tst ping.py: using LAC 31900 22:23:17.390463 tst ping.py: using RAC 25 22:23:17.515341 tst ping.py: using CellId 31900 22:23:17.639451 tst ping.py: using BVCI 31901 22:23:17.755157 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:23:17.766712 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:23:17.778042 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:23:17.789285 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:23:17.800209 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:23:17.811550 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:23:17.822993 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:23:17.834257 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:23:17.949542 tst ping.py:19: start network... 22:23:18.149933 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:23:18.610258 run create_hlr_db(pid=1993): Launched 22:23:18.724712 bus /gobi_6: Setting Powered False 22:23:19.784323 run create_hlr_db(pid=1993): Terminated: ok {rc=0} 22:23:20.219047 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1995): Launched 22:23:20.535649 run osmo-hlr_10.42.42.2(pid=1996): Launched 22:23:20.656704 run osmo-stp_10.42.42.5: Starting osmo-stp 22:23:21.210862 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1998): Launched 22:23:21.527209 run osmo-stp_10.42.42.5(pid=1999): Launched 22:23:21.648226 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:23:22.195463 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2001): Launched 22:23:22.317228 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:23:22.585332 run patchelf(pid=2002): Launched 22:23:22.762143 run osmo-stp_10.42.42.5(pid=1999): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1999)] 22:23:22.897123 run osmo-stp_10.42.42.5(pid=1999): stdout: | (launched: 2022-12-12_22:23:21.469698) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:23:23.032837 run osmo-stp_10.42.42.5(pid=1999): stderr: | [0;m[38;5;43m20221212222321659 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222321659 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222321660 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222321660 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222321661 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222321661 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222321661 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:23:23.168618 run osmo-stp_10.42.42.5(pid=1999): stdout: | (launched: 2022-12-12_22:23:21.469698) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:23:23.298930 run osmo-stp_10.42.42.5(pid=1999): stderr: | [0;m[38;5;43m20221212222321659 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222321659 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222321660 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222321660 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222321661 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222321661 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222321661 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:23:23.452608 run patchelf(pid=2002): Terminating (SIGINT) 22:23:23.632340 run patchelf(pid=2002): Terminated: ok {rc=0} 22:23:23.761903 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=1999): Process ended prematurely: osmo-stp_10.42.42.5(pid=1999) [trial-2383↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1999)] [trial-2383↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22] 22:23:23.771322 tst ping.py:22: Test FAILED (6.6 sec) 22:23:23.799115 run osmo-hlr_10.42.42.2(pid=1996): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1996)] 22:23:23.849449 run osmo-hlr_10.42.42.2(pid=1996): stdout: | (launched: 2022-12-12_22:23:20.478420) 22:23:23.900835 run osmo-hlr_10.42.42.2(pid=1996): stderr: | [0;m[1;31m20221212222320673 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212222320673 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212222320673 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212222320673 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212222320673 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212222320673 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212222320686 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:oc2g+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212222320694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212222320694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212222320694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:23:23.953028 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1995): Terminating (SIGTERM) 22:23:23.994547 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1998): Terminating (SIGTERM) 22:23:24.036193 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2001): Terminating (SIGTERM) 22:23:24.077869 --- ParallelTerminationStrategy: PID 1995 died... 22:23:24.097847 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1995): Terminated: ok {rc=0} 22:23:24.143638 --- ParallelTerminationStrategy: PID 1998 died... 22:23:24.163113 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1998): Terminated: ok {rc=0} 22:23:24.208553 --- ParallelTerminationStrategy: PID 2001 died... 22:23:24.228064 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2001): Terminated: ok {rc=0} 22:23:24.315479 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:oc2g+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 22:23:25.403107 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:23:25.415520 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:23:25.475957 tst ping_idle_ping.py: using LAC 31901 22:23:25.601624 tst ping_idle_ping.py: using RAC 26 22:23:25.727226 tst ping_idle_ping.py: using CellId 31901 22:23:25.851855 tst ping_idle_ping.py: using BVCI 31902 22:23:25.968135 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:23:25.979546 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:23:25.990630 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:23:26.002299 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:23:26.013480 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:23:26.024619 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:23:26.035950 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:23:26.047061 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:23:26.163498 tst ping_idle_ping.py:24: start network... 22:23:26.365362 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:23:26.833746 run create_hlr_db(pid=2003): Launched 22:23:26.949423 bus /gobi_6: Setting Powered False 22:23:28.008181 run create_hlr_db(pid=2003): Terminated: ok {rc=0} 22:23:28.441715 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2005): Launched 22:23:28.758044 run osmo-hlr_10.42.42.2(pid=2006): Launched 22:23:28.879321 run osmo-stp_10.42.42.5: Starting osmo-stp 22:23:29.431947 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2008): Launched 22:23:29.749360 run osmo-stp_10.42.42.5(pid=2009): Launched 22:23:29.871289 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:23:30.421345 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2011): Launched 22:23:30.542622 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:23:30.810498 run patchelf(pid=2012): Launched 22:23:30.996448 run osmo-stp_10.42.42.5(pid=2009): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2009)] 22:23:31.135257 run osmo-stp_10.42.42.5(pid=2009): stdout: | (launched: 2022-12-12_22:23:29.692108) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:23:31.274678 run osmo-stp_10.42.42.5(pid=2009): stderr: | [0;m[38;5;43m20221212222329882 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222329882 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222329882 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222329882 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222329883 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222329883 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222329883 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:23:31.414936 run osmo-stp_10.42.42.5(pid=2009): stdout: | (launched: 2022-12-12_22:23:29.692108) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:23:31.548224 run osmo-stp_10.42.42.5(pid=2009): stderr: | [0;m[38;5;43m20221212222329882 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222329882 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222329882 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222329882 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222329883 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222329883 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222329883 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:23:31.706256 run patchelf(pid=2012): Terminating (SIGINT) 22:23:31.890739 run patchelf(pid=2012): Terminated: ok {rc=0} 22:23:32.023216 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=2009): Process ended prematurely: osmo-stp_10.42.42.5(pid=2009) [trial-2383↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2009)] [trial-2383↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 22:23:32.033368 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 22:23:32.062002 run osmo-hlr_10.42.42.2(pid=2006): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2006)] 22:23:32.112824 run osmo-hlr_10.42.42.2(pid=2006): stdout: | (launched: 2022-12-12_22:23:28.701223) 22:23:32.165375 run osmo-hlr_10.42.42.2(pid=2006): stderr: | [0;m[1;31m20221212222328897 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212222328897 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212222328897 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212222328897 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212222328897 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212222328897 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212222328909 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:oc2g+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212222328919 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212222328919 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212222328919 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:23:32.217791 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2005): Terminating (SIGTERM) 22:23:32.259986 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2008): Terminating (SIGTERM) 22:23:32.302424 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2011): Terminating (SIGTERM) 22:23:32.344590 --- ParallelTerminationStrategy: PID 2005 died... 22:23:32.364481 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2005): Terminated: ok {rc=0} 22:23:32.410881 --- ParallelTerminationStrategy: PID 2008 died... 22:23:32.430409 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2008): Terminated: ok {rc=0} 22:23:32.476735 --- ParallelTerminationStrategy: PID 2011 died... 22:23:32.496284 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2011): Terminated: ok {rc=0} 22:23:32.584804 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2383 gprs:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 22:23:33.874292 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:23:33.881943 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 22:23:33.903598 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 22:23:33.938670 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 22:23:33.995913 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 22:23:34.018877 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 22:23:34.053853 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 22:23:34.606742 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2383 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 22:23:34.611973 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:23:34.623446 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 22:23:34.679472 tst switch_tch_pdch.py: using LAC 31902 22:23:34.802553 tst switch_tch_pdch.py: using RAC 27 22:23:34.926129 tst switch_tch_pdch.py: using CellId 31902 22:23:35.048493 tst switch_tch_pdch.py: using BVCI 31903 22:23:35.162894 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:23:35.174469 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:23:35.185854 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:23:35.197199 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:23:35.208453 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:23:35.219789 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:23:35.231261 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:23:35.242598 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:23:35.359383 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:23:35.475318 tst switch_tch_pdch.py:51: start network... 22:23:35.676585 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:23:36.138836 run create_hlr_db(pid=2017): Launched 22:23:36.254001 bus /gobi_6: Setting Powered False 22:23:37.313686 run create_hlr_db(pid=2017): Terminated: ok {rc=0} 22:23:37.729717 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2019): Launched 22:23:38.026952 run osmo-hlr_10.42.42.2(pid=2020): Launched 22:23:38.141074 run osmo-stp_10.42.42.5: Starting osmo-stp 22:23:38.654525 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2022): Launched 22:23:38.951441 run osmo-stp_10.42.42.5(pid=2023): Launched 22:23:39.065557 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:23:39.580757 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2025): Launched 22:23:39.695031 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:23:39.946301 run patchelf(pid=2026): Launched 22:23:40.112521 run osmo-stp_10.42.42.5(pid=2023): ERR: Terminated: ERROR {rc=1} [trial-2383↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2023)] 22:23:40.239139 run osmo-stp_10.42.42.5(pid=2023): stdout: | (launched: 2022-12-12_22:23:38.897686) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:23:40.366905 run osmo-stp_10.42.42.5(pid=2023): stderr: | [0;m[38;5;43m20221212222339066 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222339066 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222339066 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222339067 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222339069 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222339069 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222339069 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:23:40.494891 run osmo-stp_10.42.42.5(pid=2023): stdout: | (launched: 2022-12-12_22:23:38.897686) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:23:40.616930 run osmo-stp_10.42.42.5(pid=2023): stderr: | [0;m[38;5;43m20221212222339066 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222339066 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222339066 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222339067 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222339069 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222339069 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222339069 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:23:40.761812 run patchelf(pid=2026): Terminating (SIGINT) 22:23:40.931426 run patchelf(pid=2026): Terminated: ok {rc=0} 22:23:41.052788 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=2023): Process ended prematurely: osmo-stp_10.42.42.5(pid=2023) [trial-2383↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2023)] [trial-2383↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 22:23:41.061628 tst switch_tch_pdch.py:54: Test FAILED (6.4 sec) 22:23:41.088034 run osmo-hlr_10.42.42.2(pid=2020): ERR: Terminated: ERROR {rc=237} [trial-2383↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2020)] 22:23:41.135531 run osmo-hlr_10.42.42.2(pid=2020): stdout: | (launched: 2022-12-12_22:23:37.973279) 22:23:41.185131 run osmo-hlr_10.42.42.2(pid=2020): stderr: | [0;m[1;31m20221212222338148 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212222338148 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212222338149 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212222338149 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212222338149 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212222338149 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212222338164 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212222338174 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212222338174 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212222338174 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:23:41.234374 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2019): Terminating (SIGTERM) 22:23:41.273741 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2022): Terminating (SIGTERM) 22:23:41.313165 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2025): Terminating (SIGTERM) 22:23:41.352623 --- ParallelTerminationStrategy: PID 2019 died... 22:23:41.371504 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2019): Terminated: ok {rc=0} 22:23:41.415458 --- ParallelTerminationStrategy: PID 2022 died... 22:23:41.433727 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2022): Terminated: ok {rc=0} 22:23:41.477968 --- ParallelTerminationStrategy: PID 2025 died... 22:23:41.496346 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2025): Terminated: ok {rc=0} 22:23:41.581365 bus /gobi_0: Setting Powered False 22:23:42.678868 bus /gobi_0: Setting Powered False 22:23:43.790665 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2383 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 dynts:oc2g+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 22:23:45.030328 tst dynts:oc2g+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:23:45.036448 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 22:23:45.057391 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 22:23:45.094057 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 22:23:45.147896 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 22:23:45.168861 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 22:23:45.203942 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 22:23:45.758938 tst dynts:oc2g+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2383 dynts:oc2g+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 22:23:45.764105 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:23:45.775653 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 22:23:45.833790 tst switch_tch_pdch.py: using LAC 31903 22:23:45.965164 tst switch_tch_pdch.py: using RAC 28 22:23:46.100720 tst switch_tch_pdch.py: using CellId 31903 22:23:46.264569 tst switch_tch_pdch.py: using BVCI 31904 22:23:46.396745 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:23:46.411176 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:23:46.434666 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:23:46.447783 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:23:46.464777 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:23:46.480688 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:23:46.496342 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:23:46.516024 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 22:23:46.656013 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 22:23:46.783803 tst switch_tch_pdch.py:51: start network... 22:23:46.998376 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:23:47.500302 run create_hlr_db(pid=2081): Launched 22:23:47.660548 bus /gobi_6: Setting Powered False 22:23:48.752565 run create_hlr_db(pid=2081): Terminated: ok {rc=0} 22:23:49.253704 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2304): Launched 22:23:49.579522 run osmo-hlr_10.42.42.2(pid=2305): Launched 22:23:49.818957 run osmo-stp_10.42.42.5: Starting osmo-stp 22:23:50.529703 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2307): Launched 22:23:50.857705 run osmo-stp_10.42.42.5(pid=2308): Launched 22:23:51.091197 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:23:51.705680 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2312): Launched 22:23:51.838590 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:23:52.112756 run patchelf(pid=2313): Launched 22:23:52.303882 run osmo-stp_10.42.42.5(pid=2308): ERR: Terminated: ERROR {rc=1} [trial-2383↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2308)] 22:23:52.441293 run osmo-stp_10.42.42.5(pid=2308): stdout: | (launched: 2022-12-12_22:23:50.787796) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:23:52.579778 run osmo-stp_10.42.42.5(pid=2308): stderr: | [0;m[38;5;43m20221212222351120 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222351120 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222351120 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222351121 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222351121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222351121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222351121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:23:52.718908 run osmo-stp_10.42.42.5(pid=2308): stdout: | (launched: 2022-12-12_22:23:50.787796) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:23:52.851073 run osmo-stp_10.42.42.5(pid=2308): stderr: | [0;m[38;5;43m20221212222351120 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222351120 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222351120 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222351121 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222351121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222351121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222351121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:23:53.006378 run patchelf(pid=2313): Terminating (SIGINT) 22:23:53.187237 run patchelf(pid=2313): Terminated: ok {rc=0} 22:23:53.319143 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=2308): Process ended prematurely: osmo-stp_10.42.42.5(pid=2308) [trial-2383↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2308)] [trial-2383↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 22:23:53.329588 tst switch_tch_pdch.py:54: Test FAILED (7.6 sec) 22:23:53.358798 run osmo-hlr_10.42.42.2(pid=2305): ERR: Terminated: ERROR {rc=237} [trial-2383↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2305)] 22:23:53.410006 run osmo-hlr_10.42.42.2(pid=2305): stdout: | (launched: 2022-12-12_22:23:49.510245) 22:23:53.463355 run osmo-hlr_10.42.42.2(pid=2305): stderr: | [0;m[1;31m20221212222349861 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212222349861 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212222349861 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212222349861 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212222349861 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212222349861 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212222349883 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/dynts:oc2g+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212222349892 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212222349892 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212222349892 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:23:53.516249 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2304): Terminating (SIGTERM) 22:23:53.559848 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2307): Terminating (SIGTERM) 22:23:53.604598 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2312): Terminating (SIGTERM) 22:23:53.649569 --- ParallelTerminationStrategy: PID 2304 died... 22:23:53.670168 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2304): Terminated: ok {rc=0} 22:23:53.718295 --- ParallelTerminationStrategy: PID 2307 died... 22:23:53.738292 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2307): Terminated: ok {rc=0} 22:23:53.785170 --- ParallelTerminationStrategy: PID 2312 died... 22:23:53.805139 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2312): Terminated: ok {rc=0} 22:23:53.894039 bus /gobi_0: Setting Powered False 22:23:54.995382 bus /gobi_0: Setting Powered False 22:23:56.115161 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2383 dynts:oc2g+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 nitb_sms:trx-b200 --------------------------------------------------------------------- 22:23:57.360409 tst nitb_sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:23:57.365525 tst nitb_sms:trx-b200: Verifying 1 x bts (candidates: 11) 22:23:57.400776 tst nitb_sms:trx-b200: Verifying 1 x ip_address (candidates: 9) 22:23:57.408908 tst nitb_sms:trx-b200: Verifying 2 x modem (candidates: 12) 22:23:57.462833 tst nitb_sms:trx-b200: Reserving 1 x bts (candidates: 11) 22:23:57.498926 tst nitb_sms:trx-b200: Reserving 1 x ip_address (candidates: 9) 22:23:57.506944 tst nitb_sms:trx-b200: Reserving 2 x modem (candidates: 12) 22:23:58.045466 tst nitb_sms:trx-b200: RESERVED RESOURCES for nitb_sms: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 nitb_sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 22:23:58.052142 tst nitb_sms:trx-b200: Using 1 x ip_address (candidates: 1) 22:23:58.064228 tst nitb_sms:trx-b200: Using 1 x bts (candidates: 1) 22:23:58.116052 tst mo_mt_sms.py: using LAC 31904 22:23:58.244395 tst mo_mt_sms.py: using RAC 29 22:23:58.373732 tst mo_mt_sms.py: using CellId 31904 22:23:58.502587 tst mo_mt_sms.py: using BVCI 31905 22:23:58.622978 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 22:23:58.746943 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 22:23:58.867855 tst mo_mt_sms.py:9: start nitb and bts... 22:23:59.090643 run osmo-nitb_10.42.42.2: Starting osmo-nitb 22:23:59.774006 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2317): Launched 22:24:00.113643 run osmo-nitb_10.42.42.2(pid=2318): Launched 22:24:00.314644 run osmo-nitb_10.42.42.2(pid=2318): ERR: Terminated: ERROR {rc=2} [trial-2383↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2318)] 22:24:00.463999 run osmo-nitb_10.42.42.2(pid=2318): stdout: | (launched: 2022-12-12_22:24:00.047353) 22:24:00.614220 run osmo-nitb_10.42.42.2(pid=2318): stderr: | (launched: 2022-12-12_22:24:00.095974) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:24:00.764839 run osmo-nitb_10.42.42.2(pid=2318): stdout: | (launched: 2022-12-12_22:24:00.047353) 22:24:00.949815 run osmo-nitb_10.42.42.2(pid=2318): stderr: | (launched: 2022-12-12_22:24:00.095974) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fa469b2b268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=2318): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2318) [trial-2383↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2318)] 22:24:01.255893 tst osmo-nitb_10.42.42.2(pid=2318): stdout: | (launched: 2022-12-12_22:24:00.047353) 22:24:01.396323 tst osmo-nitb_10.42.42.2(pid=2318): stderr: | (launched: 2022-12-12_22:24:00.095974) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:24:01.542648 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=2318): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2318) [trial-2383↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2318)] [trial-2383↪nitb_sms:trx-b200↪mo_mt_sms.py:11] 22:24:01.551878 tst mo_mt_sms.py:11: Test FAILED (3.5 sec) 22:24:01.559493 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2317): Terminating (SIGTERM) 22:24:01.771918 --- ParallelTerminationStrategy: PID 2317 died... 22:24:01.800168 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2317): Terminated: ok {rc=0} 22:24:01.932939 bus /sierra_3: Setting Powered False 22:24:03.041595 bus /sierra_3: Setting Powered False 22:24:04.161075 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 nitb_sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 sms:trx-b200 --------------------------------------------------------------------- 22:24:05.361755 tst sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:24:05.366546 tst sms:trx-b200: Verifying 1 x bts (candidates: 11) 22:24:05.404545 tst sms:trx-b200: Verifying 6 x ip_address (candidates: 9) 22:24:05.432485 tst sms:trx-b200: Verifying 2 x modem (candidates: 12) 22:24:05.486564 tst sms:trx-b200: Reserving 1 x bts (candidates: 11) 22:24:05.522192 tst sms:trx-b200: Reserving 6 x ip_address (candidates: 9) 22:24:05.550748 tst sms:trx-b200: Reserving 2 x modem (candidates: 12) 22:24:06.091853 tst sms:trx-b200: RESERVED RESOURCES for sms: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 22:24:06.098518 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 22:24:06.110753 tst sms:trx-b200: Using 1 x bts (candidates: 1) 22:24:06.164670 tst mo_mt_sms.py: using LAC 31905 22:24:06.287611 tst mo_mt_sms.py: using RAC 30 22:24:06.409831 tst mo_mt_sms.py: using CellId 31905 22:24:06.533052 tst mo_mt_sms.py: using BVCI 31906 22:24:06.645373 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 22:24:06.657184 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 22:24:06.669192 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 22:24:06.682673 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 22:24:06.694343 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 22:24:06.707210 tst sms:trx-b200: Using 1 x modem (candidates: 2) 22:24:06.828216 tst sms:trx-b200: Using 1 x modem (candidates: 2) 22:24:06.941688 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:24:07.434732 run create_hlr_db(pid=2322): Launched 22:24:07.594030 bus /sierra_2: Setting Powered False 22:24:08.654788 run create_hlr_db(pid=2322): Terminated: ok {rc=0} 22:24:09.084819 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2324): Launched 22:24:09.383488 run osmo-hlr_10.42.42.2(pid=2325): Launched 22:24:09.497481 run osmo-stp_10.42.42.5: Starting osmo-stp 22:24:10.043854 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2327): Launched 22:24:10.359547 run osmo-stp_10.42.42.5(pid=2328): Launched 22:24:10.480254 run osmo-msc_10.42.42.6: Starting osmo-msc 22:24:11.052888 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2330): Launched 22:24:11.368131 run osmo-msc_10.42.42.6(pid=2331): Launched 22:24:11.544216 run osmo-stp_10.42.42.5(pid=2328): ERR: Terminated: ERROR {rc=1} [trial-2383↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2328)] 22:24:11.678459 run osmo-stp_10.42.42.5(pid=2328): stdout: | (launched: 2022-12-12_22:24:10.302538) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:24:11.813551 run osmo-stp_10.42.42.5(pid=2328): stderr: | [0;m[38;5;43m20221212222410492 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222410492 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222410493 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222410493 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222410494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222410494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222410494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:24:11.947460 run osmo-stp_10.42.42.5(pid=2328): stdout: | (launched: 2022-12-12_22:24:10.302538) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:24:12.073908 run osmo-stp_10.42.42.5(pid=2328): stderr: | [0;m[38;5;43m20221212222410492 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222410492 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222410493 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222410493 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222410494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222410494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222410494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:24:12.224847 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=2328): Process ended prematurely: osmo-stp_10.42.42.5(pid=2328) [trial-2383↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2328)] [trial-2383↪sms:trx-b200↪mo_mt_sms.py:16] 22:24:12.233642 tst mo_mt_sms.py:16: Test FAILED (6.1 sec) 22:24:12.260371 run osmo-hlr_10.42.42.2(pid=2325): ERR: Terminated: ERROR {rc=237} [trial-2383↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2325)] 22:24:12.310256 run osmo-hlr_10.42.42.2(pid=2325): stdout: | (launched: 2022-12-12_22:24:09.329665) 22:24:12.361673 run osmo-hlr_10.42.42.2(pid=2325): stderr: | [0;m[1;31m20221212222409503 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212222409503 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212222409503 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212222409504 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212222409504 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212222409504 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212222409516 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/sms:trx-b200/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212222409525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212222409526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212222409526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:24:12.433033 run osmo-msc_10.42.42.6(pid=2331): ERR: Terminated: ERROR {rc=2} [trial-2383↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2331)] 22:24:12.482442 run osmo-msc_10.42.42.6(pid=2331): stdout: | (launched: 2022-12-12_22:24:11.311118) 22:24:12.533384 run osmo-msc_10.42.42.6(pid=2331): stderr: | [0;m[38;5;43m20221212222411636 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212222411636 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f735aebbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212222411636 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212222411636 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212222411636 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212222411636 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212222411638 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212222411638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212222411639 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212222411639 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:24:12.584750 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2324): Terminating (SIGTERM) 22:24:12.625679 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2327): Terminating (SIGTERM) 22:24:12.666755 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2330): Terminating (SIGTERM) 22:24:12.707860 --- ParallelTerminationStrategy: PID 2324 died... 22:24:12.727428 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2324): Terminated: ok {rc=0} 22:24:12.772612 --- ParallelTerminationStrategy: PID 2327 died... 22:24:12.792223 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2327): Terminated: ok {rc=0} 22:24:12.837414 --- ParallelTerminationStrategy: PID 2330 died... 22:24:12.856484 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2330): Terminated: ok {rc=0} 22:24:12.942728 bus /sierra_3: Setting Powered False 22:24:14.039851 bus /sierra_3: Setting Powered False 22:24:15.154911 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 nitb_ussd:trx-b200 --------------------------------------------------------------------- 22:24:16.389328 tst nitb_ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:24:16.394236 tst nitb_ussd:trx-b200: Verifying 1 x bts (candidates: 11) 22:24:16.431348 tst nitb_ussd:trx-b200: Verifying 1 x ip_address (candidates: 9) 22:24:16.438601 tst nitb_ussd:trx-b200: Verifying 1 x modem (candidates: 12) 22:24:16.474888 tst nitb_ussd:trx-b200: Reserving 1 x bts (candidates: 11) 22:24:16.522704 tst nitb_ussd:trx-b200: Reserving 1 x ip_address (candidates: 9) 22:24:16.530415 tst nitb_ussd:trx-b200: Reserving 1 x modem (candidates: 12) 22:24:17.071055 tst nitb_ussd:trx-b200: RESERVED RESOURCES for nitb_ussd: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2383 nitb_ussd:trx-b200 assert_extension.py ---------------------------------------------- 22:24:17.077677 tst nitb_ussd:trx-b200: Using 1 x ip_address (candidates: 1) 22:24:17.090933 tst nitb_ussd:trx-b200: Using 1 x bts (candidates: 1) 22:24:17.145396 tst assert_extension.py: using LAC 31906 22:24:17.268408 tst assert_extension.py: using RAC 31 22:24:17.386788 tst assert_extension.py: using CellId 31906 22:24:17.504415 tst assert_extension.py: using BVCI 31907 22:24:17.613061 tst nitb_ussd:trx-b200: Using 1 x modem (candidates: 1) 22:24:17.729961 tst assert_extension.py:10: start nitb and bts... 22:24:17.944942 run osmo-nitb_10.42.42.2: Starting osmo-nitb 22:24:18.591606 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2336): Launched 22:24:18.907863 run osmo-nitb_10.42.42.2(pid=2337): Launched 22:24:19.082616 run osmo-nitb_10.42.42.2(pid=2337): ERR: Terminated: ERROR {rc=2} [trial-2383↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2337)] 22:24:19.224335 run osmo-nitb_10.42.42.2(pid=2337): stdout: | (launched: 2022-12-12_22:24:18.850896) 22:24:19.367581 run osmo-nitb_10.42.42.2(pid=2337): stderr: | (launched: 2022-12-12_22:24:18.898101) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:24:19.510455 run osmo-nitb_10.42.42.2(pid=2337): stdout: | (launched: 2022-12-12_22:24:18.850896) 22:24:19.647603 run osmo-nitb_10.42.42.2(pid=2337): stderr: | (launched: 2022-12-12_22:24:18.898101) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fa469b2b268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=2337): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2337) [trial-2383↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2337)] 22:24:20.027384 tst osmo-nitb_10.42.42.2(pid=2337): stdout: | (launched: 2022-12-12_22:24:18.850896) 22:24:20.154674 tst osmo-nitb_10.42.42.2(pid=2337): stderr: | (launched: 2022-12-12_22:24:18.898101) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:24:20.305472 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=2337): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2337) [trial-2383↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2337)] [trial-2383↪nitb_ussd:trx-b200↪assert_extension.py:12] 22:24:20.314330 tst assert_extension.py:12: Test FAILED (3.2 sec) 22:24:20.321293 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2336): Terminating (SIGTERM) 22:24:20.531545 --- ParallelTerminationStrategy: PID 2336 died... 22:24:20.553070 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2336): Terminated: ok {rc=0} 22:24:20.639978 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 nitb_ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 ussd:trx-b200 --------------------------------------------------------------------- 22:24:21.818020 tst ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:24:21.822506 tst ussd:trx-b200: Verifying 1 x bts (candidates: 11) 22:24:21.856109 tst ussd:trx-b200: Verifying 6 x ip_address (candidates: 9) 22:24:21.883259 tst ussd:trx-b200: Verifying 1 x modem (candidates: 12) 22:24:21.918752 tst ussd:trx-b200: Reserving 1 x bts (candidates: 11) 22:24:21.952159 tst ussd:trx-b200: Reserving 6 x ip_address (candidates: 9) 22:24:21.979037 tst ussd:trx-b200: Reserving 1 x modem (candidates: 12) 22:24:22.508884 tst ussd:trx-b200: RESERVED RESOURCES for ussd: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2383 ussd:trx-b200 assert_extension.py ---------------------------------------------- 22:24:22.514213 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 22:24:22.525391 tst ussd:trx-b200: Using 1 x bts (candidates: 1) 22:24:22.573788 tst assert_extension.py: using LAC 31907 22:24:22.701343 tst assert_extension.py: using RAC 32 22:24:22.825828 tst assert_extension.py: using CellId 31907 22:24:22.951891 tst assert_extension.py: using BVCI 31908 22:24:23.067335 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 22:24:23.078321 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 22:24:23.089211 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 22:24:23.099936 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 22:24:23.110745 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 22:24:23.121538 tst ussd:trx-b200: Using 1 x modem (candidates: 1) 22:24:23.236362 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:24:23.696635 run create_hlr_db(pid=2341): Launched 22:24:23.810911 bus /sierra_2: Setting Powered False 22:24:24.869957 run create_hlr_db(pid=2341): Terminated: ok {rc=0} 22:24:25.305417 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2343): Launched 22:24:25.622469 run osmo-hlr_10.42.42.2(pid=2344): Launched 22:24:25.743694 run osmo-stp_10.42.42.5: Starting osmo-stp 22:24:26.294909 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2346): Launched 22:24:26.612159 run osmo-stp_10.42.42.5(pid=2347): Launched 22:24:26.734587 run osmo-msc_10.42.42.6: Starting osmo-msc 22:24:27.307166 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2349): Launched 22:24:27.623893 run osmo-msc_10.42.42.6(pid=2350): Launched 22:24:27.802032 run osmo-stp_10.42.42.5(pid=2347): ERR: Terminated: ERROR {rc=1} [trial-2383↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2347)] 22:24:27.936635 run osmo-stp_10.42.42.5(pid=2347): stdout: | (launched: 2022-12-12_22:24:26.554747) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:24:28.071547 run osmo-stp_10.42.42.5(pid=2347): stderr: | [0;m[38;5;43m20221212222426747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222426747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222426747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222426748 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222426750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222426750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222426750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:24:28.205297 run osmo-stp_10.42.42.5(pid=2347): stdout: | (launched: 2022-12-12_22:24:26.554747) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:24:28.331138 run osmo-stp_10.42.42.5(pid=2347): stderr: | [0;m[38;5;43m20221212222426747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222426747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222426747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222426748 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222426750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222426750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222426750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:24:28.482349 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=2347): Process ended prematurely: osmo-stp_10.42.42.5(pid=2347) [trial-2383↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2347)] [trial-2383↪ussd:trx-b200↪assert_extension.py:17] 22:24:28.491122 tst assert_extension.py:17: Test FAILED (6.0 sec) 22:24:28.518038 run osmo-hlr_10.42.42.2(pid=2344): ERR: Terminated: ERROR {rc=237} [trial-2383↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2344)] 22:24:28.567638 run osmo-hlr_10.42.42.2(pid=2344): stdout: | (launched: 2022-12-12_22:24:25.565297) 22:24:28.618764 run osmo-hlr_10.42.42.2(pid=2344): stderr: | [0;m[1;31m20221212222425763 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212222425763 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212222425763 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212222425763 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212222425763 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212222425763 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212222425775 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/ussd:trx-b200/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212222425784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212222425784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212222425784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:24:28.691123 run osmo-msc_10.42.42.6(pid=2350): ERR: Terminated: ERROR {rc=2} [trial-2383↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2350)] 22:24:28.740598 run osmo-msc_10.42.42.6(pid=2350): stdout: | (launched: 2022-12-12_22:24:27.566721) 22:24:28.791949 run osmo-msc_10.42.42.6(pid=2350): stderr: | [0;m[38;5;43m20221212222427887 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212222427887 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe2bafc5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212222427887 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212222427887 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212222427888 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212222427888 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212222427890 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212222427890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212222427890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212222427890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:24:28.843597 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2343): Terminating (SIGTERM) 22:24:28.884821 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2346): Terminating (SIGTERM) 22:24:28.926225 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2349): Terminating (SIGTERM) 22:24:28.967810 --- ParallelTerminationStrategy: PID 2343 died... 22:24:28.987541 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2343): Terminated: ok {rc=0} 22:24:29.033498 --- ParallelTerminationStrategy: PID 2346 died... 22:24:29.052634 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2346): Terminated: ok {rc=0} 22:24:29.098244 --- ParallelTerminationStrategy: PID 2349 died... 22:24:29.117525 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2349): Terminated: ok {rc=0} 22:24:29.204437 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 22:24:30.415209 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:24:30.421616 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 22:24:30.458448 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 22:24:30.485892 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 22:24:30.538785 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 22:24:30.572521 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 22:24:30.599446 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 22:24:31.158506 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 22:24:31.221785 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:24:31.234223 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 22:24:31.307311 tst mo_mt_call.py: using LAC 31908 22:24:31.431290 tst mo_mt_call.py: using RAC 33 22:24:31.589318 tst mo_mt_call.py: using CellId 31908 22:24:31.712167 tst mo_mt_call.py: using BVCI 31909 22:24:31.873558 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:24:31.889175 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:24:31.904349 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:24:31.920134 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:24:31.934955 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:24:31.950068 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:24:32.077009 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:24:32.217229 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:24:32.728153 run create_hlr_db(pid=2355): Launched 22:24:32.859852 bus /sierra_2: Setting Powered False 22:24:33.922940 run create_hlr_db(pid=2355): Terminated: ok {rc=0} 22:24:34.353102 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2357): Launched 22:24:34.661049 run osmo-hlr_10.42.42.2(pid=2359): Launched 22:24:34.777850 run osmo-stp_10.42.42.5: Starting osmo-stp 22:24:35.298559 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2361): Launched 22:24:35.600141 run osmo-stp_10.42.42.5(pid=2362): Launched 22:24:35.715776 run osmo-msc_10.42.42.6: Starting osmo-msc 22:24:36.263447 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2364): Launched 22:24:36.566341 run osmo-msc_10.42.42.6(pid=2365): Launched 22:24:36.736309 run osmo-stp_10.42.42.5(pid=2362): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2362)] 22:24:36.865348 run osmo-stp_10.42.42.5(pid=2362): stdout: | (launched: 2022-12-12_22:24:35.545459) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:24:36.994469 run osmo-stp_10.42.42.5(pid=2362): stderr: | [0;m[38;5;43m20221212222435716 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222435716 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222435717 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222435717 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222435717 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222435717 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222435718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:24:37.120872 run osmo-stp_10.42.42.5(pid=2362): stdout: | (launched: 2022-12-12_22:24:35.545459) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:24:37.241701 run osmo-stp_10.42.42.5(pid=2362): stderr: | [0;m[38;5;43m20221212222435716 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222435716 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222435717 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222435717 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222435717 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222435717 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222435718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:24:37.385960 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2362): Process ended prematurely: osmo-stp_10.42.42.5(pid=2362) [trial-2383↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2362)] [trial-2383↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 22:24:37.394585 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 22:24:37.420902 run osmo-hlr_10.42.42.2(pid=2359): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2359)] 22:24:37.468938 run osmo-hlr_10.42.42.2(pid=2359): stdout: | (launched: 2022-12-12_22:24:34.605956) 22:24:37.518292 run osmo-hlr_10.42.42.2(pid=2359): stderr: | [0;m[1;31m20221212222434784 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212222434784 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212222434784 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212222434784 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212222434784 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212222434784 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212222434796 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212222434805 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212222434805 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212222434805 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:24:37.586887 run osmo-msc_10.42.42.6(pid=2365): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2365)] 22:24:37.634250 run osmo-msc_10.42.42.6(pid=2365): stdout: | (launched: 2022-12-12_22:24:36.511190) 22:24:37.683468 run osmo-msc_10.42.42.6(pid=2365): stderr: | [0;m[38;5;43m20221212222436783 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212222436783 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9a1b64dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212222436783 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212222436784 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212222436784 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212222436784 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212222436786 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212222436786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212222436786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212222436786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:24:37.733086 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2357): Terminating (SIGTERM) 22:24:37.772436 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2361): Terminating (SIGTERM) 22:24:37.811801 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2364): Terminating (SIGTERM) 22:24:37.851377 --- ParallelTerminationStrategy: PID 2357 died... 22:24:37.870079 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2357): Terminated: ok {rc=0} 22:24:37.913816 --- ParallelTerminationStrategy: PID 2361 died... 22:24:37.932078 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2361): Terminated: ok {rc=0} 22:24:37.975713 --- ParallelTerminationStrategy: PID 2364 died... 22:24:37.994051 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2364): Terminated: ok {rc=0} 22:24:38.079851 bus /sierra_3: Setting Powered False 22:24:39.179746 bus /sierra_3: Setting Powered False 22:24:40.293839 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2383 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 22:24:41.440490 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:24:41.452069 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 22:24:41.521144 tst mo_mt_call_osmux.py: using LAC 31909 22:24:41.641986 tst mo_mt_call_osmux.py: using RAC 34 22:24:41.764109 tst mo_mt_call_osmux.py: using CellId 31909 22:24:41.884145 tst mo_mt_call_osmux.py: using BVCI 31910 22:24:41.994888 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:24:42.005929 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:24:42.017190 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:24:42.028124 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:24:42.039153 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:24:42.050267 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:24:42.164705 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:24:42.285301 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:24:42.756191 run create_hlr_db(pid=2367): Launched 22:24:42.871828 bus /sierra_2: Setting Powered False 22:24:43.931567 run create_hlr_db(pid=2367): Terminated: ok {rc=0} 22:24:44.373679 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2369): Launched 22:24:44.696249 run osmo-hlr_10.42.42.2(pid=2370): Launched 22:24:44.819874 run osmo-stp_10.42.42.5: Starting osmo-stp 22:24:45.374999 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2372): Launched 22:24:45.697665 run osmo-stp_10.42.42.5(pid=2373): Launched 22:24:45.821855 run osmo-msc_10.42.42.6: Starting osmo-msc 22:24:46.496223 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2375): Launched 22:24:46.843356 run osmo-msc_10.42.42.6(pid=2376): Launched 22:24:47.225949 run osmo-stp_10.42.42.5(pid=2373): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2373)] 22:24:47.363290 run osmo-stp_10.42.42.5(pid=2373): stdout: | (launched: 2022-12-12_22:24:45.639497) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:24:47.499357 run osmo-stp_10.42.42.5(pid=2373): stderr: | [0;m[38;5;43m20221212222445842 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222445843 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222445843 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222445843 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222445844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222445844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222445844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:24:47.633541 run osmo-stp_10.42.42.5(pid=2373): stdout: | (launched: 2022-12-12_22:24:45.639497) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:24:47.761445 run osmo-stp_10.42.42.5(pid=2373): stderr: | [0;m[38;5;43m20221212222445842 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222445843 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222445843 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222445843 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222445844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222445844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222445844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:24:47.915122 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2373): Process ended prematurely: osmo-stp_10.42.42.5(pid=2373) [trial-2383↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2373)] [trial-2383↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 22:24:47.924546 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 22:24:47.952249 run osmo-hlr_10.42.42.2(pid=2370): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2370)] 22:24:48.002229 run osmo-hlr_10.42.42.2(pid=2370): stdout: | (launched: 2022-12-12_22:24:44.637695) 22:24:48.053957 run osmo-hlr_10.42.42.2(pid=2370): stderr: | [0;m[1;31m20221212222444839 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212222444839 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212222444839 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212222444839 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212222444839 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212222444839 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212222444851 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212222444861 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212222444862 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212222444862 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:24:48.126098 run osmo-msc_10.42.42.6(pid=2376): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2376)] 22:24:48.176032 run osmo-msc_10.42.42.6(pid=2376): stdout: | (launched: 2022-12-12_22:24:46.769849) 22:24:48.227736 run osmo-msc_10.42.42.6(pid=2376): stderr: | [0;m[38;5;43m20221212222447190 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212222447190 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc589ad0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212222447190 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212222447190 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212222447190 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212222447190 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212222447192 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212222447192 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212222447193 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212222447193 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:24:48.279757 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2369): Terminating (SIGTERM) 22:24:48.321371 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2372): Terminating (SIGTERM) 22:24:48.363065 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2375): Terminating (SIGTERM) 22:24:48.404649 --- ParallelTerminationStrategy: PID 2369 died... 22:24:48.424543 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2369): Terminated: ok {rc=0} 22:24:48.470391 --- ParallelTerminationStrategy: PID 2372 died... 22:24:48.489769 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2372): Terminated: ok {rc=0} 22:24:48.535348 --- ParallelTerminationStrategy: PID 2375 died... 22:24:48.554786 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2375): Terminated: ok {rc=0} 22:24:48.642694 bus /sierra_3: Setting Powered False 22:24:49.741601 bus /sierra_3: Setting Powered False 22:24:50.859138 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 22:24:52.108008 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:24:52.114704 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 22:24:52.148688 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 22:24:52.174981 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 22:24:52.227533 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 22:24:52.260572 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 22:24:52.286881 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 22:24:52.834891 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 22:24:52.883701 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:24:52.895050 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 22:24:52.962968 tst mo_mt_call.py: using LAC 31910 22:24:53.082543 tst mo_mt_call.py: using RAC 35 22:24:53.200268 tst mo_mt_call.py: using CellId 31910 22:24:53.319720 tst mo_mt_call.py: using BVCI 31911 22:24:53.430297 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:24:53.441262 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:24:53.451997 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:24:53.462994 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:24:53.473997 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:24:53.485068 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:24:53.603495 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:24:53.724543 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:24:54.224476 run create_hlr_db(pid=2381): Launched 22:24:54.355391 bus /sierra_2: Setting Powered False 22:24:55.418647 run create_hlr_db(pid=2381): Terminated: ok {rc=0} 22:24:55.866834 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2383): Launched 22:24:56.189364 run osmo-hlr_10.42.42.2(pid=2384): Launched 22:24:56.313297 run osmo-stp_10.42.42.5: Starting osmo-stp 22:24:56.872778 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2386): Launched 22:24:57.195229 run osmo-stp_10.42.42.5(pid=2387): Launched 22:24:57.318635 run osmo-msc_10.42.42.6: Starting osmo-msc 22:24:57.903575 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2389): Launched 22:24:58.226148 run osmo-msc_10.42.42.6(pid=2390): Launched 22:24:58.406738 run osmo-stp_10.42.42.5(pid=2387): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2387)] 22:24:58.542867 run osmo-stp_10.42.42.5(pid=2387): stdout: | (launched: 2022-12-12_22:24:57.136475) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:24:58.680057 run osmo-stp_10.42.42.5(pid=2387): stderr: | [0;m[38;5;43m20221212222457329 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222457329 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222457329 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222457330 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222457333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222457333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222457333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:24:58.817064 run osmo-stp_10.42.42.5(pid=2387): stdout: | (launched: 2022-12-12_22:24:57.136475) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:24:58.946257 run osmo-stp_10.42.42.5(pid=2387): stderr: | [0;m[38;5;43m20221212222457329 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222457329 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222457329 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222457330 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222457333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222457333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222457333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:24:59.100576 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2387): Process ended prematurely: osmo-stp_10.42.42.5(pid=2387) [trial-2383↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2387)] [trial-2383↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 22:24:59.110074 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 22:24:59.137440 run osmo-hlr_10.42.42.2(pid=2384): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2384)] 22:24:59.187556 run osmo-hlr_10.42.42.2(pid=2384): stdout: | (launched: 2022-12-12_22:24:56.131156) 22:24:59.239339 run osmo-hlr_10.42.42.2(pid=2384): stderr: | [0;m[1;31m20221212222456328 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212222456328 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212222456328 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212222456328 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212222456328 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212222456329 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212222456342 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212222456351 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212222456352 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212222456352 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:24:59.311288 run osmo-msc_10.42.42.6(pid=2390): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2390)] 22:24:59.361176 run osmo-msc_10.42.42.6(pid=2390): stdout: | (launched: 2022-12-12_22:24:58.167890) 22:24:59.412639 run osmo-msc_10.42.42.6(pid=2390): stderr: | [0;m[38;5;43m20221212222458493 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212222458493 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f26da9a5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212222458493 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212222458494 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212222458494 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212222458494 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212222458496 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212222458496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212222458496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212222458496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:24:59.464804 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2383): Terminating (SIGTERM) 22:24:59.506201 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2386): Terminating (SIGTERM) 22:24:59.547737 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2389): Terminating (SIGTERM) 22:24:59.589640 --- ParallelTerminationStrategy: PID 2383 died... 22:24:59.609549 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2383): Terminated: ok {rc=0} 22:24:59.656131 --- ParallelTerminationStrategy: PID 2386 died... 22:24:59.675789 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2386): Terminated: ok {rc=0} 22:24:59.721930 --- ParallelTerminationStrategy: PID 2389 died... 22:24:59.741441 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2389): Terminated: ok {rc=0} 22:24:59.829477 bus /sierra_3: Setting Powered False 22:25:00.935163 bus /sierra_3: Setting Powered False 22:25:02.063965 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2383 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 22:25:03.220056 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:25:03.231531 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 22:25:03.299769 tst mo_mt_call_osmux.py: using LAC 31911 22:25:03.428809 tst mo_mt_call_osmux.py: using RAC 36 22:25:03.556557 tst mo_mt_call_osmux.py: using CellId 31911 22:25:03.685420 tst mo_mt_call_osmux.py: using BVCI 31912 22:25:03.805095 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:25:03.816723 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:25:03.828077 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:25:03.839411 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:25:03.850800 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:25:03.862355 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:25:03.981819 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:25:04.099280 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:25:04.571242 run create_hlr_db(pid=2395): Launched 22:25:04.689423 bus /sierra_2: Setting Powered False 22:25:05.749963 run create_hlr_db(pid=2395): Terminated: ok {rc=0} 22:25:06.172370 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2397): Launched 22:25:06.475334 run osmo-hlr_10.42.42.2(pid=2398): Launched 22:25:06.592689 run osmo-stp_10.42.42.5: Starting osmo-stp 22:25:07.130018 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2400): Launched 22:25:07.432318 run osmo-stp_10.42.42.5(pid=2401): Launched 22:25:07.548869 run osmo-msc_10.42.42.6: Starting osmo-msc 22:25:08.103289 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2403): Launched 22:25:08.406060 run osmo-msc_10.42.42.6(pid=2404): Launched 22:25:08.576519 run osmo-stp_10.42.42.5(pid=2401): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2401)] 22:25:08.705627 run osmo-stp_10.42.42.5(pid=2401): stdout: | (launched: 2022-12-12_22:25:07.377359) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:25:08.834948 run osmo-stp_10.42.42.5(pid=2401): stderr: | [0;m[38;5;43m20221212222507549 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222507549 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222507549 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222507550 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222507550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222507550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222507550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:25:08.961291 run osmo-stp_10.42.42.5(pid=2401): stdout: | (launched: 2022-12-12_22:25:07.377359) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:25:09.081991 run osmo-stp_10.42.42.5(pid=2401): stderr: | [0;m[38;5;43m20221212222507549 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222507549 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222507549 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222507550 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222507550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222507550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222507550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:25:09.226930 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2401): Process ended prematurely: osmo-stp_10.42.42.5(pid=2401) [trial-2383↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2401)] [trial-2383↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 22:25:09.235632 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 22:25:09.261945 run osmo-hlr_10.42.42.2(pid=2398): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2398)] 22:25:09.309708 run osmo-hlr_10.42.42.2(pid=2398): stdout: | (launched: 2022-12-12_22:25:06.420308) 22:25:09.358683 run osmo-hlr_10.42.42.2(pid=2398): stderr: | [0;m[1;31m20221212222506599 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212222506599 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212222506599 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212222506599 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212222506599 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212222506599 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212222506611 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212222506620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212222506620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212222506620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:25:09.427127 run osmo-msc_10.42.42.6(pid=2404): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2404)] 22:25:09.474418 run osmo-msc_10.42.42.6(pid=2404): stdout: | (launched: 2022-12-12_22:25:08.351108) 22:25:09.523405 run osmo-msc_10.42.42.6(pid=2404): stderr: | [0;m[38;5;43m20221212222508622 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212222508622 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb138df6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212222508623 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212222508623 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212222508623 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212222508623 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212222508625 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212222508625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212222508625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212222508625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:25:09.573352 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2397): Terminating (SIGTERM) 22:25:09.612441 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2400): Terminating (SIGTERM) 22:25:09.651594 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2403): Terminating (SIGTERM) 22:25:09.691129 --- ParallelTerminationStrategy: PID 2397 died... 22:25:09.709744 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2397): Terminated: ok {rc=0} 22:25:09.753197 --- ParallelTerminationStrategy: PID 2400 died... 22:25:09.771476 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2400): Terminated: ok {rc=0} 22:25:09.814873 --- ParallelTerminationStrategy: PID 2403 died... 22:25:09.832894 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2403): Terminated: ok {rc=0} 22:25:09.918119 bus /sierra_3: Setting Powered False 22:25:11.016221 bus /sierra_3: Setting Powered False 22:25:12.127906 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 22:25:13.378308 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:25:13.384871 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 22:25:13.418088 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 22:25:13.444456 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 22:25:13.495638 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 22:25:13.528140 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 22:25:13.554306 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 22:25:14.104623 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 22:25:14.153757 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:25:14.164639 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 22:25:14.233149 tst mo_mt_call.py: using LAC 31912 22:25:14.360745 tst mo_mt_call.py: using RAC 37 22:25:14.479973 tst mo_mt_call.py: using CellId 31912 22:25:14.598585 tst mo_mt_call.py: using BVCI 31913 22:25:14.711033 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:25:14.721993 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:25:14.732708 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:25:14.744205 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:25:14.755429 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:25:14.766548 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:25:14.886485 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:25:15.004870 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:25:15.507069 run create_hlr_db(pid=2409): Launched 22:25:15.639609 bus /sierra_2: Setting Powered False 22:25:16.703740 run create_hlr_db(pid=2409): Terminated: ok {rc=0} 22:25:17.172748 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2411): Launched 22:25:17.480927 run osmo-hlr_10.42.42.2(pid=2412): Launched 22:25:17.599669 run osmo-stp_10.42.42.5: Starting osmo-stp 22:25:18.138467 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2414): Launched 22:25:18.442075 run osmo-stp_10.42.42.5(pid=2415): Launched 22:25:18.558047 run osmo-msc_10.42.42.6: Starting osmo-msc 22:25:19.109496 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2417): Launched 22:25:19.414123 run osmo-msc_10.42.42.6(pid=2418): Launched 22:25:19.585309 run osmo-stp_10.42.42.5(pid=2415): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2415)] 22:25:19.714134 run osmo-stp_10.42.42.5(pid=2415): stdout: | (launched: 2022-12-12_22:25:18.386481) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:25:19.843242 run osmo-stp_10.42.42.5(pid=2415): stderr: | [0;m[38;5;43m20221212222518559 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222518560 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222518560 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222518560 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222518561 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222518561 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222518561 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:25:19.970048 run osmo-stp_10.42.42.5(pid=2415): stdout: | (launched: 2022-12-12_22:25:18.386481) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:25:20.091164 run osmo-stp_10.42.42.5(pid=2415): stderr: | [0;m[38;5;43m20221212222518559 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222518560 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222518560 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222518560 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222518561 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222518561 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222518561 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:25:20.235757 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2415): Process ended prematurely: osmo-stp_10.42.42.5(pid=2415) [trial-2383↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2415)] [trial-2383↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 22:25:20.244539 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 22:25:20.270790 run osmo-hlr_10.42.42.2(pid=2412): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2412)] 22:25:20.318380 run osmo-hlr_10.42.42.2(pid=2412): stdout: | (launched: 2022-12-12_22:25:17.425662) 22:25:20.367374 run osmo-hlr_10.42.42.2(pid=2412): stderr: | [0;m[1;31m20221212222517602 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212222517602 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212222517602 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212222517602 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212222517602 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212222517603 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212222517615 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212222517623 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212222517623 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212222517623 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:25:20.436229 run osmo-msc_10.42.42.6(pid=2418): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2418)] 22:25:20.483582 run osmo-msc_10.42.42.6(pid=2418): stdout: | (launched: 2022-12-12_22:25:19.358879) 22:25:20.532290 run osmo-msc_10.42.42.6(pid=2418): stderr: | [0;m[38;5;43m20221212222519633 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212222519633 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fde8e84fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212222519633 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212222519633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212222519633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212222519634 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212222519635 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212222519636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212222519636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212222519636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:25:20.581712 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2411): Terminating (SIGTERM) 22:25:20.620593 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2414): Terminating (SIGTERM) 22:25:20.660179 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2417): Terminating (SIGTERM) 22:25:20.699757 --- ParallelTerminationStrategy: PID 2411 died... 22:25:20.718528 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2411): Terminated: ok {rc=0} 22:25:20.762359 --- ParallelTerminationStrategy: PID 2414 died... 22:25:20.780538 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2414): Terminated: ok {rc=0} 22:25:20.824580 --- ParallelTerminationStrategy: PID 2417 died... 22:25:20.843214 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2417): Terminated: ok {rc=0} 22:25:20.928556 bus /sierra_3: Setting Powered False 22:25:22.026346 bus /sierra_3: Setting Powered False 22:25:23.141311 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2383 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 22:25:24.287122 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:25:24.298570 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 22:25:24.366561 tst mo_mt_call_osmux.py: using LAC 31913 22:25:24.486136 tst mo_mt_call_osmux.py: using RAC 38 22:25:24.608814 tst mo_mt_call_osmux.py: using CellId 31913 22:25:24.729844 tst mo_mt_call_osmux.py: using BVCI 31914 22:25:24.841065 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:25:24.851941 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:25:24.862671 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:25:24.873552 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:25:24.884918 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:25:24.896076 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:25:25.012192 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:25:25.132547 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:25:25.634088 run create_hlr_db(pid=2420): Launched 22:25:25.765269 bus /sierra_2: Setting Powered False 22:25:26.827602 run create_hlr_db(pid=2420): Terminated: ok {rc=0} 22:25:27.258686 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2422): Launched 22:25:27.560343 run osmo-hlr_10.42.42.2(pid=2423): Launched 22:25:27.676675 run osmo-stp_10.42.42.5: Starting osmo-stp 22:25:28.215798 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2425): Launched 22:25:28.518755 run osmo-stp_10.42.42.5(pid=2426): Launched 22:25:28.636413 run osmo-msc_10.42.42.6: Starting osmo-msc 22:25:29.187580 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2428): Launched 22:25:29.490645 run osmo-msc_10.42.42.6(pid=2429): Launched 22:25:29.662014 run osmo-stp_10.42.42.5(pid=2426): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2426)] 22:25:29.791460 run osmo-stp_10.42.42.5(pid=2426): stdout: | (launched: 2022-12-12_22:25:28.463798) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:25:29.921174 run osmo-stp_10.42.42.5(pid=2426): stderr: | [0;m[38;5;43m20221212222528633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222528633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222528634 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222528634 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222528635 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222528635 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222528635 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:25:30.048078 run osmo-stp_10.42.42.5(pid=2426): stdout: | (launched: 2022-12-12_22:25:28.463798) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:25:30.168529 run osmo-stp_10.42.42.5(pid=2426): stderr: | [0;m[38;5;43m20221212222528633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222528633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222528634 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222528634 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222528635 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222528635 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222528635 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:25:30.312833 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2426): Process ended prematurely: osmo-stp_10.42.42.5(pid=2426) [trial-2383↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2426)] [trial-2383↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 22:25:30.321755 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 22:25:30.347917 run osmo-hlr_10.42.42.2(pid=2423): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2423)] 22:25:30.395352 run osmo-hlr_10.42.42.2(pid=2423): stdout: | (launched: 2022-12-12_22:25:27.505566) 22:25:30.444046 run osmo-hlr_10.42.42.2(pid=2423): stderr: | [0;m[1;31m20221212222527683 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212222527683 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212222527683 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212222527683 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212222527683 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212222527684 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212222527697 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212222527707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212222527708 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212222527708 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:25:30.512899 run osmo-msc_10.42.42.6(pid=2429): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2429)] 22:25:30.560006 run osmo-msc_10.42.42.6(pid=2429): stdout: | (launched: 2022-12-12_22:25:29.435203) 22:25:30.608834 run osmo-msc_10.42.42.6(pid=2429): stderr: | [0;m[38;5;43m20221212222529707 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212222529707 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7efca69adc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212222529707 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212222529707 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212222529707 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212222529708 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212222529709 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212222529710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212222529710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212222529710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:25:30.657808 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2422): Terminating (SIGTERM) 22:25:30.696840 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2425): Terminating (SIGTERM) 22:25:30.735952 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2428): Terminating (SIGTERM) 22:25:30.775123 --- ParallelTerminationStrategy: PID 2422 died... 22:25:30.793890 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2422): Terminated: ok {rc=0} 22:25:30.845305 --- ParallelTerminationStrategy: PID 2425 died... 22:25:30.865426 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2425): Terminated: ok {rc=0} 22:25:30.912742 --- ParallelTerminationStrategy: PID 2428 died... 22:25:30.954725 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2428): Terminated: ok {rc=0} 22:25:31.047220 bus /sierra_3: Setting Powered False 22:25:32.154503 bus /sierra_3: Setting Powered False 22:25:33.281858 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 22:25:34.527607 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:25:34.535654 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 22:25:34.569619 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 22:25:34.597277 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 22:25:34.650349 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 22:25:34.683360 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 22:25:34.709510 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 22:25:35.262101 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 22:25:35.314304 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:25:35.326029 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 22:25:35.396635 tst mo_mt_call.py: using LAC 31914 22:25:35.524471 tst mo_mt_call.py: using RAC 39 22:25:35.652615 tst mo_mt_call.py: using CellId 31914 22:25:35.780113 tst mo_mt_call.py: using BVCI 31915 22:25:35.899627 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:25:35.911231 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:25:35.922503 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:25:35.933951 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:25:35.945418 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:25:35.956642 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 22:25:36.076262 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 22:25:36.193138 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:25:36.662006 run create_hlr_db(pid=2434): Launched 22:25:36.779430 bus /sierra_2: Setting Powered False 22:25:37.839831 run create_hlr_db(pid=2434): Terminated: ok {rc=0} 22:25:38.262727 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2436): Launched 22:25:38.565480 run osmo-hlr_10.42.42.2(pid=2437): Launched 22:25:38.683126 run osmo-stp_10.42.42.5: Starting osmo-stp 22:25:39.211981 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2439): Launched 22:25:39.516859 run osmo-stp_10.42.42.5(pid=2442): Launched 22:25:39.634102 run osmo-msc_10.42.42.6: Starting osmo-msc 22:25:40.190341 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2444): Launched 22:25:40.493275 run osmo-msc_10.42.42.6(pid=2445): Launched 22:25:40.664721 run osmo-stp_10.42.42.5(pid=2442): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2442)] 22:25:40.793973 run osmo-stp_10.42.42.5(pid=2442): stdout: | (launched: 2022-12-12_22:25:39.461591) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:25:40.923020 run osmo-stp_10.42.42.5(pid=2442): stderr: | [0;m[38;5;43m20221212222539634 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222539634 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222539634 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222539635 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222539637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222539637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222539637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:25:41.049489 run osmo-stp_10.42.42.5(pid=2442): stdout: | (launched: 2022-12-12_22:25:39.461591) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:25:41.169959 run osmo-stp_10.42.42.5(pid=2442): stderr: | [0;m[38;5;43m20221212222539634 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222539634 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222539634 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222539635 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222539637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222539637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222539637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:25:41.314115 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2442): Process ended prematurely: osmo-stp_10.42.42.5(pid=2442) [trial-2383↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2442)] [trial-2383↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 22:25:41.322876 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 22:25:41.349172 run osmo-hlr_10.42.42.2(pid=2437): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2437)] 22:25:41.396730 run osmo-hlr_10.42.42.2(pid=2437): stdout: | (launched: 2022-12-12_22:25:38.510585) 22:25:41.445746 run osmo-hlr_10.42.42.2(pid=2437): stderr: | [0;m[1;31m20221212222538686 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212222538686 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212222538687 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212222538687 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212222538687 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212222538687 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212222538700 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212222538710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212222538710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212222538710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:25:41.513816 run osmo-msc_10.42.42.6(pid=2445): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2445)] 22:25:41.561082 run osmo-msc_10.42.42.6(pid=2445): stdout: | (launched: 2022-12-12_22:25:40.438073) 22:25:41.609906 run osmo-msc_10.42.42.6(pid=2445): stderr: | [0;m[38;5;43m20221212222540711 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212222540711 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd906630c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212222540711 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212222540711 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212222540711 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212222540712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212222540713 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212222540714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212222540714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212222540714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:25:41.659050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2436): Terminating (SIGTERM) 22:25:41.698343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2439): Terminating (SIGTERM) 22:25:41.737640 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2444): Terminating (SIGTERM) 22:25:41.777105 --- ParallelTerminationStrategy: PID 2436 died... 22:25:41.796039 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2436): Terminated: ok {rc=0} 22:25:41.839862 --- ParallelTerminationStrategy: PID 2439 died... 22:25:41.858108 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2439): Terminated: ok {rc=0} 22:25:41.927026 --- ParallelTerminationStrategy: PID 2444 died... 22:25:41.945335 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2444): Terminated: ok {rc=0} 22:25:42.028209 bus /sierra_3: Setting Powered False 22:25:43.125645 bus /sierra_3: Setting Powered False 22:25:44.245278 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2383 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 22:25:45.389950 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:25:45.401396 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 22:25:45.470016 tst mo_mt_call_osmux.py: using LAC 31915 22:25:45.592440 tst mo_mt_call_osmux.py: using RAC 40 22:25:45.715106 tst mo_mt_call_osmux.py: using CellId 31915 22:25:45.841247 tst mo_mt_call_osmux.py: using BVCI 31916 22:25:45.968760 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:25:45.980599 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:25:45.992254 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:25:46.004573 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:25:46.018134 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:25:46.030234 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 22:25:46.150208 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 22:25:46.268718 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:25:46.761579 run create_hlr_db(pid=2447): Launched 22:25:46.912112 bus /sierra_2: Setting Powered False 22:25:47.972563 run create_hlr_db(pid=2447): Terminated: ok {rc=0} 22:25:48.394209 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2449): Launched 22:25:48.696161 run osmo-hlr_10.42.42.2(pid=2450): Launched 22:25:48.812737 run osmo-stp_10.42.42.5: Starting osmo-stp 22:25:49.334561 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2452): Launched 22:25:49.636041 run osmo-stp_10.42.42.5(pid=2453): Launched 22:25:49.752306 run osmo-msc_10.42.42.6: Starting osmo-msc 22:25:50.301183 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2455): Launched 22:25:50.604303 run osmo-msc_10.42.42.6(pid=2456): Launched 22:25:50.774634 run osmo-stp_10.42.42.5(pid=2453): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2453)] 22:25:50.903485 run osmo-stp_10.42.42.5(pid=2453): stdout: | (launched: 2022-12-12_22:25:49.581334) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:25:51.032088 run osmo-stp_10.42.42.5(pid=2453): stderr: | [0;m[38;5;43m20221212222549752 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222549753 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222549753 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222549753 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222549754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222549754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222549754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:25:51.159484 run osmo-stp_10.42.42.5(pid=2453): stdout: | (launched: 2022-12-12_22:25:49.581334) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:25:51.279895 run osmo-stp_10.42.42.5(pid=2453): stderr: | [0;m[38;5;43m20221212222549752 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222549753 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222549753 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222549753 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222549754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222549754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222549754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:25:51.423782 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2453): Process ended prematurely: osmo-stp_10.42.42.5(pid=2453) [trial-2383↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2453)] [trial-2383↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 22:25:51.432563 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 22:25:51.459068 run osmo-hlr_10.42.42.2(pid=2450): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2450)] 22:25:51.507045 run osmo-hlr_10.42.42.2(pid=2450): stdout: | (launched: 2022-12-12_22:25:48.641287) 22:25:51.556348 run osmo-hlr_10.42.42.2(pid=2450): stderr: | [0;m[1;31m20221212222548819 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212222548819 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212222548819 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212222548819 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212222548819 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212222548819 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212222548836 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212222548846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212222548846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212222548847 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:25:51.625436 run osmo-msc_10.42.42.6(pid=2456): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2456)] 22:25:51.673304 run osmo-msc_10.42.42.6(pid=2456): stdout: | (launched: 2022-12-12_22:25:50.548920) 22:25:51.722616 run osmo-msc_10.42.42.6(pid=2456): stderr: | [0;m[38;5;43m20221212222550822 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212222550822 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f16a954ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212222550822 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212222550822 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212222550822 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212222550822 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212222550824 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212222550825 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212222550825 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212222550825 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:25:51.772161 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2449): Terminating (SIGTERM) 22:25:51.811980 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2452): Terminating (SIGTERM) 22:25:51.851960 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2455): Terminating (SIGTERM) 22:25:51.891644 --- ParallelTerminationStrategy: PID 2449 died... 22:25:51.910131 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2449): Terminated: ok {rc=0} 22:25:51.954287 --- ParallelTerminationStrategy: PID 2452 died... 22:25:51.972612 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2452): Terminated: ok {rc=0} 22:25:52.017045 --- ParallelTerminationStrategy: PID 2455 died... 22:25:52.035733 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2455): Terminated: ok {rc=0} 22:25:52.121474 bus /sierra_3: Setting Powered False 22:25:53.220395 bus /sierra_3: Setting Powered False 22:25:54.335797 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 22:25:55.587717 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:25:55.594845 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 22:25:55.628827 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 22:25:55.656234 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 22:25:55.711802 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 22:25:55.745732 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 22:25:55.771926 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 22:25:56.325341 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 22:25:56.377435 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:25:56.389215 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 22:25:56.458781 tst mo_mt_call.py: using LAC 31916 22:25:56.584855 tst mo_mt_call.py: using RAC 41 22:25:56.709952 tst mo_mt_call.py: using CellId 31916 22:25:56.836309 tst mo_mt_call.py: using BVCI 31917 22:25:56.954349 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:25:56.965863 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:25:56.977146 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:25:56.988312 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:25:56.999649 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:25:57.010942 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:25:57.127509 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:25:57.244894 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:25:57.747973 run create_hlr_db(pid=2461): Launched 22:25:57.879804 bus /sierra_2: Setting Powered False 22:25:58.944418 run create_hlr_db(pid=2461): Terminated: ok {rc=0} 22:25:59.377376 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2463): Launched 22:25:59.681977 run osmo-hlr_10.42.42.2(pid=2464): Launched 22:25:59.798014 run osmo-stp_10.42.42.5: Starting osmo-stp 22:26:00.323998 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2466): Launched 22:26:00.626062 run osmo-stp_10.42.42.5(pid=2467): Launched 22:26:00.741366 run osmo-msc_10.42.42.6: Starting osmo-msc 22:26:01.355928 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2469): Launched 22:26:01.674064 run osmo-msc_10.42.42.6(pid=2470): Launched 22:26:02.026935 run osmo-stp_10.42.42.5(pid=2467): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2467)] 22:26:02.194574 run osmo-stp_10.42.42.5(pid=2467): stdout: | (launched: 2022-12-12_22:26:00.571045) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:26:02.332854 run osmo-stp_10.42.42.5(pid=2467): stderr: | [0;m[38;5;43m20221212222600743 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222600743 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222600743 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222600743 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222600744 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222600744 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222600744 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:26:02.472218 run osmo-stp_10.42.42.5(pid=2467): stdout: | (launched: 2022-12-12_22:26:00.571045) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:26:02.602391 run osmo-stp_10.42.42.5(pid=2467): stderr: | [0;m[38;5;43m20221212222600743 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222600743 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222600743 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222600743 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222600744 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222600744 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222600744 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:26:02.756804 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2467): Process ended prematurely: osmo-stp_10.42.42.5(pid=2467) [trial-2383↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2467)] [trial-2383↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 22:26:02.766426 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 22:26:02.793979 run osmo-hlr_10.42.42.2(pid=2464): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2464)] 22:26:02.843950 run osmo-hlr_10.42.42.2(pid=2464): stdout: | (launched: 2022-12-12_22:25:59.626878) 22:26:02.895781 run osmo-hlr_10.42.42.2(pid=2464): stderr: | [0;m[1;31m20221212222559803 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212222559803 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212222559803 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212222559803 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212222559803 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212222559803 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212222559815 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212222559824 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212222559825 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212222559825 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:26:02.967204 run osmo-msc_10.42.42.6(pid=2470): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2470)] 22:26:03.017298 run osmo-msc_10.42.42.6(pid=2470): stdout: | (launched: 2022-12-12_22:26:01.615209) 22:26:03.068481 run osmo-msc_10.42.42.6(pid=2470): stderr: | [0;m[38;5;43m20221212222602247 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212222602253 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f426fe8dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212222602253 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212222602253 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212222602254 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212222602254 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212222602267 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212222602268 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212222602268 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212222602268 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:26:03.120278 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2463): Terminating (SIGTERM) 22:26:03.161638 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2466): Terminating (SIGTERM) 22:26:03.203670 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2469): Terminating (SIGTERM) 22:26:03.245342 --- ParallelTerminationStrategy: PID 2463 died... 22:26:03.265246 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2463): Terminated: ok {rc=0} 22:26:03.311216 --- ParallelTerminationStrategy: PID 2466 died... 22:26:03.330774 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2466): Terminated: ok {rc=0} 22:26:03.376744 --- ParallelTerminationStrategy: PID 2469 died... 22:26:03.396277 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2469): Terminated: ok {rc=0} 22:26:03.483585 bus /sierra_3: Setting Powered False 22:26:04.582440 bus /sierra_3: Setting Powered False 22:26:05.698946 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2383 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 22:26:06.847677 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:26:06.859719 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 22:26:06.930737 tst mo_mt_call_osmux.py: using LAC 31917 22:26:07.059648 tst mo_mt_call_osmux.py: using RAC 42 22:26:07.190521 tst mo_mt_call_osmux.py: using CellId 31917 22:26:07.318307 tst mo_mt_call_osmux.py: using BVCI 31918 22:26:07.437992 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:26:07.449644 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:26:07.461080 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:26:07.472428 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:26:07.483931 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:26:07.495349 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:26:07.615052 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:26:07.732457 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:26:08.204052 run create_hlr_db(pid=2472): Launched 22:26:08.321118 bus /sierra_2: Setting Powered False 22:26:09.381724 run create_hlr_db(pid=2472): Terminated: ok {rc=0} 22:26:09.824229 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2474): Launched 22:26:10.149548 run osmo-hlr_10.42.42.2(pid=2475): Launched 22:26:10.274193 run osmo-stp_10.42.42.5: Starting osmo-stp 22:26:10.838126 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2477): Launched 22:26:11.160439 run osmo-stp_10.42.42.5(pid=2478): Launched 22:26:11.284756 run osmo-msc_10.42.42.6: Starting osmo-msc 22:26:11.871187 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2480): Launched 22:26:12.194148 run osmo-msc_10.42.42.6(pid=2481): Launched 22:26:12.374772 run osmo-stp_10.42.42.5(pid=2478): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2478)] 22:26:12.510575 run osmo-stp_10.42.42.5(pid=2478): stdout: | (launched: 2022-12-12_22:26:11.102205) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:26:12.646769 run osmo-stp_10.42.42.5(pid=2478): stderr: | [0;m[38;5;43m20221212222611296 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222611296 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222611296 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222611297 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222611297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222611297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222611297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:26:12.783257 run osmo-stp_10.42.42.5(pid=2478): stdout: | (launched: 2022-12-12_22:26:11.102205) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:26:12.912377 run osmo-stp_10.42.42.5(pid=2478): stderr: | [0;m[38;5;43m20221212222611296 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222611296 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222611296 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222611297 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222611297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222611297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222611297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:26:13.066366 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2478): Process ended prematurely: osmo-stp_10.42.42.5(pid=2478) [trial-2383↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2478)] [trial-2383↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 22:26:13.075805 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 22:26:13.103512 run osmo-hlr_10.42.42.2(pid=2475): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2475)] 22:26:13.153399 run osmo-hlr_10.42.42.2(pid=2475): stdout: | (launched: 2022-12-12_22:26:10.091300) 22:26:13.204871 run osmo-hlr_10.42.42.2(pid=2475): stderr: | [0;m[1;31m20221212222610289 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212222610289 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212222610289 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212222610289 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212222610289 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212222610289 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212222610302 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212222610310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212222610310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212222610310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:26:13.276910 run osmo-msc_10.42.42.6(pid=2481): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2481)] 22:26:13.327027 run osmo-msc_10.42.42.6(pid=2481): stdout: | (launched: 2022-12-12_22:26:12.135627) 22:26:13.378347 run osmo-msc_10.42.42.6(pid=2481): stderr: | [0;m[38;5;43m20221212222612462 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212222612462 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0a85110c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212222612462 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212222612462 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212222612462 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212222612462 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212222612464 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212222612464 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212222612465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212222612465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:26:13.430196 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2474): Terminating (SIGTERM) 22:26:13.471489 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2477): Terminating (SIGTERM) 22:26:13.512773 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2480): Terminating (SIGTERM) 22:26:13.554696 --- ParallelTerminationStrategy: PID 2474 died... 22:26:13.574396 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2474): Terminated: ok {rc=0} 22:26:13.619854 --- ParallelTerminationStrategy: PID 2477 died... 22:26:13.639109 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2477): Terminated: ok {rc=0} 22:26:13.684904 --- ParallelTerminationStrategy: PID 2480 died... 22:26:13.704606 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2480): Terminated: ok {rc=0} 22:26:13.791154 bus /sierra_3: Setting Powered False 22:26:14.888589 bus /sierra_3: Setting Powered False 22:26:16.011414 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 22:26:17.259916 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:26:17.267665 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 22:26:17.301130 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 22:26:17.327495 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 22:26:17.378770 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 22:26:17.412020 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 22:26:17.438581 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 22:26:17.997407 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 22:26:18.050244 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:26:18.061991 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 22:26:18.133391 tst mo_mt_call.py: using LAC 31918 22:26:18.260764 tst mo_mt_call.py: using RAC 43 22:26:18.389162 tst mo_mt_call.py: using CellId 31918 22:26:18.516815 tst mo_mt_call.py: using BVCI 31919 22:26:18.635522 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:26:18.647074 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:26:18.658425 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:26:18.670335 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:26:18.682353 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:26:18.694311 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:26:18.813673 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:26:18.930350 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:26:19.402126 run create_hlr_db(pid=2486): Launched 22:26:19.518394 bus /sierra_2: Setting Powered False 22:26:20.578405 run create_hlr_db(pid=2486): Terminated: ok {rc=0} 22:26:21.019226 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2488): Launched 22:26:21.325647 run osmo-hlr_10.42.42.2(pid=2489): Launched 22:26:21.441972 run osmo-stp_10.42.42.5: Starting osmo-stp 22:26:21.980750 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2491): Launched 22:26:22.282990 run osmo-stp_10.42.42.5(pid=2492): Launched 22:26:22.399132 run osmo-msc_10.42.42.6: Starting osmo-msc 22:26:22.947553 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2494): Launched 22:26:23.249781 run osmo-msc_10.42.42.6(pid=2495): Launched 22:26:23.420069 run osmo-stp_10.42.42.5(pid=2492): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2492)] 22:26:23.549638 run osmo-stp_10.42.42.5(pid=2492): stdout: | (launched: 2022-12-12_22:26:22.227979) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:26:23.678682 run osmo-stp_10.42.42.5(pid=2492): stderr: | [0;m[38;5;43m20221212222622399 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222622399 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222622399 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222622399 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222622400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222622400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222622400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:26:23.805219 run osmo-stp_10.42.42.5(pid=2492): stdout: | (launched: 2022-12-12_22:26:22.227979) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:26:23.925662 run osmo-stp_10.42.42.5(pid=2492): stderr: | [0;m[38;5;43m20221212222622399 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222622399 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222622399 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222622399 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222622400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222622400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222622400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:26:24.069429 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2492): Process ended prematurely: osmo-stp_10.42.42.5(pid=2492) [trial-2383↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2492)] [trial-2383↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 22:26:24.078079 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 22:26:24.104613 run osmo-hlr_10.42.42.2(pid=2489): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2489)] 22:26:24.152185 run osmo-hlr_10.42.42.2(pid=2489): stdout: | (launched: 2022-12-12_22:26:21.270354) 22:26:24.201331 run osmo-hlr_10.42.42.2(pid=2489): stderr: | [0;m[1;31m20221212222621447 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212222621447 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212222621447 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212222621447 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212222621447 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212222621447 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212222621465 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212222621475 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212222621475 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212222621475 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:26:24.270021 run osmo-msc_10.42.42.6(pid=2495): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2495)] 22:26:24.317628 run osmo-msc_10.42.42.6(pid=2495): stdout: | (launched: 2022-12-12_22:26:23.194931) 22:26:24.366637 run osmo-msc_10.42.42.6(pid=2495): stderr: | [0;m[38;5;43m20221212222623469 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212222623469 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f06938aac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212222623469 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212222623469 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212222623470 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212222623470 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212222623474 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212222623474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212222623474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212222623474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:26:24.416008 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2488): Terminating (SIGTERM) 22:26:24.455427 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2491): Terminating (SIGTERM) 22:26:24.494720 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2494): Terminating (SIGTERM) 22:26:24.534284 --- ParallelTerminationStrategy: PID 2488 died... 22:26:24.553055 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2488): Terminated: ok {rc=0} 22:26:24.596927 --- ParallelTerminationStrategy: PID 2491 died... 22:26:24.615716 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2491): Terminated: ok {rc=0} 22:26:24.659188 --- ParallelTerminationStrategy: PID 2494 died... 22:26:24.677403 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2494): Terminated: ok {rc=0} 22:26:24.761100 bus /sierra_3: Setting Powered False 22:26:25.856165 bus /sierra_3: Setting Powered False 22:26:26.971953 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2383 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 22:26:28.118561 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:26:28.130364 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 22:26:28.201023 tst mo_mt_call_osmux.py: using LAC 31919 22:26:28.321358 tst mo_mt_call_osmux.py: using RAC 44 22:26:28.441399 tst mo_mt_call_osmux.py: using CellId 31919 22:26:28.562412 tst mo_mt_call_osmux.py: using BVCI 31920 22:26:28.673338 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:26:28.684349 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:26:28.695163 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:26:28.706377 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:26:28.717682 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:26:28.728692 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:26:28.848216 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:26:28.966055 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:26:29.439424 run create_hlr_db(pid=2498): Launched 22:26:29.555524 bus /sierra_2: Setting Powered False 22:26:30.614623 run create_hlr_db(pid=2498): Terminated: ok {rc=0} 22:26:31.065835 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2500): Launched 22:26:31.445732 run osmo-hlr_10.42.42.2(pid=2501): Launched 22:26:31.730424 run osmo-stp_10.42.42.5: Starting osmo-stp 22:26:32.440763 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2503): Launched 22:26:32.764665 run osmo-stp_10.42.42.5(pid=2504): Launched 22:26:32.888526 run osmo-msc_10.42.42.6: Starting osmo-msc 22:26:33.473656 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2506): Launched 22:26:33.797916 run osmo-msc_10.42.42.6(pid=2507): Launched 22:26:33.979041 run osmo-stp_10.42.42.5(pid=2504): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2504)] 22:26:34.115651 run osmo-stp_10.42.42.5(pid=2504): stdout: | (launched: 2022-12-12_22:26:32.706239) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:26:34.252379 run osmo-stp_10.42.42.5(pid=2504): stderr: | [0;m[38;5;43m20221212222632900 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222632900 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222632900 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222632901 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222632901 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222632901 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222632901 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:26:34.388662 run osmo-stp_10.42.42.5(pid=2504): stdout: | (launched: 2022-12-12_22:26:32.706239) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:26:34.517936 run osmo-stp_10.42.42.5(pid=2504): stderr: | [0;m[38;5;43m20221212222632900 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222632900 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222632900 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222632901 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222632901 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222632901 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222632901 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:26:34.672333 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2504): Process ended prematurely: osmo-stp_10.42.42.5(pid=2504) [trial-2383↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2504)] [trial-2383↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 22:26:34.682054 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 22:26:34.709742 run osmo-hlr_10.42.42.2(pid=2501): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2501)] 22:26:34.759529 run osmo-hlr_10.42.42.2(pid=2501): stdout: | (launched: 2022-12-12_22:26:31.380655) 22:26:34.811340 run osmo-hlr_10.42.42.2(pid=2501): stderr: | [0;m[1;31m20221212222631614 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212222631614 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212222631614 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212222631614 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212222631614 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212222631614 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212222631628 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212222631646 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212222631647 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212222631647 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:26:34.883322 run osmo-msc_10.42.42.6(pid=2507): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2507)] 22:26:34.932804 run osmo-msc_10.42.42.6(pid=2507): stdout: | (launched: 2022-12-12_22:26:33.738951) 22:26:34.984015 run osmo-msc_10.42.42.6(pid=2507): stderr: | [0;m[38;5;43m20221212222634060 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212222634060 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f065b2edc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212222634060 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212222634060 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212222634060 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212222634060 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212222634062 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212222634063 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212222634063 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212222634063 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:26:35.035429 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2500): Terminating (SIGTERM) 22:26:35.076374 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2503): Terminating (SIGTERM) 22:26:35.117735 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2506): Terminating (SIGTERM) 22:26:35.158992 --- ParallelTerminationStrategy: PID 2500 died... 22:26:35.178813 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2500): Terminated: ok {rc=0} 22:26:35.224532 --- ParallelTerminationStrategy: PID 2503 died... 22:26:35.243891 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2503): Terminated: ok {rc=0} 22:26:35.289373 --- ParallelTerminationStrategy: PID 2506 died... 22:26:35.308552 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2506): Terminated: ok {rc=0} 22:26:35.395005 bus /sierra_3: Setting Powered False 22:26:36.493953 bus /sierra_3: Setting Powered False 22:26:37.608819 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 voice:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 22:26:38.860648 tst voice:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:26:38.867213 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 22:26:38.901418 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 22:26:38.929816 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 22:26:38.983534 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 22:26:39.018348 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 22:26:39.045528 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 22:26:39.594614 tst voice:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 22:26:39.646232 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:26:39.657585 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:26:39.729228 tst mo_mt_call.py: using LAC 31920 22:26:39.856512 tst mo_mt_call.py: using RAC 45 22:26:39.984724 tst mo_mt_call.py: using CellId 31920 22:26:40.112239 tst mo_mt_call.py: using BVCI 31921 22:26:40.230326 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:26:40.241624 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:26:40.252587 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:26:40.263751 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:26:40.274880 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:26:40.286014 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 22:26:40.401305 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 22:26:40.516141 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:26:40.985840 run create_hlr_db(pid=2512): Launched 22:26:41.103460 bus /sierra_2: Setting Powered False 22:26:42.163239 run create_hlr_db(pid=2512): Terminated: ok {rc=0} 22:26:42.605754 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2514): Launched 22:26:42.929943 run osmo-hlr_10.42.42.2(pid=2515): Launched 22:26:43.054306 run osmo-stp_10.42.42.5: Starting osmo-stp 22:26:43.617978 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2517): Launched 22:26:43.940641 run osmo-stp_10.42.42.5(pid=2518): Launched 22:26:44.063481 run osmo-msc_10.42.42.6: Starting osmo-msc 22:26:44.646247 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2520): Launched 22:26:44.969230 run osmo-msc_10.42.42.6(pid=2521): Launched 22:26:45.150243 run osmo-stp_10.42.42.5(pid=2518): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2518)] 22:26:45.286282 run osmo-stp_10.42.42.5(pid=2518): stdout: | (launched: 2022-12-12_22:26:43.881989) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:26:45.422963 run osmo-stp_10.42.42.5(pid=2518): stderr: | [0;m[38;5;43m20221212222644072 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222644072 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222644072 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222644073 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222644075 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222644075 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222644075 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:26:45.559582 run osmo-stp_10.42.42.5(pid=2518): stdout: | (launched: 2022-12-12_22:26:43.881989) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:26:45.688157 run osmo-stp_10.42.42.5(pid=2518): stderr: | [0;m[38;5;43m20221212222644072 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222644072 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222644072 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222644073 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222644075 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222644075 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222644075 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:26:45.841870 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2518): Process ended prematurely: osmo-stp_10.42.42.5(pid=2518) [trial-2383↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2518)] [trial-2383↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 22:26:45.855362 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 22:26:45.887647 run osmo-hlr_10.42.42.2(pid=2515): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2515)] 22:26:45.944646 run osmo-hlr_10.42.42.2(pid=2515): stdout: | (launched: 2022-12-12_22:26:42.871366) 22:26:45.996047 run osmo-hlr_10.42.42.2(pid=2515): stderr: | [0;m[1;31m20221212222643068 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212222643068 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212222643068 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212222643068 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212222643068 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212222643068 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212222643080 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212222643088 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212222643088 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212222643089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:26:46.068299 run osmo-msc_10.42.42.6(pid=2521): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2521)] 22:26:46.118642 run osmo-msc_10.42.42.6(pid=2521): stdout: | (launched: 2022-12-12_22:26:44.910726) 22:26:46.171444 run osmo-msc_10.42.42.6(pid=2521): stderr: | [0;m[38;5;43m20221212222645234 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212222645234 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe61d2cac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212222645235 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212222645235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212222645235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212222645235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212222645237 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212222645237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212222645237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212222645237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:26:46.223835 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2514): Terminating (SIGTERM) 22:26:46.267265 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2517): Terminating (SIGTERM) 22:26:46.311204 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2520): Terminating (SIGTERM) 22:26:46.356858 --- ParallelTerminationStrategy: PID 2514 died... 22:26:46.376749 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2514): Terminated: ok {rc=0} 22:26:46.425379 --- ParallelTerminationStrategy: PID 2517 died... 22:26:46.445880 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2517): Terminated: ok {rc=0} 22:26:46.493562 --- ParallelTerminationStrategy: PID 2520 died... 22:26:46.513599 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2520): Terminated: ok {rc=0} 22:26:46.602947 bus /sierra_3: Setting Powered False 22:26:47.700243 bus /sierra_3: Setting Powered False 22:26:48.814827 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2383 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 22:26:49.963365 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:26:49.975394 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:26:50.047728 tst mo_mt_call_osmux.py: using LAC 31921 22:26:50.177686 tst mo_mt_call_osmux.py: using RAC 46 22:26:50.304852 tst mo_mt_call_osmux.py: using CellId 31921 22:26:50.432714 tst mo_mt_call_osmux.py: using BVCI 31922 22:26:50.551444 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:26:50.562847 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:26:50.573956 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:26:50.584942 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:26:50.596054 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:26:50.607217 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 22:26:50.726919 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 22:26:50.844751 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:26:51.317431 run create_hlr_db(pid=2523): Launched 22:26:51.435710 bus /sierra_2: Setting Powered False 22:26:52.495896 run create_hlr_db(pid=2523): Terminated: ok {rc=0} 22:26:52.920121 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2525): Launched 22:26:53.224565 run osmo-hlr_10.42.42.2(pid=2526): Launched 22:26:53.341261 run osmo-stp_10.42.42.5: Starting osmo-stp 22:26:53.883504 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2528): Launched 22:26:54.187390 run osmo-stp_10.42.42.5(pid=2529): Launched 22:26:54.304830 run osmo-msc_10.42.42.6: Starting osmo-msc 22:26:54.856138 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2531): Launched 22:26:55.160578 run osmo-msc_10.42.42.6(pid=2532): Launched 22:26:55.332302 run osmo-stp_10.42.42.5(pid=2529): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2529)] 22:26:55.463224 run osmo-stp_10.42.42.5(pid=2529): stdout: | (launched: 2022-12-12_22:26:54.131763) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:26:55.592808 run osmo-stp_10.42.42.5(pid=2529): stderr: | [0;m[38;5;43m20221212222654302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222654302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222654302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222654303 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222654303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222654303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222654303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:26:55.720162 run osmo-stp_10.42.42.5(pid=2529): stdout: | (launched: 2022-12-12_22:26:54.131763) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:26:55.841566 run osmo-stp_10.42.42.5(pid=2529): stderr: | [0;m[38;5;43m20221212222654302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222654302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222654302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222654303 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222654303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222654303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222654303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:26:55.986647 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2529): Process ended prematurely: osmo-stp_10.42.42.5(pid=2529) [trial-2383↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2529)] [trial-2383↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 22:26:55.995540 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 22:26:56.022596 run osmo-hlr_10.42.42.2(pid=2526): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2526)] 22:26:56.070408 run osmo-hlr_10.42.42.2(pid=2526): stdout: | (launched: 2022-12-12_22:26:53.169152) 22:26:56.119478 run osmo-hlr_10.42.42.2(pid=2526): stderr: | [0;m[1;31m20221212222653347 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212222653347 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212222653347 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212222653347 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212222653347 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212222653347 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212222653359 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212222653368 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212222653368 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212222653368 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:26:56.187837 run osmo-msc_10.42.42.6(pid=2532): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2532)] 22:26:56.235300 run osmo-msc_10.42.42.6(pid=2532): stdout: | (launched: 2022-12-12_22:26:55.104814) 22:26:56.284435 run osmo-msc_10.42.42.6(pid=2532): stderr: | [0;m[38;5;43m20221212222655379 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212222655380 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe3b04bec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212222655380 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212222655380 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212222655380 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212222655380 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212222655382 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212222655382 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212222655382 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212222655383 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:26:56.334031 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2525): Terminating (SIGTERM) 22:26:56.373810 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2528): Terminating (SIGTERM) 22:26:56.413425 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2531): Terminating (SIGTERM) 22:26:56.453519 --- ParallelTerminationStrategy: PID 2525 died... 22:26:56.472470 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2525): Terminated: ok {rc=0} 22:26:56.517138 --- ParallelTerminationStrategy: PID 2528 died... 22:26:56.535462 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2528): Terminated: ok {rc=0} 22:26:56.579988 --- ParallelTerminationStrategy: PID 2531 died... 22:26:56.598514 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2531): Terminated: ok {rc=0} 22:26:56.684475 bus /sierra_3: Setting Powered False 22:26:57.783285 bus /sierra_3: Setting Powered False 22:26:58.898490 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 voice:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 voice:trx-b200+mod-bts0-trxdversion0 --------------------------------------------------------------------- 22:27:00.151696 tst voice:trx-b200+mod-bts0-trxdversion0: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:27:00.156482 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 1 x bts (candidates: 11) 22:27:00.189534 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 6 x ip_address (candidates: 9) 22:27:00.215623 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 2 x modem (candidates: 12) 22:27:00.267599 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 1 x bts (candidates: 11) 22:27:00.300364 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 6 x ip_address (candidates: 9) 22:27:00.326345 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 2 x modem (candidates: 12) 22:27:00.882185 tst voice:trx-b200+mod-bts0-trxdversion0: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call.py ---------------------------------------------- 22:27:00.963165 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 22:27:00.978939 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 22:27:01.047012 tst mo_mt_call.py: using LAC 31922 22:27:01.180583 tst mo_mt_call.py: using RAC 47 22:27:01.309242 tst mo_mt_call.py: using CellId 31922 22:27:01.466970 tst mo_mt_call.py: using BVCI 31923 22:27:01.594464 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 22:27:01.606959 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 22:27:01.619074 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 22:27:01.631706 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 22:27:01.644455 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 22:27:01.656708 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 22:27:01.782044 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 22:27:01.905818 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:27:02.417691 run create_hlr_db(pid=2537): Launched 22:27:02.550775 bus /sierra_2: Setting Powered False 22:27:03.614648 run create_hlr_db(pid=2537): Terminated: ok {rc=0} 22:27:04.064262 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2539): Launched 22:27:04.387865 run osmo-hlr_10.42.42.2(pid=2540): Launched 22:27:04.511575 run osmo-stp_10.42.42.5: Starting osmo-stp 22:27:05.067862 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2542): Launched 22:27:05.391582 run osmo-stp_10.42.42.5(pid=2543): Launched 22:27:05.514843 run osmo-msc_10.42.42.6: Starting osmo-msc 22:27:06.099714 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2545): Launched 22:27:06.422689 run osmo-msc_10.42.42.6(pid=2546): Launched 22:27:06.603336 run osmo-stp_10.42.42.5(pid=2543): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2543)] 22:27:06.739155 run osmo-stp_10.42.42.5(pid=2543): stdout: | (launched: 2022-12-12_22:27:05.332892) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:27:06.876051 run osmo-stp_10.42.42.5(pid=2543): stderr: | [0;m[38;5;43m20221212222705528 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222705528 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222705529 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222705529 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222705529 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222705530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222705530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:27:07.011805 run osmo-stp_10.42.42.5(pid=2543): stdout: | (launched: 2022-12-12_22:27:05.332892) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:27:07.140434 run osmo-stp_10.42.42.5(pid=2543): stderr: | [0;m[38;5;43m20221212222705528 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222705528 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222705529 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222705529 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222705529 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222705530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222705530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:27:07.294622 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2543): Process ended prematurely: osmo-stp_10.42.42.5(pid=2543) [trial-2383↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2543)] [trial-2383↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8] 22:27:07.303848 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 22:27:07.331326 run osmo-hlr_10.42.42.2(pid=2540): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2540)] 22:27:07.380867 run osmo-hlr_10.42.42.2(pid=2540): stdout: | (launched: 2022-12-12_22:27:04.329277) 22:27:07.432309 run osmo-hlr_10.42.42.2(pid=2540): stderr: | [0;m[1;31m20221212222704527 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212222704527 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212222704527 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212222704527 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212222704527 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212222704527 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212222704539 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212222704547 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212222704548 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212222704548 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:27:07.503890 run osmo-msc_10.42.42.6(pid=2546): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2546)] 22:27:07.553371 run osmo-msc_10.42.42.6(pid=2546): stdout: | (launched: 2022-12-12_22:27:06.364057) 22:27:07.604496 run osmo-msc_10.42.42.6(pid=2546): stderr: | [0;m[38;5;43m20221212222706687 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212222706687 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe125435c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212222706687 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212222706687 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212222706687 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212222706687 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212222706689 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212222706689 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212222706690 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212222706690 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:27:07.655994 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2539): Terminating (SIGTERM) 22:27:07.697350 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2542): Terminating (SIGTERM) 22:27:07.738945 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2545): Terminating (SIGTERM) 22:27:07.780410 --- ParallelTerminationStrategy: PID 2539 died... 22:27:07.800067 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2539): Terminated: ok {rc=0} 22:27:07.845851 --- ParallelTerminationStrategy: PID 2542 died... 22:27:07.865241 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2542): Terminated: ok {rc=0} 22:27:07.911047 --- ParallelTerminationStrategy: PID 2545 died... 22:27:07.930619 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2545): Terminated: ok {rc=0} 22:27:08.016845 bus /sierra_3: Setting Powered False 22:27:09.113908 bus /sierra_3: Setting Powered False 22:27:10.228795 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2383 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call_osmux.py ---------------------------------------------- 22:27:11.377270 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 22:27:11.389297 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 22:27:11.441339 tst mo_mt_call_osmux.py: using LAC 31923 22:27:11.570086 tst mo_mt_call_osmux.py: using RAC 48 22:27:11.691273 tst mo_mt_call_osmux.py: using CellId 31923 22:27:11.814537 tst mo_mt_call_osmux.py: using BVCI 31924 22:27:11.927388 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 22:27:11.938538 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 22:27:11.949393 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 22:27:11.960707 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 22:27:11.971759 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 22:27:11.982805 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 22:27:12.099935 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 22:27:12.217217 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:27:12.692596 run create_hlr_db(pid=2548): Launched 22:27:12.809499 bus /sierra_2: Setting Powered False 22:27:13.869772 run create_hlr_db(pid=2548): Terminated: ok {rc=0} 22:27:14.313135 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2550): Launched 22:27:14.635839 run osmo-hlr_10.42.42.2(pid=2551): Launched 22:27:14.759693 run osmo-stp_10.42.42.5: Starting osmo-stp 22:27:15.317300 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2553): Launched 22:27:15.639687 run osmo-stp_10.42.42.5(pid=2554): Launched 22:27:15.764066 run osmo-msc_10.42.42.6: Starting osmo-msc 22:27:16.417578 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2556): Launched 22:27:16.746200 run osmo-msc_10.42.42.6(pid=2557): Launched 22:27:16.981524 run osmo-stp_10.42.42.5(pid=2554): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2554)] 22:27:17.335778 run osmo-stp_10.42.42.5(pid=2554): stdout: | (launched: 2022-12-12_22:27:15.581345) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:27:17.473049 run osmo-stp_10.42.42.5(pid=2554): stderr: | [0;m[38;5;43m20221212222715774 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222715774 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222715774 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222715775 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222715777 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222715777 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222715777 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:27:17.608414 run osmo-stp_10.42.42.5(pid=2554): stdout: | (launched: 2022-12-12_22:27:15.581345) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:27:17.737899 run osmo-stp_10.42.42.5(pid=2554): stderr: | [0;m[38;5;43m20221212222715774 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222715774 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222715774 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222715775 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222715777 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222715777 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222715777 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:27:17.893388 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2554): Process ended prematurely: osmo-stp_10.42.42.5(pid=2554) [trial-2383↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2554)] [trial-2383↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8] 22:27:17.902795 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 22:27:17.930549 run osmo-hlr_10.42.42.2(pid=2551): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2551)] 22:27:17.980578 run osmo-hlr_10.42.42.2(pid=2551): stdout: | (launched: 2022-12-12_22:27:14.577482) 22:27:18.032430 run osmo-hlr_10.42.42.2(pid=2551): stderr: | [0;m[1;31m20221212222714776 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212222714776 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212222714776 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212222714776 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212222714776 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212222714776 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212222714788 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212222714796 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212222714796 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212222714797 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:27:18.104631 run osmo-msc_10.42.42.6(pid=2557): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2557)] 22:27:18.154670 run osmo-msc_10.42.42.6(pid=2557): stdout: | (launched: 2022-12-12_22:27:16.687146) 22:27:18.206198 run osmo-msc_10.42.42.6(pid=2557): stderr: | [0;m[38;5;43m20221212222717176 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212222717176 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f21452b7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212222717176 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212222717176 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212222717185 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212222717185 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212222717187 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212222717187 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212222717187 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212222717187 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:27:18.258263 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2550): Terminating (SIGTERM) 22:27:18.300023 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2553): Terminating (SIGTERM) 22:27:18.341918 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2556): Terminating (SIGTERM) 22:27:18.383913 --- ParallelTerminationStrategy: PID 2550 died... 22:27:18.403970 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2550): Terminated: ok {rc=0} 22:27:18.450306 --- ParallelTerminationStrategy: PID 2553 died... 22:27:18.469840 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2553): Terminated: ok {rc=0} 22:27:18.515612 --- ParallelTerminationStrategy: PID 2556 died... 22:27:18.534963 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2556): Terminated: ok {rc=0} 22:27:18.622147 bus /sierra_3: Setting Powered False 22:27:19.720504 bus /sierra_3: Setting Powered False 22:27:20.836015 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 voice:trx-b200+mod-bts0-trxdversion0 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 22:27:22.085750 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:27:22.092263 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 22:27:22.125988 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 22:27:22.153221 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 22:27:22.205984 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 22:27:22.239970 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 22:27:22.267241 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 22:27:22.818936 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 22:27:22.870599 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:27:22.882890 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 22:27:22.936511 tst mo_mt_call.py: using LAC 31924 22:27:23.066608 tst mo_mt_call.py: using RAC 49 22:27:23.195209 tst mo_mt_call.py: using CellId 31924 22:27:23.327656 tst mo_mt_call.py: using BVCI 31925 22:27:23.446829 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:27:23.458552 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:27:23.470112 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:27:23.481699 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:27:23.493217 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:27:23.504637 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 22:27:23.624363 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 22:27:23.741134 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:27:24.213127 run create_hlr_db(pid=2562): Launched 22:27:24.330690 bus /sierra_2: Setting Powered False 22:27:25.391446 run create_hlr_db(pid=2562): Terminated: ok {rc=0} 22:27:25.815379 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2564): Launched 22:27:26.121409 run osmo-hlr_10.42.42.2(pid=2565): Launched 22:27:26.238779 run osmo-stp_10.42.42.5: Starting osmo-stp 22:27:26.778173 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2567): Launched 22:27:27.081740 run osmo-stp_10.42.42.5(pid=2568): Launched 22:27:27.199513 run osmo-msc_10.42.42.6: Starting osmo-msc 22:27:27.751411 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2570): Launched 22:27:28.055878 run osmo-msc_10.42.42.6(pid=2571): Launched 22:27:28.227558 run osmo-stp_10.42.42.5(pid=2568): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2568)] 22:27:28.357665 run osmo-stp_10.42.42.5(pid=2568): stdout: | (launched: 2022-12-12_22:27:27.026290) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:27:28.487367 run osmo-stp_10.42.42.5(pid=2568): stderr: | [0;m[38;5;43m20221212222727196 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222727196 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222727196 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222727196 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222727199 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222727199 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222727199 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:27:28.614551 run osmo-stp_10.42.42.5(pid=2568): stdout: | (launched: 2022-12-12_22:27:27.026290) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:27:28.735517 run osmo-stp_10.42.42.5(pid=2568): stderr: | [0;m[38;5;43m20221212222727196 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222727196 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222727196 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222727196 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222727199 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222727199 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222727199 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:27:28.880276 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2568): Process ended prematurely: osmo-stp_10.42.42.5(pid=2568) [trial-2383↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2568)] [trial-2383↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 22:27:28.889397 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 22:27:28.916214 run osmo-hlr_10.42.42.2(pid=2565): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2565)] 22:27:28.963827 run osmo-hlr_10.42.42.2(pid=2565): stdout: | (launched: 2022-12-12_22:27:26.065764) 22:27:29.013050 run osmo-hlr_10.42.42.2(pid=2565): stderr: | [0;m[1;31m20221212222726241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212222726241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212222726241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212222726241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212222726241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212222726241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212222726257 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212222726267 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212222726267 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212222726267 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:27:29.081310 run osmo-msc_10.42.42.6(pid=2571): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2571)] 22:27:29.128692 run osmo-msc_10.42.42.6(pid=2571): stdout: | (launched: 2022-12-12_22:27:28.000295) 22:27:29.177526 run osmo-msc_10.42.42.6(pid=2571): stderr: | [0;m[38;5;43m20221212222728274 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212222728274 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f98a5eafc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212222728274 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212222728274 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212222728274 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212222728274 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212222728276 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212222728277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212222728277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212222728277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:27:29.226933 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2564): Terminating (SIGTERM) 22:27:29.266271 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2567): Terminating (SIGTERM) 22:27:29.305976 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2570): Terminating (SIGTERM) 22:27:29.345890 --- ParallelTerminationStrategy: PID 2564 died... 22:27:29.364597 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2564): Terminated: ok {rc=0} 22:27:29.408703 --- ParallelTerminationStrategy: PID 2567 died... 22:27:29.427280 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2567): Terminated: ok {rc=0} 22:27:29.471132 --- ParallelTerminationStrategy: PID 2570 died... 22:27:29.489700 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2570): Terminated: ok {rc=0} 22:27:29.575250 bus /sierra_3: Setting Powered False 22:27:30.673696 bus /sierra_3: Setting Powered False 22:27:31.794651 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2383 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 22:27:32.960041 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:27:32.972663 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 22:27:33.032562 tst mo_mt_call_osmux.py: using LAC 31925 22:27:33.166716 tst mo_mt_call_osmux.py: using RAC 50 22:27:33.303432 tst mo_mt_call_osmux.py: using CellId 31925 22:27:33.424815 tst mo_mt_call_osmux.py: using BVCI 31926 22:27:33.535904 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:27:33.547302 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:27:33.558441 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:27:33.569978 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:27:33.581501 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:27:33.592650 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 22:27:33.712006 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 22:27:33.836681 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:27:34.338615 run create_hlr_db(pid=2573): Launched 22:27:34.470704 bus /sierra_2: Setting Powered False 22:27:35.534541 run create_hlr_db(pid=2573): Terminated: ok {rc=0} 22:27:35.967252 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2575): Launched 22:27:36.270468 run osmo-hlr_10.42.42.2(pid=2576): Launched 22:27:36.386579 run osmo-stp_10.42.42.5: Starting osmo-stp 22:27:36.909693 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2578): Launched 22:27:37.211967 run osmo-stp_10.42.42.5(pid=2579): Launched 22:27:37.328117 run osmo-msc_10.42.42.6: Starting osmo-msc 22:27:37.876267 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2581): Launched 22:27:38.181091 run osmo-msc_10.42.42.6(pid=2582): Launched 22:27:38.351986 run osmo-stp_10.42.42.5(pid=2579): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2579)] 22:27:38.481384 run osmo-stp_10.42.42.5(pid=2579): stdout: | (launched: 2022-12-12_22:27:37.156822) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:27:38.610641 run osmo-stp_10.42.42.5(pid=2579): stderr: | [0;m[38;5;43m20221212222737328 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222737328 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222737329 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222737329 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222737330 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222737330 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222737330 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:27:38.737409 run osmo-stp_10.42.42.5(pid=2579): stdout: | (launched: 2022-12-12_22:27:37.156822) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:27:38.858543 run osmo-stp_10.42.42.5(pid=2579): stderr: | [0;m[38;5;43m20221212222737328 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222737328 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222737329 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222737329 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222737330 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222737330 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222737330 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:27:39.003481 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2579): Process ended prematurely: osmo-stp_10.42.42.5(pid=2579) [trial-2383↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2579)] [trial-2383↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 22:27:39.012459 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 22:27:39.038947 run osmo-hlr_10.42.42.2(pid=2576): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2576)] 22:27:39.086800 run osmo-hlr_10.42.42.2(pid=2576): stdout: | (launched: 2022-12-12_22:27:36.215363) 22:27:39.136181 run osmo-hlr_10.42.42.2(pid=2576): stderr: | [0;m[1;31m20221212222736390 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212222736390 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212222736390 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212222736390 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212222736390 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212222736391 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212222736403 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212222736412 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212222736413 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212222736413 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:27:39.204697 run osmo-msc_10.42.42.6(pid=2582): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2582)] 22:27:39.252228 run osmo-msc_10.42.42.6(pid=2582): stdout: | (launched: 2022-12-12_22:27:38.125815) 22:27:39.301205 run osmo-msc_10.42.42.6(pid=2582): stderr: | [0;m[38;5;43m20221212222738399 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212222738400 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7feca4f28c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212222738400 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212222738400 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212222738400 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212222738400 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212222738402 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212222738402 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212222738403 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212222738403 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:27:39.350980 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2575): Terminating (SIGTERM) 22:27:39.390590 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2578): Terminating (SIGTERM) 22:27:39.430282 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2581): Terminating (SIGTERM) 22:27:39.470296 --- ParallelTerminationStrategy: PID 2575 died... 22:27:39.489208 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2575): Terminated: ok {rc=0} 22:27:39.533595 --- ParallelTerminationStrategy: PID 2578 died... 22:27:39.551960 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2578): Terminated: ok {rc=0} 22:27:39.596341 --- ParallelTerminationStrategy: PID 2581 died... 22:27:39.614877 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2581): Terminated: ok {rc=0} 22:27:39.700263 bus /sierra_3: Setting Powered False 22:27:40.798273 bus /sierra_3: Setting Powered False 22:27:41.911097 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 emergency:trx-b200 --------------------------------------------------------------------- 22:27:43.162845 tst emergency:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:27:43.168462 tst emergency:trx-b200: Verifying 1 x bts (candidates: 11) 22:27:43.202255 tst emergency:trx-b200: Verifying 6 x ip_address (candidates: 9) 22:27:43.229496 tst emergency:trx-b200: Verifying 4 x modem (candidates: 12) 22:27:43.314645 tst emergency:trx-b200: Reserving 1 x bts (candidates: 11) 22:27:43.347978 tst emergency:trx-b200: Reserving 6 x ip_address (candidates: 9) 22:27:43.375039 tst emergency:trx-b200: Reserving 4 x modem (candidates: 12) 22:27:43.965479 tst emergency:trx-b200: RESERVED RESOURCES for emergency: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2383 emergency:trx-b200 emergency_mo_mt_call.py ---------------------------------------------- 22:27:43.970496 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 22:27:43.981800 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 22:27:44.032387 tst emergency_mo_mt_call.py: using LAC 31926 22:27:44.157535 tst emergency_mo_mt_call.py: using RAC 51 22:27:44.275020 tst emergency_mo_mt_call.py: using CellId 31926 22:27:44.391443 tst emergency_mo_mt_call.py: using BVCI 31927 22:27:44.501023 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 22:27:44.511587 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 22:27:44.522022 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 22:27:44.532668 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 22:27:44.543393 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 22:27:44.554508 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 22:27:44.669536 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 22:27:44.788148 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:27:45.281395 run create_hlr_db(pid=2589): Launched 22:27:45.411517 bus /sierra_2: Setting Powered False 22:27:46.469874 run create_hlr_db(pid=2589): Terminated: ok {rc=0} 22:27:46.917699 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2591): Launched 22:27:47.243681 run osmo-hlr_10.42.42.2(pid=2592): Launched 22:27:47.372767 run osmo-stp_10.42.42.5: Starting osmo-stp 22:27:47.920047 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2594): Launched 22:27:48.237576 run osmo-stp_10.42.42.5(pid=2595): Launched 22:27:48.367570 tst emergency_mo_mt_call.py: using MSISDN 8004 22:27:48.530495 run osmo-msc_10.42.42.6: Starting osmo-msc 22:27:49.103079 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2597): Launched 22:27:49.420574 run osmo-msc_10.42.42.6(pid=2598): Launched 22:27:49.598004 run osmo-stp_10.42.42.5(pid=2595): ERR: Terminated: ERROR {rc=1} [trial-2383↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2595)] 22:27:49.731899 run osmo-stp_10.42.42.5(pid=2595): stdout: | (launched: 2022-12-12_22:27:48.180405) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:27:49.866492 run osmo-stp_10.42.42.5(pid=2595): stderr: | [0;m[38;5;43m20221212222748374 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222748374 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222748374 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222748375 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222748375 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222748375 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222748375 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:27:50.001243 run osmo-stp_10.42.42.5(pid=2595): stdout: | (launched: 2022-12-12_22:27:48.180405) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:27:50.128045 run osmo-stp_10.42.42.5(pid=2595): stderr: | [0;m[38;5;43m20221212222748374 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222748374 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222748374 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222748375 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222748375 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222748375 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222748375 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:27:50.279376 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=2595): Process ended prematurely: osmo-stp_10.42.42.5(pid=2595) [trial-2383↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2595)] [trial-2383↪emergency:trx-b200↪emergency_mo_mt_call.py:19] 22:27:50.288210 tst emergency_mo_mt_call.py:19: Test FAILED (6.3 sec) 22:27:50.315319 run osmo-hlr_10.42.42.2(pid=2592): ERR: Terminated: ERROR {rc=237} [trial-2383↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2592)] 22:27:50.365155 run osmo-hlr_10.42.42.2(pid=2592): stdout: | (launched: 2022-12-12_22:27:47.178218) 22:27:50.416314 run osmo-hlr_10.42.42.2(pid=2592): stderr: | [0;m[1;31m20221212222747385 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212222747386 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212222747386 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212222747386 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212222747386 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212222747386 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212222747398 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/emergency:trx-b200/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212222747406 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212222747406 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212222747406 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:27:50.488022 run osmo-msc_10.42.42.6(pid=2598): ERR: Terminated: ERROR {rc=2} [trial-2383↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2598)] 22:27:50.537636 run osmo-msc_10.42.42.6(pid=2598): stdout: | (launched: 2022-12-12_22:27:49.363204) 22:27:50.588825 run osmo-msc_10.42.42.6(pid=2598): stderr: | [0;m[38;5;43m20221212222749687 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212222749687 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f12828d8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212222749687 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212222749687 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212222749688 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212222749688 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212222749690 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212222749690 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212222749690 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212222749690 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:27:50.640342 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2591): Terminating (SIGTERM) 22:27:50.681468 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2594): Terminating (SIGTERM) 22:27:50.722854 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2597): Terminating (SIGTERM) 22:27:50.764614 --- ParallelTerminationStrategy: PID 2591 died... 22:27:50.784707 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2591): Terminated: ok {rc=0} 22:27:50.831088 --- ParallelTerminationStrategy: PID 2594 died... 22:27:50.850656 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2594): Terminated: ok {rc=0} 22:27:50.896571 --- ParallelTerminationStrategy: PID 2597 died... 22:27:50.916111 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2597): Terminated: ok {rc=0} 22:27:51.003253 bus /sierra_3: Setting Powered False 22:27:52.098181 bus /sierra_3: Setting Powered False 22:27:53.213151 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2383 emergency:trx-b200 emergency_preemptive_call.py ---------------------------------------------- 22:27:54.300403 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 22:27:54.311542 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 22:27:54.362387 tst emergency_preemptive_call.py: using LAC 31927 22:27:54.481562 tst emergency_preemptive_call.py: using RAC 52 22:27:54.607395 tst emergency_preemptive_call.py: using CellId 31927 22:27:54.733519 tst emergency_preemptive_call.py: using BVCI 31928 22:27:54.844705 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 22:27:54.855461 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 22:27:54.866041 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 22:27:54.876815 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 22:27:54.887663 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 22:27:54.898528 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 22:27:55.013349 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 22:27:55.131189 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 22:27:55.246135 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 22:27:55.364774 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:27:55.860606 run create_hlr_db(pid=2600): Launched 22:27:55.990665 bus /sierra_2: Setting Powered False 22:27:57.053460 run create_hlr_db(pid=2600): Terminated: ok {rc=0} 22:27:57.478988 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2602): Launched 22:27:57.777381 run osmo-hlr_10.42.42.2(pid=2603): Launched 22:27:57.892434 run osmo-stp_10.42.42.5: Starting osmo-stp 22:27:58.420276 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2605): Launched 22:27:58.718179 run osmo-stp_10.42.42.5(pid=2606): Launched 22:27:58.841998 tst emergency_preemptive_call.py: using MSISDN 8005 22:27:58.995395 run osmo-msc_10.42.42.6: Starting osmo-msc 22:27:59.534129 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2608): Launched 22:27:59.833088 run osmo-msc_10.42.42.6(pid=2609): Launched 22:28:00.000900 run osmo-stp_10.42.42.5(pid=2606): ERR: Terminated: ERROR {rc=1} [trial-2383↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2606)] 22:28:00.127531 run osmo-stp_10.42.42.5(pid=2606): stdout: | (launched: 2022-12-12_22:27:58.663824) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:28:00.254858 run osmo-stp_10.42.42.5(pid=2606): stderr: | [0;m[38;5;43m20221212222758832 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222758832 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222758832 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222758833 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222758836 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222758836 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222758836 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:28:00.379894 run osmo-stp_10.42.42.5(pid=2606): stdout: | (launched: 2022-12-12_22:27:58.663824) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:28:00.498965 run osmo-stp_10.42.42.5(pid=2606): stderr: | [0;m[38;5;43m20221212222758832 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222758832 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222758832 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222758833 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222758836 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222758836 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222758836 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:28:00.641265 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=2606): Process ended prematurely: osmo-stp_10.42.42.5(pid=2606) [trial-2383↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2606)] [trial-2383↪emergency:trx-b200↪emergency_preemptive_call.py:32] 22:28:00.649647 tst emergency_preemptive_call.py:32: Test FAILED (6.3 sec) 22:28:00.676000 run osmo-hlr_10.42.42.2(pid=2603): ERR: Terminated: ERROR {rc=237} [trial-2383↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2603)] 22:28:00.724182 run osmo-hlr_10.42.42.2(pid=2603): stdout: | (launched: 2022-12-12_22:27:57.723350) 22:28:00.773662 run osmo-hlr_10.42.42.2(pid=2603): stderr: | [0;m[1;31m20221212222757897 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212222757897 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212222757897 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212222757897 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212222757897 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212222757897 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212222757910 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/emergency:trx-b200/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212222757919 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212222757919 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212222757919 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:28:00.843969 run osmo-msc_10.42.42.6(pid=2609): ERR: Terminated: ERROR {rc=2} [trial-2383↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2609)] 22:28:00.895361 run osmo-msc_10.42.42.6(pid=2609): stdout: | (launched: 2022-12-12_22:27:59.778317) 22:28:00.946179 run osmo-msc_10.42.42.6(pid=2609): stderr: | [0;m[38;5;43m20221212222800052 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212222800053 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7c9589dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212222800053 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212222800053 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212222800053 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212222800053 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212222800055 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212222800055 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212222800055 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212222800056 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:28:00.997152 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2602): Terminating (SIGTERM) 22:28:01.037860 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2605): Terminating (SIGTERM) 22:28:01.078634 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2608): Terminating (SIGTERM) 22:28:01.120022 --- ParallelTerminationStrategy: PID 2602 died... 22:28:01.139202 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2602): Terminated: ok {rc=0} 22:28:01.186343 --- ParallelTerminationStrategy: PID 2605 died... 22:28:01.205521 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2605): Terminated: ok {rc=0} 22:28:01.250722 --- ParallelTerminationStrategy: PID 2608 died... 22:28:01.269653 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2608): Terminated: ok {rc=0} 22:28:01.359041 bus /sierra_9: Setting Powered False 22:28:02.459536 bus /sierra_9: Setting Powered False 22:28:03.576896 bus /sierra_8: Setting Powered False 22:28:04.672042 bus /sierra_8: Setting Powered False 22:28:05.787261 bus /sierra_3: Setting Powered False 22:28:06.885352 bus /sierra_3: Setting Powered False 22:28:08.001712 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 emergency:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 gprs:trx-b200 --------------------------------------------------------------------- 22:28:09.283534 tst gprs:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:28:09.288176 tst gprs:trx-b200: Verifying 1 x bts (candidates: 11) 22:28:09.321405 tst gprs:trx-b200: Verifying 9 x ip_address (candidates: 9) 22:28:09.359477 tst gprs:trx-b200: Verifying 4 x modem (candidates: 12) 22:28:09.444049 tst gprs:trx-b200: Reserving 1 x bts (candidates: 11) 22:28:09.478208 tst gprs:trx-b200: Reserving 9 x ip_address (candidates: 9) 22:28:09.517398 tst gprs:trx-b200: Reserving 4 x modem (candidates: 12) 22:28:10.111134 tst gprs:trx-b200: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2383 gprs:trx-b200 cs_paging_gprs_active.py ---------------------------------------------- 22:28:10.164229 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:28:10.175229 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 22:28:10.223426 tst cs_paging_gprs_active.py: using LAC 31928 22:28:10.351936 tst cs_paging_gprs_active.py: using RAC 53 22:28:10.478571 tst cs_paging_gprs_active.py: using CellId 31928 22:28:10.605090 tst cs_paging_gprs_active.py: using BVCI 31929 22:28:10.723835 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:28:10.734903 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:28:10.745803 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:28:10.756568 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:28:10.767323 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:28:10.778090 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:28:10.789475 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:28:10.800229 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:28:10.811224 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 22:28:10.929515 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 22:28:11.044762 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:28:11.250029 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:28:11.555609 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2614): Launched 22:28:11.821595 run iperf3-srv_10.42.42.10(pid=2615): Launched 22:28:11.937165 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:28:12.143097 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:28:12.451190 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2616): Launched 22:28:12.716111 run iperf3-srv_10.42.42.10(pid=2617): Launched 22:28:12.830445 tst cs_paging_gprs_active.py:38: start network... 22:28:13.034325 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:28:13.506703 run create_hlr_db(pid=2619): Launched 22:28:13.624690 bus /sierra_2: Setting Powered False 22:28:14.685459 run create_hlr_db(pid=2619): Terminated: ok {rc=0} 22:28:15.128810 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2622): Launched 22:28:15.453561 run osmo-hlr_10.42.42.2(pid=2623): Launched 22:28:15.580373 run osmo-stp_10.42.42.5: Starting osmo-stp 22:28:16.149730 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2626): Launched 22:28:16.478743 run osmo-stp_10.42.42.5(pid=2627): Launched 22:28:16.776490 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:28:17.430621 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2629): Launched 22:28:17.554936 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:28:17.829589 run patchelf(pid=2630): Launched 22:28:18.011782 run osmo-stp_10.42.42.5(pid=2627): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2627)] 22:28:18.150176 run osmo-stp_10.42.42.5(pid=2627): stdout: | (launched: 2022-12-12_22:28:16.415689) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:28:18.290285 run osmo-stp_10.42.42.5(pid=2627): stderr: | [0;m[38;5;43m20221212222816668 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222816669 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222816669 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222816670 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222816672 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222816672 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222816672 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:28:18.430054 run osmo-stp_10.42.42.5(pid=2627): stdout: | (launched: 2022-12-12_22:28:16.415689) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:28:18.564279 run osmo-stp_10.42.42.5(pid=2627): stderr: | [0;m[38;5;43m20221212222816668 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222816669 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222816669 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222816670 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222816672 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222816672 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222816672 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:28:18.723308 run patchelf(pid=2630): Terminating (SIGINT) 22:28:18.907904 run patchelf(pid=2630): Terminated: ok {rc=0} 22:28:19.040808 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=2627): Process ended prematurely: osmo-stp_10.42.42.5(pid=2627) [trial-2383↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2627)] [trial-2383↪gprs:trx-b200↪cs_paging_gprs_active.py:38] 22:28:19.051064 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 22:28:19.079398 run osmo-hlr_10.42.42.2(pid=2623): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-b200↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2623)] 22:28:19.129149 run osmo-hlr_10.42.42.2(pid=2623): stdout: | (launched: 2022-12-12_22:28:15.395181) 22:28:19.180621 run osmo-hlr_10.42.42.2(pid=2623): stderr: | [0;m[1;31m20221212222815593 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212222815593 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212222815593 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212222815593 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212222815593 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212222815593 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212222815606 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-b200/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212222815615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212222815615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212222815615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:28:19.232250 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2614): Terminating (SIGTERM) 22:28:19.274010 run iperf3-srv_10.42.42.10(pid=2615): Terminating (SIGTERM) 22:28:19.315711 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2616): Terminating (SIGTERM) 22:28:19.357677 run iperf3-srv_10.42.42.10(pid=2617): Terminating (SIGTERM) 22:28:19.399447 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2622): Terminating (SIGTERM) 22:28:19.441283 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2626): Terminating (SIGTERM) 22:28:19.482858 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2629): Terminating (SIGTERM) 22:28:19.524723 --- ParallelTerminationStrategy: PID 2614 died... 22:28:19.544600 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2614): Terminated: ok {rc=0} 22:28:19.590471 --- ParallelTerminationStrategy: PID 2615 died... 22:28:19.609644 run iperf3-srv_10.42.42.10(pid=2615): Terminated {rc=256} 22:28:19.655168 --- ParallelTerminationStrategy: PID 2616 died... 22:28:19.674399 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2616): Terminated: ok {rc=0} 22:28:19.719949 --- ParallelTerminationStrategy: PID 2617 died... 22:28:19.739396 run iperf3-srv_10.42.42.10(pid=2617): Terminated {rc=256} 22:28:19.784586 --- ParallelTerminationStrategy: PID 2622 died... 22:28:19.803816 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2622): Terminated: ok {rc=0} 22:28:19.849272 --- ParallelTerminationStrategy: PID 2626 died... 22:28:19.868424 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2626): Terminated: ok {rc=0} 22:28:19.914321 --- ParallelTerminationStrategy: PID 2629 died... 22:28:19.933551 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2629): Terminated: ok {rc=0} 22:28:20.019833 bus /gobi_0: Setting Powered False 22:28:21.118718 bus /gobi_0: Setting Powered False 22:28:22.234074 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-b200 iperf3.py ---------------------------------------------- 22:28:23.383545 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:28:23.395117 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 22:28:23.448021 tst iperf3.py: using LAC 31929 22:28:23.577866 tst iperf3.py: using RAC 54 22:28:23.707780 tst iperf3.py: using CellId 31929 22:28:23.837817 tst iperf3.py: using BVCI 31930 22:28:23.950137 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:28:23.960735 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:28:23.971225 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:28:23.982067 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:28:23.993323 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:28:24.003861 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:28:24.014984 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:28:24.025769 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:28:24.036727 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 22:28:24.154637 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:28:24.361177 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:28:24.666638 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2631): Launched 22:28:24.932023 run iperf3-srv_10.42.42.10(pid=2632): Launched 22:28:25.046604 tst iperf3.py:8: start network... 22:28:25.251615 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:28:25.722491 run create_hlr_db(pid=2633): Launched 22:28:25.838119 bus /gobi_6: Setting Powered False 22:28:26.898243 run create_hlr_db(pid=2633): Terminated: ok {rc=0} 22:28:27.320611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2635): Launched 22:28:27.625313 run osmo-hlr_10.42.42.2(pid=2636): Launched 22:28:27.742907 run osmo-stp_10.42.42.5: Starting osmo-stp 22:28:28.278645 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2638): Launched 22:28:28.584342 run osmo-stp_10.42.42.5(pid=2639): Launched 22:28:28.703007 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:28:29.228614 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2641): Launched 22:28:29.345823 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:28:29.602615 run patchelf(pid=2642): Launched 22:28:29.772579 run osmo-stp_10.42.42.5(pid=2639): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2639)] 22:28:29.901615 run osmo-stp_10.42.42.5(pid=2639): stdout: | (launched: 2022-12-12_22:28:28.528742) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:28:30.032183 run osmo-stp_10.42.42.5(pid=2639): stderr: | [0;m[38;5;43m20221212222828698 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222828699 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222828699 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222828699 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222828700 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222828700 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222828700 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:28:30.162979 run osmo-stp_10.42.42.5(pid=2639): stdout: | (launched: 2022-12-12_22:28:28.528742) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:28:30.287892 run osmo-stp_10.42.42.5(pid=2639): stderr: | [0;m[38;5;43m20221212222828698 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222828699 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222828699 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222828699 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222828700 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222828700 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222828700 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:28:30.437127 run patchelf(pid=2642): Terminating (SIGINT) 22:28:30.610110 run patchelf(pid=2642): Terminated: ok {rc=0} 22:28:30.734633 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2639): Process ended prematurely: osmo-stp_10.42.42.5(pid=2639) [trial-2383↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2639)] [trial-2383↪gprs:trx-b200↪iperf3.py:8] 22:28:30.744082 tst iperf3.py:8: Test FAILED (7.4 sec) 22:28:30.771338 run osmo-hlr_10.42.42.2(pid=2636): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-b200↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2636)] 22:28:30.819010 run osmo-hlr_10.42.42.2(pid=2636): stdout: | (launched: 2022-12-12_22:28:27.569946) 22:28:30.904926 run osmo-hlr_10.42.42.2(pid=2636): stderr: | [0;m[1;31m20221212222827749 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212222827749 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212222827749 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212222827749 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212222827749 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212222827749 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212222827761 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-b200/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212222827769 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212222827769 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212222827769 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:28:30.959980 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2631): Terminating (SIGTERM) 22:28:31.003486 run iperf3-srv_10.42.42.10(pid=2632): Terminating (SIGTERM) 22:28:31.049235 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2635): Terminating (SIGTERM) 22:28:31.093278 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2638): Terminating (SIGTERM) 22:28:31.138878 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2641): Terminating (SIGTERM) 22:28:31.184571 --- ParallelTerminationStrategy: PID 2631 died... 22:28:31.204873 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2631): Terminated: ok {rc=0} 22:28:31.254000 --- ParallelTerminationStrategy: PID 2632 died... 22:28:31.273969 run iperf3-srv_10.42.42.10(pid=2632): Terminated {rc=256} 22:28:31.321728 --- ParallelTerminationStrategy: PID 2635 died... 22:28:31.342514 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2635): Terminated: ok {rc=0} 22:28:31.391011 --- ParallelTerminationStrategy: PID 2638 died... 22:28:31.411420 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2638): Terminated: ok {rc=0} 22:28:31.459479 --- ParallelTerminationStrategy: PID 2641 died... 22:28:31.479708 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2641): Terminated: ok {rc=0} 22:28:31.572608 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-b200 iperf3m4.py ---------------------------------------------- 22:28:32.723062 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:28:32.734721 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 22:28:32.785716 tst iperf3m4.py: using LAC 31930 22:28:32.913131 tst iperf3m4.py: using RAC 55 22:28:33.043850 tst iperf3m4.py: using CellId 31930 22:28:33.171636 tst iperf3m4.py: using BVCI 31931 22:28:33.290370 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:28:33.301564 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:28:33.312401 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:28:33.323421 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:28:33.334281 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:28:33.345173 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:28:33.356183 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:28:33.367110 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:28:33.378188 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 22:28:33.494037 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 22:28:33.617684 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 22:28:33.735216 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 22:28:33.854159 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:28:34.074544 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:28:34.400813 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2643): Launched 22:28:34.684510 run iperf3-srv_10.42.42.10(pid=2644): Launched 22:28:34.807241 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:28:35.027431 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:28:35.354298 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2645): Launched 22:28:35.636878 run iperf3-srv_10.42.42.10(pid=2646): Launched 22:28:35.759327 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:28:35.980006 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:28:36.306350 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2647): Launched 22:28:36.589531 run iperf3-srv_10.42.42.10(pid=2648): Launched 22:28:36.711579 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:28:36.931767 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:28:37.259110 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2649): Launched 22:28:37.541149 run iperf3-srv_10.42.42.10(pid=2650): Launched 22:28:37.662502 tst iperf3m4.py:8: start network... 22:28:37.881199 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:28:38.385422 run create_hlr_db(pid=2651): Launched 22:28:38.506651 bus /gobi_6: Setting Powered False 22:28:39.567224 run create_hlr_db(pid=2651): Terminated: ok {rc=0} 22:28:39.992671 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2653): Launched 22:28:40.296444 run osmo-hlr_10.42.42.2(pid=2654): Launched 22:28:40.413432 run osmo-stp_10.42.42.5: Starting osmo-stp 22:28:40.955483 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2656): Launched 22:28:41.259022 run osmo-stp_10.42.42.5(pid=2657): Launched 22:28:41.376017 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:28:41.901682 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2659): Launched 22:28:42.018650 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:28:42.275862 run patchelf(pid=2660): Launched 22:28:42.446302 run osmo-stp_10.42.42.5(pid=2657): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2657)] 22:28:42.575800 run osmo-stp_10.42.42.5(pid=2657): stdout: | (launched: 2022-12-12_22:28:41.203416) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:28:42.706431 run osmo-stp_10.42.42.5(pid=2657): stderr: | [0;m[38;5;43m20221212222841373 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222841373 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222841374 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222841374 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222841376 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222841377 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222841377 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:28:42.837129 run osmo-stp_10.42.42.5(pid=2657): stdout: | (launched: 2022-12-12_22:28:41.203416) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:28:42.962132 run osmo-stp_10.42.42.5(pid=2657): stderr: | [0;m[38;5;43m20221212222841373 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222841373 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222841374 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222841374 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222841376 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222841377 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222841377 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:28:43.110261 run patchelf(pid=2660): Terminating (SIGINT) 22:28:43.284598 run patchelf(pid=2660): Terminated: ok {rc=0} 22:28:43.409388 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2657): Process ended prematurely: osmo-stp_10.42.42.5(pid=2657) [trial-2383↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2657)] [trial-2383↪gprs:trx-b200↪iperf3m4.py:8] 22:28:43.418677 tst iperf3m4.py:8: Test FAILED (10.7 sec) 22:28:43.446157 run osmo-hlr_10.42.42.2(pid=2654): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-b200↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2654)] 22:28:43.493878 run osmo-hlr_10.42.42.2(pid=2654): stdout: | (launched: 2022-12-12_22:28:40.241265) 22:28:43.542659 run osmo-hlr_10.42.42.2(pid=2654): stderr: | [0;m[1;31m20221212222840419 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212222840420 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212222840420 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212222840420 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212222840420 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212222840420 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212222840431 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-b200/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212222840440 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212222840440 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212222840440 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:28:43.592038 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2643): Terminating (SIGTERM) 22:28:43.631435 run iperf3-srv_10.42.42.10(pid=2644): Terminating (SIGTERM) 22:28:43.671162 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2645): Terminating (SIGTERM) 22:28:43.710881 run iperf3-srv_10.42.42.10(pid=2646): Terminating (SIGTERM) 22:28:43.750467 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2647): Terminating (SIGTERM) 22:28:43.790430 run iperf3-srv_10.42.42.10(pid=2648): Terminating (SIGTERM) 22:28:43.830088 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2649): Terminating (SIGTERM) 22:28:43.869771 run iperf3-srv_10.42.42.10(pid=2650): Terminating (SIGTERM) 22:28:43.909348 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2653): Terminating (SIGTERM) 22:28:43.949452 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2656): Terminating (SIGTERM) 22:28:43.989178 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2659): Terminating (SIGTERM) 22:28:44.028885 --- ParallelTerminationStrategy: PID 2643 died... 22:28:44.047879 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2643): Terminated: ok {rc=0} 22:28:44.092527 --- ParallelTerminationStrategy: PID 2644 died... 22:28:44.111045 run iperf3-srv_10.42.42.10(pid=2644): Terminated {rc=256} 22:28:44.154973 --- ParallelTerminationStrategy: PID 2645 died... 22:28:44.173414 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2645): Terminated: ok {rc=0} 22:28:44.217703 --- ParallelTerminationStrategy: PID 2646 died... 22:28:44.236167 run iperf3-srv_10.42.42.10(pid=2646): Terminated {rc=256} 22:28:44.279953 --- ParallelTerminationStrategy: PID 2647 died... 22:28:44.298473 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2647): Terminated: ok {rc=0} 22:28:44.343419 --- ParallelTerminationStrategy: PID 2648 died... 22:28:44.362256 run iperf3-srv_10.42.42.10(pid=2648): Terminated {rc=256} 22:28:44.406338 --- ParallelTerminationStrategy: PID 2649 died... 22:28:44.424656 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2649): Terminated: ok {rc=0} 22:28:44.468905 --- ParallelTerminationStrategy: PID 2650 died... 22:28:44.487887 run iperf3-srv_10.42.42.10(pid=2650): Terminated {rc=256} 22:28:44.532689 --- ParallelTerminationStrategy: PID 2653 died... 22:28:44.551382 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2653): Terminated: ok {rc=0} 22:28:44.595563 --- ParallelTerminationStrategy: PID 2656 died... 22:28:44.614210 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2656): Terminated: ok {rc=0} 22:28:44.658076 --- ParallelTerminationStrategy: PID 2659 died... 22:28:44.676556 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2659): Terminated: ok {rc=0} 22:28:44.759707 bus /gobi_4: Setting Powered False 22:28:45.867908 bus /gobi_4: Setting Powered False 22:28:47.012379 bus /gobi_1: Setting Powered False 22:28:48.124006 bus /gobi_1: Setting Powered False 22:28:49.238818 bus /gobi_0: Setting Powered False 22:28:50.337772 bus /gobi_0: Setting Powered False 22:28:51.453525 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-b200 ping.py ---------------------------------------------- 22:28:52.556301 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:28:52.568175 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 22:28:52.617734 tst ping.py: using LAC 31931 22:28:52.744777 tst ping.py: using RAC 56 22:28:52.869725 tst ping.py: using CellId 31931 22:28:52.995674 tst ping.py: using BVCI 31932 22:28:53.111951 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:28:53.123106 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:28:53.134211 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:28:53.145449 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:28:53.156200 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:28:53.167137 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:28:53.178130 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:28:53.189172 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 22:28:53.307170 tst ping.py:19: start network... 22:28:53.522741 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:28:54.016377 run create_hlr_db(pid=2662): Launched 22:28:54.145553 bus /gobi_6: Setting Powered False 22:28:55.208595 run create_hlr_db(pid=2662): Terminated: ok {rc=0} 22:28:55.635759 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2664): Launched 22:28:55.934668 run osmo-hlr_10.42.42.2(pid=2665): Launched 22:28:56.050020 run osmo-stp_10.42.42.5: Starting osmo-stp 22:28:56.585207 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2667): Launched 22:28:56.883911 run osmo-stp_10.42.42.5(pid=2668): Launched 22:28:56.998256 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:28:57.514152 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2670): Launched 22:28:57.628327 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:28:57.880793 run patchelf(pid=2671): Launched 22:28:58.047948 run osmo-stp_10.42.42.5(pid=2668): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2668)] 22:28:58.175366 run osmo-stp_10.42.42.5(pid=2668): stdout: | (launched: 2022-12-12_22:28:56.829751) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:28:58.303654 run osmo-stp_10.42.42.5(pid=2668): stderr: | [0;m[38;5;43m20221212222857000 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222857000 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222857000 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222857000 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222857001 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222857001 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222857001 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:28:58.432729 run osmo-stp_10.42.42.5(pid=2668): stdout: | (launched: 2022-12-12_22:28:56.829751) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:28:58.555804 run osmo-stp_10.42.42.5(pid=2668): stderr: | [0;m[38;5;43m20221212222857000 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222857000 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222857000 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222857000 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222857001 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222857001 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222857001 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:28:58.702132 run patchelf(pid=2671): Terminating (SIGINT) 22:28:58.872347 run patchelf(pid=2671): Terminated: ok {rc=0} 22:28:58.994682 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=2668): Process ended prematurely: osmo-stp_10.42.42.5(pid=2668) [trial-2383↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2668)] [trial-2383↪gprs:trx-b200↪ping.py:22] 22:28:59.003267 tst ping.py:22: Test FAILED (6.4 sec) 22:28:59.029822 run osmo-hlr_10.42.42.2(pid=2665): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-b200↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2665)] 22:28:59.077772 run osmo-hlr_10.42.42.2(pid=2665): stdout: | (launched: 2022-12-12_22:28:55.880549) 22:28:59.127117 run osmo-hlr_10.42.42.2(pid=2665): stderr: | [0;m[1;31m20221212222856055 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212222856055 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212222856055 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212222856055 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212222856055 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212222856055 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212222856067 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-b200/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212222856078 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212222856078 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212222856078 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:28:59.176851 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2664): Terminating (SIGTERM) 22:28:59.216612 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2667): Terminating (SIGTERM) 22:28:59.256513 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2670): Terminating (SIGTERM) 22:28:59.296180 --- ParallelTerminationStrategy: PID 2664 died... 22:28:59.315671 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2664): Terminated: ok {rc=0} 22:28:59.359757 --- ParallelTerminationStrategy: PID 2667 died... 22:28:59.378117 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2667): Terminated: ok {rc=0} 22:28:59.422021 --- ParallelTerminationStrategy: PID 2670 died... 22:28:59.440526 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2670): Terminated: ok {rc=0} 22:28:59.527388 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-b200 ping_idle_ping.py ---------------------------------------------- 22:29:00.615977 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:29:00.627798 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 22:29:00.679992 tst ping_idle_ping.py: using LAC 31932 22:29:00.800699 tst ping_idle_ping.py: using RAC 57 22:29:00.935336 tst ping_idle_ping.py: using CellId 31932 22:29:01.069890 tst ping_idle_ping.py: using BVCI 31933 22:29:01.229708 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:29:01.243672 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:29:01.256339 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:29:01.268053 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:29:01.279681 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:29:01.291249 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:29:01.302966 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 22:29:01.314664 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 22:29:01.447746 tst ping_idle_ping.py:24: start network... 22:29:01.678292 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:29:02.170132 run create_hlr_db(pid=2673): Launched 22:29:02.326156 bus /gobi_6: Setting Powered False 22:29:03.386368 run create_hlr_db(pid=2673): Terminated: ok {rc=0} 22:29:03.822724 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2675): Launched 22:29:04.144118 run osmo-hlr_10.42.42.2(pid=2676): Launched 22:29:04.266317 run osmo-stp_10.42.42.5: Starting osmo-stp 22:29:04.822683 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2678): Launched 22:29:05.142907 run osmo-stp_10.42.42.5(pid=2679): Launched 22:29:05.265370 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:29:05.817867 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2681): Launched 22:29:05.940091 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:29:06.210061 run patchelf(pid=2682): Launched 22:29:06.388523 run osmo-stp_10.42.42.5(pid=2679): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2679)] 22:29:06.524537 run osmo-stp_10.42.42.5(pid=2679): stdout: | (launched: 2022-12-12_22:29:05.084134) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:29:06.662697 run osmo-stp_10.42.42.5(pid=2679): stderr: | [0;m[38;5;43m20221212222905275 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222905275 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222905275 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222905276 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222905276 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222905276 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222905276 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:29:06.800060 run osmo-stp_10.42.42.5(pid=2679): stdout: | (launched: 2022-12-12_22:29:05.084134) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:29:06.931739 run osmo-stp_10.42.42.5(pid=2679): stderr: | [0;m[38;5;43m20221212222905275 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222905275 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222905275 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222905276 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222905276 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222905276 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222905276 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:29:07.087884 run patchelf(pid=2682): Terminating (SIGINT) 22:29:07.268475 run patchelf(pid=2682): Terminated: ok {rc=0} 22:29:07.398689 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=2679): Process ended prematurely: osmo-stp_10.42.42.5(pid=2679) [trial-2383↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2679)] [trial-2383↪gprs:trx-b200↪ping_idle_ping.py:27] 22:29:07.408031 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 22:29:07.435895 run osmo-hlr_10.42.42.2(pid=2676): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-b200↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2676)] 22:29:07.485401 run osmo-hlr_10.42.42.2(pid=2676): stdout: | (launched: 2022-12-12_22:29:04.085214) 22:29:07.536562 run osmo-hlr_10.42.42.2(pid=2676): stderr: | [0;m[1;31m20221212222904281 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212222904281 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212222904281 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212222904281 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212222904281 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212222904281 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212222904294 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-b200/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212222904302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212222904302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212222904302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:29:07.588288 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2675): Terminating (SIGTERM) 22:29:07.629719 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2678): Terminating (SIGTERM) 22:29:07.671067 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2681): Terminating (SIGTERM) 22:29:07.712841 --- ParallelTerminationStrategy: PID 2675 died... 22:29:07.732774 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2675): Terminated: ok {rc=0} 22:29:07.779161 --- ParallelTerminationStrategy: PID 2678 died... 22:29:07.798712 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2678): Terminated: ok {rc=0} 22:29:07.844487 --- ParallelTerminationStrategy: PID 2681 died... 22:29:07.863848 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2681): Terminated: ok {rc=0} 22:29:07.951038 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2383 gprs:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 gprs:trx-b200+mod-bts0-egprs --------------------------------------------------------------------- 22:29:09.262142 tst gprs:trx-b200+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:29:09.267874 tst gprs:trx-b200+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 22:29:09.300603 tst gprs:trx-b200+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 22:29:09.339156 tst gprs:trx-b200+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 22:29:09.425025 tst gprs:trx-b200+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 22:29:09.459156 tst gprs:trx-b200+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 22:29:09.498365 tst gprs:trx-b200+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 22:29:10.086039 tst gprs:trx-b200+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2383 gprs:trx-b200+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 22:29:10.135189 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:29:10.145963 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:29:10.195365 tst cs_paging_gprs_active.py: using LAC 31933 22:29:10.318396 tst cs_paging_gprs_active.py: using RAC 58 22:29:10.440318 tst cs_paging_gprs_active.py: using CellId 31933 22:29:10.562431 tst cs_paging_gprs_active.py: using BVCI 31934 22:29:10.674531 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:29:10.685406 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:29:10.695940 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:29:10.706811 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:29:10.717567 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:29:10.728312 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:29:10.739334 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:29:10.750036 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:29:10.760893 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:29:10.881974 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:29:11.003131 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:29:11.224664 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:29:11.551527 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2686): Launched 22:29:11.834066 run iperf3-srv_10.42.42.10(pid=2687): Launched 22:29:11.956694 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:29:12.176382 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:29:12.502052 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2688): Launched 22:29:12.785089 run iperf3-srv_10.42.42.10(pid=2689): Launched 22:29:12.907690 tst cs_paging_gprs_active.py:38: start network... 22:29:13.128303 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:29:13.633721 run create_hlr_db(pid=2690): Launched 22:29:13.766227 bus /gobi_6: Setting Powered False 22:29:14.830323 run create_hlr_db(pid=2690): Terminated: ok {rc=0} 22:29:15.282109 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2692): Launched 22:29:15.607474 run osmo-hlr_10.42.42.2(pid=2693): Launched 22:29:15.731455 run osmo-stp_10.42.42.5: Starting osmo-stp 22:29:16.369693 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2695): Launched 22:29:16.716062 run osmo-stp_10.42.42.5(pid=2696): Launched 22:29:16.988811 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:29:17.574824 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2698): Launched 22:29:17.699799 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:29:17.974567 run patchelf(pid=2699): Launched 22:29:18.155868 run osmo-stp_10.42.42.5(pid=2696): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2696)] 22:29:18.294567 run osmo-stp_10.42.42.5(pid=2696): stdout: | (launched: 2022-12-12_22:29:16.644605) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:29:18.434301 run osmo-stp_10.42.42.5(pid=2696): stderr: | [0;m[38;5;43m20221212222916858 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222916859 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222916859 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222916859 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222916862 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222916862 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222916862 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:29:18.573970 run osmo-stp_10.42.42.5(pid=2696): stdout: | (launched: 2022-12-12_22:29:16.644605) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:29:18.707924 run osmo-stp_10.42.42.5(pid=2696): stderr: | [0;m[38;5;43m20221212222916858 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222916859 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222916859 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222916859 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222916862 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222916862 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222916862 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:29:18.867613 run patchelf(pid=2699): Terminating (SIGINT) 22:29:19.052426 run patchelf(pid=2699): Terminated: ok {rc=0} 22:29:19.184900 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=2696): Process ended prematurely: osmo-stp_10.42.42.5(pid=2696) [trial-2383↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2696)] [trial-2383↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 22:29:19.195073 tst cs_paging_gprs_active.py:38: Test FAILED (9.1 sec) 22:29:19.223392 run osmo-hlr_10.42.42.2(pid=2693): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2693)] 22:29:19.273348 run osmo-hlr_10.42.42.2(pid=2693): stdout: | (launched: 2022-12-12_22:29:15.548523) 22:29:19.326055 run osmo-hlr_10.42.42.2(pid=2693): stderr: | [0;m[1;31m20221212222915749 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212222915749 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212222915749 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212222915749 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212222915749 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212222915749 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212222915761 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-b200+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212222915770 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212222915770 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212222915770 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:29:19.377850 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2686): Terminating (SIGTERM) 22:29:19.419432 run iperf3-srv_10.42.42.10(pid=2687): Terminating (SIGTERM) 22:29:19.461004 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2688): Terminating (SIGTERM) 22:29:19.502702 run iperf3-srv_10.42.42.10(pid=2689): Terminating (SIGTERM) 22:29:19.544074 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2692): Terminating (SIGTERM) 22:29:19.585862 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2695): Terminating (SIGTERM) 22:29:19.627494 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2698): Terminating (SIGTERM) 22:29:19.669419 --- ParallelTerminationStrategy: PID 2686 died... 22:29:19.689261 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2686): Terminated: ok {rc=0} 22:29:19.735228 --- ParallelTerminationStrategy: PID 2687 died... 22:29:19.754608 run iperf3-srv_10.42.42.10(pid=2687): Terminated {rc=256} 22:29:19.800092 --- ParallelTerminationStrategy: PID 2688 died... 22:29:19.819470 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2688): Terminated: ok {rc=0} 22:29:19.865101 --- ParallelTerminationStrategy: PID 2689 died... 22:29:19.884414 run iperf3-srv_10.42.42.10(pid=2689): Terminated {rc=256} 22:29:19.930353 --- ParallelTerminationStrategy: PID 2692 died... 22:29:19.949906 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2692): Terminated: ok {rc=0} 22:29:19.996140 --- ParallelTerminationStrategy: PID 2695 died... 22:29:20.015693 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2695): Terminated: ok {rc=0} 22:29:20.061653 --- ParallelTerminationStrategy: PID 2698 died... 22:29:20.081288 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2698): Terminated: ok {rc=0} 22:29:20.167853 bus /gobi_0: Setting Powered False 22:29:21.266915 bus /gobi_0: Setting Powered False 22:29:22.381362 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-b200+mod-bts0-egprs iperf3.py ---------------------------------------------- 22:29:23.529230 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:29:23.541308 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:29:23.595417 tst iperf3.py: using LAC 31934 22:29:23.725379 tst iperf3.py: using RAC 59 22:29:23.845386 tst iperf3.py: using CellId 31934 22:29:23.962954 tst iperf3.py: using BVCI 31935 22:29:24.075625 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:29:24.086419 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:29:24.096882 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:29:24.107797 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:29:24.118558 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:29:24.129363 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:29:24.140298 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:29:24.151415 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:29:24.162431 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:29:24.279681 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:29:24.485727 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:29:24.791497 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2700): Launched 22:29:25.057614 run iperf3-srv_10.42.42.10(pid=2701): Launched 22:29:25.173105 tst iperf3.py:8: start network... 22:29:25.379055 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:29:25.853520 run create_hlr_db(pid=2702): Launched 22:29:25.971172 bus /gobi_6: Setting Powered False 22:29:27.031572 run create_hlr_db(pid=2702): Terminated: ok {rc=0} 22:29:27.474824 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2704): Launched 22:29:27.799420 run osmo-hlr_10.42.42.2(pid=2705): Launched 22:29:27.923632 run osmo-stp_10.42.42.5: Starting osmo-stp 22:29:28.483241 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2707): Launched 22:29:28.807471 run osmo-stp_10.42.42.5(pid=2708): Launched 22:29:28.931836 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:29:29.490548 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2710): Launched 22:29:29.614874 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:29:29.888401 run patchelf(pid=2711): Launched 22:29:30.069393 run osmo-stp_10.42.42.5(pid=2708): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2708)] 22:29:30.206740 run osmo-stp_10.42.42.5(pid=2708): stdout: | (launched: 2022-12-12_22:29:28.748662) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:29:30.345837 run osmo-stp_10.42.42.5(pid=2708): stderr: | [0;m[38;5;43m20221212222928945 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222928945 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222928945 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222928946 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222928946 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222928946 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222928946 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:29:30.485055 run osmo-stp_10.42.42.5(pid=2708): stdout: | (launched: 2022-12-12_22:29:28.748662) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:29:30.618069 run osmo-stp_10.42.42.5(pid=2708): stderr: | [0;m[38;5;43m20221212222928945 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222928945 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222928945 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222928946 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222928946 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222928946 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222928946 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:29:30.776020 run patchelf(pid=2711): Terminating (SIGINT) 22:29:30.968672 run patchelf(pid=2711): Terminated: ok {rc=0} 22:29:31.103197 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2708): Process ended prematurely: osmo-stp_10.42.42.5(pid=2708) [trial-2383↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2708)] [trial-2383↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8] 22:29:31.113858 tst iperf3.py:8: Test FAILED (7.6 sec) 22:29:31.143055 run osmo-hlr_10.42.42.2(pid=2705): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2705)] 22:29:31.193841 run osmo-hlr_10.42.42.2(pid=2705): stdout: | (launched: 2022-12-12_22:29:27.740786) 22:29:31.246474 run osmo-hlr_10.42.42.2(pid=2705): stderr: | [0;m[1;31m20221212222927941 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212222927941 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212222927941 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212222927941 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212222927941 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212222927941 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212222927955 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-b200+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212222927963 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212222927963 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212222927963 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:29:31.299345 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2700): Terminating (SIGTERM) 22:29:31.342264 run iperf3-srv_10.42.42.10(pid=2701): Terminating (SIGTERM) 22:29:31.387222 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2704): Terminating (SIGTERM) 22:29:31.430341 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2707): Terminating (SIGTERM) 22:29:31.474646 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2710): Terminating (SIGTERM) 22:29:31.518310 --- ParallelTerminationStrategy: PID 2700 died... 22:29:31.538520 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2700): Terminated: ok {rc=0} 22:29:31.585231 --- ParallelTerminationStrategy: PID 2701 died... 22:29:31.605174 run iperf3-srv_10.42.42.10(pid=2701): Terminated {rc=256} 22:29:31.651688 --- ParallelTerminationStrategy: PID 2704 died... 22:29:31.671409 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2704): Terminated: ok {rc=0} 22:29:31.717878 --- ParallelTerminationStrategy: PID 2707 died... 22:29:31.737619 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2707): Terminated: ok {rc=0} 22:29:31.784444 --- ParallelTerminationStrategy: PID 2710 died... 22:29:31.804445 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2710): Terminated: ok {rc=0} 22:29:31.896151 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-b200+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 22:29:33.047753 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:29:33.059747 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:29:33.118874 tst iperf3m4.py: using LAC 31935 22:29:33.245455 tst iperf3m4.py: using RAC 60 22:29:33.365432 tst iperf3m4.py: using CellId 31935 22:29:33.492316 tst iperf3m4.py: using BVCI 31936 22:29:33.613341 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:29:33.624751 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:29:33.635943 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:29:33.647407 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:29:33.658755 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:29:33.669979 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:29:33.681459 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:29:33.692508 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:29:33.703894 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:29:33.824522 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:29:33.944189 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:29:34.065035 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:29:34.188906 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:29:34.409676 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:29:34.717366 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2713): Launched 22:29:34.982319 run iperf3-srv_10.42.42.10(pid=2714): Launched 22:29:35.096725 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:29:35.301284 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:29:35.606657 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2715): Launched 22:29:35.871543 run iperf3-srv_10.42.42.10(pid=2716): Launched 22:29:35.986368 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:29:36.190929 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:29:36.496559 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2717): Launched 22:29:36.762309 run iperf3-srv_10.42.42.10(pid=2718): Launched 22:29:36.877154 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:29:37.081663 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:29:37.387524 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2719): Launched 22:29:37.653062 run iperf3-srv_10.42.42.10(pid=2720): Launched 22:29:37.767690 tst iperf3m4.py:8: start network... 22:29:37.971998 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:29:38.443990 run create_hlr_db(pid=2721): Launched 22:29:38.562616 bus /gobi_6: Setting Powered False 22:29:39.622479 run create_hlr_db(pid=2721): Terminated: ok {rc=0} 22:29:40.067363 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2723): Launched 22:29:40.393165 run osmo-hlr_10.42.42.2(pid=2724): Launched 22:29:40.518471 run osmo-stp_10.42.42.5: Starting osmo-stp 22:29:41.081349 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2726): Launched 22:29:41.404938 run osmo-stp_10.42.42.5(pid=2727): Launched 22:29:41.529370 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:29:42.091716 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2729): Launched 22:29:42.215283 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:29:42.489603 run patchelf(pid=2730): Launched 22:29:42.671446 run osmo-stp_10.42.42.5(pid=2727): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2727)] 22:29:42.809479 run osmo-stp_10.42.42.5(pid=2727): stdout: | (launched: 2022-12-12_22:29:41.346106) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:29:42.949541 run osmo-stp_10.42.42.5(pid=2727): stderr: | [0;m[38;5;43m20221212222941538 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222941539 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222941539 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222941539 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222941540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222941540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222941540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:29:43.089365 run osmo-stp_10.42.42.5(pid=2727): stdout: | (launched: 2022-12-12_22:29:41.346106) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:29:43.223114 run osmo-stp_10.42.42.5(pid=2727): stderr: | [0;m[38;5;43m20221212222941538 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222941539 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222941539 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222941539 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222941540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222941540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222941540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:29:43.381740 run patchelf(pid=2730): Terminating (SIGINT) 22:29:43.566073 run patchelf(pid=2730): Terminated: ok {rc=0} 22:29:43.698435 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2727): Process ended prematurely: osmo-stp_10.42.42.5(pid=2727) [trial-2383↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2727)] [trial-2383↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8] 22:29:43.708190 tst iperf3m4.py:8: Test FAILED (10.7 sec) 22:29:43.736671 run osmo-hlr_10.42.42.2(pid=2724): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2724)] 22:29:43.786119 run osmo-hlr_10.42.42.2(pid=2724): stdout: | (launched: 2022-12-12_22:29:40.334063) 22:29:43.837249 run osmo-hlr_10.42.42.2(pid=2724): stderr: | [0;m[1;31m20221212222940533 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212222940533 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212222940533 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212222940533 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212222940533 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212222940533 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212222940558 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-b200+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212222940570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212222940570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212222940570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:29:43.888328 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2713): Terminating (SIGTERM) 22:29:43.929302 run iperf3-srv_10.42.42.10(pid=2714): Terminating (SIGTERM) 22:29:43.970678 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2715): Terminating (SIGTERM) 22:29:44.012095 run iperf3-srv_10.42.42.10(pid=2716): Terminating (SIGTERM) 22:29:44.053083 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2717): Terminating (SIGTERM) 22:29:44.094416 run iperf3-srv_10.42.42.10(pid=2718): Terminating (SIGTERM) 22:29:44.135490 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2719): Terminating (SIGTERM) 22:29:44.176710 run iperf3-srv_10.42.42.10(pid=2720): Terminating (SIGTERM) 22:29:44.217705 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2723): Terminating (SIGTERM) 22:29:44.258921 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2726): Terminating (SIGTERM) 22:29:44.300093 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2729): Terminating (SIGTERM) 22:29:44.341564 --- ParallelTerminationStrategy: PID 2713 died... 22:29:44.361240 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2713): Terminated: ok {rc=0} 22:29:44.406684 --- ParallelTerminationStrategy: PID 2714 died... 22:29:44.425837 run iperf3-srv_10.42.42.10(pid=2714): Terminated {rc=256} 22:29:44.470982 --- ParallelTerminationStrategy: PID 2715 died... 22:29:44.490135 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2715): Terminated: ok {rc=0} 22:29:44.535185 --- ParallelTerminationStrategy: PID 2716 died... 22:29:44.554409 run iperf3-srv_10.42.42.10(pid=2716): Terminated {rc=256} 22:29:44.599329 --- ParallelTerminationStrategy: PID 2717 died... 22:29:44.618492 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2717): Terminated: ok {rc=0} 22:29:44.663524 --- ParallelTerminationStrategy: PID 2718 died... 22:29:44.682571 run iperf3-srv_10.42.42.10(pid=2718): Terminated {rc=256} 22:29:44.727469 --- ParallelTerminationStrategy: PID 2719 died... 22:29:44.746580 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2719): Terminated: ok {rc=0} 22:29:44.791561 --- ParallelTerminationStrategy: PID 2720 died... 22:29:44.810768 run iperf3-srv_10.42.42.10(pid=2720): Terminated {rc=256} 22:29:44.855835 --- ParallelTerminationStrategy: PID 2723 died... 22:29:44.874942 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2723): Terminated: ok {rc=0} 22:29:44.920403 --- ParallelTerminationStrategy: PID 2726 died... 22:29:44.939993 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2726): Terminated: ok {rc=0} 22:29:44.985864 --- ParallelTerminationStrategy: PID 2729 died... 22:29:45.005202 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2729): Terminated: ok {rc=0} 22:29:45.090283 bus /gobi_4: Setting Powered False 22:29:46.190494 bus /gobi_4: Setting Powered False 22:29:47.300740 bus /gobi_1: Setting Powered False 22:29:48.397685 bus /gobi_1: Setting Powered False 22:29:49.512500 bus /gobi_0: Setting Powered False 22:29:50.607638 bus /gobi_0: Setting Powered False 22:29:51.718890 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-b200+mod-bts0-egprs ping.py ---------------------------------------------- 22:29:52.818244 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:29:52.829756 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:29:52.880692 tst ping.py: using LAC 31936 22:29:53.000103 tst ping.py: using RAC 61 22:29:53.121290 tst ping.py: using CellId 31936 22:29:53.242265 tst ping.py: using BVCI 31937 22:29:53.351898 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:29:53.362844 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:29:53.373635 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:29:53.384525 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:29:53.395473 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:29:53.406426 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:29:53.417642 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:29:53.428502 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:29:53.543627 tst ping.py:19: start network... 22:29:53.745440 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:29:54.207996 run create_hlr_db(pid=2731): Launched 22:29:54.322520 bus /gobi_6: Setting Powered False 22:29:55.382140 run create_hlr_db(pid=2731): Terminated: ok {rc=0} 22:29:55.820630 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2733): Launched 22:29:56.139405 run osmo-hlr_10.42.42.2(pid=2734): Launched 22:29:56.261315 run osmo-stp_10.42.42.5: Starting osmo-stp 22:29:56.816376 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2736): Launched 22:29:57.135220 run osmo-stp_10.42.42.5(pid=2737): Launched 22:29:57.256934 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:29:57.807302 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2739): Launched 22:29:57.929352 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:29:58.199070 run patchelf(pid=2740): Launched 22:29:58.376177 run osmo-stp_10.42.42.5(pid=2737): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2737)] 22:29:58.511388 run osmo-stp_10.42.42.5(pid=2737): stdout: | (launched: 2022-12-12_22:29:57.077619) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:29:58.648218 run osmo-stp_10.42.42.5(pid=2737): stderr: | [0;m[38;5;43m20221212222957269 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222957269 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222957270 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222957270 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222957271 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222957271 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222957271 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:29:58.785057 run osmo-stp_10.42.42.5(pid=2737): stdout: | (launched: 2022-12-12_22:29:57.077619) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:29:58.915491 run osmo-stp_10.42.42.5(pid=2737): stderr: | [0;m[38;5;43m20221212222957269 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212222957269 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212222957270 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212222957270 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212222957271 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212222957271 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212222957271 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:29:59.071678 run patchelf(pid=2740): Terminating (SIGINT) 22:29:59.252243 run patchelf(pid=2740): Terminated: ok {rc=0} 22:29:59.382414 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=2737): Process ended prematurely: osmo-stp_10.42.42.5(pid=2737) [trial-2383↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2737)] [trial-2383↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22] 22:29:59.391834 tst ping.py:22: Test FAILED (6.6 sec) 22:29:59.419784 run osmo-hlr_10.42.42.2(pid=2734): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-b200+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2734)] 22:29:59.469307 run osmo-hlr_10.42.42.2(pid=2734): stdout: | (launched: 2022-12-12_22:29:56.081673) 22:29:59.520648 run osmo-hlr_10.42.42.2(pid=2734): stderr: | [0;m[1;31m20221212222956279 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212222956279 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212222956279 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212222956279 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212222956279 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212222956279 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212222956292 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-b200+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212222956300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212222956300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212222956300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:29:59.572565 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2733): Terminating (SIGTERM) 22:29:59.614077 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2736): Terminating (SIGTERM) 22:29:59.655275 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2739): Terminating (SIGTERM) 22:29:59.697232 --- ParallelTerminationStrategy: PID 2733 died... 22:29:59.717076 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2733): Terminated: ok {rc=0} 22:29:59.762854 --- ParallelTerminationStrategy: PID 2736 died... 22:29:59.782271 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2736): Terminated: ok {rc=0} 22:29:59.827647 --- ParallelTerminationStrategy: PID 2739 died... 22:29:59.846945 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2739): Terminated: ok {rc=0} 22:29:59.933583 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-b200+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 22:30:01.021362 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:30:01.034271 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:30:01.089025 tst ping_idle_ping.py: using LAC 31937 22:30:01.221727 tst ping_idle_ping.py: using RAC 62 22:30:01.357122 tst ping_idle_ping.py: using CellId 31937 22:30:01.485775 tst ping_idle_ping.py: using BVCI 31938 22:30:01.628936 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:30:01.641100 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:30:01.652554 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:30:01.664720 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:30:01.676480 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:30:01.688182 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:30:01.700052 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:30:01.711756 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:30:01.835768 tst ping_idle_ping.py:24: start network... 22:30:02.123270 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:30:02.629415 run create_hlr_db(pid=2744): Launched 22:30:02.759727 bus /gobi_6: Setting Powered False 22:30:03.822747 run create_hlr_db(pid=2744): Terminated: ok {rc=0} 22:30:04.251578 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2746): Launched 22:30:04.552543 run osmo-hlr_10.42.42.2(pid=2747): Launched 22:30:04.670495 run osmo-stp_10.42.42.5: Starting osmo-stp 22:30:05.205224 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2749): Launched 22:30:05.506132 run osmo-stp_10.42.42.5(pid=2750): Launched 22:30:05.623548 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:30:06.143133 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2752): Launched 22:30:06.258623 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:30:06.512481 run patchelf(pid=2753): Launched 22:30:06.680915 run osmo-stp_10.42.42.5(pid=2750): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2750)] 22:30:06.809247 run osmo-stp_10.42.42.5(pid=2750): stdout: | (launched: 2022-12-12_22:30:05.451734) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:30:06.938562 run osmo-stp_10.42.42.5(pid=2750): stderr: | [0;m[38;5;43m20221212223005624 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223005624 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223005624 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223005625 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223005625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223005625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223005625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:30:07.068224 run osmo-stp_10.42.42.5(pid=2750): stdout: | (launched: 2022-12-12_22:30:05.451734) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:30:07.192145 run osmo-stp_10.42.42.5(pid=2750): stderr: | [0;m[38;5;43m20221212223005624 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223005624 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223005624 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223005625 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223005625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223005625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223005625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:30:07.338429 run patchelf(pid=2753): Terminating (SIGINT) 22:30:07.510338 run patchelf(pid=2753): Terminated: ok {rc=0} 22:30:07.633699 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=2750): Process ended prematurely: osmo-stp_10.42.42.5(pid=2750) [trial-2383↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2750)] [trial-2383↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27] 22:30:07.642547 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 22:30:07.669678 run osmo-hlr_10.42.42.2(pid=2747): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2747)] 22:30:07.717296 run osmo-hlr_10.42.42.2(pid=2747): stdout: | (launched: 2022-12-12_22:30:04.497306) 22:30:07.766621 run osmo-hlr_10.42.42.2(pid=2747): stderr: | [0;m[1;31m20221212223004671 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212223004671 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212223004671 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212223004672 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212223004672 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212223004672 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212223004684 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-b200+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212223004693 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212223004693 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212223004693 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:30:07.816512 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2746): Terminating (SIGTERM) 22:30:07.856426 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2749): Terminating (SIGTERM) 22:30:07.895943 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2752): Terminating (SIGTERM) 22:30:07.935833 --- ParallelTerminationStrategy: PID 2746 died... 22:30:07.954873 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2746): Terminated: ok {rc=0} 22:30:07.998921 --- ParallelTerminationStrategy: PID 2749 died... 22:30:08.017288 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2749): Terminated: ok {rc=0} 22:30:08.062038 --- ParallelTerminationStrategy: PID 2752 died... 22:30:08.080485 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2752): Terminated: ok {rc=0} 22:30:08.166623 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2383 gprs:trx-b200+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 gprs:trx-b200+mod-bts0-dynts-ipa --------------------------------------------------------------------- 22:30:09.470569 tst gprs:trx-b200+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:30:09.478602 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 22:30:09.512643 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 22:30:09.552042 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 22:30:09.642104 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 22:30:09.675746 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 22:30:09.714755 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 22:30:10.313622 tst gprs:trx-b200+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2383 gprs:trx-b200+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 22:30:10.367531 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:30:10.379091 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:30:10.451712 tst cs_paging_gprs_active.py: using LAC 31938 22:30:10.578074 tst cs_paging_gprs_active.py: using RAC 63 22:30:10.704286 tst cs_paging_gprs_active.py: using CellId 31938 22:30:10.824076 tst cs_paging_gprs_active.py: using BVCI 31939 22:30:10.935423 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:30:10.946231 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:30:10.957237 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:30:10.968009 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:30:10.978849 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:30:10.989778 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:30:11.000711 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:30:11.011753 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:30:11.022651 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:30:11.142177 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:30:11.263073 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:30:11.481653 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:30:11.806153 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2757): Launched 22:30:12.089873 run iperf3-srv_10.42.42.10(pid=2758): Launched 22:30:12.211361 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:30:12.430059 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:30:12.754670 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2759): Launched 22:30:13.036165 run iperf3-srv_10.42.42.10(pid=2760): Launched 22:30:13.157880 tst cs_paging_gprs_active.py:38: start network... 22:30:13.376883 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:30:13.879231 run create_hlr_db(pid=2761): Launched 22:30:14.011612 bus /gobi_6: Setting Powered False 22:30:15.076129 run create_hlr_db(pid=2761): Terminated: ok {rc=0} 22:30:15.510942 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2763): Launched 22:30:15.815227 run osmo-hlr_10.42.42.2(pid=2764): Launched 22:30:16.124695 run osmo-stp_10.42.42.5: Starting osmo-stp 22:30:16.733175 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2766): Launched 22:30:17.057894 run osmo-stp_10.42.42.5(pid=2767): Launched 22:30:17.242357 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:30:17.881266 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2769): Launched 22:30:18.006680 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:30:18.281967 run patchelf(pid=2770): Launched 22:30:18.462797 run osmo-stp_10.42.42.5(pid=2767): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2767)] 22:30:18.600159 run osmo-stp_10.42.42.5(pid=2767): stdout: | (launched: 2022-12-12_22:30:16.998914) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:30:18.739317 run osmo-stp_10.42.42.5(pid=2767): stderr: | [0;m[38;5;43m20221212223017328 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223017341 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223017341 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223017342 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223017342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223017342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223017342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:30:18.878262 run osmo-stp_10.42.42.5(pid=2767): stdout: | (launched: 2022-12-12_22:30:16.998914) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:30:19.011762 run osmo-stp_10.42.42.5(pid=2767): stderr: | [0;m[38;5;43m20221212223017328 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223017341 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223017341 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223017342 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223017342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223017342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223017342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:30:19.169907 run patchelf(pid=2770): Terminating (SIGINT) 22:30:19.353921 run patchelf(pid=2770): Terminated: ok {rc=0} 22:30:19.486022 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=2767): Process ended prematurely: osmo-stp_10.42.42.5(pid=2767) [trial-2383↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2767)] [trial-2383↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 22:30:19.495898 tst cs_paging_gprs_active.py:38: Test FAILED (9.2 sec) 22:30:19.524142 run osmo-hlr_10.42.42.2(pid=2764): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2764)] 22:30:19.573737 run osmo-hlr_10.42.42.2(pid=2764): stdout: | (launched: 2022-12-12_22:30:15.760326) 22:30:19.625250 run osmo-hlr_10.42.42.2(pid=2764): stderr: | [0;m[1;31m20221212223015985 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212223015985 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212223015985 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212223015985 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212223015985 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212223015986 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212223015999 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-b200+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212223016016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212223016016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212223016016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:30:19.676828 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2757): Terminating (SIGTERM) 22:30:19.718401 run iperf3-srv_10.42.42.10(pid=2758): Terminating (SIGTERM) 22:30:19.759851 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2759): Terminating (SIGTERM) 22:30:19.801414 run iperf3-srv_10.42.42.10(pid=2760): Terminating (SIGTERM) 22:30:19.842822 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2763): Terminating (SIGTERM) 22:30:19.884242 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2766): Terminating (SIGTERM) 22:30:19.925758 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2769): Terminating (SIGTERM) 22:30:19.967741 --- ParallelTerminationStrategy: PID 2757 died... 22:30:19.987640 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2757): Terminated: ok {rc=0} 22:30:20.034265 --- ParallelTerminationStrategy: PID 2758 died... 22:30:20.053653 run iperf3-srv_10.42.42.10(pid=2758): Terminated {rc=256} 22:30:20.099409 --- ParallelTerminationStrategy: PID 2759 died... 22:30:20.118829 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2759): Terminated: ok {rc=0} 22:30:20.164627 --- ParallelTerminationStrategy: PID 2760 died... 22:30:20.184033 run iperf3-srv_10.42.42.10(pid=2760): Terminated {rc=256} 22:30:20.229551 --- ParallelTerminationStrategy: PID 2763 died... 22:30:20.248931 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2763): Terminated: ok {rc=0} 22:30:20.294414 --- ParallelTerminationStrategy: PID 2766 died... 22:30:20.313745 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2766): Terminated: ok {rc=0} 22:30:20.359337 --- ParallelTerminationStrategy: PID 2769 died... 22:30:20.378710 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2769): Terminated: ok {rc=0} 22:30:20.465303 bus /gobi_0: Setting Powered False 22:30:21.562814 bus /gobi_0: Setting Powered False 22:30:22.677328 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-b200+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 22:30:23.824001 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:30:23.836020 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:30:23.909517 tst iperf3.py: using LAC 31939 22:30:24.040651 tst iperf3.py: using RAC 64 22:30:24.170308 tst iperf3.py: using CellId 31939 22:30:24.297829 tst iperf3.py: using BVCI 31940 22:30:24.417445 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:30:24.428695 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:30:24.440244 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:30:24.451567 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:30:24.462888 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:30:24.474259 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:30:24.485449 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:30:24.496591 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:30:24.507995 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:30:24.623808 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:30:24.828588 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:30:25.132934 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2771): Launched 22:30:25.397561 run iperf3-srv_10.42.42.10(pid=2772): Launched 22:30:25.512312 tst iperf3.py:8: start network... 22:30:25.717377 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:30:26.190345 run create_hlr_db(pid=2773): Launched 22:30:26.306909 bus /gobi_6: Setting Powered False 22:30:27.367190 run create_hlr_db(pid=2773): Terminated: ok {rc=0} 22:30:27.788791 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2775): Launched 22:30:28.092183 run osmo-hlr_10.42.42.2(pid=2776): Launched 22:30:28.209135 run osmo-stp_10.42.42.5: Starting osmo-stp 22:30:28.743074 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2778): Launched 22:30:29.047380 run osmo-stp_10.42.42.5(pid=2779): Launched 22:30:29.163893 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:30:29.700791 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2781): Launched 22:30:29.817170 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:30:30.073652 run patchelf(pid=2782): Launched 22:30:30.243029 run osmo-stp_10.42.42.5(pid=2779): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2779)] 22:30:30.371944 run osmo-stp_10.42.42.5(pid=2779): stdout: | (launched: 2022-12-12_22:30:28.992220) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:30:30.502309 run osmo-stp_10.42.42.5(pid=2779): stderr: | [0;m[38;5;43m20221212223029163 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223029163 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223029164 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223029164 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223029165 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223029165 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223029165 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:30:30.632422 run osmo-stp_10.42.42.5(pid=2779): stdout: | (launched: 2022-12-12_22:30:28.992220) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:30:30.757301 run osmo-stp_10.42.42.5(pid=2779): stderr: | [0;m[38;5;43m20221212223029163 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223029163 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223029164 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223029164 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223029165 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223029165 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223029165 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:30:30.915267 run patchelf(pid=2782): Terminating (SIGINT) 22:30:31.091168 run patchelf(pid=2782): Terminated: ok {rc=0} 22:30:31.218584 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2779): Process ended prematurely: osmo-stp_10.42.42.5(pid=2779) [trial-2383↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2779)] [trial-2383↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8] 22:30:31.228788 tst iperf3.py:8: Test FAILED (7.4 sec) 22:30:31.259552 run osmo-hlr_10.42.42.2(pid=2776): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2776)] 22:30:31.309815 run osmo-hlr_10.42.42.2(pid=2776): stdout: | (launched: 2022-12-12_22:30:28.037271) 22:30:31.361378 run osmo-hlr_10.42.42.2(pid=2776): stderr: | [0;m[1;31m20221212223028214 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212223028214 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212223028214 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212223028214 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212223028214 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212223028214 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212223028226 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212223028235 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212223028235 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212223028235 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:30:31.413526 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2771): Terminating (SIGTERM) 22:30:31.455146 run iperf3-srv_10.42.42.10(pid=2772): Terminating (SIGTERM) 22:30:31.498503 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2775): Terminating (SIGTERM) 22:30:31.541239 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2778): Terminating (SIGTERM) 22:30:31.584908 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2781): Terminating (SIGTERM) 22:30:31.627230 --- ParallelTerminationStrategy: PID 2771 died... 22:30:31.647748 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2771): Terminated: ok {rc=0} 22:30:31.694740 --- ParallelTerminationStrategy: PID 2772 died... 22:30:31.714056 run iperf3-srv_10.42.42.10(pid=2772): Terminated {rc=256} 22:30:31.760461 --- ParallelTerminationStrategy: PID 2775 died... 22:30:31.779919 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2775): Terminated: ok {rc=0} 22:30:31.826665 --- ParallelTerminationStrategy: PID 2778 died... 22:30:31.846086 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2778): Terminated: ok {rc=0} 22:30:31.893494 --- ParallelTerminationStrategy: PID 2781 died... 22:30:31.912683 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2781): Terminated: ok {rc=0} 22:30:32.000090 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-b200+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 22:30:33.149532 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:30:33.161542 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:30:33.238933 tst iperf3m4.py: using LAC 31940 22:30:33.366540 tst iperf3m4.py: using RAC 65 22:30:33.493331 tst iperf3m4.py: using CellId 31940 22:30:33.619581 tst iperf3m4.py: using BVCI 31941 22:30:33.738171 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:30:33.749649 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:30:33.760674 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:30:33.771919 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:30:33.783130 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:30:33.794385 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:30:33.805583 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:30:33.816507 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:30:33.827800 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:30:33.947267 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:30:34.066458 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:30:34.183667 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:30:34.301689 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:30:34.507252 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:30:34.812897 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2783): Launched 22:30:35.078618 run iperf3-srv_10.42.42.10(pid=2784): Launched 22:30:35.193361 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:30:35.398679 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:30:35.704279 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2785): Launched 22:30:35.970143 run iperf3-srv_10.42.42.10(pid=2786): Launched 22:30:36.085594 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:30:36.290465 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:30:36.597862 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2787): Launched 22:30:36.864300 run iperf3-srv_10.42.42.10(pid=2788): Launched 22:30:36.979223 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:30:37.184049 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:30:37.490743 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2789): Launched 22:30:37.757114 run iperf3-srv_10.42.42.10(pid=2790): Launched 22:30:37.872457 tst iperf3m4.py:8: start network... 22:30:38.077452 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:30:38.551727 run create_hlr_db(pid=2791): Launched 22:30:38.669267 bus /gobi_6: Setting Powered False 22:30:39.729711 run create_hlr_db(pid=2791): Terminated: ok {rc=0} 22:30:40.155263 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2793): Launched 22:30:40.460139 run osmo-hlr_10.42.42.2(pid=2794): Launched 22:30:40.577242 run osmo-stp_10.42.42.5: Starting osmo-stp 22:30:41.126282 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2796): Launched 22:30:41.432857 run osmo-stp_10.42.42.5(pid=2797): Launched 22:30:41.550837 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:30:42.079402 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2799): Launched 22:30:42.196877 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:30:42.455279 run patchelf(pid=2800): Launched 22:30:42.626080 run osmo-stp_10.42.42.5(pid=2797): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2797)] 22:30:42.756417 run osmo-stp_10.42.42.5(pid=2797): stdout: | (launched: 2022-12-12_22:30:41.376257) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:30:42.886941 run osmo-stp_10.42.42.5(pid=2797): stderr: | [0;m[38;5;43m20221212223041550 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223041550 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223041550 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223041551 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223041551 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223041551 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223041551 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:30:43.018102 run osmo-stp_10.42.42.5(pid=2797): stdout: | (launched: 2022-12-12_22:30:41.376257) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:30:43.143486 run osmo-stp_10.42.42.5(pid=2797): stderr: | [0;m[38;5;43m20221212223041550 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223041550 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223041550 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223041551 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223041551 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223041551 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223041551 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:30:43.292217 run patchelf(pid=2800): Terminating (SIGINT) 22:30:43.466899 run patchelf(pid=2800): Terminated: ok {rc=0} 22:30:43.591750 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2797): Process ended prematurely: osmo-stp_10.42.42.5(pid=2797) [trial-2383↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2797)] [trial-2383↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8] 22:30:43.601675 tst iperf3m4.py:8: Test FAILED (10.5 sec) 22:30:43.629424 run osmo-hlr_10.42.42.2(pid=2794): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2794)] 22:30:43.676791 run osmo-hlr_10.42.42.2(pid=2794): stdout: | (launched: 2022-12-12_22:30:40.404394) 22:30:43.725938 run osmo-hlr_10.42.42.2(pid=2794): stderr: | [0;m[1;31m20221212223040584 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212223040584 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212223040584 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212223040584 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212223040584 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212223040584 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212223040596 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212223040605 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212223040606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212223040606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:30:43.775705 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2783): Terminating (SIGTERM) 22:30:43.815781 run iperf3-srv_10.42.42.10(pid=2784): Terminating (SIGTERM) 22:30:43.855693 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2785): Terminating (SIGTERM) 22:30:43.895615 run iperf3-srv_10.42.42.10(pid=2786): Terminating (SIGTERM) 22:30:43.935344 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2787): Terminating (SIGTERM) 22:30:43.975195 run iperf3-srv_10.42.42.10(pid=2788): Terminating (SIGTERM) 22:30:44.015022 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2789): Terminating (SIGTERM) 22:30:44.054968 run iperf3-srv_10.42.42.10(pid=2790): Terminating (SIGTERM) 22:30:44.094818 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2793): Terminating (SIGTERM) 22:30:44.134816 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2796): Terminating (SIGTERM) 22:30:44.174561 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2799): Terminating (SIGTERM) 22:30:44.214978 --- ParallelTerminationStrategy: PID 2783 died... 22:30:44.234022 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2783): Terminated: ok {rc=0} 22:30:44.278727 --- ParallelTerminationStrategy: PID 2784 died... 22:30:44.297442 run iperf3-srv_10.42.42.10(pid=2784): Terminated {rc=256} 22:30:44.341619 --- ParallelTerminationStrategy: PID 2785 died... 22:30:44.360291 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2785): Terminated: ok {rc=0} 22:30:44.404482 --- ParallelTerminationStrategy: PID 2786 died... 22:30:44.422916 run iperf3-srv_10.42.42.10(pid=2786): Terminated {rc=256} 22:30:44.467145 --- ParallelTerminationStrategy: PID 2787 died... 22:30:44.485834 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2787): Terminated: ok {rc=0} 22:30:44.530066 --- ParallelTerminationStrategy: PID 2788 died... 22:30:44.548708 run iperf3-srv_10.42.42.10(pid=2788): Terminated {rc=256} 22:30:44.592659 --- ParallelTerminationStrategy: PID 2789 died... 22:30:44.611248 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2789): Terminated: ok {rc=0} 22:30:44.655404 --- ParallelTerminationStrategy: PID 2790 died... 22:30:44.673889 run iperf3-srv_10.42.42.10(pid=2790): Terminated {rc=256} 22:30:44.718702 --- ParallelTerminationStrategy: PID 2793 died... 22:30:44.737250 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2793): Terminated: ok {rc=0} 22:30:44.782296 --- ParallelTerminationStrategy: PID 2796 died... 22:30:44.800895 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2796): Terminated: ok {rc=0} 22:30:44.844855 --- ParallelTerminationStrategy: PID 2799 died... 22:30:44.863834 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2799): Terminated: ok {rc=0} 22:30:44.949933 bus /gobi_4: Setting Powered False 22:30:46.054793 bus /gobi_4: Setting Powered False 22:30:47.175595 bus /gobi_1: Setting Powered False 22:30:48.279010 bus /gobi_1: Setting Powered False 22:30:49.393648 bus /gobi_0: Setting Powered False 22:30:50.491536 bus /gobi_0: Setting Powered False 22:30:51.609098 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-b200+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 22:30:52.712775 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:30:52.724673 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:30:52.796526 tst ping.py: using LAC 31941 22:30:52.923049 tst ping.py: using RAC 66 22:30:53.048856 tst ping.py: using CellId 31941 22:30:53.174684 tst ping.py: using BVCI 31942 22:30:53.292100 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:30:53.303484 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:30:53.314569 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:30:53.325729 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:30:53.336656 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:30:53.348070 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:30:53.359689 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:30:53.370811 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:30:53.489722 tst ping.py:19: start network... 22:30:53.706087 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:30:54.200117 run create_hlr_db(pid=2801): Launched 22:30:54.329196 bus /gobi_6: Setting Powered False 22:30:55.392264 run create_hlr_db(pid=2801): Terminated: ok {rc=0} 22:30:55.835934 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2803): Launched 22:30:56.155245 run osmo-hlr_10.42.42.2(pid=2804): Launched 22:30:56.276255 run osmo-stp_10.42.42.5: Starting osmo-stp 22:30:56.826877 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2806): Launched 22:30:57.145644 run osmo-stp_10.42.42.5(pid=2807): Launched 22:30:57.268520 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:30:57.823011 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2809): Launched 22:30:57.945589 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:30:58.215061 run patchelf(pid=2810): Launched 22:30:58.392862 run osmo-stp_10.42.42.5(pid=2807): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2807)] 22:30:58.528648 run osmo-stp_10.42.42.5(pid=2807): stdout: | (launched: 2022-12-12_22:30:57.088066) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:30:58.665349 run osmo-stp_10.42.42.5(pid=2807): stderr: | [0;m[38;5;43m20221212223057278 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223057278 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223057278 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223057279 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223057279 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223057279 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223057279 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:30:58.802176 run osmo-stp_10.42.42.5(pid=2807): stdout: | (launched: 2022-12-12_22:30:57.088066) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:30:58.933296 run osmo-stp_10.42.42.5(pid=2807): stderr: | [0;m[38;5;43m20221212223057278 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223057278 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223057278 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223057279 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223057279 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223057279 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223057279 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:30:59.089140 run patchelf(pid=2810): Terminating (SIGINT) 22:30:59.270040 run patchelf(pid=2810): Terminated: ok {rc=0} 22:30:59.400147 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=2807): Process ended prematurely: osmo-stp_10.42.42.5(pid=2807) [trial-2383↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2807)] [trial-2383↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22] 22:30:59.409548 tst ping.py:22: Test FAILED (6.7 sec) 22:30:59.437521 run osmo-hlr_10.42.42.2(pid=2804): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2804)] 22:30:59.487346 run osmo-hlr_10.42.42.2(pid=2804): stdout: | (launched: 2022-12-12_22:30:56.096782) 22:30:59.539153 run osmo-hlr_10.42.42.2(pid=2804): stderr: | [0;m[1;31m20221212223056298 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212223056298 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212223056298 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212223056298 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212223056298 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212223056298 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212223056311 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-b200+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212223056319 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212223056319 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212223056319 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:30:59.591477 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2803): Terminating (SIGTERM) 22:30:59.633148 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2806): Terminating (SIGTERM) 22:30:59.674778 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2809): Terminating (SIGTERM) 22:30:59.716619 --- ParallelTerminationStrategy: PID 2803 died... 22:30:59.736706 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2803): Terminated: ok {rc=0} 22:30:59.782690 --- ParallelTerminationStrategy: PID 2806 died... 22:30:59.802150 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2806): Terminated: ok {rc=0} 22:30:59.848532 --- ParallelTerminationStrategy: PID 2809 died... 22:30:59.868031 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2809): Terminated: ok {rc=0} 22:30:59.954645 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-b200+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 22:31:01.041562 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:31:01.054331 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:31:01.127227 tst ping_idle_ping.py: using LAC 31942 22:31:01.250177 tst ping_idle_ping.py: using RAC 67 22:31:01.379313 tst ping_idle_ping.py: using CellId 31942 22:31:01.537922 tst ping_idle_ping.py: using BVCI 31943 22:31:01.657972 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:31:01.670575 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:31:01.683921 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:31:01.697856 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:31:01.710819 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:31:01.722675 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:31:01.735759 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:31:01.748231 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:31:01.868125 tst ping_idle_ping.py:24: start network... 22:31:02.115595 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:31:02.601851 run create_hlr_db(pid=2812): Launched 22:31:02.718712 bus /gobi_6: Setting Powered False 22:31:03.778459 run create_hlr_db(pid=2812): Terminated: ok {rc=0} 22:31:04.214831 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2814): Launched 22:31:04.532928 run osmo-hlr_10.42.42.2(pid=2815): Launched 22:31:04.656711 run osmo-stp_10.42.42.5: Starting osmo-stp 22:31:05.207085 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2817): Launched 22:31:05.526605 run osmo-stp_10.42.42.5(pid=2818): Launched 22:31:05.652054 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:31:06.205671 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2820): Launched 22:31:06.328929 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:31:06.600349 run patchelf(pid=2821): Launched 22:31:06.778803 run osmo-stp_10.42.42.5(pid=2818): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2818)] 22:31:06.916403 run osmo-stp_10.42.42.5(pid=2818): stdout: | (launched: 2022-12-12_22:31:05.468621) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:31:07.054412 run osmo-stp_10.42.42.5(pid=2818): stderr: | [0;m[38;5;43m20221212223105661 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223105661 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223105662 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223105662 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223105662 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223105662 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223105663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:31:07.191644 run osmo-stp_10.42.42.5(pid=2818): stdout: | (launched: 2022-12-12_22:31:05.468621) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:31:07.323136 run osmo-stp_10.42.42.5(pid=2818): stderr: | [0;m[38;5;43m20221212223105661 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223105661 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223105662 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223105662 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223105662 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223105662 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223105663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:31:07.478394 run patchelf(pid=2821): Terminating (SIGINT) 22:31:07.660199 run patchelf(pid=2821): Terminated: ok {rc=0} 22:31:07.790621 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=2818): Process ended prematurely: osmo-stp_10.42.42.5(pid=2818) [trial-2383↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2818)] [trial-2383↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 22:31:07.800000 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 22:31:07.827707 run osmo-hlr_10.42.42.2(pid=2815): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2815)] 22:31:07.877333 run osmo-hlr_10.42.42.2(pid=2815): stdout: | (launched: 2022-12-12_22:31:04.475593) 22:31:07.928760 run osmo-hlr_10.42.42.2(pid=2815): stderr: | [0;m[1;31m20221212223104673 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212223104673 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212223104673 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212223104673 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212223104673 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212223104673 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212223104685 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-b200+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212223104693 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212223104693 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212223104693 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:31:07.980422 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2814): Terminating (SIGTERM) 22:31:08.022148 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2817): Terminating (SIGTERM) 22:31:08.063654 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2820): Terminating (SIGTERM) 22:31:08.105118 --- ParallelTerminationStrategy: PID 2814 died... 22:31:08.124904 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2814): Terminated: ok {rc=0} 22:31:08.170546 --- ParallelTerminationStrategy: PID 2817 died... 22:31:08.189824 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2817): Terminated: ok {rc=0} 22:31:08.235043 --- ParallelTerminationStrategy: PID 2820 died... 22:31:08.254237 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2820): Terminated: ok {rc=0} 22:31:08.340465 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2383 gprs:trx-b200+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 gprs:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 22:31:09.639269 tst gprs:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:31:09.646775 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 22:31:09.680259 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 22:31:09.720057 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 22:31:09.808588 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 22:31:09.842548 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 22:31:09.881819 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 22:31:10.471071 tst gprs:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2383 gprs:trx-b200+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 22:31:10.522078 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:31:10.532875 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:31:10.607303 tst cs_paging_gprs_active.py: using LAC 31943 22:31:10.727761 tst cs_paging_gprs_active.py: using RAC 68 22:31:10.847265 tst cs_paging_gprs_active.py: using CellId 31943 22:31:10.965635 tst cs_paging_gprs_active.py: using BVCI 31944 22:31:11.085876 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:31:11.097344 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:31:11.108350 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:31:11.119616 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:31:11.130890 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:31:11.142025 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:31:11.153289 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:31:11.164277 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:31:11.175526 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:31:11.298302 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:31:11.415944 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:31:11.622402 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:31:11.927874 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2828): Launched 22:31:12.194241 run iperf3-srv_10.42.42.10(pid=2829): Launched 22:31:12.309746 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:31:12.514787 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:31:12.820832 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2830): Launched 22:31:13.086443 run iperf3-srv_10.42.42.10(pid=2831): Launched 22:31:13.201381 tst cs_paging_gprs_active.py:38: start network... 22:31:13.406226 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:31:13.879307 run create_hlr_db(pid=2832): Launched 22:31:13.997351 bus /gobi_6: Setting Powered False 22:31:15.057970 run create_hlr_db(pid=2832): Terminated: ok {rc=0} 22:31:15.502596 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2834): Launched 22:31:15.828172 run osmo-hlr_10.42.42.2(pid=2835): Launched 22:31:16.057557 run osmo-stp_10.42.42.5: Starting osmo-stp 22:31:16.787466 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2837): Launched 22:31:17.122487 run osmo-stp_10.42.42.5(pid=2838): Launched 22:31:17.275879 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:31:17.904137 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2840): Launched 22:31:18.029785 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:31:18.305269 run patchelf(pid=2841): Launched 22:31:18.486600 run osmo-stp_10.42.42.5(pid=2838): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2838)] 22:31:18.625095 run osmo-stp_10.42.42.5(pid=2838): stdout: | (launched: 2022-12-12_22:31:17.053518) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:31:18.766912 run osmo-stp_10.42.42.5(pid=2838): stderr: | [0;m[38;5;43m20221212223117367 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223117367 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223117373 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223117374 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223117374 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223117374 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223117374 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:31:18.906991 run osmo-stp_10.42.42.5(pid=2838): stdout: | (launched: 2022-12-12_22:31:17.053518) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:31:19.041605 run osmo-stp_10.42.42.5(pid=2838): stderr: | [0;m[38;5;43m20221212223117367 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223117367 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223117373 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223117374 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223117374 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223117374 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223117374 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:31:19.200454 run patchelf(pid=2841): Terminating (SIGINT) 22:31:19.383783 run patchelf(pid=2841): Terminated: ok {rc=0} 22:31:19.516381 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=2838): Process ended prematurely: osmo-stp_10.42.42.5(pid=2838) [trial-2383↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2838)] [trial-2383↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 22:31:19.526500 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 22:31:19.554671 run osmo-hlr_10.42.42.2(pid=2835): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2835)] 22:31:19.604299 run osmo-hlr_10.42.42.2(pid=2835): stdout: | (launched: 2022-12-12_22:31:15.769937) 22:31:19.655670 run osmo-hlr_10.42.42.2(pid=2835): stderr: | [0;m[1;31m20221212223116113 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212223116113 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212223116113 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212223116113 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212223116113 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212223116113 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212223116139 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-b200+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212223116156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212223116156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212223116156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:31:19.708149 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2828): Terminating (SIGTERM) 22:31:19.749535 run iperf3-srv_10.42.42.10(pid=2829): Terminating (SIGTERM) 22:31:19.790956 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2830): Terminating (SIGTERM) 22:31:19.832227 run iperf3-srv_10.42.42.10(pid=2831): Terminating (SIGTERM) 22:31:19.873463 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2834): Terminating (SIGTERM) 22:31:19.914790 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2837): Terminating (SIGTERM) 22:31:19.956296 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2840): Terminating (SIGTERM) 22:31:19.998349 --- ParallelTerminationStrategy: PID 2828 died... 22:31:20.018159 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2828): Terminated: ok {rc=0} 22:31:20.063759 --- ParallelTerminationStrategy: PID 2829 died... 22:31:20.083216 run iperf3-srv_10.42.42.10(pid=2829): Terminated {rc=256} 22:31:20.128441 --- ParallelTerminationStrategy: PID 2830 died... 22:31:20.147802 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2830): Terminated: ok {rc=0} 22:31:20.193299 --- ParallelTerminationStrategy: PID 2831 died... 22:31:20.212471 run iperf3-srv_10.42.42.10(pid=2831): Terminated {rc=256} 22:31:20.257436 --- ParallelTerminationStrategy: PID 2834 died... 22:31:20.276634 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2834): Terminated: ok {rc=0} 22:31:20.321744 --- ParallelTerminationStrategy: PID 2837 died... 22:31:20.341106 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2837): Terminated: ok {rc=0} 22:31:20.386285 --- ParallelTerminationStrategy: PID 2840 died... 22:31:20.405586 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2840): Terminated: ok {rc=0} 22:31:20.491852 bus /gobi_0: Setting Powered False 22:31:21.591724 bus /gobi_0: Setting Powered False 22:31:22.706581 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-b200+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 22:31:23.855110 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:31:23.867096 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:31:23.941419 tst iperf3.py: using LAC 31944 22:31:24.062135 tst iperf3.py: using RAC 69 22:31:24.184726 tst iperf3.py: using CellId 31944 22:31:24.304598 tst iperf3.py: using BVCI 31945 22:31:24.415851 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:31:24.426637 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:31:24.437389 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:31:24.448199 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:31:24.458989 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:31:24.469982 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:31:24.480816 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:31:24.491683 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:31:24.502723 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:31:24.620472 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:31:24.840567 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:31:25.166664 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2842): Launched 22:31:25.448693 run iperf3-srv_10.42.42.10(pid=2843): Launched 22:31:25.570715 tst iperf3.py:8: start network... 22:31:25.790624 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:31:26.294904 run create_hlr_db(pid=2844): Launched 22:31:26.426826 bus /gobi_6: Setting Powered False 22:31:27.490966 run create_hlr_db(pid=2844): Terminated: ok {rc=0} 22:31:27.942277 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2846): Launched 22:31:28.266004 run osmo-hlr_10.42.42.2(pid=2847): Launched 22:31:28.390073 run osmo-stp_10.42.42.5: Starting osmo-stp 22:31:28.954642 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2849): Launched 22:31:29.279483 run osmo-stp_10.42.42.5(pid=2850): Launched 22:31:29.403669 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:31:29.964213 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2852): Launched 22:31:30.088255 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:31:30.361848 run patchelf(pid=2853): Launched 22:31:30.542471 run osmo-stp_10.42.42.5(pid=2850): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2850)] 22:31:30.679924 run osmo-stp_10.42.42.5(pid=2850): stdout: | (launched: 2022-12-12_22:31:29.220764) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:31:30.818973 run osmo-stp_10.42.42.5(pid=2850): stderr: | [0;m[38;5;43m20221212223129414 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223129415 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223129415 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223129415 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223129416 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223129416 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223129416 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:31:30.977799 run osmo-stp_10.42.42.5(pid=2850): stdout: | (launched: 2022-12-12_22:31:29.220764) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:31:31.111121 run osmo-stp_10.42.42.5(pid=2850): stderr: | [0;m[38;5;43m20221212223129414 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223129415 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223129415 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223129415 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223129416 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223129416 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223129416 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:31:31.265599 run patchelf(pid=2853): Terminating (SIGINT) 22:31:31.445481 run patchelf(pid=2853): Terminated: ok {rc=0} 22:31:31.574346 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2850): Process ended prematurely: osmo-stp_10.42.42.5(pid=2850) [trial-2383↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2850)] [trial-2383↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8] 22:31:31.586506 tst iperf3.py:8: Test FAILED (7.8 sec) 22:31:31.617405 run osmo-hlr_10.42.42.2(pid=2847): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2847)] 22:31:31.669846 run osmo-hlr_10.42.42.2(pid=2847): stdout: | (launched: 2022-12-12_22:31:28.207546) 22:31:31.722507 run osmo-hlr_10.42.42.2(pid=2847): stderr: | [0;m[1;31m20221212223128405 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212223128405 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212223128405 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212223128405 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212223128405 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212223128406 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212223128418 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212223128426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212223128427 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212223128427 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:31:31.776487 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2842): Terminating (SIGTERM) 22:31:31.819321 run iperf3-srv_10.42.42.10(pid=2843): Terminating (SIGTERM) 22:31:31.864692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2846): Terminating (SIGTERM) 22:31:31.907742 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2849): Terminating (SIGTERM) 22:31:31.952463 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2852): Terminating (SIGTERM) 22:31:31.998241 --- ParallelTerminationStrategy: PID 2842 died... 22:31:32.018354 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2842): Terminated: ok {rc=0} 22:31:32.067320 --- ParallelTerminationStrategy: PID 2843 died... 22:31:32.086768 run iperf3-srv_10.42.42.10(pid=2843): Terminated {rc=256} 22:31:32.134199 --- ParallelTerminationStrategy: PID 2846 died... 22:31:32.153693 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2846): Terminated: ok {rc=0} 22:31:32.201459 --- ParallelTerminationStrategy: PID 2849 died... 22:31:32.220294 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2849): Terminated: ok {rc=0} 22:31:32.266091 --- ParallelTerminationStrategy: PID 2852 died... 22:31:32.284580 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2852): Terminated: ok {rc=0} 22:31:32.370823 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-b200+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 22:31:33.518815 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:31:33.530492 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:31:33.599980 tst iperf3m4.py: using LAC 31945 22:31:33.721392 tst iperf3m4.py: using RAC 70 22:31:33.843736 tst iperf3m4.py: using CellId 31945 22:31:33.966743 tst iperf3m4.py: using BVCI 31946 22:31:34.080531 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:31:34.091548 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:31:34.102179 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:31:34.113394 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:31:34.124125 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:31:34.135009 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:31:34.146156 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:31:34.157089 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:31:34.168285 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:31:34.285569 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:31:34.407314 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:31:34.529281 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:31:34.652557 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:31:34.858997 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:31:35.164219 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2854): Launched 22:31:35.440847 run iperf3-srv_10.42.42.10(pid=2855): Launched 22:31:35.555735 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:31:35.760606 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:31:36.066146 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2856): Launched 22:31:36.331191 run iperf3-srv_10.42.42.10(pid=2857): Launched 22:31:36.445958 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:31:36.650509 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:31:36.955385 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2858): Launched 22:31:37.219734 run iperf3-srv_10.42.42.10(pid=2859): Launched 22:31:37.334665 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:31:37.539689 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:31:37.845200 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2860): Launched 22:31:38.110588 run iperf3-srv_10.42.42.10(pid=2861): Launched 22:31:38.224909 tst iperf3m4.py:8: start network... 22:31:38.429329 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:31:38.900911 run create_hlr_db(pid=2862): Launched 22:31:39.018014 bus /gobi_6: Setting Powered False 22:31:40.079540 run create_hlr_db(pid=2862): Terminated: ok {rc=0} 22:31:40.503706 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2864): Launched 22:31:40.808454 run osmo-hlr_10.42.42.2(pid=2865): Launched 22:31:40.925855 run osmo-stp_10.42.42.5: Starting osmo-stp 22:31:41.456297 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2867): Launched 22:31:41.761161 run osmo-stp_10.42.42.5(pid=2868): Launched 22:31:41.879719 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:31:42.406402 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2871): Launched 22:31:42.522890 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:31:42.781862 run patchelf(pid=2872): Launched 22:31:42.951813 run osmo-stp_10.42.42.5(pid=2868): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2868)] 22:31:43.081113 run osmo-stp_10.42.42.5(pid=2868): stdout: | (launched: 2022-12-12_22:31:41.705681) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:31:43.211201 run osmo-stp_10.42.42.5(pid=2868): stderr: | [0;m[38;5;43m20221212223141878 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223141878 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223141878 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223141879 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223141879 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223141879 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223141879 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:31:43.341967 run osmo-stp_10.42.42.5(pid=2868): stdout: | (launched: 2022-12-12_22:31:41.705681) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:31:43.467096 run osmo-stp_10.42.42.5(pid=2868): stderr: | [0;m[38;5;43m20221212223141878 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223141878 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223141878 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223141879 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223141879 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223141879 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223141879 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:31:43.615285 run patchelf(pid=2872): Terminating (SIGINT) 22:31:43.788355 run patchelf(pid=2872): Terminated: ok {rc=0} 22:31:43.913083 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2868): Process ended prematurely: osmo-stp_10.42.42.5(pid=2868) [trial-2383↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2868)] [trial-2383↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8] 22:31:43.922590 tst iperf3m4.py:8: Test FAILED (10.4 sec) 22:31:43.950071 run osmo-hlr_10.42.42.2(pid=2865): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2865)] 22:31:43.997589 run osmo-hlr_10.42.42.2(pid=2865): stdout: | (launched: 2022-12-12_22:31:40.752857) 22:31:44.046313 run osmo-hlr_10.42.42.2(pid=2865): stderr: | [0;m[1;31m20221212223140928 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212223140928 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212223140928 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212223140928 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212223140928 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212223140928 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212223140940 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212223140949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212223140949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212223140949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:31:44.095599 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2854): Terminating (SIGTERM) 22:31:44.135101 run iperf3-srv_10.42.42.10(pid=2855): Terminating (SIGTERM) 22:31:44.174752 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2856): Terminating (SIGTERM) 22:31:44.214339 run iperf3-srv_10.42.42.10(pid=2857): Terminating (SIGTERM) 22:31:44.253835 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2858): Terminating (SIGTERM) 22:31:44.293379 run iperf3-srv_10.42.42.10(pid=2859): Terminating (SIGTERM) 22:31:44.332829 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2860): Terminating (SIGTERM) 22:31:44.372610 run iperf3-srv_10.42.42.10(pid=2861): Terminating (SIGTERM) 22:31:44.411984 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2864): Terminating (SIGTERM) 22:31:44.451425 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2867): Terminating (SIGTERM) 22:31:44.490785 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2871): Terminating (SIGTERM) 22:31:44.530418 --- ParallelTerminationStrategy: PID 2854 died... 22:31:44.549422 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2854): Terminated: ok {rc=0} 22:31:44.594257 --- ParallelTerminationStrategy: PID 2855 died... 22:31:44.612471 run iperf3-srv_10.42.42.10(pid=2855): Terminated {rc=256} 22:31:44.656564 --- ParallelTerminationStrategy: PID 2856 died... 22:31:44.675007 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2856): Terminated: ok {rc=0} 22:31:44.718855 --- ParallelTerminationStrategy: PID 2857 died... 22:31:44.736856 run iperf3-srv_10.42.42.10(pid=2857): Terminated {rc=256} 22:31:44.780825 --- ParallelTerminationStrategy: PID 2858 died... 22:31:44.799624 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2858): Terminated: ok {rc=0} 22:31:44.843476 --- ParallelTerminationStrategy: PID 2859 died... 22:31:44.861893 run iperf3-srv_10.42.42.10(pid=2859): Terminated {rc=256} 22:31:44.905563 --- ParallelTerminationStrategy: PID 2860 died... 22:31:44.924052 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2860): Terminated: ok {rc=0} 22:31:44.968223 --- ParallelTerminationStrategy: PID 2861 died... 22:31:44.986759 run iperf3-srv_10.42.42.10(pid=2861): Terminated {rc=256} 22:31:45.030759 --- ParallelTerminationStrategy: PID 2864 died... 22:31:45.049175 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2864): Terminated: ok {rc=0} 22:31:45.093268 --- ParallelTerminationStrategy: PID 2867 died... 22:31:45.111633 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2867): Terminated: ok {rc=0} 22:31:45.155826 --- ParallelTerminationStrategy: PID 2871 died... 22:31:45.174262 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2871): Terminated: ok {rc=0} 22:31:45.257251 bus /gobi_4: Setting Powered False 22:31:46.351649 bus /gobi_4: Setting Powered False 22:31:47.467176 bus /gobi_1: Setting Powered False 22:31:48.565835 bus /gobi_1: Setting Powered False 22:31:49.685352 bus /gobi_0: Setting Powered False 22:31:50.785074 bus /gobi_0: Setting Powered False 22:31:51.900451 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-b200+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 22:31:53.002881 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:31:53.015080 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:31:53.087590 tst ping.py: using LAC 31946 22:31:53.213048 tst ping.py: using RAC 71 22:31:53.340790 tst ping.py: using CellId 31946 22:31:53.466424 tst ping.py: using BVCI 31947 22:31:53.584275 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:31:53.595670 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:31:53.606906 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:31:53.618023 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:31:53.629012 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:31:53.640168 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:31:53.651433 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:31:53.662641 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:31:53.780793 tst ping.py:19: start network... 22:31:53.984095 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:31:54.448124 run create_hlr_db(pid=2873): Launched 22:31:54.562836 bus /gobi_6: Setting Powered False 22:31:55.623233 run create_hlr_db(pid=2873): Terminated: ok {rc=0} 22:31:56.062092 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2875): Launched 22:31:56.383712 run osmo-hlr_10.42.42.2(pid=2876): Launched 22:31:56.507065 run osmo-stp_10.42.42.5: Starting osmo-stp 22:31:57.068871 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2878): Launched 22:31:57.387188 run osmo-stp_10.42.42.5(pid=2879): Launched 22:31:57.509969 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:31:58.063828 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2881): Launched 22:31:58.186270 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:31:58.455860 run patchelf(pid=2882): Launched 22:31:58.634391 run osmo-stp_10.42.42.5(pid=2879): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2879)] 22:31:58.769962 run osmo-stp_10.42.42.5(pid=2879): stdout: | (launched: 2022-12-12_22:31:57.329856) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:31:58.906809 run osmo-stp_10.42.42.5(pid=2879): stderr: | [0;m[38;5;43m20221212223157519 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223157519 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223157519 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223157520 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223157522 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223157522 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223157522 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:31:59.044200 run osmo-stp_10.42.42.5(pid=2879): stdout: | (launched: 2022-12-12_22:31:57.329856) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:31:59.175286 run osmo-stp_10.42.42.5(pid=2879): stderr: | [0;m[38;5;43m20221212223157519 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223157519 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223157519 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223157520 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223157522 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223157522 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223157522 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:31:59.330383 run patchelf(pid=2882): Terminating (SIGINT) 22:31:59.510667 run patchelf(pid=2882): Terminated: ok {rc=0} 22:31:59.640533 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=2879): Process ended prematurely: osmo-stp_10.42.42.5(pid=2879) [trial-2383↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2879)] [trial-2383↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22] 22:31:59.650076 tst ping.py:22: Test FAILED (6.6 sec) 22:31:59.677946 run osmo-hlr_10.42.42.2(pid=2876): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2876)] 22:31:59.727319 run osmo-hlr_10.42.42.2(pid=2876): stdout: | (launched: 2022-12-12_22:31:56.324720) 22:31:59.778539 run osmo-hlr_10.42.42.2(pid=2876): stderr: | [0;m[1;31m20221212223156521 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212223156521 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212223156521 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212223156521 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212223156521 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212223156521 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212223156537 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-b200+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212223156546 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212223156546 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212223156546 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:31:59.830130 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2875): Terminating (SIGTERM) 22:31:59.871379 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2878): Terminating (SIGTERM) 22:31:59.912878 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2881): Terminating (SIGTERM) 22:31:59.954867 --- ParallelTerminationStrategy: PID 2875 died... 22:31:59.974877 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2875): Terminated: ok {rc=0} 22:32:00.021852 --- ParallelTerminationStrategy: PID 2878 died... 22:32:00.041500 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2878): Terminated: ok {rc=0} 22:32:00.087503 --- ParallelTerminationStrategy: PID 2881 died... 22:32:00.106908 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2881): Terminated: ok {rc=0} 22:32:00.194345 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-b200+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 22:32:01.286702 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:32:01.303540 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:32:01.400233 tst ping_idle_ping.py: using LAC 31947 22:32:01.536708 tst ping_idle_ping.py: using RAC 72 22:32:01.659693 tst ping_idle_ping.py: using CellId 31947 22:32:01.814837 tst ping_idle_ping.py: using BVCI 31948 22:32:01.933192 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:32:01.944711 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:32:01.956022 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:32:01.968364 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:32:01.981492 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:32:01.993714 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:32:02.005881 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:32:02.018048 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:32:02.135440 tst ping_idle_ping.py:24: start network... 22:32:02.361868 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:32:02.832322 run create_hlr_db(pid=2883): Launched 22:32:02.947780 bus /gobi_6: Setting Powered False 22:32:04.008176 run create_hlr_db(pid=2883): Terminated: ok {rc=0} 22:32:04.427574 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2885): Launched 22:32:04.727201 run osmo-hlr_10.42.42.2(pid=2886): Launched 22:32:04.842247 run osmo-stp_10.42.42.5: Starting osmo-stp 22:32:05.373545 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2888): Launched 22:32:05.674080 run osmo-stp_10.42.42.5(pid=2889): Launched 22:32:05.789234 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:32:06.307674 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2891): Launched 22:32:06.422799 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:32:06.676153 run patchelf(pid=2892): Launched 22:32:06.843292 run osmo-stp_10.42.42.5(pid=2889): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2889)] 22:32:06.970985 run osmo-stp_10.42.42.5(pid=2889): stdout: | (launched: 2022-12-12_22:32:05.619751) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:32:07.100091 run osmo-stp_10.42.42.5(pid=2889): stderr: | [0;m[38;5;43m20221212223205787 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223205787 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223205787 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223205788 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223205790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223205790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223205790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:32:07.228933 run osmo-stp_10.42.42.5(pid=2889): stdout: | (launched: 2022-12-12_22:32:05.619751) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:32:07.352153 run osmo-stp_10.42.42.5(pid=2889): stderr: | [0;m[38;5;43m20221212223205787 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223205787 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223205787 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223205788 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223205790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223205790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223205790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:32:07.498448 run patchelf(pid=2892): Terminating (SIGINT) 22:32:07.668495 run patchelf(pid=2892): Terminated: ok {rc=0} 22:32:07.791345 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=2889): Process ended prematurely: osmo-stp_10.42.42.5(pid=2889) [trial-2383↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2889)] [trial-2383↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 22:32:07.800163 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 22:32:07.826992 run osmo-hlr_10.42.42.2(pid=2886): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2886)] 22:32:07.874249 run osmo-hlr_10.42.42.2(pid=2886): stdout: | (launched: 2022-12-12_22:32:04.673014) 22:32:07.923262 run osmo-hlr_10.42.42.2(pid=2886): stderr: | [0;m[1;31m20221212223204850 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212223204850 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212223204850 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212223204850 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212223204850 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212223204850 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212223204866 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-b200+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212223204875 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212223204875 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212223204876 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:32:07.972805 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2885): Terminating (SIGTERM) 22:32:08.012256 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2888): Terminating (SIGTERM) 22:32:08.051817 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2891): Terminating (SIGTERM) 22:32:08.091756 --- ParallelTerminationStrategy: PID 2885 died... 22:32:08.110756 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2885): Terminated: ok {rc=0} 22:32:08.155026 --- ParallelTerminationStrategy: PID 2888 died... 22:32:08.173458 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2888): Terminated: ok {rc=0} 22:32:08.217698 --- ParallelTerminationStrategy: PID 2891 died... 22:32:08.235986 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2891): Terminated: ok {rc=0} 22:32:08.317705 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2383 gprs:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 22:32:09.614935 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:32:09.621315 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 22:32:09.654553 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 22:32:09.692785 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 22:32:09.778068 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 22:32:09.810759 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 22:32:09.848745 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 22:32:10.445420 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2383 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 22:32:10.495160 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:32:10.506400 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 22:32:10.558447 tst cs_paging_gprs_active.py: using LAC 31948 22:32:10.679207 tst cs_paging_gprs_active.py: using RAC 73 22:32:10.801389 tst cs_paging_gprs_active.py: using CellId 31948 22:32:10.924015 tst cs_paging_gprs_active.py: using BVCI 31949 22:32:11.037770 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:32:11.048744 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:32:11.059661 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:32:11.070953 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:32:11.082390 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:32:11.093584 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:32:11.104759 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:32:11.115993 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:32:11.127396 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:32:11.248306 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:32:11.369623 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:32:11.591103 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:32:11.919658 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2896): Launched 22:32:12.205799 run iperf3-srv_10.42.42.10(pid=2897): Launched 22:32:12.329904 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:32:12.551903 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:32:12.881706 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2898): Launched 22:32:13.166546 run iperf3-srv_10.42.42.10(pid=2899): Launched 22:32:13.289565 tst cs_paging_gprs_active.py:38: start network... 22:32:13.511011 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:32:14.015990 run create_hlr_db(pid=2900): Launched 22:32:14.150584 bus /gobi_6: Setting Powered False 22:32:15.215612 run create_hlr_db(pid=2900): Terminated: ok {rc=0} 22:32:15.650515 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2902): Launched 22:32:15.981680 run osmo-hlr_10.42.42.2(pid=2903): Launched 22:32:16.159309 run osmo-stp_10.42.42.5: Starting osmo-stp 22:32:16.864583 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2905): Launched 22:32:17.213746 run osmo-stp_10.42.42.5(pid=2906): Launched 22:32:17.383562 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:32:17.949044 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2908): Launched 22:32:18.075118 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:32:18.352351 run patchelf(pid=2909): Launched 22:32:18.535098 run osmo-stp_10.42.42.5(pid=2906): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2906)] 22:32:18.672791 run osmo-stp_10.42.42.5(pid=2906): stdout: | (launched: 2022-12-12_22:32:17.143244) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:32:18.812081 run osmo-stp_10.42.42.5(pid=2906): stderr: | [0;m[38;5;43m20221212223217380 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223217380 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223217381 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223217381 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223217381 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223217381 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223217382 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:32:18.951626 run osmo-stp_10.42.42.5(pid=2906): stdout: | (launched: 2022-12-12_22:32:17.143244) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:32:19.086263 run osmo-stp_10.42.42.5(pid=2906): stderr: | [0;m[38;5;43m20221212223217380 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223217380 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223217381 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223217381 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223217381 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223217381 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223217382 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:32:19.245193 run patchelf(pid=2909): Terminating (SIGINT) 22:32:19.429606 run patchelf(pid=2909): Terminated: ok {rc=0} 22:32:19.562245 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=2906): Process ended prematurely: osmo-stp_10.42.42.5(pid=2906) [trial-2383↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2906)] [trial-2383↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 22:32:19.572214 tst cs_paging_gprs_active.py:38: Test FAILED (9.1 sec) 22:32:19.600676 run osmo-hlr_10.42.42.2(pid=2903): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2903)] 22:32:19.650617 run osmo-hlr_10.42.42.2(pid=2903): stdout: | (launched: 2022-12-12_22:32:15.908139) 22:32:19.702440 run osmo-hlr_10.42.42.2(pid=2903): stderr: | [0;m[1;31m20221212223216214 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212223216214 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212223216214 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212223216214 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212223216214 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212223216214 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212223216227 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212223216235 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212223216235 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212223216236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:32:19.754578 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2896): Terminating (SIGTERM) 22:32:19.796390 run iperf3-srv_10.42.42.10(pid=2897): Terminating (SIGTERM) 22:32:19.838234 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2898): Terminating (SIGTERM) 22:32:19.879958 run iperf3-srv_10.42.42.10(pid=2899): Terminating (SIGTERM) 22:32:19.921480 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2902): Terminating (SIGTERM) 22:32:19.963166 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2905): Terminating (SIGTERM) 22:32:20.004876 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2908): Terminating (SIGTERM) 22:32:20.047256 --- ParallelTerminationStrategy: PID 2896 died... 22:32:20.067299 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2896): Terminated: ok {rc=0} 22:32:20.113624 --- ParallelTerminationStrategy: PID 2897 died... 22:32:20.133187 run iperf3-srv_10.42.42.10(pid=2897): Terminated {rc=256} 22:32:20.179170 --- ParallelTerminationStrategy: PID 2898 died... 22:32:20.198963 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2898): Terminated: ok {rc=0} 22:32:20.244581 --- ParallelTerminationStrategy: PID 2899 died... 22:32:20.263987 run iperf3-srv_10.42.42.10(pid=2899): Terminated {rc=256} 22:32:20.310075 --- ParallelTerminationStrategy: PID 2902 died... 22:32:20.329511 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2902): Terminated: ok {rc=0} 22:32:20.375176 --- ParallelTerminationStrategy: PID 2905 died... 22:32:20.394794 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2905): Terminated: ok {rc=0} 22:32:20.440477 --- ParallelTerminationStrategy: PID 2908 died... 22:32:20.459922 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2908): Terminated: ok {rc=0} 22:32:20.546875 bus /gobi_0: Setting Powered False 22:32:21.645539 bus /gobi_0: Setting Powered False 22:32:22.761235 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 22:32:23.910142 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:32:23.922641 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 22:32:23.978976 tst iperf3.py: using LAC 31949 22:32:24.100877 tst iperf3.py: using RAC 74 22:32:24.222025 tst iperf3.py: using CellId 31949 22:32:24.343133 tst iperf3.py: using BVCI 31950 22:32:24.456777 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:32:24.468177 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:32:24.479121 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:32:24.490568 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:32:24.501760 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:32:24.513048 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:32:24.524267 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:32:24.535536 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:32:24.546815 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:32:24.666945 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:32:24.887871 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:32:25.216425 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2910): Launched 22:32:25.500014 run iperf3-srv_10.42.42.10(pid=2911): Launched 22:32:25.623225 tst iperf3.py:8: start network... 22:32:25.843713 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:32:26.350159 run create_hlr_db(pid=2912): Launched 22:32:26.482351 bus /gobi_6: Setting Powered False 22:32:27.542906 run create_hlr_db(pid=2912): Terminated: ok {rc=0} 22:32:27.977418 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2914): Launched 22:32:28.285124 run osmo-hlr_10.42.42.2(pid=2915): Launched 22:32:28.402768 run osmo-stp_10.42.42.5: Starting osmo-stp 22:32:28.943070 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2917): Launched 22:32:29.248873 run osmo-stp_10.42.42.5(pid=2918): Launched 22:32:29.366523 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:32:29.894763 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2920): Launched 22:32:30.011331 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:32:30.269143 run patchelf(pid=2921): Launched 22:32:30.440004 run osmo-stp_10.42.42.5(pid=2918): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2918)] 22:32:30.570265 run osmo-stp_10.42.42.5(pid=2918): stdout: | (launched: 2022-12-12_22:32:29.193149) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:32:30.701507 run osmo-stp_10.42.42.5(pid=2918): stderr: | [0;m[38;5;43m20221212223229365 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223229365 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223229365 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223229366 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223229366 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223229366 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223229366 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:32:30.841691 run osmo-stp_10.42.42.5(pid=2918): stdout: | (launched: 2022-12-12_22:32:29.193149) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:32:30.976004 run osmo-stp_10.42.42.5(pid=2918): stderr: | [0;m[38;5;43m20221212223229365 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223229365 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223229365 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223229366 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223229366 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223229366 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223229366 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:32:31.128822 run patchelf(pid=2921): Terminating (SIGINT) 22:32:31.307674 run patchelf(pid=2921): Terminated: ok {rc=0} 22:32:31.436431 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2918): Process ended prematurely: osmo-stp_10.42.42.5(pid=2918) [trial-2383↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2918)] [trial-2383↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 22:32:31.446847 tst iperf3.py:8: Test FAILED (7.6 sec) 22:32:31.477466 run osmo-hlr_10.42.42.2(pid=2915): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2915)] 22:32:31.527685 run osmo-hlr_10.42.42.2(pid=2915): stdout: | (launched: 2022-12-12_22:32:28.228837) 22:32:31.579579 run osmo-hlr_10.42.42.2(pid=2915): stderr: | [0;m[1;31m20221212223228408 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212223228408 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212223228408 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212223228408 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212223228408 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212223228408 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212223228420 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212223228429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212223228429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212223228429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:32:31.631958 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2910): Terminating (SIGTERM) 22:32:31.674552 run iperf3-srv_10.42.42.10(pid=2911): Terminating (SIGTERM) 22:32:31.719298 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2914): Terminating (SIGTERM) 22:32:31.762321 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2917): Terminating (SIGTERM) 22:32:31.806060 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2920): Terminating (SIGTERM) 22:32:31.848765 --- ParallelTerminationStrategy: PID 2910 died... 22:32:31.868367 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2910): Terminated: ok {rc=0} 22:32:31.917257 --- ParallelTerminationStrategy: PID 2911 died... 22:32:31.936483 run iperf3-srv_10.42.42.10(pid=2911): Terminated {rc=256} 22:32:31.983329 --- ParallelTerminationStrategy: PID 2914 died... 22:32:32.002856 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2914): Terminated: ok {rc=0} 22:32:32.049739 --- ParallelTerminationStrategy: PID 2917 died... 22:32:32.069190 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2917): Terminated: ok {rc=0} 22:32:32.116105 --- ParallelTerminationStrategy: PID 2920 died... 22:32:32.135266 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2920): Terminated: ok {rc=0} 22:32:32.226351 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 22:32:33.375455 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:32:33.390029 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 22:32:33.443720 tst iperf3m4.py: using LAC 31950 22:32:33.564843 tst iperf3m4.py: using RAC 75 22:32:33.687011 tst iperf3m4.py: using CellId 31950 22:32:33.809550 tst iperf3m4.py: using BVCI 31951 22:32:33.930754 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:32:33.942747 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:32:33.954301 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:32:33.966122 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:32:33.978405 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:32:33.990164 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:32:34.001856 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:32:34.013403 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:32:34.025435 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:32:34.146086 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:32:34.265550 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:32:34.385279 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:32:34.507564 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:32:34.729016 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:32:35.056399 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2922): Launched 22:32:35.339180 run iperf3-srv_10.42.42.10(pid=2923): Launched 22:32:35.462075 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:32:35.682909 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:32:36.010741 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2924): Launched 22:32:36.294515 run iperf3-srv_10.42.42.10(pid=2925): Launched 22:32:36.417917 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:32:36.639047 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:32:36.966767 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2926): Launched 22:32:37.250605 run iperf3-srv_10.42.42.10(pid=2927): Launched 22:32:37.373076 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:32:37.592864 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:32:37.920179 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2928): Launched 22:32:38.203896 run iperf3-srv_10.42.42.10(pid=2929): Launched 22:32:38.326529 tst iperf3m4.py:8: start network... 22:32:38.546784 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:32:39.052022 run create_hlr_db(pid=2930): Launched 22:32:39.183508 bus /gobi_6: Setting Powered False 22:32:40.248047 run create_hlr_db(pid=2930): Terminated: ok {rc=0} 22:32:40.683066 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2932): Launched 22:32:40.988100 run osmo-hlr_10.42.42.2(pid=2933): Launched 22:32:41.105270 run osmo-stp_10.42.42.5: Starting osmo-stp 22:32:41.654923 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2935): Launched 22:32:41.960038 run osmo-stp_10.42.42.5(pid=2936): Launched 22:32:42.076634 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:32:42.602269 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2938): Launched 22:32:42.719118 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:32:42.977457 run patchelf(pid=2939): Launched 22:32:43.149257 run osmo-stp_10.42.42.5(pid=2936): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2936)] 22:32:43.279475 run osmo-stp_10.42.42.5(pid=2936): stdout: | (launched: 2022-12-12_22:32:41.904517) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:32:43.410496 run osmo-stp_10.42.42.5(pid=2936): stderr: | [0;m[38;5;43m20221212223242075 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223242075 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223242076 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223242076 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223242077 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223242077 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223242077 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:32:43.541475 run osmo-stp_10.42.42.5(pid=2936): stdout: | (launched: 2022-12-12_22:32:41.904517) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:32:43.666932 run osmo-stp_10.42.42.5(pid=2936): stderr: | [0;m[38;5;43m20221212223242075 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223242075 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223242076 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223242076 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223242077 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223242077 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223242077 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:32:43.815528 run patchelf(pid=2939): Terminating (SIGINT) 22:32:43.988836 run patchelf(pid=2939): Terminated: ok {rc=0} 22:32:44.113930 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2936): Process ended prematurely: osmo-stp_10.42.42.5(pid=2936) [trial-2383↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2936)] [trial-2383↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 22:32:44.123336 tst iperf3m4.py:8: Test FAILED (10.8 sec) 22:32:44.150893 run osmo-hlr_10.42.42.2(pid=2933): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2933)] 22:32:44.198111 run osmo-hlr_10.42.42.2(pid=2933): stdout: | (launched: 2022-12-12_22:32:40.932324) 22:32:44.247233 run osmo-hlr_10.42.42.2(pid=2933): stderr: | [0;m[1;31m20221212223241108 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212223241108 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212223241108 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212223241108 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212223241108 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212223241108 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212223241121 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212223241130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212223241130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212223241130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:32:44.296777 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2922): Terminating (SIGTERM) 22:32:44.336418 run iperf3-srv_10.42.42.10(pid=2923): Terminating (SIGTERM) 22:32:44.377059 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2924): Terminating (SIGTERM) 22:32:44.420918 run iperf3-srv_10.42.42.10(pid=2925): Terminating (SIGTERM) 22:32:44.463230 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2926): Terminating (SIGTERM) 22:32:44.505317 run iperf3-srv_10.42.42.10(pid=2927): Terminating (SIGTERM) 22:32:44.547145 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2928): Terminating (SIGTERM) 22:32:44.589354 run iperf3-srv_10.42.42.10(pid=2929): Terminating (SIGTERM) 22:32:44.630932 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2932): Terminating (SIGTERM) 22:32:44.672726 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2935): Terminating (SIGTERM) 22:32:44.714689 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2938): Terminating (SIGTERM) 22:32:44.756877 --- ParallelTerminationStrategy: PID 2922 died... 22:32:44.776275 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2922): Terminated: ok {rc=0} 22:32:44.823175 --- ParallelTerminationStrategy: PID 2923 died... 22:32:44.842740 run iperf3-srv_10.42.42.10(pid=2923): Terminated {rc=256} 22:32:44.889321 --- ParallelTerminationStrategy: PID 2924 died... 22:32:44.908759 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2924): Terminated: ok {rc=0} 22:32:44.955518 --- ParallelTerminationStrategy: PID 2925 died... 22:32:44.975048 run iperf3-srv_10.42.42.10(pid=2925): Terminated {rc=256} 22:32:45.021434 --- ParallelTerminationStrategy: PID 2926 died... 22:32:45.041240 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2926): Terminated: ok {rc=0} 22:32:45.087955 --- ParallelTerminationStrategy: PID 2927 died... 22:32:45.107527 run iperf3-srv_10.42.42.10(pid=2927): Terminated {rc=256} 22:32:45.154499 --- ParallelTerminationStrategy: PID 2928 died... 22:32:45.174044 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2928): Terminated: ok {rc=0} 22:32:45.221150 --- ParallelTerminationStrategy: PID 2929 died... 22:32:45.240584 run iperf3-srv_10.42.42.10(pid=2929): Terminated {rc=256} 22:32:45.287083 --- ParallelTerminationStrategy: PID 2932 died... 22:32:45.306578 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2932): Terminated: ok {rc=0} 22:32:45.353358 --- ParallelTerminationStrategy: PID 2935 died... 22:32:45.372782 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2935): Terminated: ok {rc=0} 22:32:45.419548 --- ParallelTerminationStrategy: PID 2938 died... 22:32:45.439053 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2938): Terminated: ok {rc=0} 22:32:45.527024 bus /gobi_4: Setting Powered False 22:32:46.625502 bus /gobi_4: Setting Powered False 22:32:47.741862 bus /gobi_1: Setting Powered False 22:32:48.840153 bus /gobi_1: Setting Powered False 22:32:49.953746 bus /gobi_0: Setting Powered False 22:32:51.050326 bus /gobi_0: Setting Powered False 22:32:52.167072 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 22:32:53.269613 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:32:53.281590 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 22:32:53.334161 tst ping.py: using LAC 31951 22:32:53.454940 tst ping.py: using RAC 76 22:32:53.574535 tst ping.py: using CellId 31951 22:32:53.697988 tst ping.py: using BVCI 31952 22:32:53.808922 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:32:53.820240 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:32:53.831252 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:32:53.842663 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:32:53.853982 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:32:53.865355 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:32:53.876584 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:32:53.888149 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:32:54.007261 tst ping.py:19: start network... 22:32:54.223423 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:32:54.719227 run create_hlr_db(pid=2940): Launched 22:32:54.848120 bus /gobi_6: Setting Powered False 22:32:55.911545 run create_hlr_db(pid=2940): Terminated: ok {rc=0} 22:32:56.337845 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2942): Launched 22:32:56.637052 run osmo-hlr_10.42.42.2(pid=2943): Launched 22:32:56.753692 run osmo-stp_10.42.42.5: Starting osmo-stp 22:32:57.286383 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2945): Launched 22:32:57.585508 run osmo-stp_10.42.42.5(pid=2946): Launched 22:32:57.700775 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:32:58.221881 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2948): Launched 22:32:58.337759 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:32:58.592173 run patchelf(pid=2949): Launched 22:32:58.759290 run osmo-stp_10.42.42.5(pid=2946): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2946)] 22:32:58.886862 run osmo-stp_10.42.42.5(pid=2946): stdout: | (launched: 2022-12-12_22:32:57.530681) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:32:59.015637 run osmo-stp_10.42.42.5(pid=2946): stderr: | [0;m[38;5;43m20221212223257701 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223257701 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223257701 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223257702 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223257704 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223257704 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223257704 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:32:59.144804 run osmo-stp_10.42.42.5(pid=2946): stdout: | (launched: 2022-12-12_22:32:57.530681) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:32:59.267942 run osmo-stp_10.42.42.5(pid=2946): stderr: | [0;m[38;5;43m20221212223257701 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223257701 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223257701 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223257702 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223257704 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223257704 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223257704 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:32:59.413895 run patchelf(pid=2949): Terminating (SIGINT) 22:32:59.584567 run patchelf(pid=2949): Terminated: ok {rc=0} 22:32:59.708225 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=2946): Process ended prematurely: osmo-stp_10.42.42.5(pid=2946) [trial-2383↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2946)] [trial-2383↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 22:32:59.717384 tst ping.py:22: Test FAILED (6.4 sec) 22:32:59.744656 run osmo-hlr_10.42.42.2(pid=2943): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2943)] 22:32:59.792246 run osmo-hlr_10.42.42.2(pid=2943): stdout: | (launched: 2022-12-12_22:32:56.582793) 22:32:59.841865 run osmo-hlr_10.42.42.2(pid=2943): stderr: | [0;m[1;31m20221212223256759 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212223256759 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212223256759 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212223256759 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212223256759 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212223256760 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212223256772 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212223256782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212223256782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212223256782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:32:59.891850 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2942): Terminating (SIGTERM) 22:32:59.931735 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2945): Terminating (SIGTERM) 22:32:59.971107 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2948): Terminating (SIGTERM) 22:33:00.010973 --- ParallelTerminationStrategy: PID 2942 died... 22:33:00.029898 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2942): Terminated: ok {rc=0} 22:33:00.073897 --- ParallelTerminationStrategy: PID 2945 died... 22:33:00.092898 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2945): Terminated: ok {rc=0} 22:33:00.137610 --- ParallelTerminationStrategy: PID 2948 died... 22:33:00.156284 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2948): Terminated: ok {rc=0} 22:33:00.243050 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 22:33:01.344496 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:33:01.362364 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 22:33:01.429458 tst ping_idle_ping.py: using LAC 31952 22:33:01.587817 tst ping_idle_ping.py: using RAC 77 22:33:01.722564 tst ping_idle_ping.py: using CellId 31952 22:33:01.887084 tst ping_idle_ping.py: using BVCI 31953 22:33:02.001622 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:33:02.014151 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:33:02.027743 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:33:02.041096 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:33:02.053716 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:33:02.067213 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:33:02.081654 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:33:02.094016 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:33:02.219100 tst ping_idle_ping.py:24: start network... 22:33:02.425745 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:33:02.894436 run create_hlr_db(pid=2951): Launched 22:33:03.008767 bus /gobi_6: Setting Powered False 22:33:04.068833 run create_hlr_db(pid=2951): Terminated: ok {rc=0} 22:33:04.487584 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2953): Launched 22:33:04.789110 run osmo-hlr_10.42.42.2(pid=2954): Launched 22:33:04.904240 run osmo-stp_10.42.42.5: Starting osmo-stp 22:33:05.437172 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2956): Launched 22:33:05.736926 run osmo-stp_10.42.42.5(pid=2957): Launched 22:33:05.852614 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:33:06.371810 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2959): Launched 22:33:06.486935 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:33:06.740200 run patchelf(pid=2960): Launched 22:33:06.907914 run osmo-stp_10.42.42.5(pid=2957): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2957)] 22:33:07.035235 run osmo-stp_10.42.42.5(pid=2957): stdout: | (launched: 2022-12-12_22:33:05.682318) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:33:07.164206 run osmo-stp_10.42.42.5(pid=2957): stderr: | [0;m[38;5;43m20221212223305852 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223305852 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223305852 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223305853 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223305853 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223305853 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223305853 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:33:07.293407 run osmo-stp_10.42.42.5(pid=2957): stdout: | (launched: 2022-12-12_22:33:05.682318) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:33:07.416245 run osmo-stp_10.42.42.5(pid=2957): stderr: | [0;m[38;5;43m20221212223305852 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223305852 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223305852 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223305853 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223305853 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223305853 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223305853 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:33:07.562086 run patchelf(pid=2960): Terminating (SIGINT) 22:33:07.732525 run patchelf(pid=2960): Terminated: ok {rc=0} 22:33:07.855276 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=2957): Process ended prematurely: osmo-stp_10.42.42.5(pid=2957) [trial-2383↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2957)] [trial-2383↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 22:33:07.864169 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 22:33:07.891019 run osmo-hlr_10.42.42.2(pid=2954): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2954)] 22:33:07.938518 run osmo-hlr_10.42.42.2(pid=2954): stdout: | (launched: 2022-12-12_22:33:04.734172) 22:33:07.987551 run osmo-hlr_10.42.42.2(pid=2954): stderr: | [0;m[1;31m20221212223304909 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212223304909 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212223304909 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212223304909 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212223304909 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212223304909 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212223304921 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212223304929 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212223304930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212223304930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:33:08.036757 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2953): Terminating (SIGTERM) 22:33:08.076144 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2956): Terminating (SIGTERM) 22:33:08.115492 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2959): Terminating (SIGTERM) 22:33:08.155253 --- ParallelTerminationStrategy: PID 2953 died... 22:33:08.174132 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2953): Terminated: ok {rc=0} 22:33:08.217831 --- ParallelTerminationStrategy: PID 2956 died... 22:33:08.236759 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2956): Terminated: ok {rc=0} 22:33:08.280895 --- ParallelTerminationStrategy: PID 2959 died... 22:33:08.299554 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2959): Terminated: ok {rc=0} 22:33:08.384730 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2383 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 22:33:09.693080 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:33:09.699518 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 22:33:09.732527 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 22:33:09.767617 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 22:33:09.818544 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 22:33:09.851228 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 22:33:09.885326 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 22:33:10.443892 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2383 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 22:33:10.448914 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:33:10.459985 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 22:33:10.526806 tst switch_tch_pdch.py: using LAC 31953 22:33:10.647510 tst switch_tch_pdch.py: using RAC 78 22:33:10.763070 tst switch_tch_pdch.py: using CellId 31953 22:33:10.879553 tst switch_tch_pdch.py: using BVCI 31954 22:33:10.988761 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:33:10.999907 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:33:11.010935 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:33:11.022266 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:33:11.033531 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:33:11.044687 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:33:11.056056 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:33:11.067286 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:33:11.184369 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:33:11.301177 tst switch_tch_pdch.py:51: start network... 22:33:11.502054 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:33:11.965290 run create_hlr_db(pid=2965): Launched 22:33:12.079485 bus /gobi_6: Setting Powered False 22:33:13.140142 run create_hlr_db(pid=2965): Terminated: ok {rc=0} 22:33:13.578097 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2967): Launched 22:33:13.898231 run osmo-hlr_10.42.42.2(pid=2968): Launched 22:33:14.019895 run osmo-stp_10.42.42.5: Starting osmo-stp 22:33:14.568524 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2970): Launched 22:33:14.886926 run osmo-stp_10.42.42.5(pid=2971): Launched 22:33:15.008720 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:33:15.561129 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2973): Launched 22:33:15.683407 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:33:15.979625 run patchelf(pid=2974): Launched 22:33:16.172126 run osmo-stp_10.42.42.5(pid=2971): ERR: Terminated: ERROR {rc=1} [trial-2383↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2971)] 22:33:16.310153 run osmo-stp_10.42.42.5(pid=2971): stdout: | (launched: 2022-12-12_22:33:14.829406) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:33:16.449496 run osmo-stp_10.42.42.5(pid=2971): stderr: | [0;m[38;5;43m20221212223315019 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223315020 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223315020 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223315020 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223315023 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223315023 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223315023 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:33:16.589151 run osmo-stp_10.42.42.5(pid=2971): stdout: | (launched: 2022-12-12_22:33:14.829406) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:33:16.723384 run osmo-stp_10.42.42.5(pid=2971): stderr: | [0;m[38;5;43m20221212223315019 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223315020 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223315020 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223315020 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223315023 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223315023 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223315023 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:33:16.882531 run patchelf(pid=2974): Terminating (SIGINT) 22:33:17.066567 run patchelf(pid=2974): Terminated: ok {rc=0} 22:33:17.198446 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=2971): Process ended prematurely: osmo-stp_10.42.42.5(pid=2971) [trial-2383↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2971)] [trial-2383↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 22:33:17.207926 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 22:33:17.235818 run osmo-hlr_10.42.42.2(pid=2968): ERR: Terminated: ERROR {rc=237} [trial-2383↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2968)] 22:33:17.285455 run osmo-hlr_10.42.42.2(pid=2968): stdout: | (launched: 2022-12-12_22:33:13.840424) 22:33:17.336618 run osmo-hlr_10.42.42.2(pid=2968): stderr: | [0;m[1;31m20221212223314037 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212223314037 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212223314037 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212223314037 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212223314037 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212223314038 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212223314053 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212223314063 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212223314063 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212223314063 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:33:17.388203 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2967): Terminating (SIGTERM) 22:33:17.429857 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2970): Terminating (SIGTERM) 22:33:17.471355 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2973): Terminating (SIGTERM) 22:33:17.513287 --- ParallelTerminationStrategy: PID 2967 died... 22:33:17.533198 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2967): Terminated: ok {rc=0} 22:33:17.578980 --- ParallelTerminationStrategy: PID 2970 died... 22:33:17.598507 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2970): Terminated: ok {rc=0} 22:33:17.644472 --- ParallelTerminationStrategy: PID 2973 died... 22:33:17.664073 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2973): Terminated: ok {rc=0} 22:33:17.751197 bus /gobi_0: Setting Powered False 22:33:18.849620 bus /gobi_0: Setting Powered False 22:33:19.964929 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2383 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 dynts:trx-b200+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 22:33:21.219155 tst dynts:trx-b200+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:33:21.225776 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 22:33:21.259546 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 22:33:21.294831 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 22:33:21.348677 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 22:33:21.382388 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 22:33:21.417442 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 22:33:21.973659 tst dynts:trx-b200+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2383 dynts:trx-b200+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 22:33:21.978831 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:33:21.990235 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 22:33:22.061070 tst switch_tch_pdch.py: using LAC 31954 22:33:22.186472 tst switch_tch_pdch.py: using RAC 79 22:33:22.310999 tst switch_tch_pdch.py: using CellId 31954 22:33:22.435362 tst switch_tch_pdch.py: using BVCI 31955 22:33:22.550966 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:33:22.562425 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:33:22.573576 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:33:22.584783 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:33:22.595919 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:33:22.607123 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:33:22.618463 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:33:22.629677 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 22:33:22.746582 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 22:33:22.862647 tst switch_tch_pdch.py:51: start network... 22:33:23.064390 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:33:23.502134 run create_hlr_db(pid=2978): Launched 22:33:23.617360 bus /gobi_6: Setting Powered False 22:33:24.677367 run create_hlr_db(pid=2978): Terminated: ok {rc=0} 22:33:25.089097 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2980): Launched 22:33:25.407061 run osmo-hlr_10.42.42.2(pid=2981): Launched 22:33:25.529442 run osmo-stp_10.42.42.5: Starting osmo-stp 22:33:26.052928 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2983): Launched 22:33:26.371107 run osmo-stp_10.42.42.5(pid=2984): Launched 22:33:26.492935 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:33:27.017921 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2986): Launched 22:33:27.140777 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:33:27.410136 run patchelf(pid=2987): Launched 22:33:27.588159 run osmo-stp_10.42.42.5(pid=2984): ERR: Terminated: ERROR {rc=1} [trial-2383↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2984)] 22:33:27.723428 run osmo-stp_10.42.42.5(pid=2984): stdout: | (launched: 2022-12-12_22:33:26.313468) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:33:27.859921 run osmo-stp_10.42.42.5(pid=2984): stderr: | [0;m[38;5;43m20221212223326506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223326506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223326506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223326506 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223326507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223326507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223326507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:33:27.996548 run osmo-stp_10.42.42.5(pid=2984): stdout: | (launched: 2022-12-12_22:33:26.313468) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:33:28.127630 run osmo-stp_10.42.42.5(pid=2984): stderr: | [0;m[38;5;43m20221212223326506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223326506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223326506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223326506 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223326507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223326507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223326507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:33:28.282656 run patchelf(pid=2987): Terminating (SIGINT) 22:33:28.463212 run patchelf(pid=2987): Terminated: ok {rc=0} 22:33:28.592876 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=2984): Process ended prematurely: osmo-stp_10.42.42.5(pid=2984) [trial-2383↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2984)] [trial-2383↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 22:33:28.602332 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 22:33:28.630137 run osmo-hlr_10.42.42.2(pid=2981): ERR: Terminated: ERROR {rc=237} [trial-2383↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2981)] 22:33:28.679548 run osmo-hlr_10.42.42.2(pid=2981): stdout: | (launched: 2022-12-12_22:33:25.349621) 22:33:28.731175 run osmo-hlr_10.42.42.2(pid=2981): stderr: | [0;m[1;31m20221212223325547 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212223325547 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212223325547 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212223325547 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212223325547 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212223325547 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212223325562 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/dynts:trx-b200+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212223325572 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212223325573 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212223325573 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:33:28.782887 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2980): Terminating (SIGTERM) 22:33:28.824058 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2983): Terminating (SIGTERM) 22:33:28.865098 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2986): Terminating (SIGTERM) 22:33:28.906593 --- ParallelTerminationStrategy: PID 2980 died... 22:33:28.926295 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2980): Terminated: ok {rc=0} 22:33:28.971998 --- ParallelTerminationStrategy: PID 2983 died... 22:33:28.991348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2983): Terminated: ok {rc=0} 22:33:29.036809 --- ParallelTerminationStrategy: PID 2986 died... 22:33:29.056828 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2986): Terminated: ok {rc=0} 22:33:29.144374 bus /gobi_0: Setting Powered False 22:33:30.242566 bus /gobi_0: Setting Powered False 22:33:31.356507 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2383 dynts:trx-b200+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 nitb_sms:trx-sysmocell5000 --------------------------------------------------------------------- 22:33:32.611815 tst nitb_sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:33:32.616286 tst nitb_sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 22:33:32.650666 tst nitb_sms:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 22:33:32.657730 tst nitb_sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 22:33:32.712060 tst nitb_sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 22:33:32.746649 tst nitb_sms:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 22:33:32.753639 tst nitb_sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 22:33:33.290105 tst nitb_sms:trx-sysmocell5000: RESERVED RESOURCES for nitb_sms: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 nitb_sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 22:33:33.295123 tst nitb_sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 22:33:33.306400 tst nitb_sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 22:33:33.355111 tst mo_mt_sms.py: using LAC 31955 22:33:33.481396 tst mo_mt_sms.py: using RAC 80 22:33:33.606309 tst mo_mt_sms.py: using CellId 31955 22:33:33.732136 tst mo_mt_sms.py: using BVCI 31956 22:33:33.849529 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 22:33:33.964257 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 22:33:34.081564 tst mo_mt_sms.py:9: start nitb and bts... 22:33:34.298678 run osmo-nitb_10.42.42.2: Starting osmo-nitb 22:33:34.949236 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2991): Launched 22:33:35.267543 run osmo-nitb_10.42.42.2(pid=2992): Launched 22:33:35.444919 run osmo-nitb_10.42.42.2(pid=2992): ERR: Terminated: ERROR {rc=2} [trial-2383↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2992)] 22:33:35.587722 run osmo-nitb_10.42.42.2(pid=2992): stdout: | (launched: 2022-12-12_22:33:35.209928) 22:33:35.732026 run osmo-nitb_10.42.42.2(pid=2992): stderr: | (launched: 2022-12-12_22:33:35.257408) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:33:35.876306 run osmo-nitb_10.42.42.2(pid=2992): stdout: | (launched: 2022-12-12_22:33:35.209928) 22:33:36.014635 run osmo-nitb_10.42.42.2(pid=2992): stderr: | (launched: 2022-12-12_22:33:35.257408) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fa469b2b268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=2992): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2992) [trial-2383↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2992)] 22:33:36.388813 tst osmo-nitb_10.42.42.2(pid=2992): stdout: | (launched: 2022-12-12_22:33:35.209928) 22:33:36.518107 tst osmo-nitb_10.42.42.2(pid=2992): stderr: | (launched: 2022-12-12_22:33:35.257408) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:33:36.669989 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=2992): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2992) [trial-2383↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2992)] [trial-2383↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11] 22:33:36.678984 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 22:33:36.686027 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2991): Terminating (SIGTERM) 22:33:36.896062 --- ParallelTerminationStrategy: PID 2991 died... 22:33:36.917337 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2991): Terminated: ok {rc=0} 22:33:37.004469 bus /sierra_3: Setting Powered False 22:33:38.104806 bus /sierra_3: Setting Powered False 22:33:39.221160 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 nitb_sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 sms:trx-sysmocell5000 --------------------------------------------------------------------- 22:33:40.424722 tst sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:33:40.429425 tst sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 22:33:40.463848 tst sms:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 22:33:40.490942 tst sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 22:33:40.544185 tst sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 22:33:40.577948 tst sms:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 22:33:40.604465 tst sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 22:33:41.153315 tst sms:trx-sysmocell5000: RESERVED RESOURCES for sms: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 22:33:41.158380 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:33:41.169579 tst sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 22:33:41.219677 tst mo_mt_sms.py: using LAC 31956 22:33:41.346355 tst mo_mt_sms.py: using RAC 81 22:33:41.472860 tst mo_mt_sms.py: using CellId 31956 22:33:41.598483 tst mo_mt_sms.py: using BVCI 31957 22:33:41.715980 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:33:41.727207 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:33:41.738269 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:33:41.749832 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:33:41.761390 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:33:41.772812 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 22:33:41.891771 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 22:33:42.011250 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:33:42.508141 run create_hlr_db(pid=2996): Launched 22:33:42.638641 bus /sierra_2: Setting Powered False 22:33:43.702229 run create_hlr_db(pid=2996): Terminated: ok {rc=0} 22:33:44.131038 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2998): Launched 22:33:44.429745 run osmo-hlr_10.42.42.2(pid=2999): Launched 22:33:44.544719 run osmo-stp_10.42.42.5: Starting osmo-stp 22:33:45.075422 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3001): Launched 22:33:45.374655 run osmo-stp_10.42.42.5(pid=3002): Launched 22:33:45.488571 run osmo-msc_10.42.42.6: Starting osmo-msc 22:33:46.078265 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3004): Launched 22:33:46.415671 run osmo-msc_10.42.42.6(pid=3005): Launched 22:33:46.691532 run osmo-stp_10.42.42.5(pid=3002): ERR: Terminated: ERROR {rc=1} [trial-2383↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3002)] 22:33:46.919312 run osmo-stp_10.42.42.5(pid=3002): stdout: | (launched: 2022-12-12_22:33:45.320312) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:33:47.227758 run osmo-stp_10.42.42.5(pid=3002): stderr: | [0;m[38;5;43m20221212223345489 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223345490 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223345490 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223345490 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223345492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223345493 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223345493 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:33:47.390248 run osmo-stp_10.42.42.5(pid=3002): stdout: | (launched: 2022-12-12_22:33:45.320312) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:33:47.510400 run osmo-stp_10.42.42.5(pid=3002): stderr: | [0;m[38;5;43m20221212223345489 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223345490 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223345490 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223345490 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223345492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223345493 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223345493 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:33:47.653665 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=3002): Process ended prematurely: osmo-stp_10.42.42.5(pid=3002) [trial-2383↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3002)] [trial-2383↪sms:trx-sysmocell5000↪mo_mt_sms.py:16] 22:33:47.662194 tst mo_mt_sms.py:16: Test FAILED (6.5 sec) 22:33:47.688544 run osmo-hlr_10.42.42.2(pid=2999): ERR: Terminated: ERROR {rc=237} [trial-2383↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2999)] 22:33:47.737816 run osmo-hlr_10.42.42.2(pid=2999): stdout: | (launched: 2022-12-12_22:33:44.375498) 22:33:47.788106 run osmo-hlr_10.42.42.2(pid=2999): stderr: | [0;m[1;31m20221212223344550 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212223344550 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212223344550 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212223344550 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212223344550 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212223344550 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212223344562 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/sms:trx-sysmocell5000/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212223344571 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212223344571 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212223344571 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:33:47.857346 run osmo-msc_10.42.42.6(pid=3005): ERR: Terminated: ERROR {rc=2} [trial-2383↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3005)] 22:33:47.905314 run osmo-msc_10.42.42.6(pid=3005): stdout: | (launched: 2022-12-12_22:33:46.351813) 22:33:47.954695 run osmo-msc_10.42.42.6(pid=3005): stderr: | [0;m[38;5;43m20221212223346950 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212223346950 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa43ac65c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212223346951 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212223346951 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212223346952 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212223346953 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212223346956 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212223346957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212223346957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212223346957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:33:48.004450 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2998): Terminating (SIGTERM) 22:33:48.044134 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3001): Terminating (SIGTERM) 22:33:48.084269 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3004): Terminating (SIGTERM) 22:33:48.124230 --- ParallelTerminationStrategy: PID 2998 died... 22:33:48.142885 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2998): Terminated: ok {rc=0} 22:33:48.187168 --- ParallelTerminationStrategy: PID 3001 died... 22:33:48.205621 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3001): Terminated: ok {rc=0} 22:33:48.249741 --- ParallelTerminationStrategy: PID 3004 died... 22:33:48.268254 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3004): Terminated: ok {rc=0} 22:33:48.354755 bus /sierra_3: Setting Powered False 22:33:49.454219 bus /sierra_3: Setting Powered False 22:33:50.569399 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 nitb_ussd:trx-sysmocell5000 --------------------------------------------------------------------- 22:33:51.796700 tst nitb_ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:33:51.800544 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 22:33:51.835126 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 22:33:51.841993 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 22:33:51.877196 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 22:33:51.912219 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 22:33:51.919191 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 22:33:52.438875 tst nitb_ussd:trx-sysmocell5000: RESERVED RESOURCES for nitb_ussd: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2383 nitb_ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 22:33:52.445214 tst nitb_ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 22:33:52.457227 tst nitb_ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 22:33:52.507813 tst assert_extension.py: using LAC 31957 22:33:52.633452 tst assert_extension.py: using RAC 82 22:33:52.759457 tst assert_extension.py: using CellId 31957 22:33:52.884377 tst assert_extension.py: using BVCI 31958 22:33:53.001114 tst nitb_ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 22:33:53.117973 tst assert_extension.py:10: start nitb and bts... 22:33:53.318956 run osmo-nitb_10.42.42.2: Starting osmo-nitb 22:33:53.933481 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3010): Launched 22:33:54.236591 run osmo-nitb_10.42.42.2(pid=3011): Launched 22:33:54.404912 run osmo-nitb_10.42.42.2(pid=3011): ERR: Terminated: ERROR {rc=2} [trial-2383↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3011)] 22:33:54.540502 run osmo-nitb_10.42.42.2(pid=3011): stdout: | (launched: 2022-12-12_22:33:54.181468) 22:33:54.677539 run osmo-nitb_10.42.42.2(pid=3011): stderr: | (launched: 2022-12-12_22:33:54.226397) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:33:54.814625 run osmo-nitb_10.42.42.2(pid=3011): stdout: | (launched: 2022-12-12_22:33:54.181468) 22:33:54.945810 run osmo-nitb_10.42.42.2(pid=3011): stderr: | (launched: 2022-12-12_22:33:54.226397) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fa469b2b268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=3011): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3011) [trial-2383↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3011)] 22:33:55.351049 tst osmo-nitb_10.42.42.2(pid=3011): stdout: | (launched: 2022-12-12_22:33:54.181468) 22:33:55.473505 tst osmo-nitb_10.42.42.2(pid=3011): stderr: | (launched: 2022-12-12_22:33:54.226397) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:33:55.617812 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=3011): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3011) [trial-2383↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3011)] [trial-2383↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12] 22:33:55.626235 tst assert_extension.py:12: Test FAILED (3.2 sec) 22:33:55.633049 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3010): Terminating (SIGTERM) 22:33:55.842038 --- ParallelTerminationStrategy: PID 3010 died... 22:33:55.863909 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3010): Terminated: ok {rc=0} 22:33:55.951613 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 nitb_ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 ussd:trx-sysmocell5000 --------------------------------------------------------------------- 22:33:57.132337 tst ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:33:57.136405 tst ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 22:33:57.170881 tst ussd:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 22:33:57.198221 tst ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 22:33:57.234428 tst ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 22:33:57.268606 tst ussd:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 22:33:57.295919 tst ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 22:33:57.828107 tst ussd:trx-sysmocell5000: RESERVED RESOURCES for ussd: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2383 ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 22:33:57.833579 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:33:57.844611 tst ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 22:33:57.893226 tst assert_extension.py: using LAC 31958 22:33:58.018674 tst assert_extension.py: using RAC 83 22:33:58.149578 tst assert_extension.py: using CellId 31958 22:33:58.274770 tst assert_extension.py: using BVCI 31959 22:33:58.390236 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:33:58.401428 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:33:58.412451 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:33:58.423399 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:33:58.434446 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:33:58.445449 tst ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 22:33:58.558207 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:33:59.019965 run create_hlr_db(pid=3015): Launched 22:33:59.134383 bus /sierra_2: Setting Powered False 22:34:00.193695 run create_hlr_db(pid=3015): Terminated: ok {rc=0} 22:34:00.629519 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3017): Launched 22:34:00.978609 run osmo-hlr_10.42.42.2(pid=3018): Launched 22:34:01.241592 run osmo-stp_10.42.42.5: Starting osmo-stp 22:34:02.080740 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3020): Launched 22:34:02.407717 run osmo-stp_10.42.42.5(pid=3021): Launched 22:34:02.527636 run osmo-msc_10.42.42.6: Starting osmo-msc 22:34:03.097817 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3023): Launched 22:34:03.412675 run osmo-msc_10.42.42.6(pid=3024): Launched 22:34:03.588008 run osmo-stp_10.42.42.5(pid=3021): ERR: Terminated: ERROR {rc=1} [trial-2383↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3021)] 22:34:03.721478 run osmo-stp_10.42.42.5(pid=3021): stdout: | (launched: 2022-12-12_22:34:02.350893) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:34:03.854761 run osmo-stp_10.42.42.5(pid=3021): stderr: | [0;m[38;5;43m20221212223402541 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223402542 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223402542 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223402542 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223402543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223402543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223402543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:34:03.987264 run osmo-stp_10.42.42.5(pid=3021): stdout: | (launched: 2022-12-12_22:34:02.350893) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:34:04.112838 run osmo-stp_10.42.42.5(pid=3021): stderr: | [0;m[38;5;43m20221212223402541 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223402542 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223402542 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223402542 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223402543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223402543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223402543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:34:04.263155 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=3021): Process ended prematurely: osmo-stp_10.42.42.5(pid=3021) [trial-2383↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3021)] [trial-2383↪ussd:trx-sysmocell5000↪assert_extension.py:17] 22:34:04.272001 tst assert_extension.py:17: Test FAILED (6.4 sec) 22:34:04.299315 run osmo-hlr_10.42.42.2(pid=3018): ERR: Terminated: ERROR {rc=237} [trial-2383↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3018)] 22:34:04.349154 run osmo-hlr_10.42.42.2(pid=3018): stdout: | (launched: 2022-12-12_22:34:00.896606) 22:34:04.400740 run osmo-hlr_10.42.42.2(pid=3018): stderr: | [0;m[1;31m20221212223401374 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212223401374 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212223401374 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212223401375 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212223401375 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212223401376 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212223401401 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/ussd:trx-sysmocell5000/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212223401416 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212223401425 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212223401425 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:34:04.472081 run osmo-msc_10.42.42.6(pid=3024): ERR: Terminated: ERROR {rc=2} [trial-2383↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3024)] 22:34:04.521440 run osmo-msc_10.42.42.6(pid=3024): stdout: | (launched: 2022-12-12_22:34:03.355631) 22:34:04.572366 run osmo-msc_10.42.42.6(pid=3024): stderr: | [0;m[38;5;43m20221212223403680 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212223403680 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f91bc7b2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212223403680 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212223403680 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212223403681 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212223403681 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212223403682 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212223403683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212223403683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212223403683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:34:04.623909 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3017): Terminating (SIGTERM) 22:34:04.665236 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3020): Terminating (SIGTERM) 22:34:04.706578 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3023): Terminating (SIGTERM) 22:34:04.748056 --- ParallelTerminationStrategy: PID 3017 died... 22:34:04.768057 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3017): Terminated: ok {rc=0} 22:34:04.813660 --- ParallelTerminationStrategy: PID 3020 died... 22:34:04.833086 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3020): Terminated: ok {rc=0} 22:34:04.878508 --- ParallelTerminationStrategy: PID 3023 died... 22:34:04.897932 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3023): Terminated: ok {rc=0} 22:34:04.984418 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 22:34:06.192226 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:34:06.198944 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 22:34:06.233125 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 22:34:06.260568 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 22:34:06.313251 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 22:34:06.347053 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 22:34:06.373111 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 22:34:06.922896 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 22:34:06.972023 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:34:06.983134 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 22:34:07.052485 tst mo_mt_call.py: using LAC 31959 22:34:07.172215 tst mo_mt_call.py: using RAC 84 22:34:07.291134 tst mo_mt_call.py: using CellId 31959 22:34:07.411722 tst mo_mt_call.py: using BVCI 31960 22:34:07.523962 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:34:07.535404 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:34:07.546352 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:34:07.557660 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:34:07.569344 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:34:07.580542 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:34:07.695674 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:34:07.809623 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:34:08.279544 run create_hlr_db(pid=3029): Launched 22:34:08.395184 bus /sierra_2: Setting Powered False 22:34:09.454783 run create_hlr_db(pid=3029): Terminated: ok {rc=0} 22:34:09.894401 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3031): Launched 22:34:10.215025 run osmo-hlr_10.42.42.2(pid=3032): Launched 22:34:10.338486 run osmo-stp_10.42.42.5: Starting osmo-stp 22:34:10.891297 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3034): Launched 22:34:11.213663 run osmo-stp_10.42.42.5(pid=3035): Launched 22:34:11.336511 run osmo-msc_10.42.42.6: Starting osmo-msc 22:34:11.917627 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3037): Launched 22:34:12.230901 run osmo-msc_10.42.42.6(pid=3038): Launched 22:34:12.400240 run osmo-stp_10.42.42.5(pid=3035): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3035)] 22:34:12.528714 run osmo-stp_10.42.42.5(pid=3035): stdout: | (launched: 2022-12-12_22:34:11.155718) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:34:12.658123 run osmo-stp_10.42.42.5(pid=3035): stderr: | [0;m[38;5;43m20221212223411349 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223411349 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223411349 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223411350 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223411350 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223411350 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223411350 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:34:12.784260 run osmo-stp_10.42.42.5(pid=3035): stdout: | (launched: 2022-12-12_22:34:11.155718) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:34:12.903943 run osmo-stp_10.42.42.5(pid=3035): stderr: | [0;m[38;5;43m20221212223411349 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223411349 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223411349 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223411350 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223411350 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223411350 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223411350 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:34:13.047802 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3035): Process ended prematurely: osmo-stp_10.42.42.5(pid=3035) [trial-2383↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3035)] [trial-2383↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 22:34:13.056446 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 22:34:13.083044 run osmo-hlr_10.42.42.2(pid=3032): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3032)] 22:34:13.130424 run osmo-hlr_10.42.42.2(pid=3032): stdout: | (launched: 2022-12-12_22:34:10.157172) 22:34:13.179483 run osmo-hlr_10.42.42.2(pid=3032): stderr: | [0;m[1;31m20221212223410355 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212223410355 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212223410355 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212223410355 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212223410355 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212223410355 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212223410367 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212223410375 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212223410375 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212223410376 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:34:13.247775 run osmo-msc_10.42.42.6(pid=3038): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3038)] 22:34:13.295587 run osmo-msc_10.42.42.6(pid=3038): stdout: | (launched: 2022-12-12_22:34:12.175782) 22:34:13.344332 run osmo-msc_10.42.42.6(pid=3038): stderr: | [0;m[38;5;43m20221212223412450 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212223412450 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fbb83a1ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212223412450 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212223412450 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212223412450 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212223412450 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212223412452 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212223412452 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212223412452 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212223412453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:34:13.393391 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3031): Terminating (SIGTERM) 22:34:13.432643 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3034): Terminating (SIGTERM) 22:34:13.472046 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3037): Terminating (SIGTERM) 22:34:13.511647 --- ParallelTerminationStrategy: PID 3031 died... 22:34:13.530418 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3031): Terminated: ok {rc=0} 22:34:13.574309 --- ParallelTerminationStrategy: PID 3034 died... 22:34:13.592402 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3034): Terminated: ok {rc=0} 22:34:13.636519 --- ParallelTerminationStrategy: PID 3037 died... 22:34:13.654696 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3037): Terminated: ok {rc=0} 22:34:13.739723 bus /sierra_3: Setting Powered False 22:34:14.837489 bus /sierra_3: Setting Powered False 22:34:15.961357 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2383 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 22:34:17.155275 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:34:17.169715 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 22:34:17.246482 tst mo_mt_call_osmux.py: using LAC 31960 22:34:17.374918 tst mo_mt_call_osmux.py: using RAC 85 22:34:17.501984 tst mo_mt_call_osmux.py: using CellId 31960 22:34:17.628419 tst mo_mt_call_osmux.py: using BVCI 31961 22:34:17.745616 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:34:17.757708 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:34:17.769060 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:34:17.780846 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:34:17.792397 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:34:17.803930 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:34:17.923276 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:34:18.040262 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:34:18.510510 run create_hlr_db(pid=3040): Launched 22:34:18.627424 bus /sierra_2: Setting Powered False 22:34:19.687590 run create_hlr_db(pid=3040): Terminated: ok {rc=0} 22:34:20.129674 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3042): Launched 22:34:20.450957 run osmo-hlr_10.42.42.2(pid=3043): Launched 22:34:20.574572 run osmo-stp_10.42.42.5: Starting osmo-stp 22:34:21.132809 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3045): Launched 22:34:21.455222 run osmo-stp_10.42.42.5(pid=3046): Launched 22:34:21.577918 run osmo-msc_10.42.42.6: Starting osmo-msc 22:34:22.159461 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3048): Launched 22:34:22.479762 run osmo-msc_10.42.42.6(pid=3049): Launched 22:34:22.659463 run osmo-stp_10.42.42.5(pid=3046): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3046)] 22:34:22.795575 run osmo-stp_10.42.42.5(pid=3046): stdout: | (launched: 2022-12-12_22:34:21.397087) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:34:22.931803 run osmo-stp_10.42.42.5(pid=3046): stderr: | [0;m[38;5;43m20221212223421591 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223421591 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223421591 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223421591 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223421592 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223421592 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223421592 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:34:23.067479 run osmo-stp_10.42.42.5(pid=3046): stdout: | (launched: 2022-12-12_22:34:21.397087) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:34:23.196556 run osmo-stp_10.42.42.5(pid=3046): stderr: | [0;m[38;5;43m20221212223421591 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223421591 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223421591 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223421591 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223421592 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223421592 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223421592 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:34:23.349655 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3046): Process ended prematurely: osmo-stp_10.42.42.5(pid=3046) [trial-2383↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3046)] [trial-2383↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 22:34:23.359174 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 22:34:23.386605 run osmo-hlr_10.42.42.2(pid=3043): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3043)] 22:34:23.435993 run osmo-hlr_10.42.42.2(pid=3043): stdout: | (launched: 2022-12-12_22:34:20.392937) 22:34:23.486992 run osmo-hlr_10.42.42.2(pid=3043): stderr: | [0;m[1;31m20221212223420589 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212223420590 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212223420590 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212223420590 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212223420590 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212223420590 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212223420602 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212223420612 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212223420612 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212223420613 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:34:23.558557 run osmo-msc_10.42.42.6(pid=3049): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3049)] 22:34:23.607875 run osmo-msc_10.42.42.6(pid=3049): stdout: | (launched: 2022-12-12_22:34:22.421792) 22:34:23.658870 run osmo-msc_10.42.42.6(pid=3049): stderr: | [0;m[38;5;43m20221212223422746 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212223422746 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f05856c1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212223422746 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212223422747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212223422747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212223422747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212223422750 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212223422750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212223422751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212223422751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:34:23.710638 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3042): Terminating (SIGTERM) 22:34:23.751667 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3045): Terminating (SIGTERM) 22:34:23.792506 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3048): Terminating (SIGTERM) 22:34:23.833672 --- ParallelTerminationStrategy: PID 3042 died... 22:34:23.853428 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3042): Terminated: ok {rc=0} 22:34:23.898805 --- ParallelTerminationStrategy: PID 3045 died... 22:34:23.917952 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3045): Terminated: ok {rc=0} 22:34:23.963060 --- ParallelTerminationStrategy: PID 3048 died... 22:34:23.982228 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3048): Terminated: ok {rc=0} 22:34:24.068446 bus /sierra_3: Setting Powered False 22:34:25.165260 bus /sierra_3: Setting Powered False 22:34:26.276204 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 22:34:27.530968 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:34:27.537921 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 22:34:27.572053 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 22:34:27.599196 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 22:34:27.651364 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 22:34:27.685568 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 22:34:27.712582 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 22:34:28.266150 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 22:34:28.317257 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:34:28.328858 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 22:34:28.400687 tst mo_mt_call.py: using LAC 31961 22:34:28.528452 tst mo_mt_call.py: using RAC 86 22:34:28.654998 tst mo_mt_call.py: using CellId 31961 22:34:28.783319 tst mo_mt_call.py: using BVCI 31962 22:34:28.900038 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:34:28.911730 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:34:28.923217 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:34:28.934705 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:34:28.946428 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:34:28.957943 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:34:29.072048 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:34:29.188220 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:34:29.657651 run create_hlr_db(pid=3054): Launched 22:34:29.775100 bus /sierra_2: Setting Powered False 22:34:30.839303 run create_hlr_db(pid=3054): Terminated: ok {rc=0} 22:34:31.298988 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3056): Launched 22:34:31.622898 run osmo-hlr_10.42.42.2(pid=3057): Launched 22:34:31.854047 run osmo-stp_10.42.42.5: Starting osmo-stp 22:34:32.511075 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3059): Launched 22:34:32.812442 run osmo-stp_10.42.42.5(pid=3060): Launched 22:34:32.927696 run osmo-msc_10.42.42.6: Starting osmo-msc 22:34:33.478777 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3062): Launched 22:34:33.781412 run osmo-msc_10.42.42.6(pid=3063): Launched 22:34:33.952205 run osmo-stp_10.42.42.5(pid=3060): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3060)] 22:34:34.081547 run osmo-stp_10.42.42.5(pid=3060): stdout: | (launched: 2022-12-12_22:34:32.757975) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:34:34.210830 run osmo-stp_10.42.42.5(pid=3060): stderr: | [0;m[38;5;43m20221212223432927 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223432927 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223432927 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223432927 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223432928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223432928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223432928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:34:34.337527 run osmo-stp_10.42.42.5(pid=3060): stdout: | (launched: 2022-12-12_22:34:32.757975) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:34:34.460546 run osmo-stp_10.42.42.5(pid=3060): stderr: | [0;m[38;5;43m20221212223432927 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223432927 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223432927 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223432927 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223432928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223432928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223432928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:34:34.606454 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3060): Process ended prematurely: osmo-stp_10.42.42.5(pid=3060) [trial-2383↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3060)] [trial-2383↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 22:34:34.615136 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 22:34:34.641600 run osmo-hlr_10.42.42.2(pid=3057): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3057)] 22:34:34.688869 run osmo-hlr_10.42.42.2(pid=3057): stdout: | (launched: 2022-12-12_22:34:31.554010) 22:34:34.738045 run osmo-hlr_10.42.42.2(pid=3057): stderr: | [0;m[1;31m20221212223431815 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212223431815 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212223431815 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212223431815 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212223431815 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212223431815 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212223431844 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212223431859 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212223431859 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212223431859 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:34:34.806273 run osmo-msc_10.42.42.6(pid=3063): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3063)] 22:34:34.853762 run osmo-msc_10.42.42.6(pid=3063): stdout: | (launched: 2022-12-12_22:34:33.726011) 22:34:34.902504 run osmo-msc_10.42.42.6(pid=3063): stderr: | [0;m[38;5;43m20221212223433998 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212223433998 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff18cf9cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212223433998 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212223433998 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212223433998 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212223433999 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212223434000 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212223434001 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212223434001 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212223434001 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:34:34.951864 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3056): Terminating (SIGTERM) 22:34:34.991068 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3059): Terminating (SIGTERM) 22:34:35.030426 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3062): Terminating (SIGTERM) 22:34:35.069977 --- ParallelTerminationStrategy: PID 3056 died... 22:34:35.088552 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3056): Terminated: ok {rc=0} 22:34:35.132364 --- ParallelTerminationStrategy: PID 3059 died... 22:34:35.150630 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3059): Terminated: ok {rc=0} 22:34:35.194254 --- ParallelTerminationStrategy: PID 3062 died... 22:34:35.212400 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3062): Terminated: ok {rc=0} 22:34:35.297128 bus /sierra_3: Setting Powered False 22:34:36.395682 bus /sierra_3: Setting Powered False 22:34:37.509490 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2383 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 22:34:38.657827 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:34:38.670155 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 22:34:38.741113 tst mo_mt_call_osmux.py: using LAC 31962 22:34:38.868903 tst mo_mt_call_osmux.py: using RAC 87 22:34:38.998354 tst mo_mt_call_osmux.py: using CellId 31962 22:34:39.127186 tst mo_mt_call_osmux.py: using BVCI 31963 22:34:39.247285 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:34:39.259105 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:34:39.270695 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:34:39.282352 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:34:39.294039 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:34:39.305802 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:34:39.424920 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:34:39.543248 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:34:40.012096 run create_hlr_db(pid=3066): Launched 22:34:40.128621 bus /sierra_2: Setting Powered False 22:34:41.188659 run create_hlr_db(pid=3066): Terminated: ok {rc=0} 22:34:41.608745 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3068): Launched 22:34:41.910136 run osmo-hlr_10.42.42.2(pid=3069): Launched 22:34:42.025868 run osmo-stp_10.42.42.5: Starting osmo-stp 22:34:42.562698 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3071): Launched 22:34:42.864623 run osmo-stp_10.42.42.5(pid=3072): Launched 22:34:42.981064 run osmo-msc_10.42.42.6: Starting osmo-msc 22:34:43.528578 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3074): Launched 22:34:43.832470 run osmo-msc_10.42.42.6(pid=3075): Launched 22:34:44.003764 run osmo-stp_10.42.42.5(pid=3072): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3072)] 22:34:44.133143 run osmo-stp_10.42.42.5(pid=3072): stdout: | (launched: 2022-12-12_22:34:42.809946) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:34:44.262257 run osmo-stp_10.42.42.5(pid=3072): stderr: | [0;m[38;5;43m20221212223442980 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223442980 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223442980 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223442980 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223442981 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223442981 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223442981 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:34:44.388925 run osmo-stp_10.42.42.5(pid=3072): stdout: | (launched: 2022-12-12_22:34:42.809946) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:34:44.509709 run osmo-stp_10.42.42.5(pid=3072): stderr: | [0;m[38;5;43m20221212223442980 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223442980 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223442980 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223442980 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223442981 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223442981 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223442981 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:34:44.653682 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3072): Process ended prematurely: osmo-stp_10.42.42.5(pid=3072) [trial-2383↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3072)] [trial-2383↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 22:34:44.662436 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 22:34:44.688608 run osmo-hlr_10.42.42.2(pid=3069): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3069)] 22:34:44.735863 run osmo-hlr_10.42.42.2(pid=3069): stdout: | (launched: 2022-12-12_22:34:41.855291) 22:34:44.784554 run osmo-hlr_10.42.42.2(pid=3069): stderr: | [0;m[1;31m20221212223442031 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212223442032 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212223442032 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212223442032 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212223442032 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212223442032 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212223442044 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212223442052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212223442053 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212223442053 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:34:44.852553 run osmo-msc_10.42.42.6(pid=3075): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3075)] 22:34:44.899426 run osmo-msc_10.42.42.6(pid=3075): stdout: | (launched: 2022-12-12_22:34:43.776852) 22:34:44.947865 run osmo-msc_10.42.42.6(pid=3075): stderr: | [0;m[38;5;43m20221212223444047 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212223444047 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff9de1cfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212223444047 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212223444047 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212223444047 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212223444047 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212223444049 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212223444050 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212223444050 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212223444050 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:34:44.996717 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3068): Terminating (SIGTERM) 22:34:45.035792 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3071): Terminating (SIGTERM) 22:34:45.074999 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3074): Terminating (SIGTERM) 22:34:45.114537 --- ParallelTerminationStrategy: PID 3068 died... 22:34:45.133273 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3068): Terminated: ok {rc=0} 22:34:45.176814 --- ParallelTerminationStrategy: PID 3071 died... 22:34:45.194936 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3071): Terminated: ok {rc=0} 22:34:45.238865 --- ParallelTerminationStrategy: PID 3074 died... 22:34:45.257088 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3074): Terminated: ok {rc=0} 22:34:45.343617 bus /sierra_3: Setting Powered False 22:34:46.447610 bus /sierra_3: Setting Powered False 22:34:47.570966 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 22:34:48.824182 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:34:48.831297 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 22:34:48.865667 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 22:34:48.892824 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 22:34:48.949337 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 22:34:48.983436 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 22:34:49.010312 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 22:34:49.558733 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 22:34:49.609950 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:34:49.621645 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 22:34:49.690969 tst mo_mt_call.py: using LAC 31963 22:34:49.816664 tst mo_mt_call.py: using RAC 88 22:34:49.941682 tst mo_mt_call.py: using CellId 31963 22:34:50.071116 tst mo_mt_call.py: using BVCI 31964 22:34:50.191031 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:34:50.202754 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:34:50.214159 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:34:50.225568 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:34:50.237016 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:34:50.248423 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:34:50.364207 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:34:50.479729 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:34:50.948359 run create_hlr_db(pid=3080): Launched 22:34:51.065551 bus /sierra_2: Setting Powered False 22:34:52.125836 run create_hlr_db(pid=3080): Terminated: ok {rc=0} 22:34:52.566859 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3082): Launched 22:34:52.888900 run osmo-hlr_10.42.42.2(pid=3083): Launched 22:34:53.012735 run osmo-stp_10.42.42.5: Starting osmo-stp 22:34:53.570216 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3085): Launched 22:34:53.891499 run osmo-stp_10.42.42.5(pid=3086): Launched 22:34:54.014773 run osmo-msc_10.42.42.6: Starting osmo-msc 22:34:54.596709 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3088): Launched 22:34:54.919029 run osmo-msc_10.42.42.6(pid=3089): Launched 22:34:55.099275 run osmo-stp_10.42.42.5(pid=3086): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3086)] 22:34:55.235434 run osmo-stp_10.42.42.5(pid=3086): stdout: | (launched: 2022-12-12_22:34:53.833302) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:34:55.372065 run osmo-stp_10.42.42.5(pid=3086): stderr: | [0;m[38;5;43m20221212223454028 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223454028 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223454028 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223454028 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223454029 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223454029 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223454029 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:34:55.508409 run osmo-stp_10.42.42.5(pid=3086): stdout: | (launched: 2022-12-12_22:34:53.833302) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:34:55.636803 run osmo-stp_10.42.42.5(pid=3086): stderr: | [0;m[38;5;43m20221212223454028 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223454028 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223454028 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223454028 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223454029 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223454029 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223454029 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:34:55.790690 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3086): Process ended prematurely: osmo-stp_10.42.42.5(pid=3086) [trial-2383↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3086)] [trial-2383↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 22:34:55.800197 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 22:34:55.827787 run osmo-hlr_10.42.42.2(pid=3083): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3083)] 22:34:55.877426 run osmo-hlr_10.42.42.2(pid=3083): stdout: | (launched: 2022-12-12_22:34:52.830862) 22:34:55.928893 run osmo-hlr_10.42.42.2(pid=3083): stderr: | [0;m[1;31m20221212223453029 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212223453029 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212223453029 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212223453029 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212223453029 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212223453029 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212223453044 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212223453052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212223453053 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212223453053 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:34:56.000637 run osmo-msc_10.42.42.6(pid=3089): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3089)] 22:34:56.049991 run osmo-msc_10.42.42.6(pid=3089): stdout: | (launched: 2022-12-12_22:34:54.860396) 22:34:56.101474 run osmo-msc_10.42.42.6(pid=3089): stderr: | [0;m[38;5;43m20221212223455183 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212223455184 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4ee9b26c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212223455184 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212223455184 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212223455184 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212223455184 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212223455186 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212223455186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212223455186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212223455186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:34:56.153084 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3082): Terminating (SIGTERM) 22:34:56.194101 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3085): Terminating (SIGTERM) 22:34:56.235451 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3088): Terminating (SIGTERM) 22:34:56.276826 --- ParallelTerminationStrategy: PID 3082 died... 22:34:56.296242 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3082): Terminated: ok {rc=0} 22:34:56.342021 --- ParallelTerminationStrategy: PID 3085 died... 22:34:56.361296 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3085): Terminated: ok {rc=0} 22:34:56.406646 --- ParallelTerminationStrategy: PID 3088 died... 22:34:56.425845 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3088): Terminated: ok {rc=0} 22:34:56.512240 bus /sierra_3: Setting Powered False 22:34:57.610688 bus /sierra_3: Setting Powered False 22:34:58.724528 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2383 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 22:34:59.871565 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:34:59.883710 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 22:34:59.958615 tst mo_mt_call_osmux.py: using LAC 31964 22:35:00.086426 tst mo_mt_call_osmux.py: using RAC 89 22:35:00.214463 tst mo_mt_call_osmux.py: using CellId 31964 22:35:00.342233 tst mo_mt_call_osmux.py: using BVCI 31965 22:35:00.459959 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:35:00.471568 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:35:00.483011 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:35:00.494458 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:35:00.506077 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:35:00.517698 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:35:00.637908 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:35:00.757982 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:35:01.270501 run create_hlr_db(pid=3091): Launched 22:35:01.432832 bus /sierra_2: Setting Powered False 22:35:02.496468 run create_hlr_db(pid=3091): Terminated: ok {rc=0} 22:35:02.929090 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3096): Launched 22:35:03.231708 run osmo-hlr_10.42.42.2(pid=3097): Launched 22:35:03.348326 run osmo-stp_10.42.42.5: Starting osmo-stp 22:35:03.888017 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3099): Launched 22:35:04.191543 run osmo-stp_10.42.42.5(pid=3100): Launched 22:35:04.308533 run osmo-msc_10.42.42.6: Starting osmo-msc 22:35:04.858378 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3102): Launched 22:35:05.162114 run osmo-msc_10.42.42.6(pid=3103): Launched 22:35:05.332900 run osmo-stp_10.42.42.5(pid=3100): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3100)] 22:35:05.461986 run osmo-stp_10.42.42.5(pid=3100): stdout: | (launched: 2022-12-12_22:35:04.135634) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:35:05.590694 run osmo-stp_10.42.42.5(pid=3100): stderr: | [0;m[38;5;43m20221212223504306 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223504306 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223504306 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223504306 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223504307 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223504307 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223504307 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:35:05.717552 run osmo-stp_10.42.42.5(pid=3100): stdout: | (launched: 2022-12-12_22:35:04.135634) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:35:05.838388 run osmo-stp_10.42.42.5(pid=3100): stderr: | [0;m[38;5;43m20221212223504306 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223504306 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223504306 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223504306 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223504307 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223504307 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223504307 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:35:05.983357 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3100): Process ended prematurely: osmo-stp_10.42.42.5(pid=3100) [trial-2383↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3100)] [trial-2383↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 22:35:05.992175 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 22:35:06.018416 run osmo-hlr_10.42.42.2(pid=3097): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3097)] 22:35:06.066125 run osmo-hlr_10.42.42.2(pid=3097): stdout: | (launched: 2022-12-12_22:35:03.176785) 22:35:06.115291 run osmo-hlr_10.42.42.2(pid=3097): stderr: | [0;m[1;31m20221212223503350 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212223503351 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212223503351 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212223503351 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212223503351 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212223503351 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212223503362 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212223503370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212223503370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212223503370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:35:06.183957 run osmo-msc_10.42.42.6(pid=3103): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3103)] 22:35:06.231191 run osmo-msc_10.42.42.6(pid=3103): stdout: | (launched: 2022-12-12_22:35:05.106701) 22:35:06.280187 run osmo-msc_10.42.42.6(pid=3103): stderr: | [0;m[38;5;43m20221212223505378 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212223505378 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe6cabf8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212223505378 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212223505378 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212223505378 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212223505379 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212223505380 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212223505381 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212223505381 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212223505381 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:35:06.329549 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3096): Terminating (SIGTERM) 22:35:06.368838 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3099): Terminating (SIGTERM) 22:35:06.408387 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3102): Terminating (SIGTERM) 22:35:06.447906 --- ParallelTerminationStrategy: PID 3096 died... 22:35:06.466705 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3096): Terminated: ok {rc=0} 22:35:06.511106 --- ParallelTerminationStrategy: PID 3099 died... 22:35:06.529305 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3099): Terminated: ok {rc=0} 22:35:06.573249 --- ParallelTerminationStrategy: PID 3102 died... 22:35:06.591593 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3102): Terminated: ok {rc=0} 22:35:06.676934 bus /sierra_3: Setting Powered False 22:35:07.778056 bus /sierra_3: Setting Powered False 22:35:08.894980 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 22:35:10.145246 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:35:10.151803 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 22:35:10.185452 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 22:35:10.211998 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 22:35:10.263212 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 22:35:10.296368 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 22:35:10.322656 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 22:35:10.878139 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 22:35:10.926961 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:35:10.938115 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 22:35:11.006562 tst mo_mt_call.py: using LAC 31965 22:35:11.126903 tst mo_mt_call.py: using RAC 90 22:35:11.247826 tst mo_mt_call.py: using CellId 31965 22:35:11.369122 tst mo_mt_call.py: using BVCI 31966 22:35:11.479352 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:35:11.490464 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:35:11.501405 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:35:11.512485 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:35:11.523803 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:35:11.535163 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 22:35:11.655744 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 22:35:11.771694 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:35:12.275401 run create_hlr_db(pid=3108): Launched 22:35:12.406120 bus /sierra_2: Setting Powered False 22:35:13.469806 run create_hlr_db(pid=3108): Terminated: ok {rc=0} 22:35:13.901924 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3110): Launched 22:35:14.204141 run osmo-hlr_10.42.42.2(pid=3111): Launched 22:35:14.320010 run osmo-stp_10.42.42.5: Starting osmo-stp 22:35:14.877195 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3113): Launched 22:35:15.198194 run osmo-stp_10.42.42.5(pid=3114): Launched 22:35:15.321590 run osmo-msc_10.42.42.6: Starting osmo-msc 22:35:15.930322 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3116): Launched 22:35:16.285918 run osmo-msc_10.42.42.6(pid=3117): Launched 22:35:16.759737 run osmo-stp_10.42.42.5(pid=3114): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3114)] 22:35:17.138808 run osmo-stp_10.42.42.5(pid=3114): stdout: | (launched: 2022-12-12_22:35:15.140091) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:35:17.353133 run osmo-stp_10.42.42.5(pid=3114): stderr: | [0;m[38;5;43m20221212223515330 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223515330 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223515330 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223515331 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223515333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223515333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223515333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:35:17.490830 run osmo-stp_10.42.42.5(pid=3114): stdout: | (launched: 2022-12-12_22:35:15.140091) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:35:17.620356 run osmo-stp_10.42.42.5(pid=3114): stderr: | [0;m[38;5;43m20221212223515330 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223515330 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223515330 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223515331 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223515333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223515333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223515333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:35:17.774456 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3114): Process ended prematurely: osmo-stp_10.42.42.5(pid=3114) [trial-2383↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3114)] [trial-2383↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 22:35:17.783984 tst mo_mt_call.py:8: Test FAILED (6.9 sec) 22:35:17.811598 run osmo-hlr_10.42.42.2(pid=3111): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3111)] 22:35:17.861455 run osmo-hlr_10.42.42.2(pid=3111): stdout: | (launched: 2022-12-12_22:35:14.149019) 22:35:17.913180 run osmo-hlr_10.42.42.2(pid=3111): stderr: | [0;m[1;31m20221212223514323 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212223514323 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212223514323 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212223514323 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212223514323 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212223514323 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212223514335 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212223514343 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212223514344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212223514344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:35:17.985005 run osmo-msc_10.42.42.6(pid=3117): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3117)] 22:35:18.034521 run osmo-msc_10.42.42.6(pid=3117): stdout: | (launched: 2022-12-12_22:35:16.216456) 22:35:18.085736 run osmo-msc_10.42.42.6(pid=3117): stderr: | [0;m[38;5;43m20221212223516777 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212223516777 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f03ff7d4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212223516777 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212223516777 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212223516778 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212223516778 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212223516779 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212223516780 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212223516780 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212223516780 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:35:18.137885 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3110): Terminating (SIGTERM) 22:35:18.179047 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3113): Terminating (SIGTERM) 22:35:18.220553 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3116): Terminating (SIGTERM) 22:35:18.262447 --- ParallelTerminationStrategy: PID 3110 died... 22:35:18.281783 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3110): Terminated: ok {rc=0} 22:35:18.327629 --- ParallelTerminationStrategy: PID 3113 died... 22:35:18.347112 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3113): Terminated: ok {rc=0} 22:35:18.392854 --- ParallelTerminationStrategy: PID 3116 died... 22:35:18.412611 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3116): Terminated: ok {rc=0} 22:35:18.498494 bus /sierra_3: Setting Powered False 22:35:19.599067 bus /sierra_3: Setting Powered False 22:35:20.714305 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2383 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 22:35:21.860760 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:35:21.872507 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 22:35:21.941834 tst mo_mt_call_osmux.py: using LAC 31966 22:35:22.063142 tst mo_mt_call_osmux.py: using RAC 91 22:35:22.185061 tst mo_mt_call_osmux.py: using CellId 31966 22:35:22.313136 tst mo_mt_call_osmux.py: using BVCI 31967 22:35:22.430367 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:35:22.442197 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:35:22.453781 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:35:22.465650 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:35:22.477678 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:35:22.489450 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 22:35:22.608542 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 22:35:22.725937 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:35:23.195304 run create_hlr_db(pid=3119): Launched 22:35:23.312238 bus /sierra_2: Setting Powered False 22:35:24.371744 run create_hlr_db(pid=3119): Terminated: ok {rc=0} 22:35:24.793363 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3121): Launched 22:35:25.095473 run osmo-hlr_10.42.42.2(pid=3122): Launched 22:35:25.212238 run osmo-stp_10.42.42.5: Starting osmo-stp 22:35:25.756499 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3124): Launched 22:35:26.059119 run osmo-stp_10.42.42.5(pid=3125): Launched 22:35:26.176463 run osmo-msc_10.42.42.6: Starting osmo-msc 22:35:26.724537 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3127): Launched 22:35:27.027848 run osmo-msc_10.42.42.6(pid=3128): Launched 22:35:27.198922 run osmo-stp_10.42.42.5(pid=3125): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3125)] 22:35:27.327867 run osmo-stp_10.42.42.5(pid=3125): stdout: | (launched: 2022-12-12_22:35:26.004143) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:35:27.456658 run osmo-stp_10.42.42.5(pid=3125): stderr: | [0;m[38;5;43m20221212223526172 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223526172 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223526172 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223526173 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223526173 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223526173 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223526173 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:35:27.583908 run osmo-stp_10.42.42.5(pid=3125): stdout: | (launched: 2022-12-12_22:35:26.004143) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:35:27.704857 run osmo-stp_10.42.42.5(pid=3125): stderr: | [0;m[38;5;43m20221212223526172 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223526172 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223526172 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223526173 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223526173 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223526173 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223526173 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:35:27.849372 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3125): Process ended prematurely: osmo-stp_10.42.42.5(pid=3125) [trial-2383↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3125)] [trial-2383↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 22:35:27.858319 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 22:35:27.884442 run osmo-hlr_10.42.42.2(pid=3122): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3122)] 22:35:27.931957 run osmo-hlr_10.42.42.2(pid=3122): stdout: | (launched: 2022-12-12_22:35:25.040431) 22:35:27.980769 run osmo-hlr_10.42.42.2(pid=3122): stderr: | [0;m[1;31m20221212223525218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212223525218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212223525218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212223525218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212223525218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212223525218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212223525230 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212223525240 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212223525241 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212223525241 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:35:28.048521 run osmo-msc_10.42.42.6(pid=3128): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3128)] 22:35:28.095650 run osmo-msc_10.42.42.6(pid=3128): stdout: | (launched: 2022-12-12_22:35:26.972774) 22:35:28.144396 run osmo-msc_10.42.42.6(pid=3128): stderr: | [0;m[38;5;43m20221212223527243 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212223527243 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fac58794c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212223527243 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212223527243 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212223527243 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212223527243 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212223527245 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212223527246 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212223527246 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212223527246 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:35:28.193701 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3121): Terminating (SIGTERM) 22:35:28.233085 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3124): Terminating (SIGTERM) 22:35:28.272375 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3127): Terminating (SIGTERM) 22:35:28.312018 --- ParallelTerminationStrategy: PID 3121 died... 22:35:28.330862 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3121): Terminated: ok {rc=0} 22:35:28.374625 --- ParallelTerminationStrategy: PID 3124 died... 22:35:28.392773 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3124): Terminated: ok {rc=0} 22:35:28.436169 --- ParallelTerminationStrategy: PID 3127 died... 22:35:28.454270 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3127): Terminated: ok {rc=0} 22:35:28.539101 bus /sierra_3: Setting Powered False 22:35:29.637666 bus /sierra_3: Setting Powered False 22:35:30.752722 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 22:35:32.062063 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:35:32.077361 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 22:35:32.118540 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 22:35:32.146644 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 22:35:32.202717 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 22:35:32.239072 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 22:35:32.267990 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 22:35:32.812026 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 22:35:32.864324 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:35:32.876196 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 22:35:32.946988 tst mo_mt_call.py: using LAC 31967 22:35:33.068721 tst mo_mt_call.py: using RAC 92 22:35:33.189141 tst mo_mt_call.py: using CellId 31967 22:35:33.311205 tst mo_mt_call.py: using BVCI 31968 22:35:33.424477 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:35:33.435775 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:35:33.446798 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:35:33.458739 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:35:33.470687 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:35:33.482346 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:35:33.601129 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:35:33.715881 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:35:34.184738 run create_hlr_db(pid=3133): Launched 22:35:34.300726 bus /sierra_2: Setting Powered False 22:35:35.361519 run create_hlr_db(pid=3133): Terminated: ok {rc=0} 22:35:35.811189 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3135): Launched 22:35:36.114593 run osmo-hlr_10.42.42.2(pid=3136): Launched 22:35:36.230924 run osmo-stp_10.42.42.5: Starting osmo-stp 22:35:36.764824 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3138): Launched 22:35:37.067357 run osmo-stp_10.42.42.5(pid=3139): Launched 22:35:37.183569 run osmo-msc_10.42.42.6: Starting osmo-msc 22:35:37.729975 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3141): Launched 22:35:38.031628 run osmo-msc_10.42.42.6(pid=3142): Launched 22:35:38.202615 run osmo-stp_10.42.42.5(pid=3139): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3139)] 22:35:38.331290 run osmo-stp_10.42.42.5(pid=3139): stdout: | (launched: 2022-12-12_22:35:37.012415) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:35:38.460094 run osmo-stp_10.42.42.5(pid=3139): stderr: | [0;m[38;5;43m20221212223537181 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223537181 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223537182 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223537182 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223537182 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223537182 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223537183 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:35:38.587494 run osmo-stp_10.42.42.5(pid=3139): stdout: | (launched: 2022-12-12_22:35:37.012415) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:35:38.707927 run osmo-stp_10.42.42.5(pid=3139): stderr: | [0;m[38;5;43m20221212223537181 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223537181 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223537182 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223537182 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223537182 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223537182 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223537183 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:35:38.851881 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3139): Process ended prematurely: osmo-stp_10.42.42.5(pid=3139) [trial-2383↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3139)] [trial-2383↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 22:35:38.860833 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 22:35:38.887187 run osmo-hlr_10.42.42.2(pid=3136): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3136)] 22:35:38.934648 run osmo-hlr_10.42.42.2(pid=3136): stdout: | (launched: 2022-12-12_22:35:36.059307) 22:35:38.983970 run osmo-hlr_10.42.42.2(pid=3136): stderr: | [0;m[1;31m20221212223536236 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212223536237 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212223536237 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212223536237 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212223536237 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212223536237 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212223536249 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212223536259 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212223536259 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212223536259 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:35:39.052479 run osmo-msc_10.42.42.6(pid=3142): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3142)] 22:35:39.099599 run osmo-msc_10.42.42.6(pid=3142): stdout: | (launched: 2022-12-12_22:35:37.976673) 22:35:39.148577 run osmo-msc_10.42.42.6(pid=3142): stderr: | [0;m[38;5;43m20221212223538251 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212223538252 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb694ac6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212223538252 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212223538252 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212223538252 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212223538252 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212223538254 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212223538255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212223538255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212223538255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:35:39.198032 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3135): Terminating (SIGTERM) 22:35:39.237396 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3138): Terminating (SIGTERM) 22:35:39.276737 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3141): Terminating (SIGTERM) 22:35:39.316402 --- ParallelTerminationStrategy: PID 3135 died... 22:35:39.335354 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3135): Terminated: ok {rc=0} 22:35:39.379206 --- ParallelTerminationStrategy: PID 3138 died... 22:35:39.397476 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3138): Terminated: ok {rc=0} 22:35:39.440890 --- ParallelTerminationStrategy: PID 3141 died... 22:35:39.459330 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3141): Terminated: ok {rc=0} 22:35:39.544224 bus /sierra_3: Setting Powered False 22:35:40.642781 bus /sierra_3: Setting Powered False 22:35:41.759106 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2383 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 22:35:42.902493 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:35:42.914543 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 22:35:42.984174 tst mo_mt_call_osmux.py: using LAC 31968 22:35:43.104022 tst mo_mt_call_osmux.py: using RAC 93 22:35:43.224206 tst mo_mt_call_osmux.py: using CellId 31968 22:35:43.342644 tst mo_mt_call_osmux.py: using BVCI 31969 22:35:43.453710 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:35:43.464718 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:35:43.475731 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:35:43.486986 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:35:43.498350 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:35:43.509612 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:35:43.627997 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:35:43.745154 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:35:44.217382 run create_hlr_db(pid=3144): Launched 22:35:44.334284 bus /sierra_2: Setting Powered False 22:35:45.394288 run create_hlr_db(pid=3144): Terminated: ok {rc=0} 22:35:45.818055 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3146): Launched 22:35:46.144337 run osmo-hlr_10.42.42.2(pid=3147): Launched 22:35:46.455372 run osmo-stp_10.42.42.5: Starting osmo-stp 22:35:47.135429 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3149): Launched 22:35:47.450150 run osmo-stp_10.42.42.5(pid=3150): Launched 22:35:47.567558 run osmo-msc_10.42.42.6: Starting osmo-msc 22:35:48.123189 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3152): Launched 22:35:48.426732 run osmo-msc_10.42.42.6(pid=3153): Launched 22:35:48.597399 run osmo-stp_10.42.42.5(pid=3150): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3150)] 22:35:48.725899 run osmo-stp_10.42.42.5(pid=3150): stdout: | (launched: 2022-12-12_22:35:47.394733) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:35:48.854861 run osmo-stp_10.42.42.5(pid=3150): stderr: | [0;m[38;5;43m20221212223547567 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223547567 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223547567 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223547568 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223547568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223547568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223547568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:35:48.981865 run osmo-stp_10.42.42.5(pid=3150): stdout: | (launched: 2022-12-12_22:35:47.394733) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:35:49.103279 run osmo-stp_10.42.42.5(pid=3150): stderr: | [0;m[38;5;43m20221212223547567 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223547567 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223547567 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223547568 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223547568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223547568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223547568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:35:49.247898 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3150): Process ended prematurely: osmo-stp_10.42.42.5(pid=3150) [trial-2383↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3150)] [trial-2383↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 22:35:49.257090 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 22:35:49.283707 run osmo-hlr_10.42.42.2(pid=3147): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3147)] 22:35:49.331251 run osmo-hlr_10.42.42.2(pid=3147): stdout: | (launched: 2022-12-12_22:35:46.071672) 22:35:49.380026 run osmo-hlr_10.42.42.2(pid=3147): stderr: | [0;m[1;31m20221212223546422 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212223546422 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212223546422 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212223546423 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212223546423 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212223546423 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212223546447 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212223546463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212223546464 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212223546464 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:35:49.448641 run osmo-msc_10.42.42.6(pid=3153): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3153)] 22:35:49.495784 run osmo-msc_10.42.42.6(pid=3153): stdout: | (launched: 2022-12-12_22:35:48.371369) 22:35:49.544524 run osmo-msc_10.42.42.6(pid=3153): stderr: | [0;m[38;5;43m20221212223548644 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212223548644 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff157775c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212223548644 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212223548644 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212223548644 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212223548645 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212223548646 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212223548647 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212223548648 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212223548648 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:35:49.593757 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3146): Terminating (SIGTERM) 22:35:49.633075 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3149): Terminating (SIGTERM) 22:35:49.672600 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3152): Terminating (SIGTERM) 22:35:49.712430 --- ParallelTerminationStrategy: PID 3146 died... 22:35:49.731348 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3146): Terminated: ok {rc=0} 22:35:49.775270 --- ParallelTerminationStrategy: PID 3149 died... 22:35:49.793865 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3149): Terminated: ok {rc=0} 22:35:49.837970 --- ParallelTerminationStrategy: PID 3152 died... 22:35:49.856545 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3152): Terminated: ok {rc=0} 22:35:49.939855 bus /sierra_3: Setting Powered False 22:35:51.033097 bus /sierra_3: Setting Powered False 22:35:52.143961 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 22:35:53.404244 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:35:53.411336 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 22:35:53.445947 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 22:35:53.473262 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 22:35:53.525399 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 22:35:53.559876 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 22:35:53.587176 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 22:35:54.136392 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 22:35:54.187369 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:35:54.198760 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 22:35:54.269497 tst mo_mt_call.py: using LAC 31969 22:35:54.398388 tst mo_mt_call.py: using RAC 94 22:35:54.526700 tst mo_mt_call.py: using CellId 31969 22:35:54.654537 tst mo_mt_call.py: using BVCI 31970 22:35:54.772441 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:35:54.784354 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:35:54.796133 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:35:54.807877 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:35:54.819670 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:35:54.831367 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:35:54.947371 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:35:55.068053 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:35:55.569374 run create_hlr_db(pid=3158): Launched 22:35:55.701568 bus /sierra_2: Setting Powered False 22:35:56.765192 run create_hlr_db(pid=3158): Terminated: ok {rc=0} 22:35:57.196419 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3160): Launched 22:35:57.520767 run osmo-hlr_10.42.42.2(pid=3161): Launched 22:35:57.644522 run osmo-stp_10.42.42.5: Starting osmo-stp 22:35:58.203766 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3163): Launched 22:35:58.526151 run osmo-stp_10.42.42.5(pid=3164): Launched 22:35:58.649895 run osmo-msc_10.42.42.6: Starting osmo-msc 22:35:59.235623 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3166): Launched 22:35:59.559420 run osmo-msc_10.42.42.6(pid=3167): Launched 22:35:59.741194 run osmo-stp_10.42.42.5(pid=3164): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3164)] 22:35:59.878589 run osmo-stp_10.42.42.5(pid=3164): stdout: | (launched: 2022-12-12_22:35:58.467585) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:36:00.015989 run osmo-stp_10.42.42.5(pid=3164): stderr: | [0;m[38;5;43m20221212223558663 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223558663 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223558663 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223558664 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223558664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223558664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223558664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:36:00.152749 run osmo-stp_10.42.42.5(pid=3164): stdout: | (launched: 2022-12-12_22:35:58.467585) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:36:00.281594 run osmo-stp_10.42.42.5(pid=3164): stderr: | [0;m[38;5;43m20221212223558663 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223558663 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223558663 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223558664 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223558664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223558664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223558664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:36:00.435786 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3164): Process ended prematurely: osmo-stp_10.42.42.5(pid=3164) [trial-2383↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3164)] [trial-2383↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 22:36:00.445692 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 22:36:00.473545 run osmo-hlr_10.42.42.2(pid=3161): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3161)] 22:36:00.523532 run osmo-hlr_10.42.42.2(pid=3161): stdout: | (launched: 2022-12-12_22:35:57.462647) 22:36:00.575138 run osmo-hlr_10.42.42.2(pid=3161): stderr: | [0;m[1;31m20221212223557662 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212223557662 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212223557662 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212223557662 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212223557662 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212223557662 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212223557674 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212223557683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212223557683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212223557683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:36:00.647091 run osmo-msc_10.42.42.6(pid=3167): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3167)] 22:36:00.696624 run osmo-msc_10.42.42.6(pid=3167): stdout: | (launched: 2022-12-12_22:35:59.500883) 22:36:00.747565 run osmo-msc_10.42.42.6(pid=3167): stderr: | [0;m[38;5;43m20221212223559828 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212223559828 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb17437dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212223559828 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212223559829 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212223559829 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212223559829 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212223559831 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212223559831 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212223559831 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212223559831 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:36:00.799024 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3160): Terminating (SIGTERM) 22:36:00.853486 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3163): Terminating (SIGTERM) 22:36:00.905099 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3166): Terminating (SIGTERM) 22:36:00.956309 --- ParallelTerminationStrategy: PID 3160 died... 22:36:00.976068 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3160): Terminated: ok {rc=0} 22:36:01.029398 --- ParallelTerminationStrategy: PID 3163 died... 22:36:01.049047 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3163): Terminated: ok {rc=0} 22:36:01.095892 --- ParallelTerminationStrategy: PID 3166 died... 22:36:01.115420 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3166): Terminated: ok {rc=0} 22:36:01.204093 bus /sierra_3: Setting Powered False 22:36:02.307236 bus /sierra_3: Setting Powered False 22:36:03.422931 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2383 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 22:36:04.571378 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:36:04.583811 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 22:36:04.657424 tst mo_mt_call_osmux.py: using LAC 31970 22:36:04.784809 tst mo_mt_call_osmux.py: using RAC 95 22:36:04.911467 tst mo_mt_call_osmux.py: using CellId 31970 22:36:05.038468 tst mo_mt_call_osmux.py: using BVCI 31971 22:36:05.158438 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:36:05.170226 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:36:05.181727 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:36:05.193665 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:36:05.205472 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:36:05.217128 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:36:05.332503 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:36:05.452573 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:36:05.954579 run create_hlr_db(pid=3169): Launched 22:36:06.085968 bus /sierra_2: Setting Powered False 22:36:07.150619 run create_hlr_db(pid=3169): Terminated: ok {rc=0} 22:36:07.599719 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3171): Launched 22:36:07.922504 run osmo-hlr_10.42.42.2(pid=3172): Launched 22:36:08.045830 run osmo-stp_10.42.42.5: Starting osmo-stp 22:36:08.606715 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3174): Launched 22:36:08.929452 run osmo-stp_10.42.42.5(pid=3175): Launched 22:36:09.054506 run osmo-msc_10.42.42.6: Starting osmo-msc 22:36:09.642281 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3177): Launched 22:36:09.965052 run osmo-msc_10.42.42.6(pid=3178): Launched 22:36:10.148687 run osmo-stp_10.42.42.5(pid=3175): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3175)] 22:36:10.285130 run osmo-stp_10.42.42.5(pid=3175): stdout: | (launched: 2022-12-12_22:36:08.870875) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:36:10.422390 run osmo-stp_10.42.42.5(pid=3175): stderr: | [0;m[38;5;43m20221212223609065 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223609065 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223609065 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223609066 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223609066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223609066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223609066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:36:10.558422 run osmo-stp_10.42.42.5(pid=3175): stdout: | (launched: 2022-12-12_22:36:08.870875) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:36:10.687482 run osmo-stp_10.42.42.5(pid=3175): stderr: | [0;m[38;5;43m20221212223609065 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223609065 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223609065 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223609066 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223609066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223609066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223609066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:36:10.842004 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3175): Process ended prematurely: osmo-stp_10.42.42.5(pid=3175) [trial-2383↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3175)] [trial-2383↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 22:36:10.851689 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 22:36:10.879861 run osmo-hlr_10.42.42.2(pid=3172): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3172)] 22:36:10.929929 run osmo-hlr_10.42.42.2(pid=3172): stdout: | (launched: 2022-12-12_22:36:07.864131) 22:36:10.981577 run osmo-hlr_10.42.42.2(pid=3172): stderr: | [0;m[1;31m20221212223608065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212223608065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212223608065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212223608065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212223608065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212223608065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212223608077 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212223608086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212223608086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212223608086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:36:11.053547 run osmo-msc_10.42.42.6(pid=3178): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3178)] 22:36:11.103263 run osmo-msc_10.42.42.6(pid=3178): stdout: | (launched: 2022-12-12_22:36:09.906646) 22:36:11.154682 run osmo-msc_10.42.42.6(pid=3178): stderr: | [0;m[38;5;43m20221212223610229 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212223610229 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fede2a0dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212223610229 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212223610229 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212223610230 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212223610230 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212223610231 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212223610232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212223610232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212223610232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:36:11.206554 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3171): Terminating (SIGTERM) 22:36:11.247812 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3174): Terminating (SIGTERM) 22:36:11.289220 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3177): Terminating (SIGTERM) 22:36:11.331233 --- ParallelTerminationStrategy: PID 3171 died... 22:36:11.350941 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3171): Terminated: ok {rc=0} 22:36:11.396772 --- ParallelTerminationStrategy: PID 3174 died... 22:36:11.416391 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3174): Terminated: ok {rc=0} 22:36:11.462387 --- ParallelTerminationStrategy: PID 3177 died... 22:36:11.481893 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3177): Terminated: ok {rc=0} 22:36:11.569283 bus /sierra_3: Setting Powered False 22:36:12.667543 bus /sierra_3: Setting Powered False 22:36:13.782057 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 voice:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 22:36:15.037651 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:36:15.043906 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 22:36:15.078899 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 22:36:15.106316 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 22:36:15.159831 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 22:36:15.193583 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 22:36:15.220363 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 22:36:15.769222 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 22:36:15.818752 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:36:15.832031 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:36:15.920476 tst mo_mt_call.py: using LAC 31971 22:36:16.043438 tst mo_mt_call.py: using RAC 96 22:36:16.214826 tst mo_mt_call.py: using CellId 31971 22:36:16.388374 tst mo_mt_call.py: using BVCI 31972 22:36:16.547040 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:36:16.559016 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:36:16.570475 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:36:16.581929 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:36:16.594249 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:36:16.606400 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 22:36:16.754459 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 22:36:16.871842 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:36:17.363092 run create_hlr_db(pid=3183): Launched 22:36:17.505274 bus /sierra_2: Setting Powered False 22:36:18.568618 run create_hlr_db(pid=3183): Terminated: ok {rc=0} 22:36:19.000065 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3185): Launched 22:36:19.303783 run osmo-hlr_10.42.42.2(pid=3186): Launched 22:36:19.421126 run osmo-stp_10.42.42.5: Starting osmo-stp 22:36:19.980183 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3188): Launched 22:36:20.305508 run osmo-stp_10.42.42.5(pid=3189): Launched 22:36:20.429740 run osmo-msc_10.42.42.6: Starting osmo-msc 22:36:21.016131 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3191): Launched 22:36:21.340283 run osmo-msc_10.42.42.6(pid=3192): Launched 22:36:21.520458 run osmo-stp_10.42.42.5(pid=3189): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3189)] 22:36:21.657067 run osmo-stp_10.42.42.5(pid=3189): stdout: | (launched: 2022-12-12_22:36:20.247015) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:36:21.793541 run osmo-stp_10.42.42.5(pid=3189): stderr: | [0;m[38;5;43m20221212223620440 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223620440 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223620440 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223620441 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223620441 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223620441 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223620441 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:36:21.951852 run osmo-stp_10.42.42.5(pid=3189): stdout: | (launched: 2022-12-12_22:36:20.247015) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:36:22.074605 run osmo-stp_10.42.42.5(pid=3189): stderr: | [0;m[38;5;43m20221212223620440 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223620440 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223620440 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223620441 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223620441 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223620441 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223620441 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:36:22.220134 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3189): Process ended prematurely: osmo-stp_10.42.42.5(pid=3189) [trial-2383↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3189)] [trial-2383↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 22:36:22.229196 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 22:36:22.255527 run osmo-hlr_10.42.42.2(pid=3186): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3186)] 22:36:22.303149 run osmo-hlr_10.42.42.2(pid=3186): stdout: | (launched: 2022-12-12_22:36:19.248621) 22:36:22.352238 run osmo-hlr_10.42.42.2(pid=3186): stderr: | [0;m[1;31m20221212223619423 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212223619423 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212223619423 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212223619423 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212223619423 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212223619423 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212223619436 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212223619444 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212223619444 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212223619444 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:36:22.420075 run osmo-msc_10.42.42.6(pid=3192): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3192)] 22:36:22.467132 run osmo-msc_10.42.42.6(pid=3192): stdout: | (launched: 2022-12-12_22:36:21.281718) 22:36:22.515914 run osmo-msc_10.42.42.6(pid=3192): stderr: | [0;m[38;5;43m20221212223621608 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212223621608 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3e0a4b1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212223621608 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212223621608 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212223621608 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212223621608 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212223621610 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212223621611 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212223621611 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212223621611 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:36:22.565199 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3185): Terminating (SIGTERM) 22:36:22.604036 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3188): Terminating (SIGTERM) 22:36:22.644419 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3191): Terminating (SIGTERM) 22:36:22.683938 --- ParallelTerminationStrategy: PID 3185 died... 22:36:22.702838 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3185): Terminated: ok {rc=0} 22:36:22.746866 --- ParallelTerminationStrategy: PID 3188 died... 22:36:22.765164 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3188): Terminated: ok {rc=0} 22:36:22.809189 --- ParallelTerminationStrategy: PID 3191 died... 22:36:22.827686 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3191): Terminated: ok {rc=0} 22:36:22.911045 bus /sierra_3: Setting Powered False 22:36:24.008925 bus /sierra_3: Setting Powered False 22:36:25.126570 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2383 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 22:36:26.273707 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:36:26.285472 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:36:26.356022 tst mo_mt_call_osmux.py: using LAC 31972 22:36:26.478279 tst mo_mt_call_osmux.py: using RAC 97 22:36:26.599088 tst mo_mt_call_osmux.py: using CellId 31972 22:36:26.719048 tst mo_mt_call_osmux.py: using BVCI 31973 22:36:26.831704 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:36:26.842839 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:36:26.853734 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:36:26.865411 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:36:26.876491 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:36:26.887878 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 22:36:27.008700 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 22:36:27.129657 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:36:27.599081 run create_hlr_db(pid=3194): Launched 22:36:27.715290 bus /sierra_2: Setting Powered False 22:36:28.775626 run create_hlr_db(pid=3194): Terminated: ok {rc=0} 22:36:29.198412 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3196): Launched 22:36:29.501452 run osmo-hlr_10.42.42.2(pid=3197): Launched 22:36:29.619646 run osmo-stp_10.42.42.5: Starting osmo-stp 22:36:30.144522 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3199): Launched 22:36:30.447929 run osmo-stp_10.42.42.5(pid=3200): Launched 22:36:30.565285 run osmo-msc_10.42.42.6: Starting osmo-msc 22:36:31.143099 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3202): Launched 22:36:31.519196 run osmo-msc_10.42.42.6(pid=3203): Launched 22:36:31.912519 run osmo-stp_10.42.42.5(pid=3200): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3200)] 22:36:32.112201 run osmo-stp_10.42.42.5(pid=3200): stdout: | (launched: 2022-12-12_22:36:30.392763) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:36:32.314527 run osmo-stp_10.42.42.5(pid=3200): stderr: | [0;m[38;5;43m20221212223630563 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223630564 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223630564 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223630564 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223630565 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223630565 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223630565 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:36:32.444179 run osmo-stp_10.42.42.5(pid=3200): stdout: | (launched: 2022-12-12_22:36:30.392763) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:36:32.565334 run osmo-stp_10.42.42.5(pid=3200): stderr: | [0;m[38;5;43m20221212223630563 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223630564 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223630564 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223630564 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223630565 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223630565 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223630565 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:36:32.709927 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3200): Process ended prematurely: osmo-stp_10.42.42.5(pid=3200) [trial-2383↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3200)] [trial-2383↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 22:36:32.719063 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 22:36:32.745660 run osmo-hlr_10.42.42.2(pid=3197): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3197)] 22:36:32.793670 run osmo-hlr_10.42.42.2(pid=3197): stdout: | (launched: 2022-12-12_22:36:29.446537) 22:36:32.843213 run osmo-hlr_10.42.42.2(pid=3197): stderr: | [0;m[1;31m20221212223629624 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212223629624 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212223629624 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212223629624 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212223629624 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212223629624 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212223629636 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212223629646 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212223629646 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212223629646 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:36:32.912367 run osmo-msc_10.42.42.6(pid=3203): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3203)] 22:36:32.960154 run osmo-msc_10.42.42.6(pid=3203): stdout: | (launched: 2022-12-12_22:36:31.440573) 22:36:33.009562 run osmo-msc_10.42.42.6(pid=3203): stderr: | [0;m[38;5;43m20221212223631914 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212223631914 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb4b3209c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212223631914 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212223631914 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212223631914 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212223631914 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212223631916 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212223631917 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212223631917 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212223631917 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:36:33.059406 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3196): Terminating (SIGTERM) 22:36:33.099186 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3199): Terminating (SIGTERM) 22:36:33.139004 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3202): Terminating (SIGTERM) 22:36:33.178991 --- ParallelTerminationStrategy: PID 3196 died... 22:36:33.198051 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3196): Terminated: ok {rc=0} 22:36:33.242481 --- ParallelTerminationStrategy: PID 3199 died... 22:36:33.260882 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3199): Terminated: ok {rc=0} 22:36:33.305151 --- ParallelTerminationStrategy: PID 3202 died... 22:36:33.323655 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3202): Terminated: ok {rc=0} 22:36:33.407399 bus /sierra_3: Setting Powered False 22:36:34.505271 bus /sierra_3: Setting Powered False 22:36:35.621898 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 voice:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 emergency:trx-sysmocell5000 --------------------------------------------------------------------- 22:36:36.870482 tst emergency:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:36:36.874854 tst emergency:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 22:36:36.908713 tst emergency:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 22:36:36.934822 tst emergency:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 22:36:37.018213 tst emergency:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 22:36:37.051421 tst emergency:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 22:36:37.077783 tst emergency:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 22:36:37.660481 tst emergency:trx-sysmocell5000: RESERVED RESOURCES for emergency: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2383 emergency:trx-sysmocell5000 emergency_mo_mt_call.py ---------------------------------------------- 22:36:37.665620 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:36:37.676133 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 22:36:37.725866 tst emergency_mo_mt_call.py: using LAC 31973 22:36:37.842977 tst emergency_mo_mt_call.py: using RAC 98 22:36:37.961582 tst emergency_mo_mt_call.py: using CellId 31973 22:36:38.080204 tst emergency_mo_mt_call.py: using BVCI 31974 22:36:38.188268 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:36:38.199017 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:36:38.209533 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:36:38.220434 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:36:38.231308 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:36:38.242236 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 22:36:38.360163 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 22:36:38.476341 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:36:38.935710 run create_hlr_db(pid=3208): Launched 22:36:39.048916 bus /sierra_2: Setting Powered False 22:36:40.108913 run create_hlr_db(pid=3208): Terminated: ok {rc=0} 22:36:40.543721 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3210): Launched 22:36:40.860183 run osmo-hlr_10.42.42.2(pid=3211): Launched 22:36:40.981830 run osmo-stp_10.42.42.5: Starting osmo-stp 22:36:41.527022 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3213): Launched 22:36:41.843152 run osmo-stp_10.42.42.5(pid=3214): Launched 22:36:41.978569 tst emergency_mo_mt_call.py: using MSISDN 8006 22:36:42.142399 run osmo-msc_10.42.42.6: Starting osmo-msc 22:36:42.714139 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3216): Launched 22:36:43.028808 run osmo-msc_10.42.42.6(pid=3217): Launched 22:36:43.206474 run osmo-stp_10.42.42.5(pid=3214): ERR: Terminated: ERROR {rc=1} [trial-2383↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3214)] 22:36:43.339897 run osmo-stp_10.42.42.5(pid=3214): stdout: | (launched: 2022-12-12_22:36:41.785988) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:36:43.474228 run osmo-stp_10.42.42.5(pid=3214): stderr: | [0;m[38;5;43m20221212223641977 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223641977 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223641978 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223641978 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223641980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223641981 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223641981 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:36:43.607717 run osmo-stp_10.42.42.5(pid=3214): stdout: | (launched: 2022-12-12_22:36:41.785988) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:36:43.733679 run osmo-stp_10.42.42.5(pid=3214): stderr: | [0;m[38;5;43m20221212223641977 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223641977 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223641978 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223641978 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223641980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223641981 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223641981 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:36:43.884837 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=3214): Process ended prematurely: osmo-stp_10.42.42.5(pid=3214) [trial-2383↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3214)] [trial-2383↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19] 22:36:43.893773 tst emergency_mo_mt_call.py:19: Test FAILED (6.2 sec) 22:36:43.920798 run osmo-hlr_10.42.42.2(pid=3211): ERR: Terminated: ERROR {rc=237} [trial-2383↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3211)] 22:36:43.970596 run osmo-hlr_10.42.42.2(pid=3211): stdout: | (launched: 2022-12-12_22:36:40.803083) 22:36:44.021903 run osmo-hlr_10.42.42.2(pid=3211): stderr: | [0;m[1;31m20221212223641000 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212223641000 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212223641000 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212223641000 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212223641000 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212223641000 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212223641013 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/emergency:trx-sysmocell5000/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212223641021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212223641021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212223641021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:36:44.093499 run osmo-msc_10.42.42.6(pid=3217): ERR: Terminated: ERROR {rc=2} [trial-2383↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3217)] 22:36:44.143219 run osmo-msc_10.42.42.6(pid=3217): stdout: | (launched: 2022-12-12_22:36:42.971528) 22:36:44.194688 run osmo-msc_10.42.42.6(pid=3217): stderr: | [0;m[38;5;43m20221212223643295 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212223643295 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa2514adc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212223643295 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212223643295 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212223643295 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212223643295 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212223643297 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212223643298 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212223643298 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212223643298 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:36:44.246445 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3210): Terminating (SIGTERM) 22:36:44.288152 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3213): Terminating (SIGTERM) 22:36:44.329737 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3216): Terminating (SIGTERM) 22:36:44.371291 --- ParallelTerminationStrategy: PID 3210 died... 22:36:44.391024 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3210): Terminated: ok {rc=0} 22:36:44.436684 --- ParallelTerminationStrategy: PID 3213 died... 22:36:44.456123 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3213): Terminated: ok {rc=0} 22:36:44.501558 --- ParallelTerminationStrategy: PID 3216 died... 22:36:44.520857 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3216): Terminated: ok {rc=0} 22:36:44.608170 bus /sierra_3: Setting Powered False 22:36:45.706116 bus /sierra_3: Setting Powered False 22:36:46.824683 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2383 emergency:trx-sysmocell5000 emergency_preemptive_call.py ---------------------------------------------- 22:36:47.913173 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:36:47.924593 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 22:36:47.976226 tst emergency_preemptive_call.py: using LAC 31974 22:36:48.092846 tst emergency_preemptive_call.py: using RAC 99 22:36:48.209150 tst emergency_preemptive_call.py: using CellId 31974 22:36:48.324764 tst emergency_preemptive_call.py: using BVCI 31975 22:36:48.433809 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:36:48.444715 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:36:48.455231 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:36:48.466642 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:36:48.478035 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 22:36:48.489361 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 22:36:48.609274 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 22:36:48.727557 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 22:36:48.846985 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 22:36:48.961675 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:36:49.424274 run create_hlr_db(pid=3219): Launched 22:36:49.538538 bus /sierra_2: Setting Powered False 22:36:50.598488 run create_hlr_db(pid=3219): Terminated: ok {rc=0} 22:36:51.032819 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3221): Launched 22:36:51.350375 run osmo-hlr_10.42.42.2(pid=3222): Launched 22:36:51.471114 run osmo-stp_10.42.42.5: Starting osmo-stp 22:36:52.017308 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3224): Launched 22:36:52.334866 run osmo-stp_10.42.42.5(pid=3225): Launched 22:36:52.468266 tst emergency_preemptive_call.py: using MSISDN 8007 22:36:52.634226 run osmo-msc_10.42.42.6: Starting osmo-msc 22:36:53.204704 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3227): Launched 22:36:53.520523 run osmo-msc_10.42.42.6(pid=3228): Launched 22:36:53.698778 run osmo-stp_10.42.42.5(pid=3225): ERR: Terminated: ERROR {rc=1} [trial-2383↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3225)] 22:36:53.832865 run osmo-stp_10.42.42.5(pid=3225): stdout: | (launched: 2022-12-12_22:36:52.277306) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:36:53.967679 run osmo-stp_10.42.42.5(pid=3225): stderr: | [0;m[38;5;43m20221212223652468 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223652468 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223652469 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223652469 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223652471 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223652471 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223652472 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:36:54.101713 run osmo-stp_10.42.42.5(pid=3225): stdout: | (launched: 2022-12-12_22:36:52.277306) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:36:54.228380 run osmo-stp_10.42.42.5(pid=3225): stderr: | [0;m[38;5;43m20221212223652468 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223652468 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223652469 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223652469 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223652471 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223652471 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223652472 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:36:54.380127 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=3225): Process ended prematurely: osmo-stp_10.42.42.5(pid=3225) [trial-2383↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3225)] [trial-2383↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32] 22:36:54.389353 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 22:36:54.417056 run osmo-hlr_10.42.42.2(pid=3222): ERR: Terminated: ERROR {rc=237} [trial-2383↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3222)] 22:36:54.467456 run osmo-hlr_10.42.42.2(pid=3222): stdout: | (launched: 2022-12-12_22:36:51.293306) 22:36:54.519724 run osmo-hlr_10.42.42.2(pid=3222): stderr: | [0;m[1;31m20221212223651491 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212223651491 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212223651491 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212223651491 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212223651491 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212223651491 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212223651507 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/emergency:trx-sysmocell5000/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212223651516 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212223651516 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212223651517 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:36:54.592622 run osmo-msc_10.42.42.6(pid=3228): ERR: Terminated: ERROR {rc=2} [trial-2383↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3228)] 22:36:54.642843 run osmo-msc_10.42.42.6(pid=3228): stdout: | (launched: 2022-12-12_22:36:53.463299) 22:36:54.694752 run osmo-msc_10.42.42.6(pid=3228): stderr: | [0;m[38;5;43m20221212223653786 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212223653786 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f80cada5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212223653786 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212223653786 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212223653786 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212223653787 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212223653788 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212223653789 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212223653789 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212223653789 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:36:54.746980 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3221): Terminating (SIGTERM) 22:36:54.788858 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3224): Terminating (SIGTERM) 22:36:54.830977 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3227): Terminating (SIGTERM) 22:36:54.873232 --- ParallelTerminationStrategy: PID 3221 died... 22:36:54.893218 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3221): Terminated: ok {rc=0} 22:36:54.939563 --- ParallelTerminationStrategy: PID 3224 died... 22:36:54.959322 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3224): Terminated: ok {rc=0} 22:36:55.005485 --- ParallelTerminationStrategy: PID 3227 died... 22:36:55.025053 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3227): Terminated: ok {rc=0} 22:36:55.111311 bus /sierra_9: Setting Powered False 22:36:56.209879 bus /sierra_9: Setting Powered False 22:36:57.325797 bus /sierra_8: Setting Powered False 22:36:58.423660 bus /sierra_8: Setting Powered False 22:36:59.539792 bus /sierra_3: Setting Powered False 22:37:00.635959 bus /sierra_3: Setting Powered False 22:37:01.758259 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 emergency:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 gprs:trx-sysmocell5000 --------------------------------------------------------------------- 22:37:03.052740 tst gprs:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:37:03.057537 tst gprs:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 22:37:03.092168 tst gprs:trx-sysmocell5000: Verifying 9 x ip_address (candidates: 9) 22:37:03.131114 tst gprs:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 22:37:03.219013 tst gprs:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 22:37:03.253446 tst gprs:trx-sysmocell5000: Reserving 9 x ip_address (candidates: 9) 22:37:03.292477 tst gprs:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 22:37:03.885904 tst gprs:trx-sysmocell5000: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2383 gprs:trx-sysmocell5000 cs_paging_gprs_active.py ---------------------------------------------- 22:37:03.937620 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:37:03.948358 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 22:37:04.001507 tst cs_paging_gprs_active.py: using LAC 31975 22:37:04.129063 tst cs_paging_gprs_active.py: using RAC 100 22:37:04.255639 tst cs_paging_gprs_active.py: using CellId 31975 22:37:04.382266 tst cs_paging_gprs_active.py: using BVCI 31976 22:37:04.501380 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:37:04.512632 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:37:04.523523 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:37:04.534482 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:37:04.545399 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:37:04.556207 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:37:04.567245 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:37:04.578084 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:37:04.589470 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 22:37:04.705363 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 22:37:04.824695 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:37:05.044251 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:37:05.370506 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3234): Launched 22:37:05.653202 run iperf3-srv_10.42.42.10(pid=3235): Launched 22:37:05.774828 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:37:05.993869 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:37:06.309921 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3236): Launched 22:37:06.576292 run iperf3-srv_10.42.42.10(pid=3237): Launched 22:37:06.691526 tst cs_paging_gprs_active.py:38: start network... 22:37:06.896583 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:37:07.369482 run create_hlr_db(pid=3238): Launched 22:37:07.488645 bus /sierra_2: Setting Powered False 22:37:08.549364 run create_hlr_db(pid=3238): Terminated: ok {rc=0} 22:37:08.993686 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3240): Launched 22:37:09.319785 run osmo-hlr_10.42.42.2(pid=3241): Launched 22:37:09.444391 run osmo-stp_10.42.42.5: Starting osmo-stp 22:37:10.003728 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3243): Launched 22:37:10.328846 run osmo-stp_10.42.42.5(pid=3244): Launched 22:37:10.453463 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:37:11.018662 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3246): Launched 22:37:11.143269 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:37:11.417984 run patchelf(pid=3247): Launched 22:37:11.598654 run osmo-stp_10.42.42.5(pid=3244): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3244)] 22:37:11.735913 run osmo-stp_10.42.42.5(pid=3244): stdout: | (launched: 2022-12-12_22:37:10.270092) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:37:11.874702 run osmo-stp_10.42.42.5(pid=3244): stderr: | [0;m[38;5;43m20221212223710462 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223710462 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223710463 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223710463 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223710463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223710464 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223710464 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:37:12.013890 run osmo-stp_10.42.42.5(pid=3244): stdout: | (launched: 2022-12-12_22:37:10.270092) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:37:12.147274 run osmo-stp_10.42.42.5(pid=3244): stderr: | [0;m[38;5;43m20221212223710462 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223710462 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223710463 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223710463 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223710463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223710464 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223710464 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:37:12.305532 run patchelf(pid=3247): Terminating (SIGINT) 22:37:12.488374 run patchelf(pid=3247): Terminated: ok {rc=0} 22:37:12.620580 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=3244): Process ended prematurely: osmo-stp_10.42.42.5(pid=3244) [trial-2383↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3244)] [trial-2383↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38] 22:37:12.630649 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 22:37:12.658710 run osmo-hlr_10.42.42.2(pid=3241): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3241)] 22:37:12.708064 run osmo-hlr_10.42.42.2(pid=3241): stdout: | (launched: 2022-12-12_22:37:09.261038) 22:37:12.759405 run osmo-hlr_10.42.42.2(pid=3241): stderr: | [0;m[1;31m20221212223709459 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212223709459 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212223709459 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212223709459 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212223709459 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212223709459 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212223709471 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-sysmocell5000/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212223709480 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212223709480 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212223709480 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:37:12.811897 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3234): Terminating (SIGTERM) 22:37:12.853269 run iperf3-srv_10.42.42.10(pid=3235): Terminating (SIGTERM) 22:37:12.894564 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3236): Terminating (SIGTERM) 22:37:12.936094 run iperf3-srv_10.42.42.10(pid=3237): Terminating (SIGTERM) 22:37:12.977490 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3240): Terminating (SIGTERM) 22:37:13.019061 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3243): Terminating (SIGTERM) 22:37:13.060474 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3246): Terminating (SIGTERM) 22:37:13.102149 --- ParallelTerminationStrategy: PID 3234 died... 22:37:13.121969 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3234): Terminated: ok {rc=0} 22:37:13.167941 --- ParallelTerminationStrategy: PID 3235 died... 22:37:13.187134 run iperf3-srv_10.42.42.10(pid=3235): Terminated {rc=256} 22:37:13.232843 --- ParallelTerminationStrategy: PID 3236 died... 22:37:13.252483 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3236): Terminated: ok {rc=0} 22:37:13.298243 --- ParallelTerminationStrategy: PID 3237 died... 22:37:13.317520 run iperf3-srv_10.42.42.10(pid=3237): Terminated {rc=256} 22:37:13.362815 --- ParallelTerminationStrategy: PID 3240 died... 22:37:13.382074 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3240): Terminated: ok {rc=0} 22:37:13.427407 --- ParallelTerminationStrategy: PID 3243 died... 22:37:13.446752 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3243): Terminated: ok {rc=0} 22:37:13.491909 --- ParallelTerminationStrategy: PID 3246 died... 22:37:13.511301 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3246): Terminated: ok {rc=0} 22:37:13.597412 bus /gobi_0: Setting Powered False 22:37:14.695462 bus /gobi_0: Setting Powered False 22:37:15.810263 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-sysmocell5000 iperf3.py ---------------------------------------------- 22:37:16.988833 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:37:17.005935 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 22:37:17.072065 tst iperf3.py: using LAC 31976 22:37:17.202290 tst iperf3.py: using RAC 101 22:37:17.325089 tst iperf3.py: using CellId 31976 22:37:17.443722 tst iperf3.py: using BVCI 31977 22:37:17.555170 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:37:17.566165 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:37:17.576673 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:37:17.587596 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:37:17.598413 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:37:17.609082 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:37:17.620007 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:37:17.630673 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:37:17.641511 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 22:37:17.756160 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:37:17.961067 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:37:18.267216 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3248): Launched 22:37:18.532410 run iperf3-srv_10.42.42.10(pid=3249): Launched 22:37:18.647945 tst iperf3.py:8: start network... 22:37:18.852635 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:37:19.324061 run create_hlr_db(pid=3250): Launched 22:37:19.441071 bus /gobi_6: Setting Powered False 22:37:20.501727 run create_hlr_db(pid=3250): Terminated: ok {rc=0} 22:37:20.925466 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3252): Launched 22:37:21.231128 run osmo-hlr_10.42.42.2(pid=3253): Launched 22:37:21.348005 run osmo-stp_10.42.42.5: Starting osmo-stp 22:37:21.887667 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3255): Launched 22:37:22.192357 run osmo-stp_10.42.42.5(pid=3256): Launched 22:37:22.310233 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:37:22.850539 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3258): Launched 22:37:22.967373 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:37:23.224298 run patchelf(pid=3259): Launched 22:37:23.393807 run osmo-stp_10.42.42.5(pid=3256): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3256)] 22:37:23.522280 run osmo-stp_10.42.42.5(pid=3256): stdout: | (launched: 2022-12-12_22:37:22.136920) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:37:23.652145 run osmo-stp_10.42.42.5(pid=3256): stderr: | [0;m[38;5;43m20221212223722307 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223722307 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223722307 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223722308 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223722308 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223722308 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223722309 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:37:23.782343 run osmo-stp_10.42.42.5(pid=3256): stdout: | (launched: 2022-12-12_22:37:22.136920) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:37:23.906934 run osmo-stp_10.42.42.5(pid=3256): stderr: | [0;m[38;5;43m20221212223722307 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223722307 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223722307 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223722308 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223722308 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223722308 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223722309 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:37:24.054250 run patchelf(pid=3259): Terminating (SIGINT) 22:37:24.226515 run patchelf(pid=3259): Terminated: ok {rc=0} 22:37:24.350165 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3256): Process ended prematurely: osmo-stp_10.42.42.5(pid=3256) [trial-2383↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3256)] [trial-2383↪gprs:trx-sysmocell5000↪iperf3.py:8] 22:37:24.359442 tst iperf3.py:8: Test FAILED (7.4 sec) 22:37:24.386810 run osmo-hlr_10.42.42.2(pid=3253): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-sysmocell5000↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3253)] 22:37:24.434759 run osmo-hlr_10.42.42.2(pid=3253): stdout: | (launched: 2022-12-12_22:37:21.175286) 22:37:24.483971 run osmo-hlr_10.42.42.2(pid=3253): stderr: | [0;m[1;31m20221212223721350 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212223721350 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212223721350 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212223721350 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212223721350 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212223721350 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212223721362 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-sysmocell5000/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212223721370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212223721370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212223721370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:37:24.533734 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3248): Terminating (SIGTERM) 22:37:24.573448 run iperf3-srv_10.42.42.10(pid=3249): Terminating (SIGTERM) 22:37:24.613142 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3252): Terminating (SIGTERM) 22:37:24.652686 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3255): Terminating (SIGTERM) 22:37:24.692135 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3258): Terminating (SIGTERM) 22:37:24.731680 --- ParallelTerminationStrategy: PID 3248 died... 22:37:24.750382 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3248): Terminated: ok {rc=0} 22:37:24.794330 --- ParallelTerminationStrategy: PID 3249 died... 22:37:24.812779 run iperf3-srv_10.42.42.10(pid=3249): Terminated {rc=256} 22:37:24.856889 --- ParallelTerminationStrategy: PID 3252 died... 22:37:24.875583 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3252): Terminated: ok {rc=0} 22:37:24.919332 --- ParallelTerminationStrategy: PID 3255 died... 22:37:24.937858 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3255): Terminated: ok {rc=0} 22:37:24.982872 --- ParallelTerminationStrategy: PID 3258 died... 22:37:25.001207 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3258): Terminated: ok {rc=0} 22:37:25.084226 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-sysmocell5000 iperf3m4.py ---------------------------------------------- 22:37:26.233203 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:37:26.245093 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 22:37:26.295310 tst iperf3m4.py: using LAC 31977 22:37:26.423218 tst iperf3m4.py: using RAC 102 22:37:26.553307 tst iperf3m4.py: using CellId 31977 22:37:26.681257 tst iperf3m4.py: using BVCI 31978 22:37:26.792675 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:37:26.803495 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:37:26.814063 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:37:26.824804 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:37:26.835599 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:37:26.846335 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:37:26.857414 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:37:26.868022 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:37:26.879012 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 22:37:26.998199 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 22:37:27.117871 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 22:37:27.237320 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 22:37:27.358152 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:37:27.577527 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:37:27.902930 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3261): Launched 22:37:28.185492 run iperf3-srv_10.42.42.10(pid=3262): Launched 22:37:28.307704 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:37:28.527902 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:37:28.855549 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3263): Launched 22:37:29.137520 run iperf3-srv_10.42.42.10(pid=3264): Launched 22:37:29.260383 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:37:29.480841 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:37:29.807894 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3265): Launched 22:37:30.089273 run iperf3-srv_10.42.42.10(pid=3266): Launched 22:37:30.211397 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:37:30.430398 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:37:30.756251 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3267): Launched 22:37:31.087723 run iperf3-srv_10.42.42.10(pid=3268): Launched 22:37:31.207942 tst iperf3m4.py:8: start network... 22:37:31.419656 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:37:31.919433 run create_hlr_db(pid=3269): Launched 22:37:32.050394 bus /gobi_6: Setting Powered False 22:37:33.110596 run create_hlr_db(pid=3269): Terminated: ok {rc=0} 22:37:33.535575 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3271): Launched 22:37:33.839262 run osmo-hlr_10.42.42.2(pid=3272): Launched 22:37:33.955586 run osmo-stp_10.42.42.5: Starting osmo-stp 22:37:34.497026 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3274): Launched 22:37:34.803918 run osmo-stp_10.42.42.5(pid=3275): Launched 22:37:34.921052 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:37:35.445682 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3277): Launched 22:37:35.562901 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:37:35.820432 run patchelf(pid=3278): Launched 22:37:35.990905 run osmo-stp_10.42.42.5(pid=3275): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3275)] 22:37:36.119977 run osmo-stp_10.42.42.5(pid=3275): stdout: | (launched: 2022-12-12_22:37:34.746948) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:37:36.250716 run osmo-stp_10.42.42.5(pid=3275): stderr: | [0;m[38;5;43m20221212223734919 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223734919 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223734920 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223734920 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223734920 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223734921 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223734921 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:37:36.381093 run osmo-stp_10.42.42.5(pid=3275): stdout: | (launched: 2022-12-12_22:37:34.746948) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:37:36.506010 run osmo-stp_10.42.42.5(pid=3275): stderr: | [0;m[38;5;43m20221212223734919 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223734919 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223734920 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223734920 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223734920 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223734921 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223734921 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:37:36.654756 run patchelf(pid=3278): Terminating (SIGINT) 22:37:36.827436 run patchelf(pid=3278): Terminated: ok {rc=0} 22:37:36.951649 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3275): Process ended prematurely: osmo-stp_10.42.42.5(pid=3275) [trial-2383↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3275)] [trial-2383↪gprs:trx-sysmocell5000↪iperf3m4.py:8] 22:37:36.961056 tst iperf3m4.py:8: Test FAILED (10.8 sec) 22:37:36.988635 run osmo-hlr_10.42.42.2(pid=3272): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-sysmocell5000↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3272)] 22:37:37.036189 run osmo-hlr_10.42.42.2(pid=3272): stdout: | (launched: 2022-12-12_22:37:33.783912) 22:37:37.085503 run osmo-hlr_10.42.42.2(pid=3272): stderr: | [0;m[1;31m20221212223733962 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212223733962 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212223733962 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212223733962 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212223733962 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212223733962 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212223733974 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-sysmocell5000/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212223733983 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212223733983 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212223733983 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:37:37.135379 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3261): Terminating (SIGTERM) 22:37:37.175012 run iperf3-srv_10.42.42.10(pid=3262): Terminating (SIGTERM) 22:37:37.214589 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3263): Terminating (SIGTERM) 22:37:37.254352 run iperf3-srv_10.42.42.10(pid=3264): Terminating (SIGTERM) 22:37:37.293875 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3265): Terminating (SIGTERM) 22:37:37.333495 run iperf3-srv_10.42.42.10(pid=3266): Terminating (SIGTERM) 22:37:37.373106 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3267): Terminating (SIGTERM) 22:37:37.412687 run iperf3-srv_10.42.42.10(pid=3268): Terminating (SIGTERM) 22:37:37.452110 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3271): Terminating (SIGTERM) 22:37:37.491802 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3274): Terminating (SIGTERM) 22:37:37.531375 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3277): Terminating (SIGTERM) 22:37:37.571277 --- ParallelTerminationStrategy: PID 3261 died... 22:37:37.590164 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3261): Terminated: ok {rc=0} 22:37:37.634170 --- ParallelTerminationStrategy: PID 3262 died... 22:37:37.652589 run iperf3-srv_10.42.42.10(pid=3262): Terminated {rc=256} 22:37:37.696264 --- ParallelTerminationStrategy: PID 3263 died... 22:37:37.714699 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3263): Terminated: ok {rc=0} 22:37:37.758406 --- ParallelTerminationStrategy: PID 3264 died... 22:37:37.776496 run iperf3-srv_10.42.42.10(pid=3264): Terminated {rc=256} 22:37:37.820300 --- ParallelTerminationStrategy: PID 3265 died... 22:37:37.838578 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3265): Terminated: ok {rc=0} 22:37:37.882082 --- ParallelTerminationStrategy: PID 3266 died... 22:37:37.900308 run iperf3-srv_10.42.42.10(pid=3266): Terminated {rc=256} 22:37:37.943957 --- ParallelTerminationStrategy: PID 3267 died... 22:37:37.962372 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3267): Terminated: ok {rc=0} 22:37:38.006259 --- ParallelTerminationStrategy: PID 3268 died... 22:37:38.024588 run iperf3-srv_10.42.42.10(pid=3268): Terminated {rc=256} 22:37:38.068527 --- ParallelTerminationStrategy: PID 3271 died... 22:37:38.087078 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3271): Terminated: ok {rc=0} 22:37:38.131028 --- ParallelTerminationStrategy: PID 3274 died... 22:37:38.149495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3274): Terminated: ok {rc=0} 22:37:38.193358 --- ParallelTerminationStrategy: PID 3277 died... 22:37:38.211670 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3277): Terminated: ok {rc=0} 22:37:38.296229 bus /gobi_4: Setting Powered False 22:37:39.394811 bus /gobi_4: Setting Powered False 22:37:40.510093 bus /gobi_1: Setting Powered False 22:37:41.607885 bus /gobi_1: Setting Powered False 22:37:42.721822 bus /gobi_0: Setting Powered False 22:37:43.818882 bus /gobi_0: Setting Powered False 22:37:44.930843 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-sysmocell5000 ping.py ---------------------------------------------- 22:37:46.033881 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:37:46.046688 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 22:37:46.098317 tst ping.py: using LAC 31978 22:37:46.228044 tst ping.py: using RAC 103 22:37:46.354642 tst ping.py: using CellId 31978 22:37:46.484308 tst ping.py: using BVCI 31979 22:37:46.630356 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:37:46.644107 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:37:46.659333 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:37:46.674492 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:37:46.690927 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:37:46.707010 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:37:46.721077 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:37:46.734000 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 22:37:46.884789 tst ping.py:19: start network... 22:37:47.126410 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:37:47.620404 run create_hlr_db(pid=3279): Launched 22:37:47.749463 bus /gobi_6: Setting Powered False 22:37:48.812841 run create_hlr_db(pid=3279): Terminated: ok {rc=0} 22:37:49.237041 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3281): Launched 22:37:49.534051 run osmo-hlr_10.42.42.2(pid=3282): Launched 22:37:49.647768 run osmo-stp_10.42.42.5: Starting osmo-stp 22:37:50.177678 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3284): Launched 22:37:50.475725 run osmo-stp_10.42.42.5(pid=3285): Launched 22:37:50.590447 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:37:51.104570 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3287): Launched 22:37:51.219325 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:37:51.471210 run patchelf(pid=3288): Launched 22:37:51.638533 run osmo-stp_10.42.42.5(pid=3285): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3285)] 22:37:51.765732 run osmo-stp_10.42.42.5(pid=3285): stdout: | (launched: 2022-12-12_22:37:50.421485) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:37:51.894679 run osmo-stp_10.42.42.5(pid=3285): stderr: | [0;m[38;5;43m20221212223750590 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223750591 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223750591 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223750591 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223750592 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223750592 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223750592 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:37:52.023279 run osmo-stp_10.42.42.5(pid=3285): stdout: | (launched: 2022-12-12_22:37:50.421485) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:37:52.146260 run osmo-stp_10.42.42.5(pid=3285): stderr: | [0;m[38;5;43m20221212223750590 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223750591 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223750591 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223750591 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223750592 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223750592 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223750592 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:37:52.291437 run patchelf(pid=3288): Terminating (SIGINT) 22:37:52.460727 run patchelf(pid=3288): Terminated: ok {rc=0} 22:37:52.582825 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=3285): Process ended prematurely: osmo-stp_10.42.42.5(pid=3285) [trial-2383↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3285)] [trial-2383↪gprs:trx-sysmocell5000↪ping.py:22] 22:37:52.591517 tst ping.py:22: Test FAILED (6.6 sec) 22:37:52.618274 run osmo-hlr_10.42.42.2(pid=3282): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-sysmocell5000↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3282)] 22:37:52.666279 run osmo-hlr_10.42.42.2(pid=3282): stdout: | (launched: 2022-12-12_22:37:49.479856) 22:37:52.715674 run osmo-hlr_10.42.42.2(pid=3282): stderr: | [0;m[1;31m20221212223749658 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212223749658 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212223749658 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212223749658 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212223749658 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212223749658 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212223749674 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-sysmocell5000/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212223749684 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212223749684 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212223749684 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:37:52.765523 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3281): Terminating (SIGTERM) 22:37:52.805149 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3284): Terminating (SIGTERM) 22:37:52.845228 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3287): Terminating (SIGTERM) 22:37:52.885086 --- ParallelTerminationStrategy: PID 3281 died... 22:37:52.904000 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3281): Terminated: ok {rc=0} 22:37:52.948750 --- ParallelTerminationStrategy: PID 3284 died... 22:37:52.967360 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3284): Terminated: ok {rc=0} 22:37:53.011284 --- ParallelTerminationStrategy: PID 3287 died... 22:37:53.029808 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3287): Terminated: ok {rc=0} 22:37:53.112749 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-sysmocell5000 ping_idle_ping.py ---------------------------------------------- 22:37:54.199821 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:37:54.211500 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 22:37:54.262526 tst ping_idle_ping.py: using LAC 31979 22:37:54.389121 tst ping_idle_ping.py: using RAC 104 22:37:54.513417 tst ping_idle_ping.py: using CellId 31979 22:37:54.632714 tst ping_idle_ping.py: using BVCI 31980 22:37:54.750903 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:37:54.762205 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:37:54.773393 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:37:54.784332 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:37:54.795256 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:37:54.806281 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:37:54.817415 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 22:37:54.828586 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 22:37:54.943202 tst ping_idle_ping.py:24: start network... 22:37:55.145149 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:37:55.610450 run create_hlr_db(pid=3289): Launched 22:37:55.725214 bus /gobi_6: Setting Powered False 22:37:56.785125 run create_hlr_db(pid=3289): Terminated: ok {rc=0} 22:37:57.204207 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3291): Launched 22:37:57.503200 run osmo-hlr_10.42.42.2(pid=3292): Launched 22:37:57.617373 run osmo-stp_10.42.42.5: Starting osmo-stp 22:37:58.135334 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3294): Launched 22:37:58.433833 run osmo-stp_10.42.42.5(pid=3295): Launched 22:37:58.548364 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:37:59.065239 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3297): Launched 22:37:59.180222 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:37:59.433323 run patchelf(pid=3298): Launched 22:37:59.600166 run osmo-stp_10.42.42.5(pid=3295): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3295)] 22:37:59.726685 run osmo-stp_10.42.42.5(pid=3295): stdout: | (launched: 2022-12-12_22:37:58.379639) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:37:59.854677 run osmo-stp_10.42.42.5(pid=3295): stderr: | [0;m[38;5;43m20221212223758550 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223758550 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223758550 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223758550 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223758551 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223758551 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223758551 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:37:59.982872 run osmo-stp_10.42.42.5(pid=3295): stdout: | (launched: 2022-12-12_22:37:58.379639) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:38:00.105127 run osmo-stp_10.42.42.5(pid=3295): stderr: | [0;m[38;5;43m20221212223758550 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223758550 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223758550 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223758550 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223758551 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223758551 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223758551 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:38:00.249929 run patchelf(pid=3298): Terminating (SIGINT) 22:38:00.419250 run patchelf(pid=3298): Terminated: ok {rc=0} 22:38:00.541524 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=3295): Process ended prematurely: osmo-stp_10.42.42.5(pid=3295) [trial-2383↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3295)] [trial-2383↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27] 22:38:00.550220 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 22:38:00.576697 run osmo-hlr_10.42.42.2(pid=3292): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-sysmocell5000↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3292)] 22:38:00.624631 run osmo-hlr_10.42.42.2(pid=3292): stdout: | (launched: 2022-12-12_22:37:57.448522) 22:38:00.673610 run osmo-hlr_10.42.42.2(pid=3292): stderr: | [0;m[1;31m20221212223757623 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212223757623 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212223757623 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212223757623 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212223757623 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212223757623 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212223757635 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-sysmocell5000/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212223757644 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212223757644 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212223757644 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:38:00.723247 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3291): Terminating (SIGTERM) 22:38:00.762737 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3294): Terminating (SIGTERM) 22:38:00.802203 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3297): Terminating (SIGTERM) 22:38:00.846417 --- ParallelTerminationStrategy: PID 3291 died... 22:38:00.865718 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3291): Terminated: ok {rc=0} 22:38:00.933687 --- ParallelTerminationStrategy: PID 3294 died... 22:38:00.952873 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3294): Terminated: ok {rc=0} 22:38:00.999250 --- ParallelTerminationStrategy: PID 3297 died... 22:38:01.018656 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3297): Terminated: ok {rc=0} 22:38:01.109919 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2383 gprs:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 gprs:trx-sysmocell5000+mod-bts0-egprs --------------------------------------------------------------------- 22:38:02.416445 tst gprs:trx-sysmocell5000+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:38:02.422116 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 22:38:02.455877 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 22:38:02.494301 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 22:38:02.582681 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 22:38:02.619085 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 22:38:02.658531 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 22:38:03.243978 tst gprs:trx-sysmocell5000+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2383 gprs:trx-sysmocell5000+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 22:38:03.297901 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:38:03.309442 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:38:03.376382 tst cs_paging_gprs_active.py: using LAC 31980 22:38:03.509287 tst cs_paging_gprs_active.py: using RAC 105 22:38:03.637424 tst cs_paging_gprs_active.py: using CellId 31980 22:38:03.766319 tst cs_paging_gprs_active.py: using BVCI 31981 22:38:03.886372 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:38:03.897813 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:38:03.908810 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:38:03.920026 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:38:03.931120 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:38:03.942313 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:38:03.953546 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:38:03.964537 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:38:03.975868 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:38:04.093474 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:38:04.213547 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:38:04.432557 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:38:04.757465 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3302): Launched 22:38:05.041336 run iperf3-srv_10.42.42.10(pid=3303): Launched 22:38:05.163636 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:38:05.385076 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:38:05.711517 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3304): Launched 22:38:05.993820 run iperf3-srv_10.42.42.10(pid=3305): Launched 22:38:06.115649 tst cs_paging_gprs_active.py:38: start network... 22:38:06.336788 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:38:06.842366 run create_hlr_db(pid=3306): Launched 22:38:06.975485 bus /gobi_6: Setting Powered False 22:38:08.039318 run create_hlr_db(pid=3306): Terminated: ok {rc=0} 22:38:08.473711 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3308): Launched 22:38:08.780641 run osmo-hlr_10.42.42.2(pid=3309): Launched 22:38:08.898056 run osmo-stp_10.42.42.5: Starting osmo-stp 22:38:09.437545 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3311): Launched 22:38:09.744255 run osmo-stp_10.42.42.5(pid=3312): Launched 22:38:09.861229 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:38:10.389342 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3314): Launched 22:38:10.507725 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:38:10.766823 run patchelf(pid=3315): Launched 22:38:10.936430 run osmo-stp_10.42.42.5(pid=3312): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3312)] 22:38:11.066383 run osmo-stp_10.42.42.5(pid=3312): stdout: | (launched: 2022-12-12_22:38:09.688483) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:38:11.197161 run osmo-stp_10.42.42.5(pid=3312): stderr: | [0;m[38;5;43m20221212223809859 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223809859 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223809860 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223809860 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223809862 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223809862 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223809862 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:38:11.328370 run osmo-stp_10.42.42.5(pid=3312): stdout: | (launched: 2022-12-12_22:38:09.688483) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:38:11.453908 run osmo-stp_10.42.42.5(pid=3312): stderr: | [0;m[38;5;43m20221212223809859 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223809859 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223809860 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223809860 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223809862 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223809862 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223809862 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:38:11.602815 run patchelf(pid=3315): Terminating (SIGINT) 22:38:11.775321 run patchelf(pid=3315): Terminated: ok {rc=0} 22:38:11.900012 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=3312): Process ended prematurely: osmo-stp_10.42.42.5(pid=3312) [trial-2383↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3312)] [trial-2383↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 22:38:11.909420 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 22:38:11.936485 run osmo-hlr_10.42.42.2(pid=3309): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3309)] 22:38:11.984558 run osmo-hlr_10.42.42.2(pid=3309): stdout: | (launched: 2022-12-12_22:38:08.725118) 22:38:12.034250 run osmo-hlr_10.42.42.2(pid=3309): stderr: | [0;m[1;31m20221212223808901 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212223808901 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212223808901 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212223808901 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212223808901 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212223808901 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212223808916 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-sysmocell5000+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212223808926 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212223808927 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212223808927 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:38:12.084007 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3302): Terminating (SIGTERM) 22:38:12.123942 run iperf3-srv_10.42.42.10(pid=3303): Terminating (SIGTERM) 22:38:12.163551 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3304): Terminating (SIGTERM) 22:38:12.203068 run iperf3-srv_10.42.42.10(pid=3305): Terminating (SIGTERM) 22:38:12.242652 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3308): Terminating (SIGTERM) 22:38:12.282620 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3311): Terminating (SIGTERM) 22:38:12.322201 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3314): Terminating (SIGTERM) 22:38:12.361990 --- ParallelTerminationStrategy: PID 3302 died... 22:38:12.380924 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3302): Terminated: ok {rc=0} 22:38:12.425097 --- ParallelTerminationStrategy: PID 3303 died... 22:38:12.443520 run iperf3-srv_10.42.42.10(pid=3303): Terminated {rc=256} 22:38:12.487869 --- ParallelTerminationStrategy: PID 3304 died... 22:38:12.506368 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3304): Terminated: ok {rc=0} 22:38:12.550291 --- ParallelTerminationStrategy: PID 3305 died... 22:38:12.568500 run iperf3-srv_10.42.42.10(pid=3305): Terminated {rc=256} 22:38:12.612557 --- ParallelTerminationStrategy: PID 3308 died... 22:38:12.630953 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3308): Terminated: ok {rc=0} 22:38:12.674472 --- ParallelTerminationStrategy: PID 3311 died... 22:38:12.693000 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3311): Terminated: ok {rc=0} 22:38:12.736491 --- ParallelTerminationStrategy: PID 3314 died... 22:38:12.754848 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3314): Terminated: ok {rc=0} 22:38:12.839817 bus /gobi_0: Setting Powered False 22:38:13.941112 bus /gobi_0: Setting Powered False 22:38:15.054135 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3.py ---------------------------------------------- 22:38:16.202051 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:38:16.214543 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:38:16.269724 tst iperf3.py: using LAC 31981 22:38:16.398262 tst iperf3.py: using RAC 106 22:38:16.524570 tst iperf3.py: using CellId 31981 22:38:16.650150 tst iperf3.py: using BVCI 31982 22:38:16.801462 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:38:16.816751 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:38:16.832496 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:38:16.848554 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:38:16.864454 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:38:16.880143 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:38:16.892808 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:38:16.905761 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:38:16.918575 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:38:17.062383 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:38:17.273431 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:38:17.585775 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3316): Launched 22:38:17.868207 run iperf3-srv_10.42.42.10(pid=3317): Launched 22:38:17.990397 tst iperf3.py:8: start network... 22:38:18.210110 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:38:18.713058 run create_hlr_db(pid=3318): Launched 22:38:18.844940 bus /gobi_6: Setting Powered False 22:38:19.908663 run create_hlr_db(pid=3318): Terminated: ok {rc=0} 22:38:20.341280 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3320): Launched 22:38:20.645321 run osmo-hlr_10.42.42.2(pid=3321): Launched 22:38:20.763537 run osmo-stp_10.42.42.5: Starting osmo-stp 22:38:21.293353 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3323): Launched 22:38:21.596346 run osmo-stp_10.42.42.5(pid=3324): Launched 22:38:21.711938 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:38:22.235795 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3326): Launched 22:38:22.352837 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:38:22.609416 run patchelf(pid=3327): Launched 22:38:22.779827 run osmo-stp_10.42.42.5(pid=3324): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3324)] 22:38:22.909262 run osmo-stp_10.42.42.5(pid=3324): stdout: | (launched: 2022-12-12_22:38:21.541432) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:38:23.039608 run osmo-stp_10.42.42.5(pid=3324): stderr: | [0;m[38;5;43m20221212223821711 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223821711 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223821711 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223821712 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223821714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223821714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223821714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:38:23.171099 run osmo-stp_10.42.42.5(pid=3324): stdout: | (launched: 2022-12-12_22:38:21.541432) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:38:23.296353 run osmo-stp_10.42.42.5(pid=3324): stderr: | [0;m[38;5;43m20221212223821711 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223821711 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223821711 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223821712 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223821714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223821714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223821714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:38:23.444457 run patchelf(pid=3327): Terminating (SIGINT) 22:38:23.617964 run patchelf(pid=3327): Terminated: ok {rc=0} 22:38:23.742659 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3324): Process ended prematurely: osmo-stp_10.42.42.5(pid=3324) [trial-2383↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3324)] [trial-2383↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8] 22:38:23.751799 tst iperf3.py:8: Test FAILED (7.6 sec) 22:38:23.779252 run osmo-hlr_10.42.42.2(pid=3321): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3321)] 22:38:23.826626 run osmo-hlr_10.42.42.2(pid=3321): stdout: | (launched: 2022-12-12_22:38:20.590105) 22:38:23.875426 run osmo-hlr_10.42.42.2(pid=3321): stderr: | [0;m[1;31m20221212223820765 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212223820765 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212223820765 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212223820766 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212223820766 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212223820766 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212223820778 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212223820787 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212223820787 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212223820787 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:38:23.924733 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3316): Terminating (SIGTERM) 22:38:23.964209 run iperf3-srv_10.42.42.10(pid=3317): Terminating (SIGTERM) 22:38:24.003591 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3320): Terminating (SIGTERM) 22:38:24.043006 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3323): Terminating (SIGTERM) 22:38:24.082482 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3326): Terminating (SIGTERM) 22:38:24.122326 --- ParallelTerminationStrategy: PID 3316 died... 22:38:24.141121 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3316): Terminated: ok {rc=0} 22:38:24.185721 --- ParallelTerminationStrategy: PID 3317 died... 22:38:24.204096 run iperf3-srv_10.42.42.10(pid=3317): Terminated {rc=256} 22:38:24.248074 --- ParallelTerminationStrategy: PID 3320 died... 22:38:24.266603 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3320): Terminated: ok {rc=0} 22:38:24.310516 --- ParallelTerminationStrategy: PID 3323 died... 22:38:24.328651 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3323): Terminated: ok {rc=0} 22:38:24.372647 --- ParallelTerminationStrategy: PID 3326 died... 22:38:24.391217 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3326): Terminated: ok {rc=0} 22:38:24.477145 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 22:38:25.627469 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:38:25.639581 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:38:25.693315 tst iperf3m4.py: using LAC 31982 22:38:25.822451 tst iperf3m4.py: using RAC 107 22:38:25.950157 tst iperf3m4.py: using CellId 31982 22:38:26.083969 tst iperf3m4.py: using BVCI 31983 22:38:26.198176 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:38:26.209327 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:38:26.220194 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:38:26.231754 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:38:26.243191 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:38:26.254972 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:38:26.266657 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:38:26.278087 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:38:26.289792 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:38:26.411870 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:38:26.532258 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:38:26.653395 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:38:26.774152 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:38:26.993427 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:38:27.320498 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3328): Launched 22:38:27.604316 run iperf3-srv_10.42.42.10(pid=3329): Launched 22:38:27.726452 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:38:27.946077 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:38:28.272194 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3330): Launched 22:38:28.553880 run iperf3-srv_10.42.42.10(pid=3331): Launched 22:38:28.675197 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:38:28.894204 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:38:29.220382 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3332): Launched 22:38:29.502485 run iperf3-srv_10.42.42.10(pid=3333): Launched 22:38:29.623984 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:38:29.842767 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:38:30.168032 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3334): Launched 22:38:30.449475 run iperf3-srv_10.42.42.10(pid=3335): Launched 22:38:30.571448 tst iperf3m4.py:8: start network... 22:38:30.790903 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:38:31.323224 run create_hlr_db(pid=3336): Launched 22:38:31.471929 bus /gobi_6: Setting Powered False 22:38:32.531841 run create_hlr_db(pid=3336): Terminated: ok {rc=0} 22:38:32.957191 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3338): Launched 22:38:33.261073 run osmo-hlr_10.42.42.2(pid=3339): Launched 22:38:33.377686 run osmo-stp_10.42.42.5: Starting osmo-stp 22:38:33.916424 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3341): Launched 22:38:34.220409 run osmo-stp_10.42.42.5(pid=3342): Launched 22:38:34.336763 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:38:34.861927 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3344): Launched 22:38:34.978185 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:38:35.235378 run patchelf(pid=3345): Launched 22:38:35.405807 run osmo-stp_10.42.42.5(pid=3342): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3342)] 22:38:35.535467 run osmo-stp_10.42.42.5(pid=3342): stdout: | (launched: 2022-12-12_22:38:34.164852) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:38:35.666306 run osmo-stp_10.42.42.5(pid=3342): stderr: | [0;m[38;5;43m20221212223834336 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223834336 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223834336 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223834336 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223834337 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223834337 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223834337 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:38:35.797143 run osmo-stp_10.42.42.5(pid=3342): stdout: | (launched: 2022-12-12_22:38:34.164852) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:38:35.922365 run osmo-stp_10.42.42.5(pid=3342): stderr: | [0;m[38;5;43m20221212223834336 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223834336 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223834336 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223834336 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223834337 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223834337 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223834337 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:38:36.070557 run patchelf(pid=3345): Terminating (SIGINT) 22:38:36.243369 run patchelf(pid=3345): Terminated: ok {rc=0} 22:38:36.367105 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3342): Process ended prematurely: osmo-stp_10.42.42.5(pid=3342) [trial-2383↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3342)] [trial-2383↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8] 22:38:36.376398 tst iperf3m4.py:8: Test FAILED (10.8 sec) 22:38:36.403968 run osmo-hlr_10.42.42.2(pid=3339): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3339)] 22:38:36.451693 run osmo-hlr_10.42.42.2(pid=3339): stdout: | (launched: 2022-12-12_22:38:33.205794) 22:38:36.501097 run osmo-hlr_10.42.42.2(pid=3339): stderr: | [0;m[1;31m20221212223833381 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212223833381 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212223833381 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212223833381 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212223833381 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212223833381 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212223833398 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212223833408 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212223833409 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212223833409 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:38:36.550947 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3328): Terminating (SIGTERM) 22:38:36.590709 run iperf3-srv_10.42.42.10(pid=3329): Terminating (SIGTERM) 22:38:36.630368 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3330): Terminating (SIGTERM) 22:38:36.669998 run iperf3-srv_10.42.42.10(pid=3331): Terminating (SIGTERM) 22:38:36.709395 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3332): Terminating (SIGTERM) 22:38:36.749088 run iperf3-srv_10.42.42.10(pid=3333): Terminating (SIGTERM) 22:38:36.788427 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3334): Terminating (SIGTERM) 22:38:36.828112 run iperf3-srv_10.42.42.10(pid=3335): Terminating (SIGTERM) 22:38:36.867089 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3338): Terminating (SIGTERM) 22:38:36.907065 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3341): Terminating (SIGTERM) 22:38:36.946626 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3344): Terminating (SIGTERM) 22:38:36.986945 --- ParallelTerminationStrategy: PID 3328 died... 22:38:37.005823 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3328): Terminated: ok {rc=0} 22:38:37.050430 --- ParallelTerminationStrategy: PID 3329 died... 22:38:37.068787 run iperf3-srv_10.42.42.10(pid=3329): Terminated {rc=256} 22:38:37.112269 --- ParallelTerminationStrategy: PID 3330 died... 22:38:37.130771 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3330): Terminated: ok {rc=0} 22:38:37.174786 --- ParallelTerminationStrategy: PID 3331 died... 22:38:37.193357 run iperf3-srv_10.42.42.10(pid=3331): Terminated {rc=256} 22:38:37.237624 --- ParallelTerminationStrategy: PID 3332 died... 22:38:37.255894 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3332): Terminated: ok {rc=0} 22:38:37.300206 --- ParallelTerminationStrategy: PID 3333 died... 22:38:37.318471 run iperf3-srv_10.42.42.10(pid=3333): Terminated {rc=256} 22:38:37.361914 --- ParallelTerminationStrategy: PID 3334 died... 22:38:37.380222 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3334): Terminated: ok {rc=0} 22:38:37.423963 --- ParallelTerminationStrategy: PID 3335 died... 22:38:37.442288 run iperf3-srv_10.42.42.10(pid=3335): Terminated {rc=256} 22:38:37.485609 --- ParallelTerminationStrategy: PID 3338 died... 22:38:37.503690 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3338): Terminated: ok {rc=0} 22:38:37.547261 --- ParallelTerminationStrategy: PID 3341 died... 22:38:37.565601 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3341): Terminated: ok {rc=0} 22:38:37.609100 --- ParallelTerminationStrategy: PID 3344 died... 22:38:37.627563 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3344): Terminated: ok {rc=0} 22:38:37.710835 bus /gobi_4: Setting Powered False 22:38:38.806712 bus /gobi_4: Setting Powered False 22:38:39.922281 bus /gobi_1: Setting Powered False 22:38:41.022353 bus /gobi_1: Setting Powered False 22:38:42.137232 bus /gobi_0: Setting Powered False 22:38:43.235530 bus /gobi_0: Setting Powered False 22:38:44.350056 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-sysmocell5000+mod-bts0-egprs ping.py ---------------------------------------------- 22:38:45.451215 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:38:45.463372 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:38:45.518638 tst ping.py: using LAC 31983 22:38:45.643568 tst ping.py: using RAC 108 22:38:45.766269 tst ping.py: using CellId 31983 22:38:45.905148 tst ping.py: using BVCI 31984 22:38:46.030983 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:38:46.043418 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:38:46.055262 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:38:46.067109 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:38:46.079002 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:38:46.091004 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:38:46.102960 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:38:46.114716 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:38:46.234622 tst ping.py:19: start network... 22:38:46.496867 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:38:47.045766 run create_hlr_db(pid=3382): Launched 22:38:47.193285 bus /gobi_6: Setting Powered False 22:38:48.271994 run create_hlr_db(pid=3382): Terminated: ok {rc=0} 22:38:48.807526 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3561): Launched 22:38:49.242953 run osmo-hlr_10.42.42.2(pid=3616): Launched 22:38:49.492375 run osmo-stp_10.42.42.5: Starting osmo-stp 22:38:50.146435 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3620): Launched 22:38:50.480033 run osmo-stp_10.42.42.5(pid=3621): Launched 22:38:50.723875 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:38:51.367485 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3624): Launched 22:38:51.497850 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:38:51.765842 run patchelf(pid=3626): Launched 22:38:51.951196 run osmo-stp_10.42.42.5(pid=3621): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3621)] 22:38:52.088627 run osmo-stp_10.42.42.5(pid=3621): stdout: | (launched: 2022-12-12_22:38:50.415175) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:38:52.222741 run osmo-stp_10.42.42.5(pid=3621): stderr: | [0;m[38;5;43m20221212223850713 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223850713 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223850713 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223850713 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223850714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223850714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223850714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:38:52.355465 run osmo-stp_10.42.42.5(pid=3621): stdout: | (launched: 2022-12-12_22:38:50.415175) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:38:52.482723 run osmo-stp_10.42.42.5(pid=3621): stderr: | [0;m[38;5;43m20221212223850713 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223850713 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223850713 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223850713 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223850714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223850714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223850714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:38:52.634840 run patchelf(pid=3626): Terminating (SIGINT) 22:38:52.811909 run patchelf(pid=3626): Terminated: ok {rc=0} 22:38:52.940492 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=3621): Process ended prematurely: osmo-stp_10.42.42.5(pid=3621) [trial-2383↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3621)] [trial-2383↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22] 22:38:52.950431 tst ping.py:22: Test FAILED (7.5 sec) 22:38:52.981741 run osmo-hlr_10.42.42.2(pid=3616): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3616)] 22:38:53.032525 run osmo-hlr_10.42.42.2(pid=3616): stdout: | (launched: 2022-12-12_22:38:49.155973) 22:38:53.083940 run osmo-hlr_10.42.42.2(pid=3616): stderr: | [0;m[1;31m20221212223849500 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212223849500 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212223849500 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212223849500 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212223849500 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212223849500 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212223849515 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-sysmocell5000+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212223849532 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212223849532 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212223849532 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:38:53.136851 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3561): Terminating (SIGTERM) 22:38:53.179065 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3620): Terminating (SIGTERM) 22:38:53.223667 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3624): Terminating (SIGTERM) 22:38:53.266272 --- ParallelTerminationStrategy: PID 3561 died... 22:38:53.286076 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3561): Terminated: ok {rc=0} 22:38:53.334373 --- ParallelTerminationStrategy: PID 3620 died... 22:38:53.353841 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3620): Terminated: ok {rc=0} 22:38:53.402475 --- ParallelTerminationStrategy: PID 3624 died... 22:38:53.422083 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3624): Terminated: ok {rc=0} 22:38:53.510225 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-sysmocell5000+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 22:38:54.599709 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:38:54.612782 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:38:54.668492 tst ping_idle_ping.py: using LAC 31984 22:38:54.793845 tst ping_idle_ping.py: using RAC 109 22:38:54.916645 tst ping_idle_ping.py: using CellId 31984 22:38:55.038810 tst ping_idle_ping.py: using BVCI 31985 22:38:55.150800 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:38:55.163170 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:38:55.174975 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:38:55.188124 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:38:55.203175 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:38:55.216554 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:38:55.228867 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:38:55.242075 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:38:55.365243 tst ping_idle_ping.py:24: start network... 22:38:55.573648 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:38:56.062805 run create_hlr_db(pid=3627): Launched 22:38:56.224158 bus /gobi_6: Setting Powered False 22:38:57.285810 run create_hlr_db(pid=3627): Terminated: ok {rc=0} 22:38:57.733714 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3629): Launched 22:38:58.069699 run osmo-hlr_10.42.42.2(pid=3630): Launched 22:38:58.309831 run osmo-stp_10.42.42.5: Starting osmo-stp 22:38:59.036855 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3632): Launched 22:38:59.369707 run osmo-stp_10.42.42.5(pid=3633): Launched 22:38:59.617654 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:39:00.326390 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3635): Launched 22:39:00.459126 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:39:00.730430 run patchelf(pid=3636): Launched 22:39:00.923854 run osmo-stp_10.42.42.5(pid=3633): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3633)] 22:39:01.075051 run osmo-stp_10.42.42.5(pid=3633): stdout: | (launched: 2022-12-12_22:38:59.303964) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:39:01.211796 run osmo-stp_10.42.42.5(pid=3633): stderr: | [0;m[38;5;43m20221212223859642 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223859642 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223859642 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223859642 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223859643 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223859643 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223859643 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:39:01.389263 run osmo-stp_10.42.42.5(pid=3633): stdout: | (launched: 2022-12-12_22:38:59.303964) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:39:01.542647 run osmo-stp_10.42.42.5(pid=3633): stderr: | [0;m[38;5;43m20221212223859642 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223859642 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223859642 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223859642 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223859643 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223859643 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223859643 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:39:01.725523 run patchelf(pid=3636): Terminating (SIGINT) 22:39:01.938139 run patchelf(pid=3636): Terminated: ok {rc=0} 22:39:02.095741 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=3633): Process ended prematurely: osmo-stp_10.42.42.5(pid=3633) [trial-2383↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3633)] [trial-2383↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27] 22:39:02.107275 tst ping_idle_ping.py:27: Test FAILED (7.5 sec) 22:39:02.140026 run osmo-hlr_10.42.42.2(pid=3630): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3630)] 22:39:02.197172 run osmo-hlr_10.42.42.2(pid=3630): stdout: | (launched: 2022-12-12_22:38:57.998881) 22:39:02.257343 run osmo-hlr_10.42.42.2(pid=3630): stderr: | [0;m[1;31m20221212223858351 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212223858351 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212223858351 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212223858351 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212223858351 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212223858351 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212223858363 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-sysmocell5000+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212223858377 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212223858377 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212223858377 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:39:02.317357 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3629): Terminating (SIGTERM) 22:39:02.366612 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3632): Terminating (SIGTERM) 22:39:02.417926 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3635): Terminating (SIGTERM) 22:39:02.466953 --- ParallelTerminationStrategy: PID 3629 died... 22:39:02.489917 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3629): Terminated: ok {rc=0} 22:39:02.545637 --- ParallelTerminationStrategy: PID 3632 died... 22:39:02.569149 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3632): Terminated: ok {rc=0} 22:39:02.624908 --- ParallelTerminationStrategy: PID 3635 died... 22:39:02.648181 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3635): Terminated: ok {rc=0} 22:39:02.755053 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2383 gprs:trx-sysmocell5000+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa --------------------------------------------------------------------- 22:39:04.087335 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:39:04.094061 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 22:39:04.132835 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 22:39:04.173872 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 22:39:04.262426 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 22:39:04.298107 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 22:39:04.338600 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 22:39:04.933049 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2383 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 22:39:04.988066 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:39:05.000109 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:39:05.073688 tst cs_paging_gprs_active.py: using LAC 31985 22:39:05.198457 tst cs_paging_gprs_active.py: using RAC 110 22:39:05.324752 tst cs_paging_gprs_active.py: using CellId 31985 22:39:05.452754 tst cs_paging_gprs_active.py: using BVCI 31986 22:39:05.569538 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:39:05.581808 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:39:05.593794 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:39:05.607632 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:39:05.620697 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:39:05.634086 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:39:05.647376 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:39:05.659878 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:39:05.673243 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:39:05.798223 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:39:05.920554 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:39:06.136545 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:39:06.463281 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3640): Launched 22:39:06.771048 run iperf3-srv_10.42.42.10(pid=3641): Launched 22:39:06.898954 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:39:07.115679 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:39:07.447781 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3642): Launched 22:39:07.741589 run iperf3-srv_10.42.42.10(pid=3643): Launched 22:39:07.875762 tst cs_paging_gprs_active.py:38: start network... 22:39:08.091180 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:39:08.590969 run create_hlr_db(pid=3644): Launched 22:39:08.756374 bus /gobi_6: Setting Powered False 22:39:09.820189 run create_hlr_db(pid=3644): Terminated: ok {rc=0} 22:39:10.254637 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3647): Launched 22:39:10.559955 run osmo-hlr_10.42.42.2(pid=3648): Launched 22:39:10.677718 run osmo-stp_10.42.42.5: Starting osmo-stp 22:39:11.211727 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3650): Launched 22:39:11.517054 run osmo-stp_10.42.42.5(pid=3651): Launched 22:39:11.634891 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:39:12.164166 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3653): Launched 22:39:12.290939 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:39:12.564913 run patchelf(pid=3654): Launched 22:39:12.745976 run osmo-stp_10.42.42.5(pid=3651): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3651)] 22:39:12.883259 run osmo-stp_10.42.42.5(pid=3651): stdout: | (launched: 2022-12-12_22:39:11.461354) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:39:13.021983 run osmo-stp_10.42.42.5(pid=3651): stderr: | [0;m[38;5;43m20221212223911633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223911633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223911633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223911634 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223911634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223911634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223911634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:39:13.160447 run osmo-stp_10.42.42.5(pid=3651): stdout: | (launched: 2022-12-12_22:39:11.461354) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:39:13.293934 run osmo-stp_10.42.42.5(pid=3651): stderr: | [0;m[38;5;43m20221212223911633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223911633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223911633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223911634 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223911634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223911634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223911634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:39:13.451923 run patchelf(pid=3654): Terminating (SIGINT) 22:39:13.634900 run patchelf(pid=3654): Terminated: ok {rc=0} 22:39:13.766276 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=3651): Process ended prematurely: osmo-stp_10.42.42.5(pid=3651) [trial-2383↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3651)] [trial-2383↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 22:39:13.776317 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 22:39:13.804533 run osmo-hlr_10.42.42.2(pid=3648): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3648)] 22:39:13.854024 run osmo-hlr_10.42.42.2(pid=3648): stdout: | (launched: 2022-12-12_22:39:10.504368) 22:39:13.905361 run osmo-hlr_10.42.42.2(pid=3648): stderr: | [0;m[1;31m20221212223910681 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212223910681 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212223910681 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212223910681 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212223910681 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212223910681 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212223910693 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212223910701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212223910701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212223910702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:39:13.956661 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3640): Terminating (SIGTERM) 22:39:13.998039 run iperf3-srv_10.42.42.10(pid=3641): Terminating (SIGTERM) 22:39:14.039254 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3642): Terminating (SIGTERM) 22:39:14.080492 run iperf3-srv_10.42.42.10(pid=3643): Terminating (SIGTERM) 22:39:14.121782 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3647): Terminating (SIGTERM) 22:39:14.163103 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3650): Terminating (SIGTERM) 22:39:14.204303 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3653): Terminating (SIGTERM) 22:39:14.246291 --- ParallelTerminationStrategy: PID 3640 died... 22:39:14.266005 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3640): Terminated: ok {rc=0} 22:39:14.311632 --- ParallelTerminationStrategy: PID 3641 died... 22:39:14.330791 run iperf3-srv_10.42.42.10(pid=3641): Terminated {rc=256} 22:39:14.375889 --- ParallelTerminationStrategy: PID 3642 died... 22:39:14.395083 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3642): Terminated: ok {rc=0} 22:39:14.440191 --- ParallelTerminationStrategy: PID 3643 died... 22:39:14.459351 run iperf3-srv_10.42.42.10(pid=3643): Terminated {rc=256} 22:39:14.504473 --- ParallelTerminationStrategy: PID 3647 died... 22:39:14.523675 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3647): Terminated: ok {rc=0} 22:39:14.569354 --- ParallelTerminationStrategy: PID 3650 died... 22:39:14.588617 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3650): Terminated: ok {rc=0} 22:39:14.633862 --- ParallelTerminationStrategy: PID 3653 died... 22:39:14.653084 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3653): Terminated: ok {rc=0} 22:39:14.739253 bus /gobi_0: Setting Powered False 22:39:15.846331 bus /gobi_0: Setting Powered False 22:39:16.984205 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 22:39:18.148820 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:39:18.160824 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:39:18.235893 tst iperf3.py: using LAC 31986 22:39:18.362330 tst iperf3.py: using RAC 111 22:39:18.491010 tst iperf3.py: using CellId 31986 22:39:18.621121 tst iperf3.py: using BVCI 31987 22:39:18.739932 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:39:18.751477 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:39:18.762832 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:39:18.774167 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:39:18.785397 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:39:18.796628 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:39:18.808025 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:39:18.819314 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:39:18.830737 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:39:18.947197 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:39:19.152425 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:39:19.457978 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3655): Launched 22:39:19.723431 run iperf3-srv_10.42.42.10(pid=3656): Launched 22:39:19.838329 tst iperf3.py:8: start network... 22:39:20.042739 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:39:20.514963 run create_hlr_db(pid=3657): Launched 22:39:20.632231 bus /gobi_6: Setting Powered False 22:39:21.693128 run create_hlr_db(pid=3657): Terminated: ok {rc=0} 22:39:22.138194 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3659): Launched 22:39:22.462408 run osmo-hlr_10.42.42.2(pid=3660): Launched 22:39:22.587178 run osmo-stp_10.42.42.5: Starting osmo-stp 22:39:23.145738 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3662): Launched 22:39:23.469620 run osmo-stp_10.42.42.5(pid=3663): Launched 22:39:23.596361 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:39:24.159256 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3665): Launched 22:39:24.283457 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:39:24.556392 run patchelf(pid=3666): Launched 22:39:24.737275 run osmo-stp_10.42.42.5(pid=3663): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3663)] 22:39:24.874718 run osmo-stp_10.42.42.5(pid=3663): stdout: | (launched: 2022-12-12_22:39:23.410769) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:39:25.013633 run osmo-stp_10.42.42.5(pid=3663): stderr: | [0;m[38;5;43m20221212223923605 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223923605 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223923606 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223923606 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223923606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223923607 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223923607 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:39:25.152468 run osmo-stp_10.42.42.5(pid=3663): stdout: | (launched: 2022-12-12_22:39:23.410769) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:39:25.286412 run osmo-stp_10.42.42.5(pid=3663): stderr: | [0;m[38;5;43m20221212223923605 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223923605 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223923606 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223923606 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223923606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223923607 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223923607 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:39:25.444157 run patchelf(pid=3666): Terminating (SIGINT) 22:39:25.628005 run patchelf(pid=3666): Terminated: ok {rc=0} 22:39:25.760056 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3663): Process ended prematurely: osmo-stp_10.42.42.5(pid=3663) [trial-2383↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3663)] [trial-2383↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8] 22:39:25.770165 tst iperf3.py:8: Test FAILED (7.7 sec) 22:39:25.798316 run osmo-hlr_10.42.42.2(pid=3660): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3660)] 22:39:25.847648 run osmo-hlr_10.42.42.2(pid=3660): stdout: | (launched: 2022-12-12_22:39:22.403873) 22:39:25.898998 run osmo-hlr_10.42.42.2(pid=3660): stderr: | [0;m[1;31m20221212223922603 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212223922603 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212223922603 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212223922603 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212223922603 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212223922603 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212223922616 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212223922626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212223922626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212223922626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:39:25.950880 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3655): Terminating (SIGTERM) 22:39:25.992034 run iperf3-srv_10.42.42.10(pid=3656): Terminating (SIGTERM) 22:39:26.034457 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3659): Terminating (SIGTERM) 22:39:26.075969 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3662): Terminating (SIGTERM) 22:39:26.117067 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3665): Terminating (SIGTERM) 22:39:26.158449 --- ParallelTerminationStrategy: PID 3655 died... 22:39:26.178225 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3655): Terminated: ok {rc=0} 22:39:26.224057 --- ParallelTerminationStrategy: PID 3656 died... 22:39:26.243501 run iperf3-srv_10.42.42.10(pid=3656): Terminated {rc=256} 22:39:26.288761 --- ParallelTerminationStrategy: PID 3659 died... 22:39:26.307963 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3659): Terminated: ok {rc=0} 22:39:26.353878 --- ParallelTerminationStrategy: PID 3662 died... 22:39:26.373204 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3662): Terminated: ok {rc=0} 22:39:26.418387 --- ParallelTerminationStrategy: PID 3665 died... 22:39:26.437658 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3665): Terminated: ok {rc=0} 22:39:26.524195 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 22:39:27.674029 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:39:27.685978 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:39:27.758190 tst iperf3m4.py: using LAC 31987 22:39:27.886493 tst iperf3m4.py: using RAC 112 22:39:28.015823 tst iperf3m4.py: using CellId 31987 22:39:28.142665 tst iperf3m4.py: using BVCI 31988 22:39:28.260728 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:39:28.272244 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:39:28.283592 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:39:28.294856 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:39:28.306103 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:39:28.317378 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:39:28.328746 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:39:28.339989 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:39:28.351621 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:39:28.468707 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:39:28.589311 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:39:28.710557 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:39:28.832848 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:39:29.053050 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:39:29.380216 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3667): Launched 22:39:29.665826 run iperf3-srv_10.42.42.10(pid=3668): Launched 22:39:29.788711 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:39:30.009231 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:39:30.336674 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3669): Launched 22:39:30.618216 run iperf3-srv_10.42.42.10(pid=3670): Launched 22:39:30.739749 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:39:30.995479 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:39:31.317631 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3671): Launched 22:39:31.624596 run iperf3-srv_10.42.42.10(pid=3672): Launched 22:39:31.760934 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:39:31.984826 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:39:32.314156 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3673): Launched 22:39:32.596010 run iperf3-srv_10.42.42.10(pid=3674): Launched 22:39:32.717841 tst iperf3m4.py:8: start network... 22:39:32.936334 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:39:33.439578 run create_hlr_db(pid=3675): Launched 22:39:33.570790 bus /gobi_6: Setting Powered False 22:39:34.634508 run create_hlr_db(pid=3675): Terminated: ok {rc=0} 22:39:35.066942 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3677): Launched 22:39:35.372301 run osmo-hlr_10.42.42.2(pid=3678): Launched 22:39:35.489117 run osmo-stp_10.42.42.5: Starting osmo-stp 22:39:36.031892 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3680): Launched 22:39:36.337516 run osmo-stp_10.42.42.5(pid=3681): Launched 22:39:36.456123 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:39:36.983642 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3683): Launched 22:39:37.100568 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:39:37.358340 run patchelf(pid=3684): Launched 22:39:37.527794 run osmo-stp_10.42.42.5(pid=3681): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3681)] 22:39:37.657349 run osmo-stp_10.42.42.5(pid=3681): stdout: | (launched: 2022-12-12_22:39:36.281991) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:39:37.787723 run osmo-stp_10.42.42.5(pid=3681): stderr: | [0;m[38;5;43m20221212223936452 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223936452 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223936453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223936453 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223936453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223936454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223936454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:39:37.918314 run osmo-stp_10.42.42.5(pid=3681): stdout: | (launched: 2022-12-12_22:39:36.281991) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:39:38.043074 run osmo-stp_10.42.42.5(pid=3681): stderr: | [0;m[38;5;43m20221212223936452 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223936452 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223936453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223936453 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223936453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223936454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223936454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:39:38.191103 run patchelf(pid=3684): Terminating (SIGINT) 22:39:38.363821 run patchelf(pid=3684): Terminated: ok {rc=0} 22:39:38.487834 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3681): Process ended prematurely: osmo-stp_10.42.42.5(pid=3681) [trial-2383↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3681)] [trial-2383↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8] 22:39:38.497279 tst iperf3m4.py:8: Test FAILED (10.9 sec) 22:39:38.525189 run osmo-hlr_10.42.42.2(pid=3678): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3678)] 22:39:38.572875 run osmo-hlr_10.42.42.2(pid=3678): stdout: | (launched: 2022-12-12_22:39:35.316741) 22:39:38.622343 run osmo-hlr_10.42.42.2(pid=3678): stderr: | [0;m[1;31m20221212223935493 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212223935493 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212223935493 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212223935493 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212223935493 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212223935493 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212223935505 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212223935514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212223935514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212223935515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:39:38.672161 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3667): Terminating (SIGTERM) 22:39:38.712043 run iperf3-srv_10.42.42.10(pid=3668): Terminating (SIGTERM) 22:39:38.751903 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3669): Terminating (SIGTERM) 22:39:38.791845 run iperf3-srv_10.42.42.10(pid=3670): Terminating (SIGTERM) 22:39:38.831735 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3671): Terminating (SIGTERM) 22:39:38.871732 run iperf3-srv_10.42.42.10(pid=3672): Terminating (SIGTERM) 22:39:38.911333 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3673): Terminating (SIGTERM) 22:39:38.951096 run iperf3-srv_10.42.42.10(pid=3674): Terminating (SIGTERM) 22:39:38.990668 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3677): Terminating (SIGTERM) 22:39:39.030381 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3680): Terminating (SIGTERM) 22:39:39.070096 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3683): Terminating (SIGTERM) 22:39:39.109619 --- ParallelTerminationStrategy: PID 3667 died... 22:39:39.128894 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3667): Terminated: ok {rc=0} 22:39:39.173254 --- ParallelTerminationStrategy: PID 3668 died... 22:39:39.191617 run iperf3-srv_10.42.42.10(pid=3668): Terminated {rc=256} 22:39:39.235986 --- ParallelTerminationStrategy: PID 3669 died... 22:39:39.254385 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3669): Terminated: ok {rc=0} 22:39:39.298540 --- ParallelTerminationStrategy: PID 3670 died... 22:39:39.316893 run iperf3-srv_10.42.42.10(pid=3670): Terminated {rc=256} 22:39:39.360821 --- ParallelTerminationStrategy: PID 3671 died... 22:39:39.379529 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3671): Terminated: ok {rc=0} 22:39:39.423818 --- ParallelTerminationStrategy: PID 3672 died... 22:39:39.442167 run iperf3-srv_10.42.42.10(pid=3672): Terminated {rc=256} 22:39:39.485736 --- ParallelTerminationStrategy: PID 3673 died... 22:39:39.504104 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3673): Terminated: ok {rc=0} 22:39:39.548579 --- ParallelTerminationStrategy: PID 3674 died... 22:39:39.566971 run iperf3-srv_10.42.42.10(pid=3674): Terminated {rc=256} 22:39:39.610839 --- ParallelTerminationStrategy: PID 3677 died... 22:39:39.629275 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3677): Terminated: ok {rc=0} 22:39:39.673751 --- ParallelTerminationStrategy: PID 3680 died... 22:39:39.692203 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3680): Terminated: ok {rc=0} 22:39:39.736289 --- ParallelTerminationStrategy: PID 3683 died... 22:39:39.754738 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3683): Terminated: ok {rc=0} 22:39:39.840080 bus /gobi_4: Setting Powered False 22:39:40.939623 bus /gobi_4: Setting Powered False 22:39:42.051679 bus /gobi_1: Setting Powered False 22:39:43.149036 bus /gobi_1: Setting Powered False 22:39:44.264701 bus /gobi_0: Setting Powered False 22:39:45.360000 bus /gobi_0: Setting Powered False 22:39:46.475030 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 22:39:47.580816 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:39:47.592935 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:39:47.665586 tst ping.py: using LAC 31988 22:39:47.792732 tst ping.py: using RAC 113 22:39:47.917451 tst ping.py: using CellId 31988 22:39:48.041864 tst ping.py: using BVCI 31989 22:39:48.157601 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:39:48.169053 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:39:48.180316 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:39:48.191678 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:39:48.202857 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:39:48.214115 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:39:48.225490 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:39:48.236654 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:39:48.353092 tst ping.py:19: start network... 22:39:48.554061 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:39:49.016260 run create_hlr_db(pid=3685): Launched 22:39:49.131690 bus /gobi_6: Setting Powered False 22:39:50.195386 run create_hlr_db(pid=3685): Terminated: ok {rc=0} 22:39:50.640186 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3687): Launched 22:39:50.957894 run osmo-hlr_10.42.42.2(pid=3688): Launched 22:39:51.079740 run osmo-stp_10.42.42.5: Starting osmo-stp 22:39:51.634933 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3690): Launched 22:39:51.952823 run osmo-stp_10.42.42.5(pid=3691): Launched 22:39:52.074452 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:39:52.623695 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3693): Launched 22:39:52.746417 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:39:53.015804 run patchelf(pid=3694): Launched 22:39:53.193214 run osmo-stp_10.42.42.5(pid=3691): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3691)] 22:39:53.328898 run osmo-stp_10.42.42.5(pid=3691): stdout: | (launched: 2022-12-12_22:39:51.895520) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:39:53.465555 run osmo-stp_10.42.42.5(pid=3691): stderr: | [0;m[38;5;43m20221212223952088 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223952088 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223952088 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223952089 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223952089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223952089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223952089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:39:53.601720 run osmo-stp_10.42.42.5(pid=3691): stdout: | (launched: 2022-12-12_22:39:51.895520) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:39:53.732375 run osmo-stp_10.42.42.5(pid=3691): stderr: | [0;m[38;5;43m20221212223952088 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212223952088 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212223952088 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212223952089 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212223952089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212223952089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212223952089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:39:53.887271 run patchelf(pid=3694): Terminating (SIGINT) 22:39:54.067143 run patchelf(pid=3694): Terminated: ok {rc=0} 22:39:54.197115 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=3691): Process ended prematurely: osmo-stp_10.42.42.5(pid=3691) [trial-2383↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3691)] [trial-2383↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22] 22:39:54.206531 tst ping.py:22: Test FAILED (6.6 sec) 22:39:54.234342 run osmo-hlr_10.42.42.2(pid=3688): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3688)] 22:39:54.284390 run osmo-hlr_10.42.42.2(pid=3688): stdout: | (launched: 2022-12-12_22:39:50.900349) 22:39:54.335805 run osmo-hlr_10.42.42.2(pid=3688): stderr: | [0;m[1;31m20221212223951098 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212223951098 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212223951098 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212223951098 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212223951098 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212223951098 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212223951110 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212223951119 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212223951119 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212223951119 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:39:54.387521 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3687): Terminating (SIGTERM) 22:39:54.428785 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3690): Terminating (SIGTERM) 22:39:54.470226 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3693): Terminating (SIGTERM) 22:39:54.511858 --- ParallelTerminationStrategy: PID 3687 died... 22:39:54.531861 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3687): Terminated: ok {rc=0} 22:39:54.577763 --- ParallelTerminationStrategy: PID 3690 died... 22:39:54.597246 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3690): Terminated: ok {rc=0} 22:39:54.642991 --- ParallelTerminationStrategy: PID 3693 died... 22:39:54.662401 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3693): Terminated: ok {rc=0} 22:39:54.750016 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 22:39:55.837837 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:39:55.850486 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:39:55.924540 tst ping_idle_ping.py: using LAC 31989 22:39:56.051587 tst ping_idle_ping.py: using RAC 114 22:39:56.175515 tst ping_idle_ping.py: using CellId 31989 22:39:56.300146 tst ping_idle_ping.py: using BVCI 31990 22:39:56.416131 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:39:56.427897 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:39:56.439224 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:39:56.450589 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:39:56.461901 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:39:56.473175 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:39:56.484507 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:39:56.495799 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:39:56.611206 tst ping_idle_ping.py:24: start network... 22:39:56.814107 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:39:57.285935 run create_hlr_db(pid=3695): Launched 22:39:57.401204 bus /gobi_6: Setting Powered False 22:39:58.461455 run create_hlr_db(pid=3695): Terminated: ok {rc=0} 22:39:58.879728 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3697): Launched 22:39:59.180050 run osmo-hlr_10.42.42.2(pid=3698): Launched 22:39:59.297482 run osmo-stp_10.42.42.5: Starting osmo-stp 22:39:59.827949 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3700): Launched 22:40:00.128855 run osmo-stp_10.42.42.5(pid=3701): Launched 22:40:00.244340 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:40:00.760400 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3703): Launched 22:40:00.890340 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:40:01.155564 run patchelf(pid=3704): Launched 22:40:01.328148 run osmo-stp_10.42.42.5(pid=3701): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3701)] 22:40:01.459328 run osmo-stp_10.42.42.5(pid=3701): stdout: | (launched: 2022-12-12_22:40:00.074121) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:40:01.592021 run osmo-stp_10.42.42.5(pid=3701): stderr: | [0;m[38;5;43m20221212224000245 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224000245 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224000246 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224000246 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224000247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224000247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224000247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:40:01.724725 run osmo-stp_10.42.42.5(pid=3701): stdout: | (launched: 2022-12-12_22:40:00.074121) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:40:01.853389 run osmo-stp_10.42.42.5(pid=3701): stderr: | [0;m[38;5;43m20221212224000245 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224000245 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224000246 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224000246 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224000247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224000247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224000247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:40:02.014428 run patchelf(pid=3704): Terminating (SIGINT) 22:40:02.192295 run patchelf(pid=3704): Terminated: ok {rc=0} 22:40:02.318220 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=3701): Process ended prematurely: osmo-stp_10.42.42.5(pid=3701) [trial-2383↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3701)] [trial-2383↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 22:40:02.328737 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 22:40:02.355215 run osmo-hlr_10.42.42.2(pid=3698): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3698)] 22:40:02.402749 run osmo-hlr_10.42.42.2(pid=3698): stdout: | (launched: 2022-12-12_22:39:59.125515) 22:40:02.451751 run osmo-hlr_10.42.42.2(pid=3698): stderr: | [0;m[1;31m20221212223959304 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212223959304 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212223959304 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212223959304 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212223959304 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212223959304 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212223959317 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212223959326 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212223959326 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212223959326 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:40:02.501355 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3697): Terminating (SIGTERM) 22:40:02.541124 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3700): Terminating (SIGTERM) 22:40:02.580592 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3703): Terminating (SIGTERM) 22:40:02.620286 --- ParallelTerminationStrategy: PID 3697 died... 22:40:02.639162 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3697): Terminated: ok {rc=0} 22:40:02.682735 --- ParallelTerminationStrategy: PID 3700 died... 22:40:02.700828 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3700): Terminated: ok {rc=0} 22:40:02.744364 --- ParallelTerminationStrategy: PID 3703 died... 22:40:02.762624 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3703): Terminated: ok {rc=0} 22:40:02.847508 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2383 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 22:40:04.151661 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:40:04.157927 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 22:40:04.192092 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 22:40:04.230389 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 22:40:04.316493 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 22:40:04.349696 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 22:40:04.387617 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 22:40:04.981949 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2383 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 22:40:05.031353 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:40:05.042463 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:40:05.112425 tst cs_paging_gprs_active.py: using LAC 31990 22:40:05.242468 tst cs_paging_gprs_active.py: using RAC 115 22:40:05.373508 tst cs_paging_gprs_active.py: using CellId 31990 22:40:05.502929 tst cs_paging_gprs_active.py: using BVCI 31991 22:40:05.623615 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:40:05.635119 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:40:05.646382 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:40:05.657795 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:40:05.669513 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:40:05.680641 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:40:05.692066 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:40:05.703281 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:40:05.714679 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:40:05.833745 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:40:05.952195 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:40:06.158804 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:40:06.466329 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3713): Launched 22:40:06.733017 run iperf3-srv_10.42.42.10(pid=3714): Launched 22:40:06.848052 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:40:07.053467 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:40:07.360030 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3715): Launched 22:40:07.625768 run iperf3-srv_10.42.42.10(pid=3716): Launched 22:40:07.740208 tst cs_paging_gprs_active.py:38: start network... 22:40:07.945293 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:40:08.417576 run create_hlr_db(pid=3717): Launched 22:40:08.535881 bus /gobi_6: Setting Powered False 22:40:09.595192 run create_hlr_db(pid=3717): Terminated: ok {rc=0} 22:40:10.038671 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3719): Launched 22:40:10.364792 run osmo-hlr_10.42.42.2(pid=3720): Launched 22:40:10.489102 run osmo-stp_10.42.42.5: Starting osmo-stp 22:40:11.052228 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3722): Launched 22:40:11.376790 run osmo-stp_10.42.42.5(pid=3723): Launched 22:40:11.501584 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:40:12.064350 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3725): Launched 22:40:12.189379 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:40:12.464874 run patchelf(pid=3726): Launched 22:40:12.646198 run osmo-stp_10.42.42.5(pid=3723): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3723)] 22:40:12.783727 run osmo-stp_10.42.42.5(pid=3723): stdout: | (launched: 2022-12-12_22:40:11.317818) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:40:12.922914 run osmo-stp_10.42.42.5(pid=3723): stderr: | [0;m[38;5;43m20221212224011512 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224011512 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224011512 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224011513 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224011513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224011513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224011513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:40:13.062173 run osmo-stp_10.42.42.5(pid=3723): stdout: | (launched: 2022-12-12_22:40:11.317818) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:40:13.195709 run osmo-stp_10.42.42.5(pid=3723): stderr: | [0;m[38;5;43m20221212224011512 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224011512 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224011512 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224011513 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224011513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224011513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224011513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:40:13.354265 run patchelf(pid=3726): Terminating (SIGINT) 22:40:13.537217 run patchelf(pid=3726): Terminated: ok {rc=0} 22:40:13.668747 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=3723): Process ended prematurely: osmo-stp_10.42.42.5(pid=3723) [trial-2383↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3723)] [trial-2383↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 22:40:13.678923 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 22:40:13.707133 run osmo-hlr_10.42.42.2(pid=3720): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3720)] 22:40:13.757076 run osmo-hlr_10.42.42.2(pid=3720): stdout: | (launched: 2022-12-12_22:40:10.306163) 22:40:13.808801 run osmo-hlr_10.42.42.2(pid=3720): stderr: | [0;m[1;31m20221212224010507 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212224010507 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212224010507 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212224010507 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212224010507 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212224010507 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212224010518 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212224010526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212224010526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212224010526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:40:13.861153 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3713): Terminating (SIGTERM) 22:40:13.902696 run iperf3-srv_10.42.42.10(pid=3714): Terminating (SIGTERM) 22:40:13.944529 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3715): Terminating (SIGTERM) 22:40:13.987037 run iperf3-srv_10.42.42.10(pid=3716): Terminating (SIGTERM) 22:40:14.028744 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3719): Terminating (SIGTERM) 22:40:14.070482 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3722): Terminating (SIGTERM) 22:40:14.112104 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3725): Terminating (SIGTERM) 22:40:14.153855 --- ParallelTerminationStrategy: PID 3713 died... 22:40:14.173826 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3713): Terminated: ok {rc=0} 22:40:14.219809 --- ParallelTerminationStrategy: PID 3714 died... 22:40:14.239071 run iperf3-srv_10.42.42.10(pid=3714): Terminated {rc=256} 22:40:14.284889 --- ParallelTerminationStrategy: PID 3715 died... 22:40:14.304818 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3715): Terminated: ok {rc=0} 22:40:14.350942 --- ParallelTerminationStrategy: PID 3716 died... 22:40:14.370177 run iperf3-srv_10.42.42.10(pid=3716): Terminated {rc=256} 22:40:14.415469 --- ParallelTerminationStrategy: PID 3719 died... 22:40:14.434771 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3719): Terminated: ok {rc=0} 22:40:14.480391 --- ParallelTerminationStrategy: PID 3722 died... 22:40:14.499775 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3722): Terminated: ok {rc=0} 22:40:14.545432 --- ParallelTerminationStrategy: PID 3725 died... 22:40:14.565471 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3725): Terminated: ok {rc=0} 22:40:14.652146 bus /gobi_0: Setting Powered False 22:40:15.748537 bus /gobi_0: Setting Powered False 22:40:16.869286 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 22:40:18.033627 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:40:18.045793 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:40:18.121506 tst iperf3.py: using LAC 31991 22:40:18.254486 tst iperf3.py: using RAC 116 22:40:18.382388 tst iperf3.py: using CellId 31991 22:40:18.511651 tst iperf3.py: using BVCI 31992 22:40:18.631463 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:40:18.643024 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:40:18.654352 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:40:18.665776 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:40:18.677048 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:40:18.688303 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:40:18.699819 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:40:18.710988 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:40:18.722437 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:40:18.838549 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:40:19.059323 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:40:19.385591 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3727): Launched 22:40:19.669826 run iperf3-srv_10.42.42.10(pid=3728): Launched 22:40:19.791677 tst iperf3.py:8: start network... 22:40:20.011184 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:40:20.514668 run create_hlr_db(pid=3729): Launched 22:40:20.646073 bus /gobi_6: Setting Powered False 22:40:21.709962 run create_hlr_db(pid=3729): Terminated: ok {rc=0} 22:40:22.143431 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3731): Launched 22:40:22.448165 run osmo-hlr_10.42.42.2(pid=3732): Launched 22:40:22.566107 run osmo-stp_10.42.42.5: Starting osmo-stp 22:40:23.107089 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3734): Launched 22:40:23.411862 run osmo-stp_10.42.42.5(pid=3735): Launched 22:40:23.529342 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:40:24.056212 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3737): Launched 22:40:24.173833 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:40:24.432540 run patchelf(pid=3738): Launched 22:40:24.603146 run osmo-stp_10.42.42.5(pid=3735): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3735)] 22:40:24.732394 run osmo-stp_10.42.42.5(pid=3735): stdout: | (launched: 2022-12-12_22:40:23.356403) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:40:24.863077 run osmo-stp_10.42.42.5(pid=3735): stderr: | [0;m[38;5;43m20221212224023525 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224023525 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224023526 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224023526 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224023526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224023526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224023527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:40:24.994062 run osmo-stp_10.42.42.5(pid=3735): stdout: | (launched: 2022-12-12_22:40:23.356403) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:40:25.119810 run osmo-stp_10.42.42.5(pid=3735): stderr: | [0;m[38;5;43m20221212224023525 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224023525 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224023526 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224023526 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224023526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224023526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224023527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:40:25.268640 run patchelf(pid=3738): Terminating (SIGINT) 22:40:25.442635 run patchelf(pid=3738): Terminated: ok {rc=0} 22:40:25.567651 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3735): Process ended prematurely: osmo-stp_10.42.42.5(pid=3735) [trial-2383↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3735)] [trial-2383↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8] 22:40:25.577121 tst iperf3.py:8: Test FAILED (7.6 sec) 22:40:25.604319 run osmo-hlr_10.42.42.2(pid=3732): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3732)] 22:40:25.652244 run osmo-hlr_10.42.42.2(pid=3732): stdout: | (launched: 2022-12-12_22:40:22.392632) 22:40:25.701465 run osmo-hlr_10.42.42.2(pid=3732): stderr: | [0;m[1;31m20221212224022570 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212224022570 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212224022570 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212224022570 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212224022570 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212224022570 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212224022585 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212224022596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212224022596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212224022596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:40:25.751058 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3727): Terminating (SIGTERM) 22:40:25.791019 run iperf3-srv_10.42.42.10(pid=3728): Terminating (SIGTERM) 22:40:25.831025 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3731): Terminating (SIGTERM) 22:40:25.870937 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3734): Terminating (SIGTERM) 22:40:25.910785 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3737): Terminating (SIGTERM) 22:40:25.950307 --- ParallelTerminationStrategy: PID 3727 died... 22:40:25.969645 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3727): Terminated: ok {rc=0} 22:40:26.014393 --- ParallelTerminationStrategy: PID 3728 died... 22:40:26.033023 run iperf3-srv_10.42.42.10(pid=3728): Terminated {rc=256} 22:40:26.077128 --- ParallelTerminationStrategy: PID 3731 died... 22:40:26.095463 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3731): Terminated: ok {rc=0} 22:40:26.139580 --- ParallelTerminationStrategy: PID 3734 died... 22:40:26.157967 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3734): Terminated: ok {rc=0} 22:40:26.202520 --- ParallelTerminationStrategy: PID 3737 died... 22:40:26.221340 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3737): Terminated: ok {rc=0} 22:40:26.305191 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 22:40:27.453380 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:40:27.465493 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:40:27.551883 tst iperf3m4.py: using LAC 31992 22:40:27.681457 tst iperf3m4.py: using RAC 117 22:40:27.809245 tst iperf3m4.py: using CellId 31992 22:40:27.936838 tst iperf3m4.py: using BVCI 31993 22:40:28.055761 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:40:28.067361 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:40:28.078659 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:40:28.090473 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:40:28.101771 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:40:28.112928 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:40:28.124404 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:40:28.135696 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:40:28.147099 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:40:28.266562 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:40:28.387130 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:40:28.502554 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:40:28.620346 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:40:28.826988 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:40:29.133329 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3739): Launched 22:40:29.398708 run iperf3-srv_10.42.42.10(pid=3740): Launched 22:40:29.513602 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:40:29.718665 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:40:30.024932 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3741): Launched 22:40:30.291896 run iperf3-srv_10.42.42.10(pid=3742): Launched 22:40:30.406412 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:40:30.611415 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:40:30.933433 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3743): Launched 22:40:31.240253 run iperf3-srv_10.42.42.10(pid=3744): Launched 22:40:31.399967 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:40:31.628854 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:40:31.975400 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3745): Launched 22:40:32.274769 run iperf3-srv_10.42.42.10(pid=3746): Launched 22:40:32.390016 tst iperf3m4.py:8: start network... 22:40:32.594063 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:40:33.065621 run create_hlr_db(pid=3747): Launched 22:40:33.182075 bus /gobi_6: Setting Powered False 22:40:34.242122 run create_hlr_db(pid=3747): Terminated: ok {rc=0} 22:40:34.685333 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3749): Launched 22:40:35.010039 run osmo-hlr_10.42.42.2(pid=3750): Launched 22:40:35.135140 run osmo-stp_10.42.42.5: Starting osmo-stp 22:40:35.693434 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3752): Launched 22:40:36.017250 run osmo-stp_10.42.42.5(pid=3753): Launched 22:40:36.141501 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:40:36.700321 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3755): Launched 22:40:36.823687 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:40:37.097323 run patchelf(pid=3756): Launched 22:40:37.278053 run osmo-stp_10.42.42.5(pid=3753): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3753)] 22:40:37.415204 run osmo-stp_10.42.42.5(pid=3753): stdout: | (launched: 2022-12-12_22:40:35.958396) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:40:37.553792 run osmo-stp_10.42.42.5(pid=3753): stderr: | [0;m[38;5;43m20221212224036152 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224036152 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224036152 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224036152 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224036155 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224036155 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224036155 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:40:37.692006 run osmo-stp_10.42.42.5(pid=3753): stdout: | (launched: 2022-12-12_22:40:35.958396) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:40:37.824921 run osmo-stp_10.42.42.5(pid=3753): stderr: | [0;m[38;5;43m20221212224036152 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224036152 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224036152 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224036152 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224036155 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224036155 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224036155 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:40:37.982158 run patchelf(pid=3756): Terminating (SIGINT) 22:40:38.165620 run patchelf(pid=3756): Terminated: ok {rc=0} 22:40:38.296923 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3753): Process ended prematurely: osmo-stp_10.42.42.5(pid=3753) [trial-2383↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3753)] [trial-2383↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8] 22:40:38.307177 tst iperf3m4.py:8: Test FAILED (10.9 sec) 22:40:38.336120 run osmo-hlr_10.42.42.2(pid=3750): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3750)] 22:40:38.385921 run osmo-hlr_10.42.42.2(pid=3750): stdout: | (launched: 2022-12-12_22:40:34.951306) 22:40:38.437614 run osmo-hlr_10.42.42.2(pid=3750): stderr: | [0;m[1;31m20221212224035150 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212224035150 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212224035150 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212224035150 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212224035150 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212224035150 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212224035173 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212224035182 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212224035182 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212224035182 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:40:38.489545 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3739): Terminating (SIGTERM) 22:40:38.531166 run iperf3-srv_10.42.42.10(pid=3740): Terminating (SIGTERM) 22:40:38.572639 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3741): Terminating (SIGTERM) 22:40:38.614262 run iperf3-srv_10.42.42.10(pid=3742): Terminating (SIGTERM) 22:40:38.655812 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3743): Terminating (SIGTERM) 22:40:38.697438 run iperf3-srv_10.42.42.10(pid=3744): Terminating (SIGTERM) 22:40:38.738784 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3745): Terminating (SIGTERM) 22:40:38.780278 run iperf3-srv_10.42.42.10(pid=3746): Terminating (SIGTERM) 22:40:38.821695 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3749): Terminating (SIGTERM) 22:40:38.863260 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3752): Terminating (SIGTERM) 22:40:38.904785 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3755): Terminating (SIGTERM) 22:40:38.947134 --- ParallelTerminationStrategy: PID 3739 died... 22:40:38.966965 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3739): Terminated: ok {rc=0} 22:40:39.012665 --- ParallelTerminationStrategy: PID 3740 died... 22:40:39.031809 run iperf3-srv_10.42.42.10(pid=3740): Terminated {rc=256} 22:40:39.077220 --- ParallelTerminationStrategy: PID 3741 died... 22:40:39.096436 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3741): Terminated: ok {rc=0} 22:40:39.141962 --- ParallelTerminationStrategy: PID 3742 died... 22:40:39.161349 run iperf3-srv_10.42.42.10(pid=3742): Terminated {rc=256} 22:40:39.206581 --- ParallelTerminationStrategy: PID 3743 died... 22:40:39.225806 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3743): Terminated: ok {rc=0} 22:40:39.271419 --- ParallelTerminationStrategy: PID 3744 died... 22:40:39.290451 run iperf3-srv_10.42.42.10(pid=3744): Terminated {rc=256} 22:40:39.335927 --- ParallelTerminationStrategy: PID 3745 died... 22:40:39.355300 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3745): Terminated: ok {rc=0} 22:40:39.400625 --- ParallelTerminationStrategy: PID 3746 died... 22:40:39.419946 run iperf3-srv_10.42.42.10(pid=3746): Terminated {rc=256} 22:40:39.465569 --- ParallelTerminationStrategy: PID 3749 died... 22:40:39.484801 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3749): Terminated: ok {rc=0} 22:40:39.529864 --- ParallelTerminationStrategy: PID 3752 died... 22:40:39.549046 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3752): Terminated: ok {rc=0} 22:40:39.594500 --- ParallelTerminationStrategy: PID 3755 died... 22:40:39.613853 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3755): Terminated: ok {rc=0} 22:40:39.701651 bus /gobi_4: Setting Powered False 22:40:40.801379 bus /gobi_4: Setting Powered False 22:40:41.916397 bus /gobi_1: Setting Powered False 22:40:43.015099 bus /gobi_1: Setting Powered False 22:40:44.129978 bus /gobi_0: Setting Powered False 22:40:45.227302 bus /gobi_0: Setting Powered False 22:40:46.345070 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 22:40:47.446351 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:40:47.458069 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:40:47.529411 tst ping.py: using LAC 31993 22:40:47.648815 tst ping.py: using RAC 118 22:40:47.766057 tst ping.py: using CellId 31993 22:40:47.885780 tst ping.py: using BVCI 31994 22:40:47.994264 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:40:48.005362 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:40:48.016084 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:40:48.027144 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:40:48.038304 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:40:48.049418 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:40:48.060928 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:40:48.071686 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:40:48.186422 tst ping.py:19: start network... 22:40:48.386655 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:40:48.846261 run create_hlr_db(pid=3757): Launched 22:40:48.958845 bus /gobi_6: Setting Powered False 22:40:50.018560 run create_hlr_db(pid=3757): Terminated: ok {rc=0} 22:40:50.434552 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3759): Launched 22:40:50.732439 run osmo-hlr_10.42.42.2(pid=3760): Launched 22:40:50.846283 run osmo-stp_10.42.42.5: Starting osmo-stp 22:40:51.381920 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3762): Launched 22:40:51.679150 run osmo-stp_10.42.42.5(pid=3763): Launched 22:40:51.793730 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:40:52.308654 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3765): Launched 22:40:52.423103 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:40:52.674366 run patchelf(pid=3766): Launched 22:40:52.839995 run osmo-stp_10.42.42.5(pid=3763): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3763)] 22:40:52.966476 run osmo-stp_10.42.42.5(pid=3763): stdout: | (launched: 2022-12-12_22:40:51.624818) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:40:53.094201 run osmo-stp_10.42.42.5(pid=3763): stderr: | [0;m[38;5;43m20221212224051792 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224051792 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224051793 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224051793 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224051795 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224051795 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224051795 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:40:53.222053 run osmo-stp_10.42.42.5(pid=3763): stdout: | (launched: 2022-12-12_22:40:51.624818) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:40:53.344089 run osmo-stp_10.42.42.5(pid=3763): stderr: | [0;m[38;5;43m20221212224051792 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224051792 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224051793 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224051793 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224051795 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224051795 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224051795 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:40:53.488624 run patchelf(pid=3766): Terminating (SIGINT) 22:40:53.658085 run patchelf(pid=3766): Terminated: ok {rc=0} 22:40:53.779957 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=3763): Process ended prematurely: osmo-stp_10.42.42.5(pid=3763) [trial-2383↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3763)] [trial-2383↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22] 22:40:53.788689 tst ping.py:22: Test FAILED (6.3 sec) 22:40:53.815396 run osmo-hlr_10.42.42.2(pid=3760): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3760)] 22:40:53.862522 run osmo-hlr_10.42.42.2(pid=3760): stdout: | (launched: 2022-12-12_22:40:50.678316) 22:40:53.911000 run osmo-hlr_10.42.42.2(pid=3760): stderr: | [0;m[1;31m20221212224050855 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212224050855 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212224050855 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212224050856 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212224050856 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212224050856 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212224050871 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212224050881 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212224050881 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212224050881 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:40:53.959865 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3759): Terminating (SIGTERM) 22:40:53.999008 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3762): Terminating (SIGTERM) 22:40:54.038213 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3765): Terminating (SIGTERM) 22:40:54.077538 --- ParallelTerminationStrategy: PID 3759 died... 22:40:54.096108 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3759): Terminated: ok {rc=0} 22:40:54.140132 --- ParallelTerminationStrategy: PID 3762 died... 22:40:54.158295 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3762): Terminated: ok {rc=0} 22:40:54.201425 --- ParallelTerminationStrategy: PID 3765 died... 22:40:54.219325 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3765): Terminated: ok {rc=0} 22:40:54.304753 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 22:40:55.392877 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:40:55.404752 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:40:55.476838 tst ping_idle_ping.py: using LAC 31994 22:40:55.597788 tst ping_idle_ping.py: using RAC 119 22:40:55.728550 tst ping_idle_ping.py: using CellId 31994 22:40:55.855734 tst ping_idle_ping.py: using BVCI 31995 22:40:55.973693 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:40:55.985652 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:40:55.997239 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:40:56.009206 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:40:56.021085 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:40:56.033021 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:40:56.045163 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:40:56.056910 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:40:56.178522 tst ping_idle_ping.py:24: start network... 22:40:56.396789 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:40:56.893451 run create_hlr_db(pid=3767): Launched 22:40:57.023888 bus /gobi_6: Setting Powered False 22:40:58.086843 run create_hlr_db(pid=3767): Terminated: ok {rc=0} 22:40:58.532489 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3769): Launched 22:40:58.851396 run osmo-hlr_10.42.42.2(pid=3770): Launched 22:40:58.973520 run osmo-stp_10.42.42.5: Starting osmo-stp 22:40:59.530372 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3772): Launched 22:40:59.849369 run osmo-stp_10.42.42.5(pid=3773): Launched 22:40:59.971696 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:41:00.528712 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3775): Launched 22:41:00.651507 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:41:00.949664 run patchelf(pid=3776): Launched 22:41:01.144510 run osmo-stp_10.42.42.5(pid=3773): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3773)] 22:41:01.284883 run osmo-stp_10.42.42.5(pid=3773): stdout: | (launched: 2022-12-12_22:40:59.791829) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:41:01.425751 run osmo-stp_10.42.42.5(pid=3773): stderr: | [0;m[38;5;43m20221212224059983 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224059983 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224059984 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224059984 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224059985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224059985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224059985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:41:01.566179 run osmo-stp_10.42.42.5(pid=3773): stdout: | (launched: 2022-12-12_22:40:59.791829) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:41:01.699974 run osmo-stp_10.42.42.5(pid=3773): stderr: | [0;m[38;5;43m20221212224059983 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224059983 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224059984 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224059984 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224059985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224059985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224059985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:41:01.859897 run patchelf(pid=3776): Terminating (SIGINT) 22:41:02.044942 run patchelf(pid=3776): Terminated: ok {rc=0} 22:41:02.177644 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=3773): Process ended prematurely: osmo-stp_10.42.42.5(pid=3773) [trial-2383↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3773)] [trial-2383↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 22:41:02.187312 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 22:41:02.215500 run osmo-hlr_10.42.42.2(pid=3770): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3770)] 22:41:02.265600 run osmo-hlr_10.42.42.2(pid=3770): stdout: | (launched: 2022-12-12_22:40:58.793652) 22:41:02.318243 run osmo-hlr_10.42.42.2(pid=3770): stderr: | [0;m[1;31m20221212224058991 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212224058991 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212224058991 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212224058991 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212224058991 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212224058991 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212224059004 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212224059012 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212224059013 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212224059013 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:41:02.370898 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3769): Terminating (SIGTERM) 22:41:02.412717 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3772): Terminating (SIGTERM) 22:41:02.454619 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3775): Terminating (SIGTERM) 22:41:02.496450 --- ParallelTerminationStrategy: PID 3769 died... 22:41:02.516652 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3769): Terminated: ok {rc=0} 22:41:02.562821 --- ParallelTerminationStrategy: PID 3772 died... 22:41:02.582462 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3772): Terminated: ok {rc=0} 22:41:02.628441 --- ParallelTerminationStrategy: PID 3775 died... 22:41:02.647942 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3775): Terminated: ok {rc=0} 22:41:02.735512 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2383 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 22:41:04.049429 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:41:04.057103 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 22:41:04.091785 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 22:41:04.127036 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 22:41:04.182233 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 22:41:04.216696 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 22:41:04.251556 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 22:41:04.810002 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2383 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 22:41:04.815195 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:41:04.826966 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 22:41:04.898534 tst switch_tch_pdch.py: using LAC 31995 22:41:05.025381 tst switch_tch_pdch.py: using RAC 120 22:41:05.152041 tst switch_tch_pdch.py: using CellId 31995 22:41:05.277113 tst switch_tch_pdch.py: using BVCI 31996 22:41:05.393189 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:41:05.404780 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:41:05.416305 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:41:05.427937 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:41:05.439456 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:41:05.450876 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:41:05.462536 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:41:05.474185 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:41:05.591043 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:41:05.708204 tst switch_tch_pdch.py:51: start network... 22:41:05.909589 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:41:06.372841 run create_hlr_db(pid=3780): Launched 22:41:06.488534 bus /gobi_6: Setting Powered False 22:41:07.547894 run create_hlr_db(pid=3780): Terminated: ok {rc=0} 22:41:07.985090 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3782): Launched 22:41:08.303852 run osmo-hlr_10.42.42.2(pid=3783): Launched 22:41:08.426948 run osmo-stp_10.42.42.5: Starting osmo-stp 22:41:08.975489 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3785): Launched 22:41:09.293352 run osmo-stp_10.42.42.5(pid=3786): Launched 22:41:09.414999 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:41:09.964898 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3788): Launched 22:41:10.086245 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:41:10.354836 run patchelf(pid=3789): Launched 22:41:10.532227 run osmo-stp_10.42.42.5(pid=3786): ERR: Terminated: ERROR {rc=1} [trial-2383↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3786)] 22:41:10.667450 run osmo-stp_10.42.42.5(pid=3786): stdout: | (launched: 2022-12-12_22:41:09.235411) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:41:10.803723 run osmo-stp_10.42.42.5(pid=3786): stderr: | [0;m[38;5;43m20221212224109427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224109427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224109427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224109427 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224109430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224109430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224109430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:41:10.939956 run osmo-stp_10.42.42.5(pid=3786): stdout: | (launched: 2022-12-12_22:41:09.235411) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:41:11.071024 run osmo-stp_10.42.42.5(pid=3786): stderr: | [0;m[38;5;43m20221212224109427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224109427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224109427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224109427 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224109430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224109430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224109430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:41:11.225105 run patchelf(pid=3789): Terminating (SIGINT) 22:41:11.405301 run patchelf(pid=3789): Terminated: ok {rc=0} 22:41:11.534535 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=3786): Process ended prematurely: osmo-stp_10.42.42.5(pid=3786) [trial-2383↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3786)] [trial-2383↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 22:41:11.543955 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 22:41:11.571850 run osmo-hlr_10.42.42.2(pid=3783): ERR: Terminated: ERROR {rc=237} [trial-2383↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3783)] 22:41:11.621505 run osmo-hlr_10.42.42.2(pid=3783): stdout: | (launched: 2022-12-12_22:41:08.246198) 22:41:11.672851 run osmo-hlr_10.42.42.2(pid=3783): stderr: | [0;m[1;31m20221212224108444 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212224108444 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212224108444 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212224108444 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212224108444 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212224108444 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212224108461 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212224108471 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212224108471 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212224108471 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:41:11.724572 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3782): Terminating (SIGTERM) 22:41:11.765923 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3785): Terminating (SIGTERM) 22:41:11.807187 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3788): Terminating (SIGTERM) 22:41:11.848727 --- ParallelTerminationStrategy: PID 3782 died... 22:41:11.868604 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3782): Terminated: ok {rc=0} 22:41:11.914335 --- ParallelTerminationStrategy: PID 3785 died... 22:41:11.933542 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3785): Terminated: ok {rc=0} 22:41:11.978931 --- ParallelTerminationStrategy: PID 3788 died... 22:41:11.998232 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3788): Terminated: ok {rc=0} 22:41:12.085851 bus /gobi_0: Setting Powered False 22:41:13.183001 bus /gobi_0: Setting Powered False 22:41:14.297556 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2383 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 22:41:15.550629 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:41:15.557625 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 22:41:15.592713 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 22:41:15.626914 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 22:41:15.677876 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 22:41:15.711285 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 22:41:15.745692 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 22:41:16.329266 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2383 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 22:41:16.335840 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:41:16.350955 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 22:41:16.434822 tst switch_tch_pdch.py: using LAC 31996 22:41:16.590299 tst switch_tch_pdch.py: using RAC 121 22:41:16.723017 tst switch_tch_pdch.py: using CellId 31996 22:41:16.849310 tst switch_tch_pdch.py: using BVCI 31997 22:41:16.962004 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:41:16.974094 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:41:16.986130 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:41:17.000347 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:41:17.013589 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:41:17.025557 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:41:17.038282 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:41:17.051500 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 22:41:17.172734 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 22:41:17.291892 tst switch_tch_pdch.py:51: start network... 22:41:17.493231 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:41:17.929313 run create_hlr_db(pid=3793): Launched 22:41:18.043934 bus /gobi_6: Setting Powered False 22:41:19.104035 run create_hlr_db(pid=3793): Terminated: ok {rc=0} 22:41:19.495080 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3795): Launched 22:41:19.792923 run osmo-hlr_10.42.42.2(pid=3796): Launched 22:41:19.907350 run osmo-stp_10.42.42.5: Starting osmo-stp 22:41:20.394058 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3798): Launched 22:41:20.692022 run osmo-stp_10.42.42.5(pid=3799): Launched 22:41:20.806028 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:41:21.306514 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3801): Launched 22:41:21.421130 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:41:21.672840 run patchelf(pid=3802): Launched 22:41:21.839091 run osmo-stp_10.42.42.5(pid=3799): ERR: Terminated: ERROR {rc=1} [trial-2383↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3799)] 22:41:21.966165 run osmo-stp_10.42.42.5(pid=3799): stdout: | (launched: 2022-12-12_22:41:20.637574) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:41:22.094234 run osmo-stp_10.42.42.5(pid=3799): stderr: | [0;m[38;5;43m20221212224120809 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224120809 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224120810 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224120810 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224120811 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224120811 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224120811 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:41:22.222238 run osmo-stp_10.42.42.5(pid=3799): stdout: | (launched: 2022-12-12_22:41:20.637574) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:41:22.344461 run osmo-stp_10.42.42.5(pid=3799): stderr: | [0;m[38;5;43m20221212224120809 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224120809 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224120810 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224120810 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224120811 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224120811 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224120811 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:41:22.489905 run patchelf(pid=3802): Terminating (SIGINT) 22:41:22.659398 run patchelf(pid=3802): Terminated: ok {rc=0} 22:41:22.781144 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=3799): Process ended prematurely: osmo-stp_10.42.42.5(pid=3799) [trial-2383↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3799)] [trial-2383↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 22:41:22.789811 tst switch_tch_pdch.py:54: Test FAILED (6.4 sec) 22:41:22.816623 run osmo-hlr_10.42.42.2(pid=3796): ERR: Terminated: ERROR {rc=237} [trial-2383↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3796)] 22:41:22.863905 run osmo-hlr_10.42.42.2(pid=3796): stdout: | (launched: 2022-12-12_22:41:19.738971) 22:41:22.912868 run osmo-hlr_10.42.42.2(pid=3796): stderr: | [0;m[1;31m20221212224119914 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212224119914 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212224119914 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212224119914 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212224119914 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212224119914 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212224119950 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212224119960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212224119961 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212224119961 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:41:22.962136 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3795): Terminating (SIGTERM) 22:41:23.001527 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3798): Terminating (SIGTERM) 22:41:23.041050 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3801): Terminating (SIGTERM) 22:41:23.080536 --- ParallelTerminationStrategy: PID 3795 died... 22:41:23.099302 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3795): Terminated: ok {rc=0} 22:41:23.143706 --- ParallelTerminationStrategy: PID 3798 died... 22:41:23.161941 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3798): Terminated: ok {rc=0} 22:41:23.205354 --- ParallelTerminationStrategy: PID 3801 died... 22:41:23.223424 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3801): Terminated: ok {rc=0} 22:41:23.308477 bus /gobi_0: Setting Powered False 22:41:24.407224 bus /gobi_0: Setting Powered False 22:41:25.522003 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2383 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 nitb_sms:trx-umtrx --------------------------------------------------------------------- 22:41:26.773570 tst nitb_sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:41:26.777278 tst nitb_sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 22:41:26.811102 tst nitb_sms:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 22:41:26.817777 tst nitb_sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 22:41:26.868622 tst nitb_sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 22:41:26.901104 tst nitb_sms:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 22:41:26.907661 tst nitb_sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 22:41:27.445274 tst nitb_sms:trx-umtrx: RESERVED RESOURCES for nitb_sms: bts UmTRX ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 nitb_sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 22:41:27.450097 tst nitb_sms:trx-umtrx: Using 1 x ip_address (candidates: 1) 22:41:27.460601 tst nitb_sms:trx-umtrx: Using 1 x bts (candidates: 1) 22:41:27.507555 tst mo_mt_sms.py: using LAC 31997 22:41:27.625840 tst mo_mt_sms.py: using RAC 122 22:41:27.752487 tst mo_mt_sms.py: using CellId 31997 22:41:27.879951 tst mo_mt_sms.py: using BVCI 31998 22:41:27.994672 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 22:41:28.109859 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 22:41:28.226840 tst mo_mt_sms.py:9: start nitb and bts... 22:41:28.444429 run osmo-nitb_10.42.42.2: Starting osmo-nitb 22:41:29.094299 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3806): Launched 22:41:29.412658 run osmo-nitb_10.42.42.2(pid=3807): Launched 22:41:29.589046 run osmo-nitb_10.42.42.2(pid=3807): ERR: Terminated: ERROR {rc=2} [trial-2383↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3807)] 22:41:29.732396 run osmo-nitb_10.42.42.2(pid=3807): stdout: | (launched: 2022-12-12_22:41:29.355361) 22:41:29.876935 run osmo-nitb_10.42.42.2(pid=3807): stderr: | (launched: 2022-12-12_22:41:29.402763) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:41:30.021795 run osmo-nitb_10.42.42.2(pid=3807): stdout: | (launched: 2022-12-12_22:41:29.355361) 22:41:30.160057 run osmo-nitb_10.42.42.2(pid=3807): stderr: | (launched: 2022-12-12_22:41:29.402763) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fa469b2b268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=3807): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3807) [trial-2383↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3807)] 22:41:30.532505 tst osmo-nitb_10.42.42.2(pid=3807): stdout: | (launched: 2022-12-12_22:41:29.355361) 22:41:30.662175 tst osmo-nitb_10.42.42.2(pid=3807): stderr: | (launched: 2022-12-12_22:41:29.402763) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:41:30.814634 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=3807): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3807) [trial-2383↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3807)] [trial-2383↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11] 22:41:30.823397 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 22:41:30.838179 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3806): Terminating (SIGTERM) 22:41:31.054691 --- ParallelTerminationStrategy: PID 3806 died... 22:41:31.074670 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3806): Terminated: ok {rc=0} 22:41:31.163223 bus /sierra_3: Setting Powered False 22:41:32.262345 bus /sierra_3: Setting Powered False 22:41:33.376793 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 nitb_sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 sms:trx-umtrx --------------------------------------------------------------------- 22:41:34.571282 tst sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:41:34.575334 tst sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 22:41:34.608460 tst sms:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 22:41:34.635037 tst sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 22:41:34.687171 tst sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 22:41:34.719690 tst sms:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 22:41:34.745801 tst sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 22:41:35.290140 tst sms:trx-umtrx: RESERVED RESOURCES for sms: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 22:41:35.295056 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:41:35.305542 tst sms:trx-umtrx: Using 1 x bts (candidates: 1) 22:41:35.354705 tst mo_mt_sms.py: using LAC 31998 22:41:35.471864 tst mo_mt_sms.py: using RAC 123 22:41:35.587576 tst mo_mt_sms.py: using CellId 31998 22:41:35.702932 tst mo_mt_sms.py: using BVCI 31999 22:41:35.820029 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:41:35.831312 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:41:35.842484 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:41:35.853512 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:41:35.864389 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:41:35.875226 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 22:41:35.993271 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 22:41:36.109531 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:41:36.602830 run create_hlr_db(pid=3811): Launched 22:41:36.731987 bus /sierra_2: Setting Powered False 22:41:37.794261 run create_hlr_db(pid=3811): Terminated: ok {rc=0} 22:41:38.236757 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3813): Launched 22:41:38.553919 run osmo-hlr_10.42.42.2(pid=3814): Launched 22:41:38.675559 run osmo-stp_10.42.42.5: Starting osmo-stp 22:41:39.222876 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3816): Launched 22:41:39.542311 run osmo-stp_10.42.42.5(pid=3817): Launched 22:41:39.664113 run osmo-msc_10.42.42.6: Starting osmo-msc 22:41:40.240558 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3819): Launched 22:41:40.558749 run osmo-msc_10.42.42.6(pid=3820): Launched 22:41:40.737828 run osmo-stp_10.42.42.5(pid=3817): ERR: Terminated: ERROR {rc=1} [trial-2383↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3817)] 22:41:40.873182 run osmo-stp_10.42.42.5(pid=3817): stdout: | (launched: 2022-12-12_22:41:39.484480) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:41:41.009155 run osmo-stp_10.42.42.5(pid=3817): stderr: | [0;m[38;5;43m20221212224139680 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224139680 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224139680 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224139681 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224139681 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224139681 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224139681 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:41:41.143792 run osmo-stp_10.42.42.5(pid=3817): stdout: | (launched: 2022-12-12_22:41:39.484480) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:41:41.271091 run osmo-stp_10.42.42.5(pid=3817): stderr: | [0;m[38;5;43m20221212224139680 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224139680 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224139680 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224139681 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224139681 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224139681 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224139681 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:41:41.424049 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=3817): Process ended prematurely: osmo-stp_10.42.42.5(pid=3817) [trial-2383↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3817)] [trial-2383↪sms:trx-umtrx↪mo_mt_sms.py:16] 22:41:41.432933 tst mo_mt_sms.py:16: Test FAILED (6.1 sec) 22:41:41.460056 run osmo-hlr_10.42.42.2(pid=3814): ERR: Terminated: ERROR {rc=237} [trial-2383↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3814)] 22:41:41.509435 run osmo-hlr_10.42.42.2(pid=3814): stdout: | (launched: 2022-12-12_22:41:38.496373) 22:41:41.560719 run osmo-hlr_10.42.42.2(pid=3814): stderr: | [0;m[1;31m20221212224138696 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212224138696 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212224138696 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212224138696 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212224138696 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212224138696 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212224138727 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/sms:trx-umtrx/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212224138737 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212224138737 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212224138737 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:41:41.632189 run osmo-msc_10.42.42.6(pid=3820): ERR: Terminated: ERROR {rc=2} [trial-2383↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3820)] 22:41:41.681952 run osmo-msc_10.42.42.6(pid=3820): stdout: | (launched: 2022-12-12_22:41:40.501368) 22:41:41.733198 run osmo-msc_10.42.42.6(pid=3820): stderr: | [0;m[38;5;43m20221212224140825 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212224140825 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f61a084ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212224140825 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212224140825 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212224140825 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212224140825 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212224140827 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212224140827 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212224140827 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212224140828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:41:41.784601 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3813): Terminating (SIGTERM) 22:41:41.825923 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3816): Terminating (SIGTERM) 22:41:41.867200 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3819): Terminating (SIGTERM) 22:41:41.908794 --- ParallelTerminationStrategy: PID 3813 died... 22:41:41.928577 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3813): Terminated: ok {rc=0} 22:41:41.974043 --- ParallelTerminationStrategy: PID 3816 died... 22:41:41.993384 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3816): Terminated: ok {rc=0} 22:41:42.038614 --- ParallelTerminationStrategy: PID 3819 died... 22:41:42.058114 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3819): Terminated: ok {rc=0} 22:41:42.144925 bus /sierra_3: Setting Powered False 22:41:43.242934 bus /sierra_3: Setting Powered False 22:41:44.357093 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 nitb_ussd:trx-umtrx --------------------------------------------------------------------- 22:41:45.578586 tst nitb_ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:41:45.582630 tst nitb_ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 22:41:45.615157 tst nitb_ussd:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 22:41:45.621784 tst nitb_ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 22:41:45.657573 tst nitb_ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 22:41:45.690948 tst nitb_ussd:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 22:41:45.698130 tst nitb_ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 22:41:46.212407 tst nitb_ussd:trx-umtrx: RESERVED RESOURCES for nitb_ussd: bts UmTRX ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2383 nitb_ussd:trx-umtrx assert_extension.py ---------------------------------------------- 22:41:46.220338 tst nitb_ussd:trx-umtrx: Using 1 x ip_address (candidates: 1) 22:41:46.232112 tst nitb_ussd:trx-umtrx: Using 1 x bts (candidates: 1) 22:41:46.282366 tst assert_extension.py: using LAC 31999 22:41:46.402303 tst assert_extension.py: using RAC 124 22:41:46.529777 tst assert_extension.py: using CellId 31999 22:41:46.677789 tst assert_extension.py: using BVCI 32000 22:41:46.790778 tst nitb_ussd:trx-umtrx: Using 1 x modem (candidates: 1) 22:41:46.936546 tst assert_extension.py:10: start nitb and bts... 22:41:47.156818 run osmo-nitb_10.42.42.2: Starting osmo-nitb 22:41:47.810755 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3825): Launched 22:41:48.128710 run osmo-nitb_10.42.42.2(pid=3826): Launched 22:41:48.305411 run osmo-nitb_10.42.42.2(pid=3826): ERR: Terminated: ERROR {rc=2} [trial-2383↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3826)] 22:41:48.448468 run osmo-nitb_10.42.42.2(pid=3826): stdout: | (launched: 2022-12-12_22:41:48.071197) 22:41:48.592715 run osmo-nitb_10.42.42.2(pid=3826): stderr: | (launched: 2022-12-12_22:41:48.118616) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:41:48.737320 run osmo-nitb_10.42.42.2(pid=3826): stdout: | (launched: 2022-12-12_22:41:48.071197) 22:41:48.875554 run osmo-nitb_10.42.42.2(pid=3826): stderr: | (launched: 2022-12-12_22:41:48.118616) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fa469b2b268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=3826): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3826) [trial-2383↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3826)] 22:41:49.249354 tst osmo-nitb_10.42.42.2(pid=3826): stdout: | (launched: 2022-12-12_22:41:48.071197) 22:41:49.378523 tst osmo-nitb_10.42.42.2(pid=3826): stderr: | (launched: 2022-12-12_22:41:48.118616) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:41:49.530749 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=3826): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3826) [trial-2383↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3826)] [trial-2383↪nitb_ussd:trx-umtrx↪assert_extension.py:12] 22:41:49.539669 tst assert_extension.py:12: Test FAILED (3.3 sec) 22:41:49.546766 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3825): Terminating (SIGTERM) 22:41:49.756855 --- ParallelTerminationStrategy: PID 3825 died... 22:41:49.778112 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3825): Terminated: ok {rc=0} 22:41:49.865304 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 nitb_ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 ussd:trx-umtrx --------------------------------------------------------------------- 22:41:51.044244 tst ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:41:51.048392 tst ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 22:41:51.081342 tst ussd:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 22:41:51.108382 tst ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 22:41:51.143816 tst ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 22:41:51.176849 tst ussd:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 22:41:51.204123 tst ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 22:41:51.733229 tst ussd:trx-umtrx: RESERVED RESOURCES for ussd: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2383 ussd:trx-umtrx assert_extension.py ---------------------------------------------- 22:41:51.738312 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:41:51.749365 tst ussd:trx-umtrx: Using 1 x bts (candidates: 1) 22:41:51.798195 tst assert_extension.py: using LAC 32000 22:41:51.924010 tst assert_extension.py: using RAC 125 22:41:52.048632 tst assert_extension.py: using CellId 32000 22:41:52.173084 tst assert_extension.py: using BVCI 32001 22:41:52.288715 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:41:52.300092 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:41:52.311022 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:41:52.322391 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:41:52.334364 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:41:52.345843 tst ussd:trx-umtrx: Using 1 x modem (candidates: 1) 22:41:52.461883 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:41:52.924630 run create_hlr_db(pid=3830): Launched 22:41:53.039441 bus /sierra_2: Setting Powered False 22:41:54.098423 run create_hlr_db(pid=3830): Terminated: ok {rc=0} 22:41:54.534985 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3832): Launched 22:41:54.854894 run osmo-hlr_10.42.42.2(pid=3833): Launched 22:41:54.977335 run osmo-stp_10.42.42.5: Starting osmo-stp 22:41:55.535549 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3835): Launched 22:41:55.852679 run osmo-stp_10.42.42.5(pid=3836): Launched 22:41:55.974273 run osmo-msc_10.42.42.6: Starting osmo-msc 22:41:56.550291 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3838): Launched 22:41:56.868434 run osmo-msc_10.42.42.6(pid=3839): Launched 22:41:57.048306 run osmo-stp_10.42.42.5(pid=3836): ERR: Terminated: ERROR {rc=1} [trial-2383↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3836)] 22:41:57.183650 run osmo-stp_10.42.42.5(pid=3836): stdout: | (launched: 2022-12-12_22:41:55.794982) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:41:57.319628 run osmo-stp_10.42.42.5(pid=3836): stderr: | [0;m[38;5;43m20221212224155987 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224155987 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224155987 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224155987 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224155988 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224155988 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224155988 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:41:57.453995 run osmo-stp_10.42.42.5(pid=3836): stdout: | (launched: 2022-12-12_22:41:55.794982) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:41:57.580468 run osmo-stp_10.42.42.5(pid=3836): stderr: | [0;m[38;5;43m20221212224155987 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224155987 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224155987 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224155987 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224155988 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224155988 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224155988 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:41:57.731911 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=3836): Process ended prematurely: osmo-stp_10.42.42.5(pid=3836) [trial-2383↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3836)] [trial-2383↪ussd:trx-umtrx↪assert_extension.py:17] 22:41:57.740791 tst assert_extension.py:17: Test FAILED (6.0 sec) 22:41:57.767868 run osmo-hlr_10.42.42.2(pid=3833): ERR: Terminated: ERROR {rc=237} [trial-2383↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3833)] 22:41:57.817216 run osmo-hlr_10.42.42.2(pid=3833): stdout: | (launched: 2022-12-12_22:41:54.796850) 22:41:57.868362 run osmo-hlr_10.42.42.2(pid=3833): stderr: | [0;m[1;31m20221212224154995 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212224154995 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212224154995 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212224154995 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212224154995 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212224154995 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212224155008 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/ussd:trx-umtrx/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212224155016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212224155017 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212224155017 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:41:57.939484 run osmo-msc_10.42.42.6(pid=3839): ERR: Terminated: ERROR {rc=2} [trial-2383↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3839)] 22:41:57.988816 run osmo-msc_10.42.42.6(pid=3839): stdout: | (launched: 2022-12-12_22:41:56.810662) 22:41:58.039833 run osmo-msc_10.42.42.6(pid=3839): stderr: | [0;m[38;5;43m20221212224157135 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212224157135 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f287be92c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212224157135 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212224157135 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212224157135 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212224157135 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212224157137 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212224157138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212224157138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212224157138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:41:58.091262 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3832): Terminating (SIGTERM) 22:41:58.132500 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3835): Terminating (SIGTERM) 22:41:58.173962 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3838): Terminating (SIGTERM) 22:41:58.215647 --- ParallelTerminationStrategy: PID 3832 died... 22:41:58.235400 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3832): Terminated: ok {rc=0} 22:41:58.280805 --- ParallelTerminationStrategy: PID 3835 died... 22:41:58.300063 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3835): Terminated: ok {rc=0} 22:41:58.345589 --- ParallelTerminationStrategy: PID 3838 died... 22:41:58.364859 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3838): Terminated: ok {rc=0} 22:41:58.450513 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 22:41:59.662402 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:41:59.669697 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 22:41:59.702624 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 22:41:59.730004 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 22:41:59.783280 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 22:41:59.816672 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 22:41:59.844046 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 22:42:00.394747 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 22:42:00.447292 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:42:00.458875 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 22:42:00.531247 tst mo_mt_call.py: using LAC 32001 22:42:00.663880 tst mo_mt_call.py: using RAC 126 22:42:00.791137 tst mo_mt_call.py: using CellId 32001 22:42:00.954566 tst mo_mt_call.py: using BVCI 32002 22:42:01.224450 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:42:01.257749 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:42:01.278577 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:42:01.306885 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:42:01.331754 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:42:01.355632 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:42:01.619443 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:42:01.905185 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:42:02.456120 run create_hlr_db(pid=3850): Launched 22:42:02.573924 bus /sierra_2: Setting Powered False 22:42:03.637685 run create_hlr_db(pid=3850): Terminated: ok {rc=0} 22:42:04.089326 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3852): Launched 22:42:04.414806 run osmo-hlr_10.42.42.2(pid=3853): Launched 22:42:04.539452 run osmo-stp_10.42.42.5: Starting osmo-stp 22:42:05.104775 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3855): Launched 22:42:05.429258 run osmo-stp_10.42.42.5(pid=3856): Launched 22:42:05.553869 run osmo-msc_10.42.42.6: Starting osmo-msc 22:42:06.140839 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3858): Launched 22:42:06.465514 run osmo-msc_10.42.42.6(pid=3859): Launched 22:42:06.647984 run osmo-stp_10.42.42.5(pid=3856): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3856)] 22:42:06.785213 run osmo-stp_10.42.42.5(pid=3856): stdout: | (launched: 2022-12-12_22:42:05.370501) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:42:06.923821 run osmo-stp_10.42.42.5(pid=3856): stderr: | [0;m[38;5;43m20221212224205561 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224205561 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224205561 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224205561 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224205562 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224205562 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224205562 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:42:07.061362 run osmo-stp_10.42.42.5(pid=3856): stdout: | (launched: 2022-12-12_22:42:05.370501) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:42:07.191121 run osmo-stp_10.42.42.5(pid=3856): stderr: | [0;m[38;5;43m20221212224205561 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224205561 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224205561 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224205561 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224205562 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224205562 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224205562 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:42:07.347057 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3856): Process ended prematurely: osmo-stp_10.42.42.5(pid=3856) [trial-2383↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3856)] [trial-2383↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 22:42:07.357199 tst mo_mt_call.py:8: Test FAILED (6.9 sec) 22:42:07.385252 run osmo-hlr_10.42.42.2(pid=3853): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3853)] 22:42:07.435322 run osmo-hlr_10.42.42.2(pid=3853): stdout: | (launched: 2022-12-12_22:42:04.356028) 22:42:07.486865 run osmo-hlr_10.42.42.2(pid=3853): stderr: | [0;m[1;31m20221212224204552 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212224204552 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212224204552 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212224204552 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212224204552 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212224204552 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212224204565 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212224204573 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212224204574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212224204574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:42:07.558605 run osmo-msc_10.42.42.6(pid=3859): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3859)] 22:42:07.608362 run osmo-msc_10.42.42.6(pid=3859): stdout: | (launched: 2022-12-12_22:42:06.406761) 22:42:07.659664 run osmo-msc_10.42.42.6(pid=3859): stderr: | [0;m[38;5;43m20221212224206730 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212224206730 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f44eedd3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212224206730 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212224206730 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212224206730 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212224206731 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212224206732 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212224206733 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212224206733 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212224206733 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:42:07.711277 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3852): Terminating (SIGTERM) 22:42:07.752737 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3855): Terminating (SIGTERM) 22:42:07.794530 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3858): Terminating (SIGTERM) 22:42:07.836361 --- ParallelTerminationStrategy: PID 3852 died... 22:42:07.856183 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3852): Terminated: ok {rc=0} 22:42:07.902114 --- ParallelTerminationStrategy: PID 3855 died... 22:42:07.921521 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3855): Terminated: ok {rc=0} 22:42:07.967215 --- ParallelTerminationStrategy: PID 3858 died... 22:42:07.986627 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3858): Terminated: ok {rc=0} 22:42:08.073420 bus /sierra_3: Setting Powered False 22:42:09.171530 bus /sierra_3: Setting Powered False 22:42:10.287613 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2383 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 22:42:11.434399 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:42:11.446231 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 22:42:11.514741 tst mo_mt_call_osmux.py: using LAC 32002 22:42:11.635683 tst mo_mt_call_osmux.py: using RAC 127 22:42:11.758831 tst mo_mt_call_osmux.py: using CellId 32002 22:42:11.878418 tst mo_mt_call_osmux.py: using BVCI 32003 22:42:11.991357 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:42:12.002427 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:42:12.013256 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:42:12.024375 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:42:12.036014 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:42:12.047069 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:42:12.166853 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:42:12.286166 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:42:12.790342 run create_hlr_db(pid=3861): Launched 22:42:12.922944 bus /sierra_2: Setting Powered False 22:42:13.986559 run create_hlr_db(pid=3861): Terminated: ok {rc=0} 22:42:14.420159 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3863): Launched 22:42:14.723910 run osmo-hlr_10.42.42.2(pid=3864): Launched 22:42:14.840672 run osmo-stp_10.42.42.5: Starting osmo-stp 22:42:15.377544 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3866): Launched 22:42:15.682554 run osmo-stp_10.42.42.5(pid=3867): Launched 22:42:15.798964 run osmo-msc_10.42.42.6: Starting osmo-msc 22:42:16.438367 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3869): Launched 22:42:16.770443 run osmo-msc_10.42.42.6(pid=3870): Launched 22:42:17.105662 run osmo-stp_10.42.42.5(pid=3867): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3867)] 22:42:17.313127 run osmo-stp_10.42.42.5(pid=3867): stdout: | (launched: 2022-12-12_22:42:15.627263) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:42:17.452711 run osmo-stp_10.42.42.5(pid=3867): stderr: | [0;m[38;5;43m20221212224215797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224215797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224215798 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224215798 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224215798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224215798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224215799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:42:17.589287 run osmo-stp_10.42.42.5(pid=3867): stdout: | (launched: 2022-12-12_22:42:15.627263) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:42:17.718973 run osmo-stp_10.42.42.5(pid=3867): stderr: | [0;m[38;5;43m20221212224215797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224215797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224215798 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224215798 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224215798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224215798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224215799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:42:17.874070 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3867): Process ended prematurely: osmo-stp_10.42.42.5(pid=3867) [trial-2383↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3867)] [trial-2383↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 22:42:17.883604 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 22:42:17.911330 run osmo-hlr_10.42.42.2(pid=3864): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3864)] 22:42:17.961279 run osmo-hlr_10.42.42.2(pid=3864): stdout: | (launched: 2022-12-12_22:42:14.668881) 22:42:18.013054 run osmo-hlr_10.42.42.2(pid=3864): stderr: | [0;m[1;31m20221212224214844 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212224214844 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212224214844 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212224214845 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212224214845 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212224214845 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212224214856 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212224214866 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212224214866 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212224214866 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:42:18.085123 run osmo-msc_10.42.42.6(pid=3870): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3870)] 22:42:18.134849 run osmo-msc_10.42.42.6(pid=3870): stdout: | (launched: 2022-12-12_22:42:16.700586) 22:42:18.186222 run osmo-msc_10.42.42.6(pid=3870): stderr: | [0;m[38;5;43m20221212224217210 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212224217210 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa2d1a68c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212224217210 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212224217210 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212224217211 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212224217211 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212224217212 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212224217217 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212224217217 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212224217217 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:42:18.237804 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3863): Terminating (SIGTERM) 22:42:18.279259 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3866): Terminating (SIGTERM) 22:42:18.321319 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3869): Terminating (SIGTERM) 22:42:18.363292 --- ParallelTerminationStrategy: PID 3863 died... 22:42:18.383384 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3863): Terminated: ok {rc=0} 22:42:18.429844 --- ParallelTerminationStrategy: PID 3866 died... 22:42:18.449353 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3866): Terminated: ok {rc=0} 22:42:18.495193 --- ParallelTerminationStrategy: PID 3869 died... 22:42:18.514602 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3869): Terminated: ok {rc=0} 22:42:18.602253 bus /sierra_3: Setting Powered False 22:42:19.696306 bus /sierra_3: Setting Powered False 22:42:20.807384 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 22:42:22.049100 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:42:22.055425 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 22:42:22.088725 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 22:42:22.115126 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 22:42:22.167452 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 22:42:22.200771 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 22:42:22.227928 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 22:42:22.784601 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 22:42:22.838100 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:42:22.849667 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 22:42:22.918187 tst mo_mt_call.py: using LAC 32003 22:42:23.045268 tst mo_mt_call.py: using RAC 128 22:42:23.171731 tst mo_mt_call.py: using CellId 32003 22:42:23.298350 tst mo_mt_call.py: using BVCI 32004 22:42:23.417034 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:42:23.428623 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:42:23.440009 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:42:23.451324 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:42:23.462796 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:42:23.475208 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:42:23.595202 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:42:23.718144 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:42:24.189803 run create_hlr_db(pid=3875): Launched 22:42:24.306583 bus /sierra_2: Setting Powered False 22:42:25.366953 run create_hlr_db(pid=3875): Terminated: ok {rc=0} 22:42:25.788699 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3877): Launched 22:42:26.095998 run osmo-hlr_10.42.42.2(pid=3878): Launched 22:42:26.213295 run osmo-stp_10.42.42.5: Starting osmo-stp 22:42:26.759249 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3880): Launched 22:42:27.068705 run osmo-stp_10.42.42.5(pid=3881): Launched 22:42:27.186739 run osmo-msc_10.42.42.6: Starting osmo-msc 22:42:27.741165 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3883): Launched 22:42:28.044833 run osmo-msc_10.42.42.6(pid=3884): Launched 22:42:28.216110 run osmo-stp_10.42.42.5(pid=3881): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3881)] 22:42:28.345863 run osmo-stp_10.42.42.5(pid=3881): stdout: | (launched: 2022-12-12_22:42:27.012438) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:42:28.475566 run osmo-stp_10.42.42.5(pid=3881): stderr: | [0;m[38;5;43m20221212224227184 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224227184 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224227184 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224227185 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224227185 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224227185 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224227185 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:42:28.602310 run osmo-stp_10.42.42.5(pid=3881): stdout: | (launched: 2022-12-12_22:42:27.012438) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:42:28.723579 run osmo-stp_10.42.42.5(pid=3881): stderr: | [0;m[38;5;43m20221212224227184 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224227184 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224227184 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224227185 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224227185 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224227185 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224227185 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:42:28.867847 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3881): Process ended prematurely: osmo-stp_10.42.42.5(pid=3881) [trial-2383↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3881)] [trial-2383↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 22:42:28.876498 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 22:42:28.902900 run osmo-hlr_10.42.42.2(pid=3878): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3878)] 22:42:28.950363 run osmo-hlr_10.42.42.2(pid=3878): stdout: | (launched: 2022-12-12_22:42:26.039023) 22:42:28.999242 run osmo-hlr_10.42.42.2(pid=3878): stderr: | [0;m[1;31m20221212224226217 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212224226217 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212224226217 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212224226217 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212224226217 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212224226217 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212224226233 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212224226243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212224226243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212224226243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:42:29.068136 run osmo-msc_10.42.42.6(pid=3884): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3884)] 22:42:29.115359 run osmo-msc_10.42.42.6(pid=3884): stdout: | (launched: 2022-12-12_22:42:27.989304) 22:42:29.164155 run osmo-msc_10.42.42.6(pid=3884): stderr: | [0;m[38;5;43m20221212224228263 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212224228263 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f44ea88ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212224228263 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212224228263 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212224228263 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212224228263 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212224228265 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212224228266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212224228266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212224228266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:42:29.213399 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3877): Terminating (SIGTERM) 22:42:29.252521 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3880): Terminating (SIGTERM) 22:42:29.291709 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3883): Terminating (SIGTERM) 22:42:29.331376 --- ParallelTerminationStrategy: PID 3877 died... 22:42:29.350139 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3877): Terminated: ok {rc=0} 22:42:29.393780 --- ParallelTerminationStrategy: PID 3880 died... 22:42:29.412115 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3880): Terminated: ok {rc=0} 22:42:29.456000 --- ParallelTerminationStrategy: PID 3883 died... 22:42:29.474390 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3883): Terminated: ok {rc=0} 22:42:29.559947 bus /sierra_3: Setting Powered False 22:42:30.661452 bus /sierra_3: Setting Powered False 22:42:31.775992 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2383 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 22:42:32.922229 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:42:32.934108 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 22:42:33.006236 tst mo_mt_call_osmux.py: using LAC 32004 22:42:33.127905 tst mo_mt_call_osmux.py: using RAC 129 22:42:33.247271 tst mo_mt_call_osmux.py: using CellId 32004 22:42:33.366423 tst mo_mt_call_osmux.py: using BVCI 32005 22:42:33.479889 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:42:33.491019 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:42:33.501961 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:42:33.513671 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:42:33.525292 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:42:33.536855 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:42:33.652672 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:42:33.778189 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:42:34.283652 run create_hlr_db(pid=3886): Launched 22:42:34.416386 bus /sierra_2: Setting Powered False 22:42:35.480767 run create_hlr_db(pid=3886): Terminated: ok {rc=0} 22:42:35.914763 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3888): Launched 22:42:36.219893 run osmo-hlr_10.42.42.2(pid=3889): Launched 22:42:36.338042 run osmo-stp_10.42.42.5: Starting osmo-stp 22:42:36.877486 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3891): Launched 22:42:37.184172 run osmo-stp_10.42.42.5(pid=3892): Launched 22:42:37.300642 run osmo-msc_10.42.42.6: Starting osmo-msc 22:42:37.851333 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3894): Launched 22:42:38.155099 run osmo-msc_10.42.42.6(pid=3895): Launched 22:42:38.326311 run osmo-stp_10.42.42.5(pid=3892): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3892)] 22:42:38.455798 run osmo-stp_10.42.42.5(pid=3892): stdout: | (launched: 2022-12-12_22:42:37.128279) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:42:38.584715 run osmo-stp_10.42.42.5(pid=3892): stderr: | [0;m[38;5;43m20221212224237301 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224237301 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224237301 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224237302 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224237302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224237302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224237302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:42:38.711388 run osmo-stp_10.42.42.5(pid=3892): stdout: | (launched: 2022-12-12_22:42:37.128279) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:42:38.832248 run osmo-stp_10.42.42.5(pid=3892): stderr: | [0;m[38;5;43m20221212224237301 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224237301 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224237301 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224237302 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224237302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224237302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224237302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:42:38.976632 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3892): Process ended prematurely: osmo-stp_10.42.42.5(pid=3892) [trial-2383↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3892)] [trial-2383↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 22:42:38.985454 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 22:42:39.012265 run osmo-hlr_10.42.42.2(pid=3889): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3889)] 22:42:39.059767 run osmo-hlr_10.42.42.2(pid=3889): stdout: | (launched: 2022-12-12_22:42:36.164359) 22:42:39.108822 run osmo-hlr_10.42.42.2(pid=3889): stderr: | [0;m[1;31m20221212224236340 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212224236340 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212224236340 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212224236340 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212224236340 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212224236340 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212224236353 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212224236362 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212224236362 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212224236362 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:42:39.177031 run osmo-msc_10.42.42.6(pid=3895): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3895)] 22:42:39.224233 run osmo-msc_10.42.42.6(pid=3895): stdout: | (launched: 2022-12-12_22:42:38.099767) 22:42:39.272758 run osmo-msc_10.42.42.6(pid=3895): stderr: | [0;m[38;5;43m20221212224238374 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212224238374 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4104d48c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212224238374 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212224238374 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212224238374 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212224238374 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212224238376 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212224238377 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212224238377 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212224238377 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:42:39.322007 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3888): Terminating (SIGTERM) 22:42:39.361106 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3891): Terminating (SIGTERM) 22:42:39.400102 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3894): Terminating (SIGTERM) 22:42:39.439539 --- ParallelTerminationStrategy: PID 3888 died... 22:42:39.458321 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3888): Terminated: ok {rc=0} 22:42:39.501924 --- ParallelTerminationStrategy: PID 3891 died... 22:42:39.520014 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3891): Terminated: ok {rc=0} 22:42:39.564100 --- ParallelTerminationStrategy: PID 3894 died... 22:42:39.582410 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3894): Terminated: ok {rc=0} 22:42:39.667515 bus /sierra_3: Setting Powered False 22:42:40.765113 bus /sierra_3: Setting Powered False 22:42:41.880472 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 22:42:43.130835 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:42:43.138096 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 22:42:43.171283 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 22:42:43.198658 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 22:42:43.251314 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 22:42:43.283882 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 22:42:43.310924 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 22:42:43.859274 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 22:42:43.909301 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:42:43.920268 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 22:42:43.992915 tst mo_mt_call.py: using LAC 32005 22:42:44.112933 tst mo_mt_call.py: using RAC 130 22:42:44.232603 tst mo_mt_call.py: using CellId 32005 22:42:44.352101 tst mo_mt_call.py: using BVCI 32006 22:42:44.463965 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:42:44.474928 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:42:44.485784 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:42:44.496754 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:42:44.507943 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:42:44.518958 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:42:44.638083 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:42:44.755076 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:42:45.228368 run create_hlr_db(pid=3900): Launched 22:42:45.345501 bus /sierra_2: Setting Powered False 22:42:46.420889 run create_hlr_db(pid=3900): Terminated: ok {rc=0} 22:42:46.913833 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3902): Launched 22:42:47.249115 run osmo-hlr_10.42.42.2(pid=3903): Launched 22:42:47.373508 run osmo-stp_10.42.42.5: Starting osmo-stp 22:42:47.934374 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3905): Launched 22:42:48.259113 run osmo-stp_10.42.42.5(pid=3906): Launched 22:42:48.382917 run osmo-msc_10.42.42.6: Starting osmo-msc 22:42:48.970064 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3908): Launched 22:42:49.294704 run osmo-msc_10.42.42.6(pid=3909): Launched 22:42:49.477169 run osmo-stp_10.42.42.5(pid=3906): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3906)] 22:42:49.614340 run osmo-stp_10.42.42.5(pid=3906): stdout: | (launched: 2022-12-12_22:42:48.200052) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:42:49.752080 run osmo-stp_10.42.42.5(pid=3906): stderr: | [0;m[38;5;43m20221212224248392 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224248392 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224248393 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224248393 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224248393 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224248394 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224248394 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:42:49.888531 run osmo-stp_10.42.42.5(pid=3906): stdout: | (launched: 2022-12-12_22:42:48.200052) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:42:50.017805 run osmo-stp_10.42.42.5(pid=3906): stderr: | [0;m[38;5;43m20221212224248392 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224248392 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224248393 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224248393 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224248393 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224248394 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224248394 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:42:50.172030 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3906): Process ended prematurely: osmo-stp_10.42.42.5(pid=3906) [trial-2383↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3906)] [trial-2383↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 22:42:50.181541 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 22:42:50.209184 run osmo-hlr_10.42.42.2(pid=3903): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3903)] 22:42:50.258506 run osmo-hlr_10.42.42.2(pid=3903): stdout: | (launched: 2022-12-12_22:42:47.190042) 22:42:50.309700 run osmo-hlr_10.42.42.2(pid=3903): stderr: | [0;m[1;31m20221212224247388 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212224247388 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212224247388 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212224247388 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212224247388 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212224247388 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212224247401 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212224247412 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212224247412 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212224247412 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:42:50.381746 run osmo-msc_10.42.42.6(pid=3909): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3909)] 22:42:50.431095 run osmo-msc_10.42.42.6(pid=3909): stdout: | (launched: 2022-12-12_22:42:49.235904) 22:42:50.482177 run osmo-msc_10.42.42.6(pid=3909): stderr: | [0;m[38;5;43m20221212224249559 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212224249559 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f30eda89c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212224249559 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212224249559 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212224249560 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212224249560 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212224249561 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212224249562 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212224249562 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212224249562 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:42:50.533495 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3902): Terminating (SIGTERM) 22:42:50.574526 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3905): Terminating (SIGTERM) 22:42:50.615671 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3908): Terminating (SIGTERM) 22:42:50.656879 --- ParallelTerminationStrategy: PID 3902 died... 22:42:50.676603 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3902): Terminated: ok {rc=0} 22:42:50.722126 --- ParallelTerminationStrategy: PID 3905 died... 22:42:50.741440 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3905): Terminated: ok {rc=0} 22:42:50.787115 --- ParallelTerminationStrategy: PID 3908 died... 22:42:50.806451 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3908): Terminated: ok {rc=0} 22:42:50.892622 bus /sierra_3: Setting Powered False 22:42:51.989617 bus /sierra_3: Setting Powered False 22:42:53.104800 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2383 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 22:42:54.253630 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:42:54.265714 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 22:42:54.335450 tst mo_mt_call_osmux.py: using LAC 32006 22:42:54.457778 tst mo_mt_call_osmux.py: using RAC 131 22:42:54.578974 tst mo_mt_call_osmux.py: using CellId 32006 22:42:54.698076 tst mo_mt_call_osmux.py: using BVCI 32007 22:42:54.811303 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:42:54.822276 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:42:54.833125 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:42:54.844222 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:42:54.855412 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:42:54.866549 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:42:54.985859 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:42:55.105125 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:42:55.578698 run create_hlr_db(pid=3911): Launched 22:42:55.695256 bus /sierra_2: Setting Powered False 22:42:56.758783 run create_hlr_db(pid=3911): Terminated: ok {rc=0} 22:42:57.212487 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3913): Launched 22:42:57.538854 run osmo-hlr_10.42.42.2(pid=3914): Launched 22:42:57.664042 run osmo-stp_10.42.42.5: Starting osmo-stp 22:42:58.222831 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3916): Launched 22:42:58.547556 run osmo-stp_10.42.42.5(pid=3917): Launched 22:42:58.671731 run osmo-msc_10.42.42.6: Starting osmo-msc 22:42:59.257918 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3919): Launched 22:42:59.582391 run osmo-msc_10.42.42.6(pid=3920): Launched 22:42:59.765096 run osmo-stp_10.42.42.5(pid=3917): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3917)] 22:42:59.901465 run osmo-stp_10.42.42.5(pid=3917): stdout: | (launched: 2022-12-12_22:42:58.488588) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:43:00.039095 run osmo-stp_10.42.42.5(pid=3917): stderr: | [0;m[38;5;43m20221212224258684 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224258684 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224258684 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224258685 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224258685 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224258685 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224258685 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:43:00.175344 run osmo-stp_10.42.42.5(pid=3917): stdout: | (launched: 2022-12-12_22:42:58.488588) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:43:00.304205 run osmo-stp_10.42.42.5(pid=3917): stderr: | [0;m[38;5;43m20221212224258684 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224258684 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224258684 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224258685 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224258685 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224258685 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224258685 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:43:00.459216 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3917): Process ended prematurely: osmo-stp_10.42.42.5(pid=3917) [trial-2383↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3917)] [trial-2383↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 22:43:00.468680 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 22:43:00.496628 run osmo-hlr_10.42.42.2(pid=3914): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3914)] 22:43:00.546271 run osmo-hlr_10.42.42.2(pid=3914): stdout: | (launched: 2022-12-12_22:42:57.479830) 22:43:00.597656 run osmo-hlr_10.42.42.2(pid=3914): stderr: | [0;m[1;31m20221212224257678 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212224257678 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212224257678 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212224257678 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212224257679 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212224257679 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212224257692 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212224257700 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212224257700 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212224257700 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:43:00.669641 run osmo-msc_10.42.42.6(pid=3920): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3920)] 22:43:00.719141 run osmo-msc_10.42.42.6(pid=3920): stdout: | (launched: 2022-12-12_22:42:59.523738) 22:43:00.770491 run osmo-msc_10.42.42.6(pid=3920): stderr: | [0;m[38;5;43m20221212224259848 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212224259848 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2f20255c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212224259848 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212224259848 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212224259848 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212224259848 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212224259850 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212224259850 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212224259851 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212224259851 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:43:00.822164 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3913): Terminating (SIGTERM) 22:43:00.876731 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3916): Terminating (SIGTERM) 22:43:00.921528 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3919): Terminating (SIGTERM) 22:43:00.966054 --- ParallelTerminationStrategy: PID 3913 died... 22:43:00.986426 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3913): Terminated: ok {rc=0} 22:43:01.034421 --- ParallelTerminationStrategy: PID 3916 died... 22:43:01.055370 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3916): Terminated: ok {rc=0} 22:43:01.102436 --- ParallelTerminationStrategy: PID 3919 died... 22:43:01.122406 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3919): Terminated: ok {rc=0} 22:43:01.209553 bus /sierra_3: Setting Powered False 22:43:02.309504 bus /sierra_3: Setting Powered False 22:43:03.424083 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 22:43:04.672199 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:43:04.678665 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 22:43:04.711838 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 22:43:04.738216 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 22:43:04.790826 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 22:43:04.824177 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 22:43:04.850895 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 22:43:05.398599 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 22:43:05.448113 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:43:05.459347 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 22:43:05.526741 tst mo_mt_call.py: using LAC 32007 22:43:05.646426 tst mo_mt_call.py: using RAC 132 22:43:05.767779 tst mo_mt_call.py: using CellId 32007 22:43:05.889915 tst mo_mt_call.py: using BVCI 32008 22:43:06.000907 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:43:06.011865 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:43:06.022749 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:43:06.033837 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:43:06.045068 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:43:06.056317 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 22:43:06.175592 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 22:43:06.296924 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:43:06.801901 run create_hlr_db(pid=3925): Launched 22:43:06.934133 bus /sierra_2: Setting Powered False 22:43:07.998004 run create_hlr_db(pid=3925): Terminated: ok {rc=0} 22:43:08.450455 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3927): Launched 22:43:08.775297 run osmo-hlr_10.42.42.2(pid=3928): Launched 22:43:08.898835 run osmo-stp_10.42.42.5: Starting osmo-stp 22:43:09.462618 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3930): Launched 22:43:09.786278 run osmo-stp_10.42.42.5(pid=3931): Launched 22:43:09.910326 run osmo-msc_10.42.42.6: Starting osmo-msc 22:43:10.497938 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3933): Launched 22:43:10.821712 run osmo-msc_10.42.42.6(pid=3934): Launched 22:43:11.003174 run osmo-stp_10.42.42.5(pid=3931): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3931)] 22:43:11.140148 run osmo-stp_10.42.42.5(pid=3931): stdout: | (launched: 2022-12-12_22:43:09.727531) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:43:11.277767 run osmo-stp_10.42.42.5(pid=3931): stderr: | [0;m[38;5;43m20221212224309921 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224309921 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224309922 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224309922 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224309922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224309922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224309922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:43:11.415204 run osmo-stp_10.42.42.5(pid=3931): stdout: | (launched: 2022-12-12_22:43:09.727531) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:43:11.544338 run osmo-stp_10.42.42.5(pid=3931): stderr: | [0;m[38;5;43m20221212224309921 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224309921 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224309922 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224309922 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224309922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224309922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224309922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:43:11.698726 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3931): Process ended prematurely: osmo-stp_10.42.42.5(pid=3931) [trial-2383↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3931)] [trial-2383↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 22:43:11.708121 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 22:43:11.735803 run osmo-hlr_10.42.42.2(pid=3928): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3928)] 22:43:11.785420 run osmo-hlr_10.42.42.2(pid=3928): stdout: | (launched: 2022-12-12_22:43:08.715831) 22:43:11.836694 run osmo-hlr_10.42.42.2(pid=3928): stderr: | [0;m[1;31m20221212224308916 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212224308916 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212224308916 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212224308916 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212224308916 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212224308916 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212224308929 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212224308937 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212224308937 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212224308937 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:43:11.908247 run osmo-msc_10.42.42.6(pid=3934): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3934)] 22:43:11.957562 run osmo-msc_10.42.42.6(pid=3934): stdout: | (launched: 2022-12-12_22:43:10.763060) 22:43:12.008491 run osmo-msc_10.42.42.6(pid=3934): stderr: | [0;m[38;5;43m20221212224311085 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212224311085 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff9e72aec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212224311085 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212224311085 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212224311086 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212224311086 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212224311089 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212224311090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212224311090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212224311090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:43:12.059939 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3927): Terminating (SIGTERM) 22:43:12.101226 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3930): Terminating (SIGTERM) 22:43:12.142610 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3933): Terminating (SIGTERM) 22:43:12.184140 --- ParallelTerminationStrategy: PID 3927 died... 22:43:12.203852 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3927): Terminated: ok {rc=0} 22:43:12.249620 --- ParallelTerminationStrategy: PID 3930 died... 22:43:12.268745 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3930): Terminated: ok {rc=0} 22:43:12.314055 --- ParallelTerminationStrategy: PID 3933 died... 22:43:12.333427 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3933): Terminated: ok {rc=0} 22:43:12.420920 bus /sierra_3: Setting Powered False 22:43:13.520278 bus /sierra_3: Setting Powered False 22:43:14.634732 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2383 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 22:43:15.784107 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:43:15.796270 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 22:43:15.869591 tst mo_mt_call_osmux.py: using LAC 32008 22:43:16.014608 tst mo_mt_call_osmux.py: using RAC 133 22:43:16.145387 tst mo_mt_call_osmux.py: using CellId 32008 22:43:16.296374 tst mo_mt_call_osmux.py: using BVCI 32009 22:43:16.419546 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:43:16.432202 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:43:16.444754 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:43:16.457556 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:43:16.469634 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:43:16.481497 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 22:43:16.606319 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 22:43:16.758868 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:43:17.316515 run create_hlr_db(pid=3936): Launched 22:43:17.440190 bus /sierra_2: Setting Powered False 22:43:18.500818 run create_hlr_db(pid=3936): Terminated: ok {rc=0} 22:43:18.944567 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3938): Launched 22:43:19.268529 run osmo-hlr_10.42.42.2(pid=3939): Launched 22:43:19.392724 run osmo-stp_10.42.42.5: Starting osmo-stp 22:43:19.957973 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3941): Launched 22:43:20.280818 run osmo-stp_10.42.42.5(pid=3942): Launched 22:43:20.405112 run osmo-msc_10.42.42.6: Starting osmo-msc 22:43:20.991421 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3944): Launched 22:43:21.316292 run osmo-msc_10.42.42.6(pid=3945): Launched 22:43:21.499701 run osmo-stp_10.42.42.5(pid=3942): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3942)] 22:43:21.636661 run osmo-stp_10.42.42.5(pid=3942): stdout: | (launched: 2022-12-12_22:43:20.222236) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:43:21.773467 run osmo-stp_10.42.42.5(pid=3942): stderr: | [0;m[38;5;43m20221212224320416 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224320416 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224320416 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224320417 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224320417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224320417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224320417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:43:21.909594 run osmo-stp_10.42.42.5(pid=3942): stdout: | (launched: 2022-12-12_22:43:20.222236) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:43:22.038493 run osmo-stp_10.42.42.5(pid=3942): stderr: | [0;m[38;5;43m20221212224320416 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224320416 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224320416 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224320417 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224320417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224320417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224320417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:43:22.192931 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3942): Process ended prematurely: osmo-stp_10.42.42.5(pid=3942) [trial-2383↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3942)] [trial-2383↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 22:43:22.202604 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 22:43:22.230260 run osmo-hlr_10.42.42.2(pid=3939): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3939)] 22:43:22.280200 run osmo-hlr_10.42.42.2(pid=3939): stdout: | (launched: 2022-12-12_22:43:19.209801) 22:43:22.331962 run osmo-hlr_10.42.42.2(pid=3939): stderr: | [0;m[1;31m20221212224319411 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212224319411 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212224319411 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212224319411 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212224319411 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212224319411 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212224319424 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212224319432 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212224319432 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212224319433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:43:22.404305 run osmo-msc_10.42.42.6(pid=3945): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3945)] 22:43:22.453982 run osmo-msc_10.42.42.6(pid=3945): stdout: | (launched: 2022-12-12_22:43:21.257390) 22:43:22.505346 run osmo-msc_10.42.42.6(pid=3945): stderr: | [0;m[38;5;43m20221212224321583 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212224321583 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fdac679fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212224321583 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212224321583 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212224321583 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212224321583 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212224321585 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212224321586 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212224321586 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212224321586 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:43:22.557324 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3938): Terminating (SIGTERM) 22:43:22.598494 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3941): Terminating (SIGTERM) 22:43:22.639902 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3944): Terminating (SIGTERM) 22:43:22.681681 --- ParallelTerminationStrategy: PID 3938 died... 22:43:22.701670 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3938): Terminated: ok {rc=0} 22:43:22.747904 --- ParallelTerminationStrategy: PID 3941 died... 22:43:22.767301 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3941): Terminated: ok {rc=0} 22:43:22.813663 --- ParallelTerminationStrategy: PID 3944 died... 22:43:22.833140 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3944): Terminated: ok {rc=0} 22:43:22.920076 bus /sierra_3: Setting Powered False 22:43:24.018382 bus /sierra_3: Setting Powered False 22:43:25.133133 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 22:43:26.378331 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:43:26.384763 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 22:43:26.417316 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 22:43:26.444419 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 22:43:26.495330 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 22:43:26.527894 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 22:43:26.554307 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 22:43:27.104297 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 22:43:27.153627 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:43:27.164622 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 22:43:27.232354 tst mo_mt_call.py: using LAC 32009 22:43:27.351971 tst mo_mt_call.py: using RAC 134 22:43:27.472199 tst mo_mt_call.py: using CellId 32009 22:43:27.592297 tst mo_mt_call.py: using BVCI 32010 22:43:27.704882 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:43:27.716359 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:43:27.727164 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:43:27.738310 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:43:27.749608 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:43:27.760686 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:43:27.875994 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:43:27.990269 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:43:28.462815 run create_hlr_db(pid=3950): Launched 22:43:28.579215 bus /sierra_2: Setting Powered False 22:43:29.639601 run create_hlr_db(pid=3950): Terminated: ok {rc=0} 22:43:30.062579 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3952): Launched 22:43:30.366537 run osmo-hlr_10.42.42.2(pid=3953): Launched 22:43:30.482904 run osmo-stp_10.42.42.5: Starting osmo-stp 22:43:31.045966 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3955): Launched 22:43:31.400205 run osmo-stp_10.42.42.5(pid=3956): Launched 22:43:31.739134 run osmo-msc_10.42.42.6: Starting osmo-msc 22:43:32.320439 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3958): Launched 22:43:32.624650 run osmo-msc_10.42.42.6(pid=3959): Launched 22:43:32.795292 run osmo-stp_10.42.42.5(pid=3956): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3956)] 22:43:32.923808 run osmo-stp_10.42.42.5(pid=3956): stdout: | (launched: 2022-12-12_22:43:31.328419) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:43:33.052190 run osmo-stp_10.42.42.5(pid=3956): stderr: | [0;m[38;5;43m20221212224331527 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224331527 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224331528 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224331528 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224331528 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224331529 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224331529 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:43:33.179563 run osmo-stp_10.42.42.5(pid=3956): stdout: | (launched: 2022-12-12_22:43:31.328419) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:43:33.300291 run osmo-stp_10.42.42.5(pid=3956): stderr: | [0;m[38;5;43m20221212224331527 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224331527 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224331528 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224331528 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224331528 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224331529 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224331529 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:43:33.445240 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3956): Process ended prematurely: osmo-stp_10.42.42.5(pid=3956) [trial-2383↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3956)] [trial-2383↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 22:43:33.454207 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 22:43:33.480484 run osmo-hlr_10.42.42.2(pid=3953): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3953)] 22:43:33.528273 run osmo-hlr_10.42.42.2(pid=3953): stdout: | (launched: 2022-12-12_22:43:30.311136) 22:43:33.577409 run osmo-hlr_10.42.42.2(pid=3953): stderr: | [0;m[1;31m20221212224330490 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212224330490 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212224330490 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212224330490 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212224330490 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212224330490 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212224330502 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212224330511 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212224330511 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212224330511 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:43:33.645596 run osmo-msc_10.42.42.6(pid=3959): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3959)] 22:43:33.692797 run osmo-msc_10.42.42.6(pid=3959): stdout: | (launched: 2022-12-12_22:43:32.569166) 22:43:33.741554 run osmo-msc_10.42.42.6(pid=3959): stderr: | [0;m[38;5;43m20221212224332843 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212224332843 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5721b4dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212224332843 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212224332843 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212224332844 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212224332844 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212224332846 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212224332846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212224332846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212224332846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:43:33.790822 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3952): Terminating (SIGTERM) 22:43:33.830056 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3955): Terminating (SIGTERM) 22:43:33.869308 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3958): Terminating (SIGTERM) 22:43:33.909021 --- ParallelTerminationStrategy: PID 3952 died... 22:43:33.927862 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3952): Terminated: ok {rc=0} 22:43:33.971711 --- ParallelTerminationStrategy: PID 3955 died... 22:43:33.990067 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3955): Terminated: ok {rc=0} 22:43:34.033867 --- ParallelTerminationStrategy: PID 3958 died... 22:43:34.052210 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3958): Terminated: ok {rc=0} 22:43:34.138550 bus /sierra_3: Setting Powered False 22:43:35.237080 bus /sierra_3: Setting Powered False 22:43:36.352000 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2383 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 22:43:37.497683 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:43:37.509439 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 22:43:37.578161 tst mo_mt_call_osmux.py: using LAC 32010 22:43:37.698386 tst mo_mt_call_osmux.py: using RAC 135 22:43:37.820510 tst mo_mt_call_osmux.py: using CellId 32010 22:43:37.944502 tst mo_mt_call_osmux.py: using BVCI 32011 22:43:38.055794 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:43:38.067044 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:43:38.078000 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:43:38.089109 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:43:38.100285 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:43:38.111497 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:43:38.230869 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:43:38.347903 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:43:38.821880 run create_hlr_db(pid=3961): Launched 22:43:38.938974 bus /sierra_2: Setting Powered False 22:43:39.999687 run create_hlr_db(pid=3961): Terminated: ok {rc=0} 22:43:40.423983 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3963): Launched 22:43:40.727756 run osmo-hlr_10.42.42.2(pid=3964): Launched 22:43:40.844265 run osmo-stp_10.42.42.5: Starting osmo-stp 22:43:41.385391 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3966): Launched 22:43:41.691863 run osmo-stp_10.42.42.5(pid=3967): Launched 22:43:41.808551 run osmo-msc_10.42.42.6: Starting osmo-msc 22:43:42.360076 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3969): Launched 22:43:42.664918 run osmo-msc_10.42.42.6(pid=3970): Launched 22:43:42.838239 run osmo-stp_10.42.42.5(pid=3967): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3967)] 22:43:42.967636 run osmo-stp_10.42.42.5(pid=3967): stdout: | (launched: 2022-12-12_22:43:41.635951) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:43:43.096935 run osmo-stp_10.42.42.5(pid=3967): stderr: | [0;m[38;5;43m20221212224341808 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224341809 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224341809 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224341809 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224341810 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224341810 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224341810 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:43:43.224046 run osmo-stp_10.42.42.5(pid=3967): stdout: | (launched: 2022-12-12_22:43:41.635951) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:43:43.344465 run osmo-stp_10.42.42.5(pid=3967): stderr: | [0;m[38;5;43m20221212224341808 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224341809 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224341809 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224341809 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224341810 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224341810 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224341810 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:43:43.489368 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3967): Process ended prematurely: osmo-stp_10.42.42.5(pid=3967) [trial-2383↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3967)] [trial-2383↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 22:43:43.498061 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 22:43:43.524435 run osmo-hlr_10.42.42.2(pid=3964): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3964)] 22:43:43.572160 run osmo-hlr_10.42.42.2(pid=3964): stdout: | (launched: 2022-12-12_22:43:40.672530) 22:43:43.621869 run osmo-hlr_10.42.42.2(pid=3964): stderr: | [0;m[1;31m20221212224340850 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212224340850 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212224340850 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212224340850 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212224340850 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212224340850 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212224340862 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212224340871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212224340871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212224340871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:43:43.690755 run osmo-msc_10.42.42.6(pid=3970): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3970)] 22:43:43.738089 run osmo-msc_10.42.42.6(pid=3970): stdout: | (launched: 2022-12-12_22:43:42.609144) 22:43:43.787457 run osmo-msc_10.42.42.6(pid=3970): stderr: | [0;m[38;5;43m20221212224342880 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212224342880 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f853d33bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212224342880 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212224342881 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212224342881 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212224342881 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212224342883 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212224342883 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212224342883 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212224342883 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:43:43.837089 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3963): Terminating (SIGTERM) 22:43:43.876635 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3966): Terminating (SIGTERM) 22:43:43.916690 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3969): Terminating (SIGTERM) 22:43:43.956535 --- ParallelTerminationStrategy: PID 3963 died... 22:43:43.975603 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3963): Terminated: ok {rc=0} 22:43:44.019525 --- ParallelTerminationStrategy: PID 3966 died... 22:43:44.038077 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3966): Terminated: ok {rc=0} 22:43:44.082629 --- ParallelTerminationStrategy: PID 3969 died... 22:43:44.100980 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3969): Terminated: ok {rc=0} 22:43:44.185829 bus /sierra_3: Setting Powered False 22:43:45.286192 bus /sierra_3: Setting Powered False 22:43:46.401394 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 22:43:47.656826 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:43:47.664031 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 22:43:47.697803 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 22:43:47.725306 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 22:43:47.778992 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 22:43:47.812328 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 22:43:47.839331 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 22:43:48.389944 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 22:43:48.441806 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:43:48.453464 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 22:43:48.523946 tst mo_mt_call.py: using LAC 32011 22:43:48.647754 tst mo_mt_call.py: using RAC 136 22:43:48.771549 tst mo_mt_call.py: using CellId 32011 22:43:48.893915 tst mo_mt_call.py: using BVCI 32012 22:43:49.008214 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:43:49.019509 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:43:49.030569 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:43:49.042002 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:43:49.053492 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:43:49.064661 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:43:49.184241 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:43:49.306897 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:43:49.811775 run create_hlr_db(pid=3975): Launched 22:43:49.943634 bus /sierra_2: Setting Powered False 22:43:51.006839 run create_hlr_db(pid=3975): Terminated: ok {rc=0} 22:43:51.457697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3977): Launched 22:43:51.782706 run osmo-hlr_10.42.42.2(pid=3978): Launched 22:43:51.906252 run osmo-stp_10.42.42.5: Starting osmo-stp 22:43:52.464402 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3980): Launched 22:43:52.788205 run osmo-stp_10.42.42.5(pid=3981): Launched 22:43:52.912362 run osmo-msc_10.42.42.6: Starting osmo-msc 22:43:53.500663 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3983): Launched 22:43:53.825228 run osmo-msc_10.42.42.6(pid=3984): Launched 22:43:54.007838 run osmo-stp_10.42.42.5(pid=3981): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3981)] 22:43:54.145323 run osmo-stp_10.42.42.5(pid=3981): stdout: | (launched: 2022-12-12_22:43:52.729574) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:43:54.283741 run osmo-stp_10.42.42.5(pid=3981): stderr: | [0;m[38;5;43m20221212224352922 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224352922 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224352923 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224352923 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224352925 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224352926 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224352926 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:43:54.420596 run osmo-stp_10.42.42.5(pid=3981): stdout: | (launched: 2022-12-12_22:43:52.729574) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:43:54.549890 run osmo-stp_10.42.42.5(pid=3981): stderr: | [0;m[38;5;43m20221212224352922 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224352922 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224352923 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224352923 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224352925 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224352926 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224352926 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:43:54.704615 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3981): Process ended prematurely: osmo-stp_10.42.42.5(pid=3981) [trial-2383↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3981)] [trial-2383↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 22:43:54.714137 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 22:43:54.741744 run osmo-hlr_10.42.42.2(pid=3978): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3978)] 22:43:54.791533 run osmo-hlr_10.42.42.2(pid=3978): stdout: | (launched: 2022-12-12_22:43:51.723829) 22:43:54.843029 run osmo-hlr_10.42.42.2(pid=3978): stderr: | [0;m[1;31m20221212224351922 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212224351922 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212224351922 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212224351922 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212224351922 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212224351923 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212224351934 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212224351943 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212224351943 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212224351943 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:43:54.914799 run osmo-msc_10.42.42.6(pid=3984): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3984)] 22:43:54.964271 run osmo-msc_10.42.42.6(pid=3984): stdout: | (launched: 2022-12-12_22:43:53.766165) 22:43:55.015438 run osmo-msc_10.42.42.6(pid=3984): stderr: | [0;m[38;5;43m20221212224354088 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212224354088 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9e7ac95c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212224354089 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212224354089 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212224354089 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212224354089 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212224354091 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212224354091 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212224354091 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212224354091 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:43:55.066866 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3977): Terminating (SIGTERM) 22:43:55.108378 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3980): Terminating (SIGTERM) 22:43:55.149954 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3983): Terminating (SIGTERM) 22:43:55.191746 --- ParallelTerminationStrategy: PID 3977 died... 22:43:55.211646 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3977): Terminated: ok {rc=0} 22:43:55.257980 --- ParallelTerminationStrategy: PID 3980 died... 22:43:55.277319 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3980): Terminated: ok {rc=0} 22:43:55.322793 --- ParallelTerminationStrategy: PID 3983 died... 22:43:55.342020 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3983): Terminated: ok {rc=0} 22:43:55.429219 bus /sierra_3: Setting Powered False 22:43:56.526694 bus /sierra_3: Setting Powered False 22:43:57.642647 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2383 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 22:43:58.787796 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:43:58.799578 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 22:43:58.873419 tst mo_mt_call_osmux.py: using LAC 32012 22:43:58.993917 tst mo_mt_call_osmux.py: using RAC 137 22:43:59.122422 tst mo_mt_call_osmux.py: using CellId 32012 22:43:59.250368 tst mo_mt_call_osmux.py: using BVCI 32013 22:43:59.371468 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:43:59.383315 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:43:59.395051 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:43:59.407269 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:43:59.419662 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:43:59.431870 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:43:59.555574 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:43:59.678009 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:44:00.183718 run create_hlr_db(pid=3986): Launched 22:44:00.316080 bus /sierra_2: Setting Powered False 22:44:01.379667 run create_hlr_db(pid=3986): Terminated: ok {rc=0} 22:44:01.841288 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3988): Launched 22:44:02.179008 run osmo-hlr_10.42.42.2(pid=3989): Launched 22:44:02.303566 run osmo-stp_10.42.42.5: Starting osmo-stp 22:44:02.861622 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3991): Launched 22:44:03.185995 run osmo-stp_10.42.42.5(pid=3992): Launched 22:44:03.310098 run osmo-msc_10.42.42.6: Starting osmo-msc 22:44:03.898448 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3994): Launched 22:44:04.221550 run osmo-msc_10.42.42.6(pid=3995): Launched 22:44:04.404079 run osmo-stp_10.42.42.5(pid=3992): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3992)] 22:44:04.541879 run osmo-stp_10.42.42.5(pid=3992): stdout: | (launched: 2022-12-12_22:44:03.127299) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:44:04.680085 run osmo-stp_10.42.42.5(pid=3992): stderr: | [0;m[38;5;43m20221212224403319 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224403319 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224403319 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224403320 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224403320 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224403320 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224403320 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:44:04.817133 run osmo-stp_10.42.42.5(pid=3992): stdout: | (launched: 2022-12-12_22:44:03.127299) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:44:04.946664 run osmo-stp_10.42.42.5(pid=3992): stderr: | [0;m[38;5;43m20221212224403319 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224403319 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224403319 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224403320 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224403320 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224403320 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224403320 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:44:05.102254 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3992): Process ended prematurely: osmo-stp_10.42.42.5(pid=3992) [trial-2383↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3992)] [trial-2383↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 22:44:05.111718 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 22:44:05.139249 run osmo-hlr_10.42.42.2(pid=3989): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3989)] 22:44:05.188870 run osmo-hlr_10.42.42.2(pid=3989): stdout: | (launched: 2022-12-12_22:44:02.120265) 22:44:05.240064 run osmo-hlr_10.42.42.2(pid=3989): stderr: | [0;m[1;31m20221212224402318 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212224402318 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212224402318 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212224402318 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212224402318 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212224402318 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212224402331 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212224402339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212224402339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212224402339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:44:05.311443 run osmo-msc_10.42.42.6(pid=3995): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3995)] 22:44:05.361141 run osmo-msc_10.42.42.6(pid=3995): stdout: | (launched: 2022-12-12_22:44:04.162790) 22:44:05.412578 run osmo-msc_10.42.42.6(pid=3995): stderr: | [0;m[38;5;43m20221212224404486 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212224404486 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f209ee56c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212224404486 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212224404486 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212224404486 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212224404487 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212224404488 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212224404489 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212224404489 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212224404489 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:44:05.464082 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3988): Terminating (SIGTERM) 22:44:05.505361 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3991): Terminating (SIGTERM) 22:44:05.546742 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3994): Terminating (SIGTERM) 22:44:05.588211 --- ParallelTerminationStrategy: PID 3988 died... 22:44:05.608081 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3988): Terminated: ok {rc=0} 22:44:05.654129 --- ParallelTerminationStrategy: PID 3991 died... 22:44:05.673321 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3991): Terminated: ok {rc=0} 22:44:05.719012 --- ParallelTerminationStrategy: PID 3994 died... 22:44:05.738281 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3994): Terminated: ok {rc=0} 22:44:05.825097 bus /sierra_3: Setting Powered False 22:44:06.922397 bus /sierra_3: Setting Powered False 22:44:08.037423 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 voice:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 22:44:09.288763 tst voice:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:44:09.294792 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 22:44:09.327945 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 22:44:09.355387 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 22:44:09.412896 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 22:44:09.446019 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 22:44:09.473072 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 22:44:10.019026 tst voice:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 22:44:10.070716 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:44:10.082076 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:44:10.151193 tst mo_mt_call.py: using LAC 32013 22:44:10.278525 tst mo_mt_call.py: using RAC 138 22:44:10.401944 tst mo_mt_call.py: using CellId 32013 22:44:10.524662 tst mo_mt_call.py: using BVCI 32014 22:44:10.637106 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:44:10.648126 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:44:10.658917 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:44:10.670696 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:44:10.682295 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:44:10.693934 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 22:44:10.813908 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 22:44:10.931288 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:44:11.404770 run create_hlr_db(pid=4002): Launched 22:44:11.521451 bus /sierra_2: Setting Powered False 22:44:12.581602 run create_hlr_db(pid=4002): Terminated: ok {rc=0} 22:44:13.005700 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4004): Launched 22:44:13.311768 run osmo-hlr_10.42.42.2(pid=4005): Launched 22:44:13.428191 run osmo-stp_10.42.42.5: Starting osmo-stp 22:44:13.952202 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4007): Launched 22:44:14.257260 run osmo-stp_10.42.42.5(pid=4008): Launched 22:44:14.374958 run osmo-msc_10.42.42.6: Starting osmo-msc 22:44:14.923664 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4010): Launched 22:44:15.227525 run osmo-msc_10.42.42.6(pid=4011): Launched 22:44:15.401692 run osmo-stp_10.42.42.5(pid=4008): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4008)] 22:44:15.531357 run osmo-stp_10.42.42.5(pid=4008): stdout: | (launched: 2022-12-12_22:44:14.201250) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:44:15.660383 run osmo-stp_10.42.42.5(pid=4008): stderr: | [0;m[38;5;43m20221212224414372 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224414373 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224414373 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224414373 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224414374 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224414374 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224414374 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:44:15.787083 run osmo-stp_10.42.42.5(pid=4008): stdout: | (launched: 2022-12-12_22:44:14.201250) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:44:15.943005 run osmo-stp_10.42.42.5(pid=4008): stderr: | [0;m[38;5;43m20221212224414372 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224414373 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224414373 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224414373 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224414374 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224414374 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224414374 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:44:16.103328 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4008): Process ended prematurely: osmo-stp_10.42.42.5(pid=4008) [trial-2383↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4008)] [trial-2383↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 22:44:16.113905 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 22:44:16.144530 run osmo-hlr_10.42.42.2(pid=4005): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4005)] 22:44:16.197128 run osmo-hlr_10.42.42.2(pid=4005): stdout: | (launched: 2022-12-12_22:44:13.256311) 22:44:16.253181 run osmo-hlr_10.42.42.2(pid=4005): stderr: | [0;m[1;31m20221212224413432 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212224413432 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212224413432 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212224413432 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212224413432 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212224413432 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212224413448 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212224413458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212224413458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212224413458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:44:16.328370 run osmo-msc_10.42.42.6(pid=4011): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4011)] 22:44:16.381112 run osmo-msc_10.42.42.6(pid=4011): stdout: | (launched: 2022-12-12_22:44:15.172079) 22:44:16.434646 run osmo-msc_10.42.42.6(pid=4011): stderr: | [0;m[38;5;43m20221212224415446 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212224415446 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fcf670e8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212224415446 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212224415446 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212224415447 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212224415447 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212224415449 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212224415449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212224415450 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212224415450 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:44:16.487424 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4004): Terminating (SIGTERM) 22:44:16.531210 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4007): Terminating (SIGTERM) 22:44:16.576236 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4010): Terminating (SIGTERM) 22:44:16.622424 --- ParallelTerminationStrategy: PID 4004 died... 22:44:16.642870 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4004): Terminated: ok {rc=0} 22:44:16.692472 --- ParallelTerminationStrategy: PID 4007 died... 22:44:16.713514 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4007): Terminated: ok {rc=0} 22:44:16.761773 --- ParallelTerminationStrategy: PID 4010 died... 22:44:16.782060 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4010): Terminated: ok {rc=0} 22:44:16.873034 bus /sierra_3: Setting Powered False 22:44:17.970945 bus /sierra_3: Setting Powered False 22:44:19.085433 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2383 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 22:44:20.235524 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:44:20.247494 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:44:20.319486 tst mo_mt_call_osmux.py: using LAC 32014 22:44:20.447697 tst mo_mt_call_osmux.py: using RAC 139 22:44:20.575341 tst mo_mt_call_osmux.py: using CellId 32014 22:44:20.697582 tst mo_mt_call_osmux.py: using BVCI 32015 22:44:20.811479 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:44:20.822534 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:44:20.833456 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:44:20.844528 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:44:20.855524 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:44:20.866905 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 22:44:20.985635 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 22:44:21.106733 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:44:21.611967 run create_hlr_db(pid=4013): Launched 22:44:21.744370 bus /sierra_2: Setting Powered False 22:44:22.808902 run create_hlr_db(pid=4013): Terminated: ok {rc=0} 22:44:23.243944 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4015): Launched 22:44:23.570195 run osmo-hlr_10.42.42.2(pid=4016): Launched 22:44:23.694386 run osmo-stp_10.42.42.5: Starting osmo-stp 22:44:24.233831 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4018): Launched 22:44:24.541184 run osmo-stp_10.42.42.5(pid=4019): Launched 22:44:24.658924 run osmo-msc_10.42.42.6: Starting osmo-msc 22:44:25.216258 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4021): Launched 22:44:25.522979 run osmo-msc_10.42.42.6(pid=4022): Launched 22:44:25.695479 run osmo-stp_10.42.42.5(pid=4019): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4019)] 22:44:25.825847 run osmo-stp_10.42.42.5(pid=4019): stdout: | (launched: 2022-12-12_22:44:24.485340) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:44:25.956136 run osmo-stp_10.42.42.5(pid=4019): stderr: | [0;m[38;5;43m20221212224424657 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224424657 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224424657 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224424658 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224424658 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224424658 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224424658 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:44:26.084413 run osmo-stp_10.42.42.5(pid=4019): stdout: | (launched: 2022-12-12_22:44:24.485340) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:44:26.205998 run osmo-stp_10.42.42.5(pid=4019): stderr: | [0;m[38;5;43m20221212224424657 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224424657 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224424657 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224424658 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224424658 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224424658 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224424658 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:44:26.351787 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4019): Process ended prematurely: osmo-stp_10.42.42.5(pid=4019) [trial-2383↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4019)] [trial-2383↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 22:44:26.360582 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 22:44:26.387840 run osmo-hlr_10.42.42.2(pid=4016): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4016)] 22:44:26.435461 run osmo-hlr_10.42.42.2(pid=4016): stdout: | (launched: 2022-12-12_22:44:23.511451) 22:44:26.484673 run osmo-hlr_10.42.42.2(pid=4016): stderr: | [0;m[1;31m20221212224423709 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212224423709 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212224423710 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212224423710 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212224423710 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212224423710 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212224423722 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212224423730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212224423730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212224423730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:44:26.553610 run osmo-msc_10.42.42.6(pid=4022): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4022)] 22:44:26.601406 run osmo-msc_10.42.42.6(pid=4022): stdout: | (launched: 2022-12-12_22:44:25.467200) 22:44:26.650320 run osmo-msc_10.42.42.6(pid=4022): stderr: | [0;m[38;5;43m20221212224425738 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212224425738 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb218a05c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212224425739 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212224425739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212224425739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212224425739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212224425741 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212224425741 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212224425741 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212224425741 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:44:26.699847 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4015): Terminating (SIGTERM) 22:44:26.739155 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4018): Terminating (SIGTERM) 22:44:26.778549 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4021): Terminating (SIGTERM) 22:44:26.818411 --- ParallelTerminationStrategy: PID 4015 died... 22:44:26.837319 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4015): Terminated: ok {rc=0} 22:44:26.881360 --- ParallelTerminationStrategy: PID 4018 died... 22:44:26.899582 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4018): Terminated: ok {rc=0} 22:44:26.944083 --- ParallelTerminationStrategy: PID 4021 died... 22:44:26.962746 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4021): Terminated: ok {rc=0} 22:44:27.046135 bus /sierra_3: Setting Powered False 22:44:28.141699 bus /sierra_3: Setting Powered False 22:44:29.254803 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 voice:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 22:44:30.508578 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:44:30.515130 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 22:44:30.548386 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 22:44:30.575822 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 22:44:30.630250 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 22:44:30.662669 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 22:44:30.689676 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 22:44:31.260300 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 22:44:31.317717 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:44:31.330264 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 22:44:31.388504 tst mo_mt_call.py: using LAC 32015 22:44:31.520098 tst mo_mt_call.py: using RAC 140 22:44:31.650026 tst mo_mt_call.py: using CellId 32015 22:44:31.788524 tst mo_mt_call.py: using BVCI 32016 22:44:31.940818 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:44:31.955855 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:44:31.970980 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:44:31.986196 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:44:32.000641 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:44:32.016236 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 22:44:32.163588 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 22:44:32.286088 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:44:32.759223 run create_hlr_db(pid=4028): Launched 22:44:32.875393 bus /sierra_2: Setting Powered False 22:44:33.935608 run create_hlr_db(pid=4028): Terminated: ok {rc=0} 22:44:34.360174 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4030): Launched 22:44:34.685868 run osmo-hlr_10.42.42.2(pid=4031): Launched 22:44:34.811740 run osmo-stp_10.42.42.5: Starting osmo-stp 22:44:35.375812 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4033): Launched 22:44:35.700366 run osmo-stp_10.42.42.5(pid=4034): Launched 22:44:35.826529 run osmo-msc_10.42.42.6: Starting osmo-msc 22:44:36.414363 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4036): Launched 22:44:36.738797 run osmo-msc_10.42.42.6(pid=4037): Launched 22:44:36.919145 run osmo-stp_10.42.42.5(pid=4034): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4034)] 22:44:37.054607 run osmo-stp_10.42.42.5(pid=4034): stdout: | (launched: 2022-12-12_22:44:35.641832) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:44:37.191667 run osmo-stp_10.42.42.5(pid=4034): stderr: | [0;m[38;5;43m20221212224435836 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224435837 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224435837 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224435837 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224435838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224435838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224435838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:44:37.327761 run osmo-stp_10.42.42.5(pid=4034): stdout: | (launched: 2022-12-12_22:44:35.641832) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:44:37.456537 run osmo-stp_10.42.42.5(pid=4034): stderr: | [0;m[38;5;43m20221212224435836 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224435837 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224435837 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224435837 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224435838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224435838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224435838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:44:37.610834 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4034): Process ended prematurely: osmo-stp_10.42.42.5(pid=4034) [trial-2383↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4034)] [trial-2383↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 22:44:37.620184 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 22:44:37.647926 run osmo-hlr_10.42.42.2(pid=4031): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4031)] 22:44:37.697494 run osmo-hlr_10.42.42.2(pid=4031): stdout: | (launched: 2022-12-12_22:44:34.626761) 22:44:37.748460 run osmo-hlr_10.42.42.2(pid=4031): stderr: | [0;m[1;31m20221212224434825 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212224434825 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212224434825 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212224434825 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212224434825 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212224434826 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212224434838 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212224434846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212224434846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212224434846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:44:37.819655 run osmo-msc_10.42.42.6(pid=4037): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4037)] 22:44:37.868704 run osmo-msc_10.42.42.6(pid=4037): stdout: | (launched: 2022-12-12_22:44:36.679922) 22:44:37.919600 run osmo-msc_10.42.42.6(pid=4037): stderr: | [0;m[38;5;43m20221212224437004 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212224437004 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2b270a2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212224437004 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212224437004 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212224437005 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212224437005 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212224437006 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212224437007 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212224437007 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212224437007 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:44:37.970870 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4030): Terminating (SIGTERM) 22:44:38.011863 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4033): Terminating (SIGTERM) 22:44:38.053416 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4036): Terminating (SIGTERM) 22:44:38.094985 --- ParallelTerminationStrategy: PID 4030 died... 22:44:38.114763 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4030): Terminated: ok {rc=0} 22:44:38.159996 --- ParallelTerminationStrategy: PID 4033 died... 22:44:38.179045 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4033): Terminated: ok {rc=0} 22:44:38.224264 --- ParallelTerminationStrategy: PID 4036 died... 22:44:38.243580 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4036): Terminated: ok {rc=0} 22:44:38.329712 bus /sierra_3: Setting Powered False 22:44:39.429344 bus /sierra_3: Setting Powered False 22:44:40.542984 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2383 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 22:44:41.687395 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:44:41.699264 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 22:44:41.750941 tst mo_mt_call_osmux.py: using LAC 32016 22:44:41.872737 tst mo_mt_call_osmux.py: using RAC 141 22:44:41.994483 tst mo_mt_call_osmux.py: using CellId 32016 22:44:42.116898 tst mo_mt_call_osmux.py: using BVCI 32017 22:44:42.228171 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:44:42.239527 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:44:42.250507 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:44:42.261893 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:44:42.273211 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 22:44:42.284326 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 22:44:42.404145 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 22:44:42.526869 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:44:43.032567 run create_hlr_db(pid=4039): Launched 22:44:43.164934 bus /sierra_2: Setting Powered False 22:44:44.225999 run create_hlr_db(pid=4039): Terminated: ok {rc=0} 22:44:44.660413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4041): Launched 22:44:44.965927 run osmo-hlr_10.42.42.2(pid=4042): Launched 22:44:45.082375 run osmo-stp_10.42.42.5: Starting osmo-stp 22:44:45.624788 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4044): Launched 22:44:45.961690 run osmo-stp_10.42.42.5(pid=4045): Launched 22:44:46.192827 run osmo-msc_10.42.42.6: Starting osmo-msc 22:44:46.855168 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4047): Launched 22:44:47.203386 run osmo-msc_10.42.42.6(pid=4048): Launched 22:44:47.418112 run osmo-stp_10.42.42.5(pid=4045): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4045)] 22:44:47.550287 run osmo-stp_10.42.42.5(pid=4045): stdout: | (launched: 2022-12-12_22:44:45.885830) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:44:47.678851 run osmo-stp_10.42.42.5(pid=4045): stderr: | [0;m[38;5;43m20221212224446140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224446140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224446140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224446140 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224446141 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224446141 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224446141 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:44:47.806470 run osmo-stp_10.42.42.5(pid=4045): stdout: | (launched: 2022-12-12_22:44:45.885830) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:44:47.928191 run osmo-stp_10.42.42.5(pid=4045): stderr: | [0;m[38;5;43m20221212224446140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224446140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224446140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224446140 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224446141 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224446141 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224446141 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:44:48.074427 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4045): Process ended prematurely: osmo-stp_10.42.42.5(pid=4045) [trial-2383↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4045)] [trial-2383↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 22:44:48.083293 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 22:44:48.109949 run osmo-hlr_10.42.42.2(pid=4042): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4042)] 22:44:48.158027 run osmo-hlr_10.42.42.2(pid=4042): stdout: | (launched: 2022-12-12_22:44:44.910249) 22:44:48.207308 run osmo-hlr_10.42.42.2(pid=4042): stderr: | [0;m[1;31m20221212224445089 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212224445089 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212224445089 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212224445089 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212224445089 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212224445089 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212224445102 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212224445112 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212224445112 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212224445112 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:44:48.275925 run osmo-msc_10.42.42.6(pid=4048): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4048)] 22:44:48.323293 run osmo-msc_10.42.42.6(pid=4048): stdout: | (launched: 2022-12-12_22:44:47.135495) 22:44:48.372593 run osmo-msc_10.42.42.6(pid=4048): stderr: | [0;m[38;5;43m20221212224447434 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212224447434 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4ddfa88c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212224447434 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212224447434 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212224447434 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212224447434 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212224447436 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212224447436 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212224447437 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212224447437 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:44:48.422037 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4041): Terminating (SIGTERM) 22:44:48.461641 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4044): Terminating (SIGTERM) 22:44:48.501159 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4047): Terminating (SIGTERM) 22:44:48.541175 --- ParallelTerminationStrategy: PID 4041 died... 22:44:48.560384 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4041): Terminated: ok {rc=0} 22:44:48.604629 --- ParallelTerminationStrategy: PID 4044 died... 22:44:48.623090 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4044): Terminated: ok {rc=0} 22:44:48.667657 --- ParallelTerminationStrategy: PID 4047 died... 22:44:48.686318 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4047): Terminated: ok {rc=0} 22:44:48.771504 bus /sierra_3: Setting Powered False 22:44:49.870106 bus /sierra_3: Setting Powered False 22:44:50.985067 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 emergency:trx-umtrx --------------------------------------------------------------------- 22:44:52.239079 tst emergency:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:44:52.243681 tst emergency:trx-umtrx: Verifying 1 x bts (candidates: 11) 22:44:52.276684 tst emergency:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 22:44:52.304270 tst emergency:trx-umtrx: Verifying 4 x modem (candidates: 12) 22:44:52.389824 tst emergency:trx-umtrx: Reserving 1 x bts (candidates: 11) 22:44:52.423320 tst emergency:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 22:44:52.450849 tst emergency:trx-umtrx: Reserving 4 x modem (candidates: 12) 22:44:53.033965 tst emergency:trx-umtrx: RESERVED RESOURCES for emergency: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2383 emergency:trx-umtrx emergency_mo_mt_call.py ---------------------------------------------- 22:44:53.040171 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:44:53.051117 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 22:44:53.102948 tst emergency_mo_mt_call.py: using LAC 32017 22:44:53.221387 tst emergency_mo_mt_call.py: using RAC 142 22:44:53.346292 tst emergency_mo_mt_call.py: using CellId 32017 22:44:53.470232 tst emergency_mo_mt_call.py: using BVCI 32018 22:44:53.587700 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:44:53.598835 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:44:53.609800 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:44:53.621139 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:44:53.631915 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:44:53.642869 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 22:44:53.758005 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 22:44:53.880362 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:44:54.379154 run create_hlr_db(pid=4053): Launched 22:44:54.509149 bus /sierra_2: Setting Powered False 22:44:55.573020 run create_hlr_db(pid=4053): Terminated: ok {rc=0} 22:44:56.018207 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4055): Launched 22:44:56.339273 run osmo-hlr_10.42.42.2(pid=4056): Launched 22:44:56.461655 run osmo-stp_10.42.42.5: Starting osmo-stp 22:44:57.017130 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4058): Launched 22:44:57.336365 run osmo-stp_10.42.42.5(pid=4059): Launched 22:44:57.468822 tst emergency_mo_mt_call.py: using MSISDN 8008 22:44:57.633109 run osmo-msc_10.42.42.6: Starting osmo-msc 22:44:58.208853 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4061): Launched 22:44:58.529630 run osmo-msc_10.42.42.6(pid=4062): Launched 22:44:58.710468 run osmo-stp_10.42.42.5(pid=4059): ERR: Terminated: ERROR {rc=1} [trial-2383↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4059)] 22:44:58.846939 run osmo-stp_10.42.42.5(pid=4059): stdout: | (launched: 2022-12-12_22:44:57.278497) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:44:58.983973 run osmo-stp_10.42.42.5(pid=4059): stderr: | [0;m[38;5;43m20221212224457472 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224457473 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224457473 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224457473 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224457474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224457474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224457474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:44:59.119644 run osmo-stp_10.42.42.5(pid=4059): stdout: | (launched: 2022-12-12_22:44:57.278497) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:44:59.247957 run osmo-stp_10.42.42.5(pid=4059): stderr: | [0;m[38;5;43m20221212224457472 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224457473 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224457473 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224457473 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224457474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224457474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224457474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:44:59.401656 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=4059): Process ended prematurely: osmo-stp_10.42.42.5(pid=4059) [trial-2383↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4059)] [trial-2383↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19] 22:44:59.410643 tst emergency_mo_mt_call.py:19: Test FAILED (6.4 sec) 22:44:59.437876 run osmo-hlr_10.42.42.2(pid=4056): ERR: Terminated: ERROR {rc=237} [trial-2383↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4056)] 22:44:59.487517 run osmo-hlr_10.42.42.2(pid=4056): stdout: | (launched: 2022-12-12_22:44:56.281275) 22:44:59.538841 run osmo-hlr_10.42.42.2(pid=4056): stderr: | [0;m[1;31m20221212224456480 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212224456480 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212224456480 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212224456480 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212224456480 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212224456480 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212224456492 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/emergency:trx-umtrx/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212224456500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212224456501 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212224456501 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:44:59.610066 run osmo-msc_10.42.42.6(pid=4062): ERR: Terminated: ERROR {rc=2} [trial-2383↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4062)] 22:44:59.659623 run osmo-msc_10.42.42.6(pid=4062): stdout: | (launched: 2022-12-12_22:44:58.471648) 22:44:59.710819 run osmo-msc_10.42.42.6(pid=4062): stderr: | [0;m[38;5;43m20221212224458795 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212224458795 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6bdae9ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212224458795 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212224458795 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212224458796 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212224458796 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212224458798 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212224458798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212224458798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212224458798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:44:59.762383 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4055): Terminating (SIGTERM) 22:44:59.803500 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4058): Terminating (SIGTERM) 22:44:59.844671 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4061): Terminating (SIGTERM) 22:44:59.886337 --- ParallelTerminationStrategy: PID 4055 died... 22:44:59.906223 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4055): Terminated: ok {rc=0} 22:44:59.951837 --- ParallelTerminationStrategy: PID 4058 died... 22:44:59.971194 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4058): Terminated: ok {rc=0} 22:45:00.017310 --- ParallelTerminationStrategy: PID 4061 died... 22:45:00.036428 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4061): Terminated: ok {rc=0} 22:45:00.123504 bus /sierra_3: Setting Powered False 22:45:01.222351 bus /sierra_3: Setting Powered False 22:45:02.335287 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2383 emergency:trx-umtrx emergency_preemptive_call.py ---------------------------------------------- 22:45:03.421608 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:45:03.433306 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 22:45:03.484826 tst emergency_preemptive_call.py: using LAC 32018 22:45:03.612623 tst emergency_preemptive_call.py: using RAC 143 22:45:03.738137 tst emergency_preemptive_call.py: using CellId 32018 22:45:03.863465 tst emergency_preemptive_call.py: using BVCI 32019 22:45:03.979601 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:45:03.990841 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:45:04.001742 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:45:04.012559 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:45:04.023535 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 22:45:04.034461 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 22:45:04.149576 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 22:45:04.269945 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 22:45:04.388817 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 22:45:04.505941 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:45:04.973104 run create_hlr_db(pid=4067): Launched 22:45:05.088669 bus /sierra_2: Setting Powered False 22:45:06.147312 run create_hlr_db(pid=4067): Terminated: ok {rc=0} 22:45:06.567402 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4069): Launched 22:45:06.866501 run osmo-hlr_10.42.42.2(pid=4070): Launched 22:45:06.981518 run osmo-stp_10.42.42.5: Starting osmo-stp 22:45:07.513178 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4072): Launched 22:45:07.813839 run osmo-stp_10.42.42.5(pid=4073): Launched 22:45:07.948491 tst emergency_preemptive_call.py: using MSISDN 8009 22:45:08.114414 run osmo-msc_10.42.42.6: Starting osmo-msc 22:45:08.691296 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4075): Launched 22:45:09.011569 run osmo-msc_10.42.42.6(pid=4076): Launched 22:45:09.190745 run osmo-stp_10.42.42.5(pid=4073): ERR: Terminated: ERROR {rc=1} [trial-2383↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4073)] 22:45:09.326604 run osmo-stp_10.42.42.5(pid=4073): stdout: | (launched: 2022-12-12_22:45:07.758685) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:45:09.464035 run osmo-stp_10.42.42.5(pid=4073): stderr: | [0;m[38;5;43m20221212224507946 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224507946 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224507946 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224507947 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224507947 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224507947 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224507947 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:45:09.598968 run osmo-stp_10.42.42.5(pid=4073): stdout: | (launched: 2022-12-12_22:45:07.758685) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:45:09.726671 run osmo-stp_10.42.42.5(pid=4073): stderr: | [0;m[38;5;43m20221212224507946 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224507946 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224507946 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224507947 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224507947 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224507947 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224507947 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:45:09.879117 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=4073): Process ended prematurely: osmo-stp_10.42.42.5(pid=4073) [trial-2383↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4073)] [trial-2383↪emergency:trx-umtrx↪emergency_preemptive_call.py:32] 22:45:09.887867 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 22:45:09.915516 run osmo-hlr_10.42.42.2(pid=4070): ERR: Terminated: ERROR {rc=237} [trial-2383↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4070)] 22:45:09.965313 run osmo-hlr_10.42.42.2(pid=4070): stdout: | (launched: 2022-12-12_22:45:06.811800) 22:45:10.016562 run osmo-hlr_10.42.42.2(pid=4070): stderr: | [0;m[1;31m20221212224506987 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212224506987 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212224506987 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212224506987 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212224506987 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212224506987 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212224506999 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/emergency:trx-umtrx/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212224507008 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212224507008 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212224507008 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:45:10.088419 run osmo-msc_10.42.42.6(pid=4076): ERR: Terminated: ERROR {rc=2} [trial-2383↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4076)] 22:45:10.138016 run osmo-msc_10.42.42.6(pid=4076): stdout: | (launched: 2022-12-12_22:45:08.953491) 22:45:10.189600 run osmo-msc_10.42.42.6(pid=4076): stderr: | [0;m[38;5;43m20221212224509274 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212224509274 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fea1b3cac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212224509275 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212224509275 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212224509275 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212224509275 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212224509277 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212224509277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212224509277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212224509277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:45:10.241473 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4069): Terminating (SIGTERM) 22:45:10.283156 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4072): Terminating (SIGTERM) 22:45:10.325198 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4075): Terminating (SIGTERM) 22:45:10.367118 --- ParallelTerminationStrategy: PID 4069 died... 22:45:10.387045 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4069): Terminated: ok {rc=0} 22:45:10.433638 --- ParallelTerminationStrategy: PID 4072 died... 22:45:10.453139 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4072): Terminated: ok {rc=0} 22:45:10.499180 --- ParallelTerminationStrategy: PID 4075 died... 22:45:10.518641 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4075): Terminated: ok {rc=0} 22:45:10.606313 bus /sierra_9: Setting Powered False 22:45:11.705766 bus /sierra_9: Setting Powered False 22:45:12.820807 bus /sierra_8: Setting Powered False 22:45:13.915657 bus /sierra_8: Setting Powered False 22:45:15.031501 bus /sierra_3: Setting Powered False 22:45:16.126616 bus /sierra_3: Setting Powered False 22:45:17.243165 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 emergency:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 gprs:trx-umtrx --------------------------------------------------------------------- 22:45:18.524074 tst gprs:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:45:18.529343 tst gprs:trx-umtrx: Verifying 1 x bts (candidates: 11) 22:45:18.562978 tst gprs:trx-umtrx: Verifying 9 x ip_address (candidates: 9) 22:45:18.602441 tst gprs:trx-umtrx: Verifying 4 x modem (candidates: 12) 22:45:18.695384 tst gprs:trx-umtrx: Reserving 1 x bts (candidates: 11) 22:45:18.728609 tst gprs:trx-umtrx: Reserving 9 x ip_address (candidates: 9) 22:45:18.767748 tst gprs:trx-umtrx: Reserving 4 x modem (candidates: 12) 22:45:19.353928 tst gprs:trx-umtrx: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2383 gprs:trx-umtrx cs_paging_gprs_active.py ---------------------------------------------- 22:45:19.408146 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:45:19.418887 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 22:45:19.466205 tst cs_paging_gprs_active.py: using LAC 32019 22:45:19.588075 tst cs_paging_gprs_active.py: using RAC 144 22:45:19.708155 tst cs_paging_gprs_active.py: using CellId 32019 22:45:19.831113 tst cs_paging_gprs_active.py: using BVCI 32020 22:45:19.944919 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:45:19.955720 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:45:19.966271 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:45:19.977618 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:45:19.988750 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:45:19.999901 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:45:20.011402 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:45:20.022638 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:45:20.033999 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 22:45:20.156568 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 22:45:20.273685 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:45:20.481739 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:45:20.789114 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4081): Launched 22:45:21.056560 run iperf3-srv_10.42.42.10(pid=4082): Launched 22:45:21.172473 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:45:21.378385 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:45:21.685408 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4083): Launched 22:45:21.953674 run iperf3-srv_10.42.42.10(pid=4084): Launched 22:45:22.069595 tst cs_paging_gprs_active.py:38: start network... 22:45:22.276660 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:45:22.754403 run create_hlr_db(pid=4085): Launched 22:45:22.871733 bus /sierra_2: Setting Powered False 22:45:23.932124 run create_hlr_db(pid=4085): Terminated: ok {rc=0} 22:45:24.379582 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4087): Launched 22:45:24.708736 run osmo-hlr_10.42.42.2(pid=4088): Launched 22:45:24.834064 run osmo-stp_10.42.42.5: Starting osmo-stp 22:45:25.395635 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4090): Launched 22:45:25.721930 run osmo-stp_10.42.42.5(pid=4091): Launched 22:45:25.846029 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:45:26.408859 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4093): Launched 22:45:26.534729 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:45:26.811209 run patchelf(pid=4094): Launched 22:45:26.993938 run osmo-stp_10.42.42.5(pid=4091): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4091)] 22:45:27.131604 run osmo-stp_10.42.42.5(pid=4091): stdout: | (launched: 2022-12-12_22:45:25.662298) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:45:27.271215 run osmo-stp_10.42.42.5(pid=4091): stderr: | [0;m[38;5;43m20221212224525857 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224525857 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224525858 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224525858 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224525858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224525859 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224525859 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:45:27.411377 run osmo-stp_10.42.42.5(pid=4091): stdout: | (launched: 2022-12-12_22:45:25.662298) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:45:27.545613 run osmo-stp_10.42.42.5(pid=4091): stderr: | [0;m[38;5;43m20221212224525857 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224525857 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224525858 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224525858 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224525858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224525859 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224525859 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:45:27.703844 run patchelf(pid=4094): Terminating (SIGINT) 22:45:27.887507 run patchelf(pid=4094): Terminated: ok {rc=0} 22:45:28.019773 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=4091): Process ended prematurely: osmo-stp_10.42.42.5(pid=4091) [trial-2383↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4091)] [trial-2383↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38] 22:45:28.029824 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 22:45:28.057952 run osmo-hlr_10.42.42.2(pid=4088): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-umtrx↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4088)] 22:45:28.107187 run osmo-hlr_10.42.42.2(pid=4088): stdout: | (launched: 2022-12-12_22:45:24.649350) 22:45:28.158363 run osmo-hlr_10.42.42.2(pid=4088): stderr: | [0;m[1;31m20221212224524851 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212224524851 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212224524851 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212224524851 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212224524851 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212224524851 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212224524863 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-umtrx/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212224524871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212224524871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212224524871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:45:28.209872 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4081): Terminating (SIGTERM) 22:45:28.251186 run iperf3-srv_10.42.42.10(pid=4082): Terminating (SIGTERM) 22:45:28.292363 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4083): Terminating (SIGTERM) 22:45:28.333880 run iperf3-srv_10.42.42.10(pid=4084): Terminating (SIGTERM) 22:45:28.375078 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4087): Terminating (SIGTERM) 22:45:28.416630 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4090): Terminating (SIGTERM) 22:45:28.458526 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4093): Terminating (SIGTERM) 22:45:28.500259 --- ParallelTerminationStrategy: PID 4081 died... 22:45:28.520081 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4081): Terminated: ok {rc=0} 22:45:28.565531 --- ParallelTerminationStrategy: PID 4082 died... 22:45:28.584491 run iperf3-srv_10.42.42.10(pid=4082): Terminated {rc=256} 22:45:28.629948 --- ParallelTerminationStrategy: PID 4083 died... 22:45:28.649260 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4083): Terminated: ok {rc=0} 22:45:28.694538 --- ParallelTerminationStrategy: PID 4084 died... 22:45:28.713713 run iperf3-srv_10.42.42.10(pid=4084): Terminated {rc=256} 22:45:28.758986 --- ParallelTerminationStrategy: PID 4087 died... 22:45:28.778232 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4087): Terminated: ok {rc=0} 22:45:28.823438 --- ParallelTerminationStrategy: PID 4090 died... 22:45:28.842665 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4090): Terminated: ok {rc=0} 22:45:28.888453 --- ParallelTerminationStrategy: PID 4093 died... 22:45:28.907763 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4093): Terminated: ok {rc=0} 22:45:28.994210 bus /gobi_0: Setting Powered False 22:45:30.094314 bus /gobi_0: Setting Powered False 22:45:31.214283 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-umtrx iperf3.py ---------------------------------------------- 22:45:32.372132 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:45:32.383241 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 22:45:32.434385 tst iperf3.py: using LAC 32020 22:45:32.565386 tst iperf3.py: using RAC 145 22:45:32.694354 tst iperf3.py: using CellId 32020 22:45:32.824396 tst iperf3.py: using BVCI 32021 22:45:32.944360 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:45:32.956033 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:45:32.967014 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:45:32.978061 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:45:32.988728 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:45:32.999820 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:45:33.010938 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:45:33.021949 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:45:33.032826 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 22:45:33.150113 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:45:33.356938 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:45:33.664799 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4095): Launched 22:45:33.932861 run iperf3-srv_10.42.42.10(pid=4096): Launched 22:45:34.048567 tst iperf3.py:8: start network... 22:45:34.254419 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:45:34.729608 run create_hlr_db(pid=4097): Launched 22:45:34.849113 bus /gobi_6: Setting Powered False 22:45:35.910151 run create_hlr_db(pid=4097): Terminated: ok {rc=0} 22:45:36.335974 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4099): Launched 22:45:36.643630 run osmo-hlr_10.42.42.2(pid=4100): Launched 22:45:36.761516 run osmo-stp_10.42.42.5: Starting osmo-stp 22:45:37.303001 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4102): Launched 22:45:37.608324 run osmo-stp_10.42.42.5(pid=4103): Launched 22:45:37.726052 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:45:38.253468 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4105): Launched 22:45:38.371052 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:45:38.630194 run patchelf(pid=4106): Launched 22:45:38.800723 run osmo-stp_10.42.42.5(pid=4103): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4103)] 22:45:38.930411 run osmo-stp_10.42.42.5(pid=4103): stdout: | (launched: 2022-12-12_22:45:37.552470) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:45:39.060845 run osmo-stp_10.42.42.5(pid=4103): stderr: | [0;m[38;5;43m20221212224537724 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224537725 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224537725 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224537725 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224537726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224537726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224537726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:45:39.192155 run osmo-stp_10.42.42.5(pid=4103): stdout: | (launched: 2022-12-12_22:45:37.552470) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:45:39.317227 run osmo-stp_10.42.42.5(pid=4103): stderr: | [0;m[38;5;43m20221212224537724 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224537725 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224537725 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224537725 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224537726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224537726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224537726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:45:39.466026 run patchelf(pid=4106): Terminating (SIGINT) 22:45:39.639377 run patchelf(pid=4106): Terminated: ok {rc=0} 22:45:39.763953 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4103): Process ended prematurely: osmo-stp_10.42.42.5(pid=4103) [trial-2383↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4103)] [trial-2383↪gprs:trx-umtrx↪iperf3.py:8] 22:45:39.773418 tst iperf3.py:8: Test FAILED (7.4 sec) 22:45:39.800761 run osmo-hlr_10.42.42.2(pid=4100): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-umtrx↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4100)] 22:45:39.848793 run osmo-hlr_10.42.42.2(pid=4100): stdout: | (launched: 2022-12-12_22:45:36.587719) 22:45:39.897698 run osmo-hlr_10.42.42.2(pid=4100): stderr: | [0;m[1;31m20221212224536783 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212224536783 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212224536783 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212224536783 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212224536783 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212224536783 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212224536795 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-umtrx/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212224536803 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212224536803 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212224536803 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:45:39.947205 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4095): Terminating (SIGTERM) 22:45:39.986696 run iperf3-srv_10.42.42.10(pid=4096): Terminating (SIGTERM) 22:45:40.026073 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4099): Terminating (SIGTERM) 22:45:40.065469 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4102): Terminating (SIGTERM) 22:45:40.104737 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4105): Terminating (SIGTERM) 22:45:40.144280 --- ParallelTerminationStrategy: PID 4095 died... 22:45:40.162992 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4095): Terminated: ok {rc=0} 22:45:40.207616 --- ParallelTerminationStrategy: PID 4096 died... 22:45:40.225993 run iperf3-srv_10.42.42.10(pid=4096): Terminated {rc=256} 22:45:40.269430 --- ParallelTerminationStrategy: PID 4099 died... 22:45:40.287762 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4099): Terminated: ok {rc=0} 22:45:40.331173 --- ParallelTerminationStrategy: PID 4102 died... 22:45:40.349483 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4102): Terminated: ok {rc=0} 22:45:40.393687 --- ParallelTerminationStrategy: PID 4105 died... 22:45:40.412012 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4105): Terminated: ok {rc=0} 22:45:40.495116 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-umtrx iperf3m4.py ---------------------------------------------- 22:45:41.643500 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:45:41.655135 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 22:45:41.705074 tst iperf3m4.py: using LAC 32021 22:45:41.838421 tst iperf3m4.py: using RAC 146 22:45:41.969782 tst iperf3m4.py: using CellId 32021 22:45:42.091109 tst iperf3m4.py: using BVCI 32022 22:45:42.204650 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:45:42.215267 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:45:42.225601 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:45:42.236149 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:45:42.246721 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:45:42.257338 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:45:42.268049 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:45:42.278615 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:45:42.289299 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 22:45:42.408742 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 22:45:42.531182 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 22:45:42.651460 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 22:45:42.768592 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:45:42.975058 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:45:43.281640 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4107): Launched 22:45:43.549614 run iperf3-srv_10.42.42.10(pid=4108): Launched 22:45:43.665981 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:45:43.873992 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:45:44.183618 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4109): Launched 22:45:44.451228 run iperf3-srv_10.42.42.10(pid=4110): Launched 22:45:44.566972 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:45:44.773593 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:45:45.081631 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4111): Launched 22:45:45.349435 run iperf3-srv_10.42.42.10(pid=4112): Launched 22:45:45.465730 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:45:45.672550 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:45:46.026553 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4113): Launched 22:45:46.360651 run iperf3-srv_10.42.42.10(pid=4114): Launched 22:45:46.501295 tst iperf3m4.py:8: start network... 22:45:46.730020 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:45:47.281378 run create_hlr_db(pid=4115): Launched 22:45:47.436242 bus /gobi_6: Setting Powered False 22:45:48.497689 run create_hlr_db(pid=4115): Terminated: ok {rc=0} 22:45:48.954339 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4117): Launched 22:45:49.281470 run osmo-hlr_10.42.42.2(pid=4118): Launched 22:45:49.408005 run osmo-stp_10.42.42.5: Starting osmo-stp 22:45:49.974701 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4120): Launched 22:45:50.300880 run osmo-stp_10.42.42.5(pid=4121): Launched 22:45:50.426790 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:45:50.997276 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4123): Launched 22:45:51.121939 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:45:51.397732 run patchelf(pid=4124): Launched 22:45:51.580692 run osmo-stp_10.42.42.5(pid=4121): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4121)] 22:45:51.718979 run osmo-stp_10.42.42.5(pid=4121): stdout: | (launched: 2022-12-12_22:45:50.241671) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:45:51.858796 run osmo-stp_10.42.42.5(pid=4121): stderr: | [0;m[38;5;43m20221212224550436 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224550436 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224550436 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224550437 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224550437 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224550437 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224550437 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:45:51.998720 run osmo-stp_10.42.42.5(pid=4121): stdout: | (launched: 2022-12-12_22:45:50.241671) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:45:52.133078 run osmo-stp_10.42.42.5(pid=4121): stderr: | [0;m[38;5;43m20221212224550436 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224550436 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224550436 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224550437 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224550437 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224550437 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224550437 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:45:52.292166 run patchelf(pid=4124): Terminating (SIGINT) 22:45:52.477332 run patchelf(pid=4124): Terminated: ok {rc=0} 22:45:52.610159 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4121): Process ended prematurely: osmo-stp_10.42.42.5(pid=4121) [trial-2383↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4121)] [trial-2383↪gprs:trx-umtrx↪iperf3m4.py:8] 22:45:52.620396 tst iperf3m4.py:8: Test FAILED (11.0 sec) 22:45:52.649076 run osmo-hlr_10.42.42.2(pid=4118): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-umtrx↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4118)] 22:45:52.698323 run osmo-hlr_10.42.42.2(pid=4118): stdout: | (launched: 2022-12-12_22:45:49.221938) 22:45:52.749271 run osmo-hlr_10.42.42.2(pid=4118): stderr: | [0;m[1;31m20221212224549424 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212224549424 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212224549424 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212224549424 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212224549424 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212224549424 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212224549436 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-umtrx/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212224549444 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212224549445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212224549445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:45:52.800605 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4107): Terminating (SIGTERM) 22:45:52.841912 run iperf3-srv_10.42.42.10(pid=4108): Terminating (SIGTERM) 22:45:52.883198 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4109): Terminating (SIGTERM) 22:45:52.924536 run iperf3-srv_10.42.42.10(pid=4110): Terminating (SIGTERM) 22:45:52.965849 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4111): Terminating (SIGTERM) 22:45:53.007403 run iperf3-srv_10.42.42.10(pid=4112): Terminating (SIGTERM) 22:45:53.048675 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4113): Terminating (SIGTERM) 22:45:53.090221 run iperf3-srv_10.42.42.10(pid=4114): Terminating (SIGTERM) 22:45:53.131411 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4117): Terminating (SIGTERM) 22:45:53.172764 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4120): Terminating (SIGTERM) 22:45:53.214226 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4123): Terminating (SIGTERM) 22:45:53.255553 --- ParallelTerminationStrategy: PID 4107 died... 22:45:53.275360 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4107): Terminated: ok {rc=0} 22:45:53.321292 --- ParallelTerminationStrategy: PID 4108 died... 22:45:53.340620 run iperf3-srv_10.42.42.10(pid=4108): Terminated {rc=256} 22:45:53.386550 --- ParallelTerminationStrategy: PID 4109 died... 22:45:53.405771 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4109): Terminated: ok {rc=0} 22:45:53.451660 --- ParallelTerminationStrategy: PID 4110 died... 22:45:53.470998 run iperf3-srv_10.42.42.10(pid=4110): Terminated {rc=256} 22:45:53.515952 --- ParallelTerminationStrategy: PID 4111 died... 22:45:53.535072 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4111): Terminated: ok {rc=0} 22:45:53.580283 --- ParallelTerminationStrategy: PID 4112 died... 22:45:53.599482 run iperf3-srv_10.42.42.10(pid=4112): Terminated {rc=256} 22:45:53.645092 --- ParallelTerminationStrategy: PID 4113 died... 22:45:53.664272 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4113): Terminated: ok {rc=0} 22:45:53.709706 --- ParallelTerminationStrategy: PID 4114 died... 22:45:53.729099 run iperf3-srv_10.42.42.10(pid=4114): Terminated {rc=256} 22:45:53.774214 --- ParallelTerminationStrategy: PID 4117 died... 22:45:53.793484 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4117): Terminated: ok {rc=0} 22:45:53.838833 --- ParallelTerminationStrategy: PID 4120 died... 22:45:53.858250 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4120): Terminated: ok {rc=0} 22:45:53.903690 --- ParallelTerminationStrategy: PID 4123 died... 22:45:53.923042 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4123): Terminated: ok {rc=0} 22:45:54.009669 bus /gobi_4: Setting Powered False 22:45:55.107549 bus /gobi_4: Setting Powered False 22:45:56.223299 bus /gobi_1: Setting Powered False 22:45:57.320835 bus /gobi_1: Setting Powered False 22:45:58.436191 bus /gobi_0: Setting Powered False 22:45:59.534302 bus /gobi_0: Setting Powered False 22:46:00.649417 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-umtrx ping.py ---------------------------------------------- 22:46:01.748181 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:46:01.760379 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 22:46:01.811605 tst ping.py: using LAC 32022 22:46:01.969270 tst ping.py: using RAC 147 22:46:02.126843 tst ping.py: using CellId 32022 22:46:02.264609 tst ping.py: using BVCI 32023 22:46:02.381597 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:46:02.392523 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:46:02.403488 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:46:02.414532 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:46:02.425331 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:46:02.436498 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:46:02.447528 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:46:02.458503 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 22:46:02.573921 tst ping.py:19: start network... 22:46:02.777069 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:46:03.241332 run create_hlr_db(pid=4125): Launched 22:46:03.355912 bus /gobi_6: Setting Powered False 22:46:04.414995 run create_hlr_db(pid=4125): Terminated: ok {rc=0} 22:46:04.854045 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4127): Launched 22:46:05.172561 run osmo-hlr_10.42.42.2(pid=4128): Launched 22:46:05.294819 run osmo-stp_10.42.42.5: Starting osmo-stp 22:46:05.858261 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4130): Launched 22:46:06.178416 run osmo-stp_10.42.42.5(pid=4131): Launched 22:46:06.300559 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:46:06.854948 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4133): Launched 22:46:06.977929 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:46:07.248583 run patchelf(pid=4134): Launched 22:46:07.427130 run osmo-stp_10.42.42.5(pid=4131): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4131)] 22:46:07.563868 run osmo-stp_10.42.42.5(pid=4131): stdout: | (launched: 2022-12-12_22:46:06.120161) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:46:07.701321 run osmo-stp_10.42.42.5(pid=4131): stderr: | [0;m[38;5;43m20221212224606312 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224606312 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224606312 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224606313 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224606315 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224606315 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224606315 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:46:07.839153 run osmo-stp_10.42.42.5(pid=4131): stdout: | (launched: 2022-12-12_22:46:06.120161) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:46:07.970865 run osmo-stp_10.42.42.5(pid=4131): stderr: | [0;m[38;5;43m20221212224606312 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224606312 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224606312 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224606313 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224606315 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224606315 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224606315 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:46:08.126638 run patchelf(pid=4134): Terminating (SIGINT) 22:46:08.308082 run patchelf(pid=4134): Terminated: ok {rc=0} 22:46:08.439523 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=4131): Process ended prematurely: osmo-stp_10.42.42.5(pid=4131) [trial-2383↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4131)] [trial-2383↪gprs:trx-umtrx↪ping.py:22] 22:46:08.449144 tst ping.py:22: Test FAILED (6.7 sec) 22:46:08.477068 run osmo-hlr_10.42.42.2(pid=4128): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-umtrx↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4128)] 22:46:08.526750 run osmo-hlr_10.42.42.2(pid=4128): stdout: | (launched: 2022-12-12_22:46:05.114834) 22:46:08.577939 run osmo-hlr_10.42.42.2(pid=4128): stderr: | [0;m[1;31m20221212224605314 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212224605314 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212224605314 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212224605314 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212224605314 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212224605315 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212224605327 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-umtrx/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212224605336 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212224605336 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212224605336 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:46:08.629621 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4127): Terminating (SIGTERM) 22:46:08.671453 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4130): Terminating (SIGTERM) 22:46:08.713285 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4133): Terminating (SIGTERM) 22:46:08.755297 --- ParallelTerminationStrategy: PID 4127 died... 22:46:08.775444 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4127): Terminated: ok {rc=0} 22:46:08.821348 --- ParallelTerminationStrategy: PID 4130 died... 22:46:08.840813 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4130): Terminated: ok {rc=0} 22:46:08.887019 --- ParallelTerminationStrategy: PID 4133 died... 22:46:08.906499 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4133): Terminated: ok {rc=0} 22:46:08.992608 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-umtrx ping_idle_ping.py ---------------------------------------------- 22:46:10.080006 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:46:10.091935 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 22:46:10.141458 tst ping_idle_ping.py: using LAC 32023 22:46:10.269042 tst ping_idle_ping.py: using RAC 148 22:46:10.394802 tst ping_idle_ping.py: using CellId 32023 22:46:10.521626 tst ping_idle_ping.py: using BVCI 32024 22:46:10.638995 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:46:10.650033 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:46:10.660870 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:46:10.671732 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:46:10.682570 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:46:10.693336 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:46:10.704124 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 22:46:10.715152 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 22:46:10.834375 tst ping_idle_ping.py:24: start network... 22:46:11.050657 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:46:11.549917 run create_hlr_db(pid=4135): Launched 22:46:11.679205 bus /gobi_6: Setting Powered False 22:46:12.742915 run create_hlr_db(pid=4135): Terminated: ok {rc=0} 22:46:13.193019 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4137): Launched 22:46:13.515372 run osmo-hlr_10.42.42.2(pid=4138): Launched 22:46:13.639114 run osmo-stp_10.42.42.5: Starting osmo-stp 22:46:14.200009 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4140): Launched 22:46:14.521892 run osmo-stp_10.42.42.5(pid=4141): Launched 22:46:14.644640 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:46:15.199748 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4143): Launched 22:46:15.322374 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:46:15.593209 run patchelf(pid=4144): Launched 22:46:15.771769 run osmo-stp_10.42.42.5(pid=4141): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4141)] 22:46:15.908885 run osmo-stp_10.42.42.5(pid=4141): stdout: | (launched: 2022-12-12_22:46:14.463529) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:46:16.048336 run osmo-stp_10.42.42.5(pid=4141): stderr: | [0;m[38;5;43m20221212224614656 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224614656 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224614656 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224614657 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224614657 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224614657 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224614658 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:46:16.187895 run osmo-stp_10.42.42.5(pid=4141): stdout: | (launched: 2022-12-12_22:46:14.463529) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:46:16.321907 run osmo-stp_10.42.42.5(pid=4141): stderr: | [0;m[38;5;43m20221212224614656 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224614656 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224614656 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224614657 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224614657 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224614657 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224614658 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:46:16.480912 run patchelf(pid=4144): Terminating (SIGINT) 22:46:16.665186 run patchelf(pid=4144): Terminated: ok {rc=0} 22:46:16.797945 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=4141): Process ended prematurely: osmo-stp_10.42.42.5(pid=4141) [trial-2383↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4141)] [trial-2383↪gprs:trx-umtrx↪ping_idle_ping.py:27] 22:46:16.807889 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 22:46:16.836882 run osmo-hlr_10.42.42.2(pid=4138): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-umtrx↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4138)] 22:46:16.887316 run osmo-hlr_10.42.42.2(pid=4138): stdout: | (launched: 2022-12-12_22:46:13.456683) 22:46:16.939278 run osmo-hlr_10.42.42.2(pid=4138): stderr: | [0;m[1;31m20221212224613657 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212224613657 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212224613657 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212224613657 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212224613657 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212224613657 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212224613671 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-umtrx/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212224613679 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212224613679 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212224613679 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:46:16.991471 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4137): Terminating (SIGTERM) 22:46:17.034011 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4140): Terminating (SIGTERM) 22:46:17.077421 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4143): Terminating (SIGTERM) 22:46:17.119987 --- ParallelTerminationStrategy: PID 4137 died... 22:46:17.139842 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4137): Terminated: ok {rc=0} 22:46:17.186200 --- ParallelTerminationStrategy: PID 4140 died... 22:46:17.206032 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4140): Terminated: ok {rc=0} 22:46:17.252096 --- ParallelTerminationStrategy: PID 4143 died... 22:46:17.271354 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4143): Terminated: ok {rc=0} 22:46:17.358299 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2383 gprs:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 gprs:trx-umtrx+mod-bts0-egprs --------------------------------------------------------------------- 22:46:18.656617 tst gprs:trx-umtrx+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:46:18.662085 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 22:46:18.694721 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 22:46:18.732832 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 22:46:18.819230 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 22:46:18.852539 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 22:46:18.891139 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 22:46:19.479911 tst gprs:trx-umtrx+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2383 gprs:trx-umtrx+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 22:46:19.529935 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:46:19.540615 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:46:19.590808 tst cs_paging_gprs_active.py: using LAC 32024 22:46:19.714267 tst cs_paging_gprs_active.py: using RAC 149 22:46:19.835898 tst cs_paging_gprs_active.py: using CellId 32024 22:46:19.959139 tst cs_paging_gprs_active.py: using BVCI 32025 22:46:20.073401 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:46:20.084138 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:46:20.094730 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:46:20.105707 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:46:20.116566 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:46:20.127369 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:46:20.138475 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:46:20.149211 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:46:20.160035 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:46:20.280501 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:46:20.398178 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:46:20.605599 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:46:20.914748 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4149): Launched 22:46:21.183160 run iperf3-srv_10.42.42.10(pid=4150): Launched 22:46:21.298626 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:46:21.504724 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:46:21.814174 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4151): Launched 22:46:22.082404 run iperf3-srv_10.42.42.10(pid=4152): Launched 22:46:22.198686 tst cs_paging_gprs_active.py:38: start network... 22:46:22.405200 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:46:22.882153 run create_hlr_db(pid=4153): Launched 22:46:22.999365 bus /gobi_6: Setting Powered False 22:46:24.060332 run create_hlr_db(pid=4153): Terminated: ok {rc=0} 22:46:24.507696 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4155): Launched 22:46:24.836289 run osmo-hlr_10.42.42.2(pid=4156): Launched 22:46:24.962276 run osmo-stp_10.42.42.5: Starting osmo-stp 22:46:25.530226 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4158): Launched 22:46:25.857617 run osmo-stp_10.42.42.5(pid=4159): Launched 22:46:25.983469 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:46:26.551695 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4161): Launched 22:46:26.676668 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:46:26.954003 run patchelf(pid=4162): Launched 22:46:27.135654 run osmo-stp_10.42.42.5(pid=4159): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4159)] 22:46:27.274130 run osmo-stp_10.42.42.5(pid=4159): stdout: | (launched: 2022-12-12_22:46:25.798166) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:46:27.414164 run osmo-stp_10.42.42.5(pid=4159): stderr: | [0;m[38;5;43m20221212224625990 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224625991 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224625991 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224625991 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224625992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224625992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224625992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:46:27.554693 run osmo-stp_10.42.42.5(pid=4159): stdout: | (launched: 2022-12-12_22:46:25.798166) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:46:27.689326 run osmo-stp_10.42.42.5(pid=4159): stderr: | [0;m[38;5;43m20221212224625990 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224625991 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224625991 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224625991 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224625992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224625992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224625992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:46:27.848352 run patchelf(pid=4162): Terminating (SIGINT) 22:46:28.032735 run patchelf(pid=4162): Terminated: ok {rc=0} 22:46:28.165455 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=4159): Process ended prematurely: osmo-stp_10.42.42.5(pid=4159) [trial-2383↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4159)] [trial-2383↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 22:46:28.175441 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 22:46:28.204042 run osmo-hlr_10.42.42.2(pid=4156): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4156)] 22:46:28.253792 run osmo-hlr_10.42.42.2(pid=4156): stdout: | (launched: 2022-12-12_22:46:24.777218) 22:46:28.305456 run osmo-hlr_10.42.42.2(pid=4156): stderr: | [0;m[1;31m20221212224624976 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212224624976 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212224624976 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212224624976 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212224624976 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212224624976 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212224624989 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-umtrx+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212224624997 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212224624997 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212224624997 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:46:28.357412 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4149): Terminating (SIGTERM) 22:46:28.399382 run iperf3-srv_10.42.42.10(pid=4150): Terminating (SIGTERM) 22:46:28.441552 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4151): Terminating (SIGTERM) 22:46:28.483402 run iperf3-srv_10.42.42.10(pid=4152): Terminating (SIGTERM) 22:46:28.525318 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4155): Terminating (SIGTERM) 22:46:28.567142 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4158): Terminating (SIGTERM) 22:46:28.608804 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4161): Terminating (SIGTERM) 22:46:28.651323 --- ParallelTerminationStrategy: PID 4149 died... 22:46:28.671294 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4149): Terminated: ok {rc=0} 22:46:28.717634 --- ParallelTerminationStrategy: PID 4150 died... 22:46:28.736752 run iperf3-srv_10.42.42.10(pid=4150): Terminated {rc=256} 22:46:28.782487 --- ParallelTerminationStrategy: PID 4151 died... 22:46:28.801904 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4151): Terminated: ok {rc=0} 22:46:28.847995 --- ParallelTerminationStrategy: PID 4152 died... 22:46:28.867284 run iperf3-srv_10.42.42.10(pid=4152): Terminated {rc=256} 22:46:28.913771 --- ParallelTerminationStrategy: PID 4155 died... 22:46:28.933331 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4155): Terminated: ok {rc=0} 22:46:28.979237 --- ParallelTerminationStrategy: PID 4158 died... 22:46:28.998818 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4158): Terminated: ok {rc=0} 22:46:29.044498 --- ParallelTerminationStrategy: PID 4161 died... 22:46:29.063936 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4161): Terminated: ok {rc=0} 22:46:29.149961 bus /gobi_0: Setting Powered False 22:46:30.249442 bus /gobi_0: Setting Powered False 22:46:31.375917 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-umtrx+mod-bts0-egprs iperf3.py ---------------------------------------------- 22:46:32.534635 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:46:32.546095 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:46:32.598375 tst iperf3.py: using LAC 32025 22:46:32.722106 tst iperf3.py: using RAC 150 22:46:32.852831 tst iperf3.py: using CellId 32025 22:46:32.984460 tst iperf3.py: using BVCI 32026 22:46:33.104338 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:46:33.115856 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:46:33.127108 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:46:33.138529 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:46:33.149567 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:46:33.160556 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:46:33.171956 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:46:33.182930 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:46:33.194137 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:46:33.311756 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:46:33.518442 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:46:33.826227 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4163): Launched 22:46:34.093126 run iperf3-srv_10.42.42.10(pid=4164): Launched 22:46:34.208742 tst iperf3.py:8: start network... 22:46:34.414642 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:46:34.887437 run create_hlr_db(pid=4165): Launched 22:46:35.005490 bus /gobi_6: Setting Powered False 22:46:36.065780 run create_hlr_db(pid=4165): Terminated: ok {rc=0} 22:46:36.510601 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4167): Launched 22:46:36.836046 run osmo-hlr_10.42.42.2(pid=4168): Launched 22:46:36.961440 run osmo-stp_10.42.42.5: Starting osmo-stp 22:46:37.534130 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4170): Launched 22:46:37.860013 run osmo-stp_10.42.42.5(pid=4171): Launched 22:46:37.985128 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:46:38.548324 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4173): Launched 22:46:38.672775 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:46:38.948154 run patchelf(pid=4174): Launched 22:46:39.131048 run osmo-stp_10.42.42.5(pid=4171): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4171)] 22:46:39.268540 run osmo-stp_10.42.42.5(pid=4171): stdout: | (launched: 2022-12-12_22:46:37.801021) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:46:39.407294 run osmo-stp_10.42.42.5(pid=4171): stderr: | [0;m[38;5;43m20221212224637992 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224637992 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224637993 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224637993 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224637994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224637994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224637994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:46:39.547121 run osmo-stp_10.42.42.5(pid=4171): stdout: | (launched: 2022-12-12_22:46:37.801021) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:46:39.680148 run osmo-stp_10.42.42.5(pid=4171): stderr: | [0;m[38;5;43m20221212224637992 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224637992 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224637993 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224637993 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224637994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224637994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224637994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:46:39.838147 run patchelf(pid=4174): Terminating (SIGINT) 22:46:40.022285 run patchelf(pid=4174): Terminated: ok {rc=0} 22:46:40.154648 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4171): Process ended prematurely: osmo-stp_10.42.42.5(pid=4171) [trial-2383↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4171)] [trial-2383↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8] 22:46:40.164551 tst iperf3.py:8: Test FAILED (7.7 sec) 22:46:40.192911 run osmo-hlr_10.42.42.2(pid=4168): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4168)] 22:46:40.242608 run osmo-hlr_10.42.42.2(pid=4168): stdout: | (launched: 2022-12-12_22:46:36.777118) 22:46:40.294177 run osmo-hlr_10.42.42.2(pid=4168): stderr: | [0;m[1;31m20221212224636976 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212224636976 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212224636976 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212224636976 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212224636976 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212224636976 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212224636989 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-umtrx+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212224636998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212224636998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212224636998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:46:40.345841 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4163): Terminating (SIGTERM) 22:46:40.386778 run iperf3-srv_10.42.42.10(pid=4164): Terminating (SIGTERM) 22:46:40.427775 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4167): Terminating (SIGTERM) 22:46:40.469247 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4170): Terminating (SIGTERM) 22:46:40.510448 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4173): Terminating (SIGTERM) 22:46:40.551893 --- ParallelTerminationStrategy: PID 4163 died... 22:46:40.571722 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4163): Terminated: ok {rc=0} 22:46:40.617605 --- ParallelTerminationStrategy: PID 4164 died... 22:46:40.636582 run iperf3-srv_10.42.42.10(pid=4164): Terminated {rc=256} 22:46:40.682082 --- ParallelTerminationStrategy: PID 4167 died... 22:46:40.701389 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4167): Terminated: ok {rc=0} 22:46:40.746514 --- ParallelTerminationStrategy: PID 4170 died... 22:46:40.765796 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4170): Terminated: ok {rc=0} 22:46:40.811101 --- ParallelTerminationStrategy: PID 4173 died... 22:46:40.830382 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4173): Terminated: ok {rc=0} 22:46:40.916156 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-umtrx+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 22:46:42.061803 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:46:42.073649 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:46:42.123188 tst iperf3m4.py: using LAC 32026 22:46:42.246407 tst iperf3m4.py: using RAC 151 22:46:42.369384 tst iperf3m4.py: using CellId 32026 22:46:42.490586 tst iperf3m4.py: using BVCI 32027 22:46:42.604838 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:46:42.615701 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:46:42.626336 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:46:42.637212 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:46:42.648016 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:46:42.658915 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:46:42.670006 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:46:42.680726 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:46:42.691859 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:46:42.812168 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:46:42.934438 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:46:43.056131 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:46:43.178217 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:46:43.385401 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:46:43.693537 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4175): Launched 22:46:43.961681 run iperf3-srv_10.42.42.10(pid=4176): Launched 22:46:44.077979 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:46:44.285804 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:46:44.595503 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4177): Launched 22:46:44.862437 run iperf3-srv_10.42.42.10(pid=4178): Launched 22:46:44.977927 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:46:45.184480 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:46:45.492379 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4179): Launched 22:46:45.759993 run iperf3-srv_10.42.42.10(pid=4180): Launched 22:46:45.881204 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:46:46.120494 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:46:46.469866 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4181): Launched 22:46:46.771129 run iperf3-srv_10.42.42.10(pid=4182): Launched 22:46:46.906021 tst iperf3m4.py:8: start network... 22:46:47.133109 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:46:47.645433 run create_hlr_db(pid=4183): Launched 22:46:47.778874 bus /gobi_6: Setting Powered False 22:46:48.843140 run create_hlr_db(pid=4183): Terminated: ok {rc=0} 22:46:49.280419 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4185): Launched 22:46:49.587503 run osmo-hlr_10.42.42.2(pid=4186): Launched 22:46:49.705885 run osmo-stp_10.42.42.5: Starting osmo-stp 22:46:50.274498 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4188): Launched 22:46:50.602504 run osmo-stp_10.42.42.5(pid=4189): Launched 22:46:50.727135 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:46:51.292572 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4191): Launched 22:46:51.417680 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:46:51.694436 run patchelf(pid=4192): Launched 22:46:51.876005 run osmo-stp_10.42.42.5(pid=4189): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4189)] 22:46:52.014024 run osmo-stp_10.42.42.5(pid=4189): stdout: | (launched: 2022-12-12_22:46:50.542933) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:46:52.153511 run osmo-stp_10.42.42.5(pid=4189): stderr: | [0;m[38;5;43m20221212224650738 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224650738 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224650738 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224650738 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224650739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224650739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224650739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:46:52.293261 run osmo-stp_10.42.42.5(pid=4189): stdout: | (launched: 2022-12-12_22:46:50.542933) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:46:52.427223 run osmo-stp_10.42.42.5(pid=4189): stderr: | [0;m[38;5;43m20221212224650738 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224650738 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224650738 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224650738 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224650739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224650739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224650739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:46:52.586746 run patchelf(pid=4192): Terminating (SIGINT) 22:46:52.771497 run patchelf(pid=4192): Terminated: ok {rc=0} 22:46:52.904181 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4189): Process ended prematurely: osmo-stp_10.42.42.5(pid=4189) [trial-2383↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4189)] [trial-2383↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8] 22:46:52.914357 tst iperf3m4.py:8: Test FAILED (10.9 sec) 22:46:52.942857 run osmo-hlr_10.42.42.2(pid=4186): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4186)] 22:46:52.992363 run osmo-hlr_10.42.42.2(pid=4186): stdout: | (launched: 2022-12-12_22:46:49.531644) 22:46:53.043711 run osmo-hlr_10.42.42.2(pid=4186): stderr: | [0;m[1;31m20221212224649707 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212224649707 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212224649707 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212224649707 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212224649707 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212224649707 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212224649720 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-umtrx+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212224649729 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212224649729 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212224649729 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:46:53.095479 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4175): Terminating (SIGTERM) 22:46:53.137443 run iperf3-srv_10.42.42.10(pid=4176): Terminating (SIGTERM) 22:46:53.179019 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4177): Terminating (SIGTERM) 22:46:53.220662 run iperf3-srv_10.42.42.10(pid=4178): Terminating (SIGTERM) 22:46:53.262160 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4179): Terminating (SIGTERM) 22:46:53.303851 run iperf3-srv_10.42.42.10(pid=4180): Terminating (SIGTERM) 22:46:53.345533 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4181): Terminating (SIGTERM) 22:46:53.386984 run iperf3-srv_10.42.42.10(pid=4182): Terminating (SIGTERM) 22:46:53.428619 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4185): Terminating (SIGTERM) 22:46:53.470717 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4188): Terminating (SIGTERM) 22:46:53.512390 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4191): Terminating (SIGTERM) 22:46:53.554200 --- ParallelTerminationStrategy: PID 4175 died... 22:46:53.574213 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4175): Terminated: ok {rc=0} 22:46:53.620008 --- ParallelTerminationStrategy: PID 4176 died... 22:46:53.639343 run iperf3-srv_10.42.42.10(pid=4176): Terminated {rc=256} 22:46:53.684857 --- ParallelTerminationStrategy: PID 4177 died... 22:46:53.704754 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4177): Terminated: ok {rc=0} 22:46:53.750944 --- ParallelTerminationStrategy: PID 4178 died... 22:46:53.770393 run iperf3-srv_10.42.42.10(pid=4178): Terminated {rc=256} 22:46:53.815905 --- ParallelTerminationStrategy: PID 4179 died... 22:46:53.835467 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4179): Terminated: ok {rc=0} 22:46:53.881242 --- ParallelTerminationStrategy: PID 4180 died... 22:46:53.900624 run iperf3-srv_10.42.42.10(pid=4180): Terminated {rc=256} 22:46:53.946131 --- ParallelTerminationStrategy: PID 4181 died... 22:46:53.965560 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4181): Terminated: ok {rc=0} 22:46:54.011608 --- ParallelTerminationStrategy: PID 4182 died... 22:46:54.031152 run iperf3-srv_10.42.42.10(pid=4182): Terminated {rc=256} 22:46:54.076651 --- ParallelTerminationStrategy: PID 4185 died... 22:46:54.096201 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4185): Terminated: ok {rc=0} 22:46:54.141662 --- ParallelTerminationStrategy: PID 4188 died... 22:46:54.161370 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4188): Terminated: ok {rc=0} 22:46:54.207061 --- ParallelTerminationStrategy: PID 4191 died... 22:46:54.226726 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4191): Terminated: ok {rc=0} 22:46:54.314140 bus /gobi_4: Setting Powered False 22:46:55.413262 bus /gobi_4: Setting Powered False 22:46:56.530794 bus /gobi_1: Setting Powered False 22:46:57.628920 bus /gobi_1: Setting Powered False 22:46:58.743979 bus /gobi_0: Setting Powered False 22:46:59.838023 bus /gobi_0: Setting Powered False 22:47:00.956554 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-umtrx+mod-bts0-egprs ping.py ---------------------------------------------- 22:47:02.075934 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:47:02.091863 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:47:02.157092 tst ping.py: using LAC 32027 22:47:02.285501 tst ping.py: using RAC 152 22:47:02.405848 tst ping.py: using CellId 32027 22:47:02.533217 tst ping.py: using BVCI 32028 22:47:02.651793 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:47:02.663311 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:47:02.674594 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:47:02.685697 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:47:02.696841 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:47:02.708158 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:47:02.719416 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:47:02.730646 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:47:02.851542 tst ping.py:19: start network... 22:47:03.068223 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:47:03.565869 run create_hlr_db(pid=4193): Launched 22:47:03.695706 bus /gobi_6: Setting Powered False 22:47:04.760078 run create_hlr_db(pid=4193): Terminated: ok {rc=0} 22:47:05.189610 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4195): Launched 22:47:05.494104 run osmo-hlr_10.42.42.2(pid=4196): Launched 22:47:05.610023 run osmo-stp_10.42.42.5: Starting osmo-stp 22:47:06.142291 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4198): Launched 22:47:06.441912 run osmo-stp_10.42.42.5(pid=4199): Launched 22:47:06.557425 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:47:07.074343 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4201): Launched 22:47:07.189832 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:47:07.443675 run patchelf(pid=4202): Launched 22:47:07.611471 run osmo-stp_10.42.42.5(pid=4199): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4199)] 22:47:07.739003 run osmo-stp_10.42.42.5(pid=4199): stdout: | (launched: 2022-12-12_22:47:06.386909) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:47:07.867624 run osmo-stp_10.42.42.5(pid=4199): stderr: | [0;m[38;5;43m20221212224706555 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224706555 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224706555 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224706556 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224706556 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224706556 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224706556 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:47:07.995990 run osmo-stp_10.42.42.5(pid=4199): stdout: | (launched: 2022-12-12_22:47:06.386909) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:47:08.119262 run osmo-stp_10.42.42.5(pid=4199): stderr: | [0;m[38;5;43m20221212224706555 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224706555 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224706555 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224706556 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224706556 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224706556 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224706556 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:47:08.264823 run patchelf(pid=4202): Terminating (SIGINT) 22:47:08.435003 run patchelf(pid=4202): Terminated: ok {rc=0} 22:47:08.557297 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=4199): Process ended prematurely: osmo-stp_10.42.42.5(pid=4199) [trial-2383↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4199)] [trial-2383↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22] 22:47:08.565956 tst ping.py:22: Test FAILED (6.5 sec) 22:47:08.593024 run osmo-hlr_10.42.42.2(pid=4196): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4196)] 22:47:08.640351 run osmo-hlr_10.42.42.2(pid=4196): stdout: | (launched: 2022-12-12_22:47:05.439143) 22:47:08.689403 run osmo-hlr_10.42.42.2(pid=4196): stderr: | [0;m[1;31m20221212224705617 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212224705617 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212224705617 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212224705617 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212224705617 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212224705617 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212224705629 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-umtrx+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212224705638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212224705638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212224705638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:47:08.738825 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4195): Terminating (SIGTERM) 22:47:08.778388 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4198): Terminating (SIGTERM) 22:47:08.818183 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4201): Terminating (SIGTERM) 22:47:08.858034 --- ParallelTerminationStrategy: PID 4195 died... 22:47:08.876794 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4195): Terminated: ok {rc=0} 22:47:08.921149 --- ParallelTerminationStrategy: PID 4198 died... 22:47:08.939742 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4198): Terminated: ok {rc=0} 22:47:08.983753 --- ParallelTerminationStrategy: PID 4201 died... 22:47:09.002289 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4201): Terminated: ok {rc=0} 22:47:09.087749 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-umtrx+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 22:47:10.175822 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:47:10.187556 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:47:10.238345 tst ping_idle_ping.py: using LAC 32028 22:47:10.357678 tst ping_idle_ping.py: using RAC 153 22:47:10.476375 tst ping_idle_ping.py: using CellId 32028 22:47:10.594588 tst ping_idle_ping.py: using BVCI 32029 22:47:10.705930 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:47:10.716806 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:47:10.727420 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:47:10.738264 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:47:10.749031 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:47:10.759831 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:47:10.770822 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:47:10.781729 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:47:10.900376 tst ping_idle_ping.py:24: start network... 22:47:11.118395 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:47:11.620161 run create_hlr_db(pid=4203): Launched 22:47:11.751018 bus /gobi_6: Setting Powered False 22:47:12.814954 run create_hlr_db(pid=4203): Terminated: ok {rc=0} 22:47:13.245865 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4205): Launched 22:47:13.548605 run osmo-hlr_10.42.42.2(pid=4206): Launched 22:47:13.665451 run osmo-stp_10.42.42.5: Starting osmo-stp 22:47:14.201244 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4208): Launched 22:47:14.503117 run osmo-stp_10.42.42.5(pid=4209): Launched 22:47:14.618691 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:47:15.139973 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4211): Launched 22:47:15.256389 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:47:15.511416 run patchelf(pid=4212): Launched 22:47:15.680122 run osmo-stp_10.42.42.5(pid=4209): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4209)] 22:47:15.808386 run osmo-stp_10.42.42.5(pid=4209): stdout: | (launched: 2022-12-12_22:47:14.447533) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:47:15.960502 run osmo-stp_10.42.42.5(pid=4209): stderr: | [0;m[38;5;43m20221212224714621 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224714621 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224714621 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224714622 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224714622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224714622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224714622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:47:16.103877 run osmo-stp_10.42.42.5(pid=4209): stdout: | (launched: 2022-12-12_22:47:14.447533) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:47:16.240430 run osmo-stp_10.42.42.5(pid=4209): stderr: | [0;m[38;5;43m20221212224714621 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224714621 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224714621 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224714622 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224714622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224714622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224714622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:47:16.402387 run patchelf(pid=4212): Terminating (SIGINT) 22:47:16.592560 run patchelf(pid=4212): Terminated: ok {rc=0} 22:47:16.730081 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=4209): Process ended prematurely: osmo-stp_10.42.42.5(pid=4209) [trial-2383↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4209)] [trial-2383↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27] 22:47:16.740599 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 22:47:16.770427 run osmo-hlr_10.42.42.2(pid=4206): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4206)] 22:47:16.823056 run osmo-hlr_10.42.42.2(pid=4206): stdout: | (launched: 2022-12-12_22:47:13.493577) 22:47:16.875853 run osmo-hlr_10.42.42.2(pid=4206): stderr: | [0;m[1;31m20221212224713671 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212224713671 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212224713671 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212224713671 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212224713671 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212224713671 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212224713683 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-umtrx+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212224713693 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212224713694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212224713694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:47:16.929569 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4205): Terminating (SIGTERM) 22:47:16.972581 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4208): Terminating (SIGTERM) 22:47:17.018354 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4211): Terminating (SIGTERM) 22:47:17.064250 --- ParallelTerminationStrategy: PID 4205 died... 22:47:17.084734 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4205): Terminated: ok {rc=0} 22:47:17.132903 --- ParallelTerminationStrategy: PID 4208 died... 22:47:17.153090 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4208): Terminated: ok {rc=0} 22:47:17.199641 --- ParallelTerminationStrategy: PID 4211 died... 22:47:17.219691 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4211): Terminated: ok {rc=0} 22:47:17.307805 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2383 gprs:trx-umtrx+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 gprs:trx-umtrx+mod-bts0-dynts-ipa --------------------------------------------------------------------- 22:47:18.610530 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:47:18.616770 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 22:47:18.651029 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 22:47:18.689692 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 22:47:18.774140 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 22:47:18.806983 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 22:47:18.845918 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 22:47:19.438427 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2383 gprs:trx-umtrx+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 22:47:19.496395 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:47:19.508390 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:47:19.577754 tst cs_paging_gprs_active.py: using LAC 32029 22:47:19.713275 tst cs_paging_gprs_active.py: using RAC 154 22:47:19.839954 tst cs_paging_gprs_active.py: using CellId 32029 22:47:19.967252 tst cs_paging_gprs_active.py: using BVCI 32030 22:47:20.086585 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:47:20.097967 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:47:20.109318 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:47:20.120433 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:47:20.131499 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:47:20.142765 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:47:20.154126 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:47:20.165246 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:47:20.176432 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:47:20.294144 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:47:20.411874 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:47:20.620593 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:47:20.929197 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4217): Launched 22:47:21.197488 run iperf3-srv_10.42.42.10(pid=4218): Launched 22:47:21.313793 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:47:21.522362 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:47:21.832122 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4219): Launched 22:47:22.099437 run iperf3-srv_10.42.42.10(pid=4220): Launched 22:47:22.215296 tst cs_paging_gprs_active.py:38: start network... 22:47:22.421998 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:47:22.898774 run create_hlr_db(pid=4221): Launched 22:47:23.017502 bus /gobi_6: Setting Powered False 22:47:24.078780 run create_hlr_db(pid=4221): Terminated: ok {rc=0} 22:47:24.506759 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4223): Launched 22:47:24.815113 run osmo-hlr_10.42.42.2(pid=4224): Launched 22:47:24.933235 run osmo-stp_10.42.42.5: Starting osmo-stp 22:47:25.476511 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4226): Launched 22:47:25.784186 run osmo-stp_10.42.42.5(pid=4227): Launched 22:47:25.902137 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:47:26.432583 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4229): Launched 22:47:26.551448 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:47:26.818310 run patchelf(pid=4230): Launched 22:47:26.989732 run osmo-stp_10.42.42.5(pid=4227): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4227)] 22:47:27.119758 run osmo-stp_10.42.42.5(pid=4227): stdout: | (launched: 2022-12-12_22:47:25.727917) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:47:27.251333 run osmo-stp_10.42.42.5(pid=4227): stderr: | [0;m[38;5;43m20221212224725898 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224725898 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224725898 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224725899 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224725901 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224725901 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224725901 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:47:27.383348 run osmo-stp_10.42.42.5(pid=4227): stdout: | (launched: 2022-12-12_22:47:25.727917) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:47:27.510337 run osmo-stp_10.42.42.5(pid=4227): stderr: | [0;m[38;5;43m20221212224725898 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224725898 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224725898 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224725899 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224725901 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224725901 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224725901 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:47:27.659815 run patchelf(pid=4230): Terminating (SIGINT) 22:47:27.834288 run patchelf(pid=4230): Terminated: ok {rc=0} 22:47:27.960067 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=4227): Process ended prematurely: osmo-stp_10.42.42.5(pid=4227) [trial-2383↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4227)] [trial-2383↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 22:47:27.969472 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 22:47:27.997156 run osmo-hlr_10.42.42.2(pid=4224): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4224)] 22:47:28.044542 run osmo-hlr_10.42.42.2(pid=4224): stdout: | (launched: 2022-12-12_22:47:24.758126) 22:47:28.093571 run osmo-hlr_10.42.42.2(pid=4224): stderr: | [0;m[1;31m20221212224724936 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212224724937 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212224724937 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212224724937 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212224724937 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212224724937 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212224724952 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-umtrx+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212224724962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212224724962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212224724962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:47:28.143175 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4217): Terminating (SIGTERM) 22:47:28.182783 run iperf3-srv_10.42.42.10(pid=4218): Terminating (SIGTERM) 22:47:28.222296 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4219): Terminating (SIGTERM) 22:47:28.261889 run iperf3-srv_10.42.42.10(pid=4220): Terminating (SIGTERM) 22:47:28.301315 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4223): Terminating (SIGTERM) 22:47:28.341431 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4226): Terminating (SIGTERM) 22:47:28.380853 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4229): Terminating (SIGTERM) 22:47:28.420401 --- ParallelTerminationStrategy: PID 4217 died... 22:47:28.439223 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4217): Terminated: ok {rc=0} 22:47:28.483671 --- ParallelTerminationStrategy: PID 4218 died... 22:47:28.502164 run iperf3-srv_10.42.42.10(pid=4218): Terminated {rc=256} 22:47:28.546064 --- ParallelTerminationStrategy: PID 4219 died... 22:47:28.564639 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4219): Terminated: ok {rc=0} 22:47:28.608386 --- ParallelTerminationStrategy: PID 4220 died... 22:47:28.626917 run iperf3-srv_10.42.42.10(pid=4220): Terminated {rc=256} 22:47:28.670652 --- ParallelTerminationStrategy: PID 4223 died... 22:47:28.689061 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4223): Terminated: ok {rc=0} 22:47:28.732875 --- ParallelTerminationStrategy: PID 4226 died... 22:47:28.751810 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4226): Terminated: ok {rc=0} 22:47:28.795631 --- ParallelTerminationStrategy: PID 4229 died... 22:47:28.814151 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4229): Terminated: ok {rc=0} 22:47:28.897975 bus /gobi_0: Setting Powered False 22:47:29.996191 bus /gobi_0: Setting Powered False 22:47:31.119047 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 22:47:32.284017 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:47:32.296172 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:47:32.368145 tst iperf3.py: using LAC 32030 22:47:32.499063 tst iperf3.py: using RAC 155 22:47:32.630592 tst iperf3.py: using CellId 32030 22:47:32.760486 tst iperf3.py: using BVCI 32031 22:47:32.882233 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:47:32.893699 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:47:32.904718 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:47:32.915855 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:47:32.926871 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:47:32.937926 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:47:32.949026 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:47:32.959964 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:47:32.971132 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:47:33.088237 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:47:33.296193 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:47:33.606590 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4231): Launched 22:47:33.874152 run iperf3-srv_10.42.42.10(pid=4232): Launched 22:47:33.989878 tst iperf3.py:8: start network... 22:47:34.196603 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:47:34.672114 run create_hlr_db(pid=4233): Launched 22:47:34.790658 bus /gobi_6: Setting Powered False 22:47:35.851581 run create_hlr_db(pid=4233): Terminated: ok {rc=0} 22:47:36.297645 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4235): Launched 22:47:36.627246 run osmo-hlr_10.42.42.2(pid=4236): Launched 22:47:36.753317 run osmo-stp_10.42.42.5: Starting osmo-stp 22:47:37.406015 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4238): Launched 22:47:37.725932 run osmo-stp_10.42.42.5(pid=4239): Launched 22:47:37.845598 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:47:38.368473 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4241): Launched 22:47:38.484585 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:47:38.739579 run patchelf(pid=4242): Launched 22:47:38.907589 run osmo-stp_10.42.42.5(pid=4239): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4239)] 22:47:39.035323 run osmo-stp_10.42.42.5(pid=4239): stdout: | (launched: 2022-12-12_22:47:37.667979) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:47:39.164279 run osmo-stp_10.42.42.5(pid=4239): stderr: | [0;m[38;5;43m20221212224737838 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224737838 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224737838 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224737839 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224737839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224737839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224737839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:47:39.293230 run osmo-stp_10.42.42.5(pid=4239): stdout: | (launched: 2022-12-12_22:47:37.667979) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:47:39.416429 run osmo-stp_10.42.42.5(pid=4239): stderr: | [0;m[38;5;43m20221212224737838 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224737838 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224737838 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224737839 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224737839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224737839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224737839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:47:39.563004 run patchelf(pid=4242): Terminating (SIGINT) 22:47:39.733881 run patchelf(pid=4242): Terminated: ok {rc=0} 22:47:39.856885 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4239): Process ended prematurely: osmo-stp_10.42.42.5(pid=4239) [trial-2383↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4239)] [trial-2383↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8] 22:47:39.866160 tst iperf3.py:8: Test FAILED (7.6 sec) 22:47:39.893477 run osmo-hlr_10.42.42.2(pid=4236): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4236)] 22:47:39.940727 run osmo-hlr_10.42.42.2(pid=4236): stdout: | (launched: 2022-12-12_22:47:36.567406) 22:47:39.989721 run osmo-hlr_10.42.42.2(pid=4236): stderr: | [0;m[1;31m20221212224736768 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212224736768 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212224736768 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212224736768 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212224736768 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212224736768 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212224736783 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212224736793 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212224736794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212224736794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:47:40.039088 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4231): Terminating (SIGTERM) 22:47:40.078698 run iperf3-srv_10.42.42.10(pid=4232): Terminating (SIGTERM) 22:47:40.118251 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4235): Terminating (SIGTERM) 22:47:40.157567 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4238): Terminating (SIGTERM) 22:47:40.196816 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4241): Terminating (SIGTERM) 22:47:40.236462 --- ParallelTerminationStrategy: PID 4231 died... 22:47:40.255333 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4231): Terminated: ok {rc=0} 22:47:40.300349 --- ParallelTerminationStrategy: PID 4232 died... 22:47:40.318641 run iperf3-srv_10.42.42.10(pid=4232): Terminated {rc=256} 22:47:40.361879 --- ParallelTerminationStrategy: PID 4235 died... 22:47:40.380068 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4235): Terminated: ok {rc=0} 22:47:40.423445 --- ParallelTerminationStrategy: PID 4238 died... 22:47:40.441545 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4238): Terminated: ok {rc=0} 22:47:40.484875 --- ParallelTerminationStrategy: PID 4241 died... 22:47:40.503542 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4241): Terminated: ok {rc=0} 22:47:40.587809 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 22:47:41.733285 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:47:41.744798 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:47:41.813111 tst iperf3m4.py: using LAC 32031 22:47:41.935940 tst iperf3m4.py: using RAC 156 22:47:42.053963 tst iperf3m4.py: using CellId 32031 22:47:42.173333 tst iperf3m4.py: using BVCI 32032 22:47:42.283165 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:47:42.293977 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:47:42.304452 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:47:42.315513 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:47:42.326342 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:47:42.337366 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:47:42.348188 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:47:42.358959 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:47:42.369993 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:47:42.486324 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:47:42.602795 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:47:42.722388 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:47:42.837955 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:47:43.054220 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:47:43.375922 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4245): Launched 22:47:43.654394 run iperf3-srv_10.42.42.10(pid=4246): Launched 22:47:43.774451 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:47:43.990576 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:47:44.311564 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4247): Launched 22:47:44.589484 run iperf3-srv_10.42.42.10(pid=4248): Launched 22:47:44.709957 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:47:44.926444 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:47:45.250398 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4249): Launched 22:47:45.528741 run iperf3-srv_10.42.42.10(pid=4250): Launched 22:47:45.648880 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:47:45.867015 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:47:46.199932 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4251): Launched 22:47:46.487460 run iperf3-srv_10.42.42.10(pid=4252): Launched 22:47:46.611843 tst iperf3m4.py:8: start network... 22:47:46.822489 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:47:47.304241 run create_hlr_db(pid=4253): Launched 22:47:47.421427 bus /gobi_6: Setting Powered False 22:47:48.485478 run create_hlr_db(pid=4253): Terminated: ok {rc=0} 22:47:48.915323 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4255): Launched 22:47:49.217778 run osmo-hlr_10.42.42.2(pid=4256): Launched 22:47:49.333229 run osmo-stp_10.42.42.5: Starting osmo-stp 22:47:49.870402 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4258): Launched 22:47:50.170899 run osmo-stp_10.42.42.5(pid=4259): Launched 22:47:50.286409 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:47:50.806789 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4261): Launched 22:47:50.922586 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:47:51.176903 run patchelf(pid=4262): Launched 22:47:51.345067 run osmo-stp_10.42.42.5(pid=4259): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4259)] 22:47:51.472547 run osmo-stp_10.42.42.5(pid=4259): stdout: | (launched: 2022-12-12_22:47:50.115837) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:47:51.602696 run osmo-stp_10.42.42.5(pid=4259): stderr: | [0;m[38;5;43m20221212224750288 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224750289 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224750289 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224750289 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224750290 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224750290 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224750290 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:47:51.731665 run osmo-stp_10.42.42.5(pid=4259): stdout: | (launched: 2022-12-12_22:47:50.115837) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:47:51.855569 run osmo-stp_10.42.42.5(pid=4259): stderr: | [0;m[38;5;43m20221212224750288 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224750289 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224750289 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224750289 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224750290 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224750290 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224750290 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:47:52.001717 run patchelf(pid=4262): Terminating (SIGINT) 22:47:52.172681 run patchelf(pid=4262): Terminated: ok {rc=0} 22:47:52.296200 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4259): Process ended prematurely: osmo-stp_10.42.42.5(pid=4259) [trial-2383↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4259)] [trial-2383↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8] 22:47:52.305684 tst iperf3m4.py:8: Test FAILED (10.6 sec) 22:47:52.333158 run osmo-hlr_10.42.42.2(pid=4256): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4256)] 22:47:52.381294 run osmo-hlr_10.42.42.2(pid=4256): stdout: | (launched: 2022-12-12_22:47:49.161723) 22:47:52.430787 run osmo-hlr_10.42.42.2(pid=4256): stderr: | [0;m[1;31m20221212224749338 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212224749338 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212224749338 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212224749338 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212224749338 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212224749338 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212224749350 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212224749361 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212224749362 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212224749362 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:47:52.480697 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4245): Terminating (SIGTERM) 22:47:52.520625 run iperf3-srv_10.42.42.10(pid=4246): Terminating (SIGTERM) 22:47:52.561004 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4247): Terminating (SIGTERM) 22:47:52.600795 run iperf3-srv_10.42.42.10(pid=4248): Terminating (SIGTERM) 22:47:52.640534 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4249): Terminating (SIGTERM) 22:47:52.680259 run iperf3-srv_10.42.42.10(pid=4250): Terminating (SIGTERM) 22:47:52.720380 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4251): Terminating (SIGTERM) 22:47:52.761010 run iperf3-srv_10.42.42.10(pid=4252): Terminating (SIGTERM) 22:47:52.801117 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4255): Terminating (SIGTERM) 22:47:52.841012 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4258): Terminating (SIGTERM) 22:47:52.880838 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4261): Terminating (SIGTERM) 22:47:52.920712 --- ParallelTerminationStrategy: PID 4245 died... 22:47:52.939258 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4245): Terminated: ok {rc=0} 22:47:52.983516 --- ParallelTerminationStrategy: PID 4246 died... 22:47:53.001944 run iperf3-srv_10.42.42.10(pid=4246): Terminated {rc=256} 22:47:53.046089 --- ParallelTerminationStrategy: PID 4247 died... 22:47:53.064375 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4247): Terminated: ok {rc=0} 22:47:53.108327 --- ParallelTerminationStrategy: PID 4248 died... 22:47:53.126670 run iperf3-srv_10.42.42.10(pid=4248): Terminated {rc=256} 22:47:53.170613 --- ParallelTerminationStrategy: PID 4249 died... 22:47:53.189092 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4249): Terminated: ok {rc=0} 22:47:53.234893 --- ParallelTerminationStrategy: PID 4250 died... 22:47:53.254202 run iperf3-srv_10.42.42.10(pid=4250): Terminated {rc=256} 22:47:53.299048 --- ParallelTerminationStrategy: PID 4251 died... 22:47:53.317498 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4251): Terminated: ok {rc=0} 22:47:53.361517 --- ParallelTerminationStrategy: PID 4252 died... 22:47:53.380022 run iperf3-srv_10.42.42.10(pid=4252): Terminated {rc=256} 22:47:53.423860 --- ParallelTerminationStrategy: PID 4255 died... 22:47:53.442193 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4255): Terminated: ok {rc=0} 22:47:53.486102 --- ParallelTerminationStrategy: PID 4258 died... 22:47:53.504502 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4258): Terminated: ok {rc=0} 22:47:53.548526 --- ParallelTerminationStrategy: PID 4261 died... 22:47:53.566957 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4261): Terminated: ok {rc=0} 22:47:53.651201 bus /gobi_4: Setting Powered False 22:47:54.749041 bus /gobi_4: Setting Powered False 22:47:55.866728 bus /gobi_1: Setting Powered False 22:47:56.967156 bus /gobi_1: Setting Powered False 22:47:58.081512 bus /gobi_0: Setting Powered False 22:47:59.177121 bus /gobi_0: Setting Powered False 22:48:00.293988 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-umtrx+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 22:48:01.397693 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:48:01.410080 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:48:01.481810 tst ping.py: using LAC 32032 22:48:01.620857 tst ping.py: using RAC 157 22:48:01.777746 tst ping.py: using CellId 32032 22:48:01.931882 tst ping.py: using BVCI 32033 22:48:02.043202 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:48:02.054866 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:48:02.066392 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:48:02.079015 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:48:02.091619 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:48:02.104444 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:48:02.118639 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:48:02.130397 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:48:02.248380 tst ping.py:19: start network... 22:48:02.450466 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:48:02.914223 run create_hlr_db(pid=4271): Launched 22:48:03.029073 bus /gobi_6: Setting Powered False 22:48:04.088806 run create_hlr_db(pid=4271): Terminated: ok {rc=0} 22:48:04.504532 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4273): Launched 22:48:04.802443 run osmo-hlr_10.42.42.2(pid=4274): Launched 22:48:04.916311 run osmo-stp_10.42.42.5: Starting osmo-stp 22:48:05.442760 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4276): Launched 22:48:05.740293 run osmo-stp_10.42.42.5(pid=4277): Launched 22:48:05.853937 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:48:06.367371 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4279): Launched 22:48:06.481525 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:48:06.732924 run patchelf(pid=4280): Launched 22:48:06.898912 run osmo-stp_10.42.42.5(pid=4277): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4277)] 22:48:07.025626 run osmo-stp_10.42.42.5(pid=4277): stdout: | (launched: 2022-12-12_22:48:05.686148) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:48:07.153797 run osmo-stp_10.42.42.5(pid=4277): stderr: | [0;m[38;5;43m20221212224805855 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224805855 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224805856 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224805856 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224805858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224805858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224805858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:48:07.282380 run osmo-stp_10.42.42.5(pid=4277): stdout: | (launched: 2022-12-12_22:48:05.686148) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:48:07.404397 run osmo-stp_10.42.42.5(pid=4277): stderr: | [0;m[38;5;43m20221212224805855 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224805855 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224805856 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224805856 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224805858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224805858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224805858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:48:07.549575 run patchelf(pid=4280): Terminating (SIGINT) 22:48:07.719155 run patchelf(pid=4280): Terminated: ok {rc=0} 22:48:07.840942 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=4277): Process ended prematurely: osmo-stp_10.42.42.5(pid=4277) [trial-2383↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4277)] [trial-2383↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22] 22:48:07.849650 tst ping.py:22: Test FAILED (6.4 sec) 22:48:07.876229 run osmo-hlr_10.42.42.2(pid=4274): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4274)] 22:48:07.924350 run osmo-hlr_10.42.42.2(pid=4274): stdout: | (launched: 2022-12-12_22:48:04.748088) 22:48:07.973868 run osmo-hlr_10.42.42.2(pid=4274): stderr: | [0;m[1;31m20221212224804923 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212224804924 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212224804924 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212224804924 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212224804924 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212224804924 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212224804936 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212224804944 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212224804945 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212224804945 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:48:08.023715 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4273): Terminating (SIGTERM) 22:48:08.063740 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4276): Terminating (SIGTERM) 22:48:08.103442 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4279): Terminating (SIGTERM) 22:48:08.143290 --- ParallelTerminationStrategy: PID 4273 died... 22:48:08.162112 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4273): Terminated: ok {rc=0} 22:48:08.206137 --- ParallelTerminationStrategy: PID 4276 died... 22:48:08.224550 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4276): Terminated: ok {rc=0} 22:48:08.268636 --- ParallelTerminationStrategy: PID 4279 died... 22:48:08.287165 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4279): Terminated: ok {rc=0} 22:48:08.370057 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-umtrx+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 22:48:09.456177 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:48:09.468494 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:48:09.543512 tst ping_idle_ping.py: using LAC 32033 22:48:09.670229 tst ping_idle_ping.py: using RAC 158 22:48:09.796806 tst ping_idle_ping.py: using CellId 32033 22:48:09.924293 tst ping_idle_ping.py: using BVCI 32034 22:48:10.040926 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:48:10.052421 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:48:10.063810 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:48:10.075828 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:48:10.087634 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:48:10.099566 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:48:10.111646 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:48:10.123457 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:48:10.243163 tst ping_idle_ping.py:24: start network... 22:48:10.457301 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:48:10.947767 run create_hlr_db(pid=4281): Launched 22:48:11.076456 bus /gobi_6: Setting Powered False 22:48:12.139577 run create_hlr_db(pid=4281): Terminated: ok {rc=0} 22:48:12.565283 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4283): Launched 22:48:12.864084 run osmo-hlr_10.42.42.2(pid=4284): Launched 22:48:12.978555 run osmo-stp_10.42.42.5: Starting osmo-stp 22:48:13.507289 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4286): Launched 22:48:13.807217 run osmo-stp_10.42.42.5(pid=4287): Launched 22:48:13.921781 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:48:14.437821 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4289): Launched 22:48:14.553176 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:48:14.805288 run patchelf(pid=4290): Launched 22:48:14.971563 run osmo-stp_10.42.42.5(pid=4287): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4287)] 22:48:15.098863 run osmo-stp_10.42.42.5(pid=4287): stdout: | (launched: 2022-12-12_22:48:13.752473) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:48:15.227805 run osmo-stp_10.42.42.5(pid=4287): stderr: | [0;m[38;5;43m20221212224813922 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224813922 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224813922 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224813923 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224813923 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224813923 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224813923 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:48:15.356176 run osmo-stp_10.42.42.5(pid=4287): stdout: | (launched: 2022-12-12_22:48:13.752473) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:48:15.479096 run osmo-stp_10.42.42.5(pid=4287): stderr: | [0;m[38;5;43m20221212224813922 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224813922 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224813922 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224813923 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224813923 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224813923 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224813923 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:48:15.624580 run patchelf(pid=4290): Terminating (SIGINT) 22:48:15.795415 run patchelf(pid=4290): Terminated: ok {rc=0} 22:48:15.932556 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=4287): Process ended prematurely: osmo-stp_10.42.42.5(pid=4287) [trial-2383↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4287)] [trial-2383↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 22:48:15.942757 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 22:48:15.971821 run osmo-hlr_10.42.42.2(pid=4284): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4284)] 22:48:16.021668 run osmo-hlr_10.42.42.2(pid=4284): stdout: | (launched: 2022-12-12_22:48:12.809550) 22:48:16.077214 run osmo-hlr_10.42.42.2(pid=4284): stderr: | [0;m[1;31m20221212224812984 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212224812984 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212224812984 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212224812984 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212224812984 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212224812984 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212224812996 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212224813004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212224813004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212224813005 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:48:16.129558 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4283): Terminating (SIGTERM) 22:48:16.171906 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4286): Terminating (SIGTERM) 22:48:16.215462 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4289): Terminating (SIGTERM) 22:48:16.257829 --- ParallelTerminationStrategy: PID 4283 died... 22:48:16.277513 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4283): Terminated: ok {rc=0} 22:48:16.324770 --- ParallelTerminationStrategy: PID 4286 died... 22:48:16.344652 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4286): Terminated: ok {rc=0} 22:48:16.391935 --- ParallelTerminationStrategy: PID 4289 died... 22:48:16.411538 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4289): Terminated: ok {rc=0} 22:48:16.498988 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2383 gprs:trx-umtrx+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 gprs:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 22:48:17.799783 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:48:17.806136 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 22:48:17.839850 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 22:48:17.878291 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 22:48:17.965202 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 22:48:17.997977 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 22:48:18.035988 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 22:48:18.627416 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2383 gprs:trx-umtrx+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 22:48:18.676587 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:48:18.687522 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:48:18.756177 tst cs_paging_gprs_active.py: using LAC 32034 22:48:18.878832 tst cs_paging_gprs_active.py: using RAC 159 22:48:19.004150 tst cs_paging_gprs_active.py: using CellId 32034 22:48:19.132203 tst cs_paging_gprs_active.py: using BVCI 32035 22:48:19.250070 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:48:19.261632 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:48:19.272934 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:48:19.284322 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:48:19.295419 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:48:19.306657 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:48:19.317897 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:48:19.328913 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:48:19.340190 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:48:19.456488 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:48:19.582200 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:48:19.799858 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:48:20.122799 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4294): Launched 22:48:20.403585 run iperf3-srv_10.42.42.10(pid=4295): Launched 22:48:20.525377 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:48:20.742468 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:48:21.067723 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4296): Launched 22:48:21.347624 run iperf3-srv_10.42.42.10(pid=4297): Launched 22:48:21.468919 tst cs_paging_gprs_active.py:38: start network... 22:48:21.687241 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:48:22.188577 run create_hlr_db(pid=4298): Launched 22:48:22.319568 bus /gobi_6: Setting Powered False 22:48:23.382810 run create_hlr_db(pid=4298): Terminated: ok {rc=0} 22:48:23.814701 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4300): Launched 22:48:24.118858 run osmo-hlr_10.42.42.2(pid=4301): Launched 22:48:24.235089 run osmo-stp_10.42.42.5: Starting osmo-stp 22:48:24.770175 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4303): Launched 22:48:25.073486 run osmo-stp_10.42.42.5(pid=4304): Launched 22:48:25.190338 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:48:25.715704 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4306): Launched 22:48:25.832586 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:48:26.090527 run patchelf(pid=4307): Launched 22:48:26.259475 run osmo-stp_10.42.42.5(pid=4304): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4304)] 22:48:26.387772 run osmo-stp_10.42.42.5(pid=4304): stdout: | (launched: 2022-12-12_22:48:25.018419) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:48:26.517696 run osmo-stp_10.42.42.5(pid=4304): stderr: | [0;m[38;5;43m20221212224825189 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224825189 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224825189 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224825190 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224825190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224825190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224825190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:48:26.647917 run osmo-stp_10.42.42.5(pid=4304): stdout: | (launched: 2022-12-12_22:48:25.018419) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:48:26.772574 run osmo-stp_10.42.42.5(pid=4304): stderr: | [0;m[38;5;43m20221212224825189 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224825189 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224825189 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224825190 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224825190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224825190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224825190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:48:26.919795 run patchelf(pid=4307): Terminating (SIGINT) 22:48:27.091505 run patchelf(pid=4307): Terminated: ok {rc=0} 22:48:27.215380 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=4304): Process ended prematurely: osmo-stp_10.42.42.5(pid=4304) [trial-2383↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4304)] [trial-2383↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 22:48:27.224727 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 22:48:27.251766 run osmo-hlr_10.42.42.2(pid=4301): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4301)] 22:48:27.299658 run osmo-hlr_10.42.42.2(pid=4301): stdout: | (launched: 2022-12-12_22:48:24.063470) 22:48:27.348929 run osmo-hlr_10.42.42.2(pid=4301): stderr: | [0;m[1;31m20221212224824238 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212224824238 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212224824238 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212224824239 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212224824239 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212224824239 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212224824251 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-umtrx+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212224824262 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212224824262 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212224824262 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:48:27.398507 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4294): Terminating (SIGTERM) 22:48:27.437902 run iperf3-srv_10.42.42.10(pid=4295): Terminating (SIGTERM) 22:48:27.478650 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4296): Terminating (SIGTERM) 22:48:27.518514 run iperf3-srv_10.42.42.10(pid=4297): Terminating (SIGTERM) 22:48:27.557771 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4300): Terminating (SIGTERM) 22:48:27.597089 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4303): Terminating (SIGTERM) 22:48:27.636345 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4306): Terminating (SIGTERM) 22:48:27.675842 --- ParallelTerminationStrategy: PID 4294 died... 22:48:27.694623 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4294): Terminated: ok {rc=0} 22:48:27.738343 --- ParallelTerminationStrategy: PID 4295 died... 22:48:27.756537 run iperf3-srv_10.42.42.10(pid=4295): Terminated {rc=256} 22:48:27.800018 --- ParallelTerminationStrategy: PID 4296 died... 22:48:27.818302 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4296): Terminated: ok {rc=0} 22:48:27.861930 --- ParallelTerminationStrategy: PID 4297 died... 22:48:27.880080 run iperf3-srv_10.42.42.10(pid=4297): Terminated {rc=256} 22:48:27.923524 --- ParallelTerminationStrategy: PID 4300 died... 22:48:27.941760 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4300): Terminated: ok {rc=0} 22:48:27.985457 --- ParallelTerminationStrategy: PID 4303 died... 22:48:28.003814 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4303): Terminated: ok {rc=0} 22:48:28.047255 --- ParallelTerminationStrategy: PID 4306 died... 22:48:28.065402 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4306): Terminated: ok {rc=0} 22:48:28.150421 bus /gobi_0: Setting Powered False 22:48:29.248765 bus /gobi_0: Setting Powered False 22:48:30.363758 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 22:48:31.508404 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:48:31.520886 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:48:31.593952 tst iperf3.py: using LAC 32035 22:48:31.723649 tst iperf3.py: using RAC 160 22:48:31.853414 tst iperf3.py: using CellId 32035 22:48:32.003516 tst iperf3.py: using BVCI 32036 22:48:32.150627 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:48:32.163205 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:48:32.175322 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:48:32.187123 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:48:32.198785 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:48:32.210979 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:48:32.223243 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:48:32.234894 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:48:32.246801 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:48:32.366975 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:48:32.583785 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:48:32.905151 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4308): Launched 22:48:33.184448 run iperf3-srv_10.42.42.10(pid=4309): Launched 22:48:33.304885 tst iperf3.py:8: start network... 22:48:33.521776 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:48:34.020180 run create_hlr_db(pid=4310): Launched 22:48:34.150316 bus /gobi_6: Setting Powered False 22:48:35.213794 run create_hlr_db(pid=4310): Terminated: ok {rc=0} 22:48:35.644343 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4312): Launched 22:48:35.946344 run osmo-hlr_10.42.42.2(pid=4313): Launched 22:48:36.062003 run osmo-stp_10.42.42.5: Starting osmo-stp 22:48:36.584289 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4315): Launched 22:48:36.886411 run osmo-stp_10.42.42.5(pid=4316): Launched 22:48:37.002196 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:48:37.523268 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4318): Launched 22:48:37.639684 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:48:37.894854 run patchelf(pid=4319): Launched 22:48:38.065095 run osmo-stp_10.42.42.5(pid=4316): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4316)] 22:48:38.193521 run osmo-stp_10.42.42.5(pid=4316): stdout: | (launched: 2022-12-12_22:48:36.831442) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:48:38.323415 run osmo-stp_10.42.42.5(pid=4316): stderr: | [0;m[38;5;43m20221212224837001 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224837002 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224837002 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224837002 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224837003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224837003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224837003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:48:38.453323 run osmo-stp_10.42.42.5(pid=4316): stdout: | (launched: 2022-12-12_22:48:36.831442) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:48:38.577765 run osmo-stp_10.42.42.5(pid=4316): stderr: | [0;m[38;5;43m20221212224837001 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224837002 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224837002 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224837002 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224837003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224837003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224837003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:48:38.725444 run patchelf(pid=4319): Terminating (SIGINT) 22:48:38.897478 run patchelf(pid=4319): Terminated: ok {rc=0} 22:48:39.021670 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4316): Process ended prematurely: osmo-stp_10.42.42.5(pid=4316) [trial-2383↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4316)] [trial-2383↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8] 22:48:39.031349 tst iperf3.py:8: Test FAILED (7.6 sec) 22:48:39.058992 run osmo-hlr_10.42.42.2(pid=4313): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4313)] 22:48:39.107329 run osmo-hlr_10.42.42.2(pid=4313): stdout: | (launched: 2022-12-12_22:48:35.891164) 22:48:39.157488 run osmo-hlr_10.42.42.2(pid=4313): stderr: | [0;m[1;31m20221212224836068 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212224836068 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212224836068 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212224836068 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212224836068 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212224836068 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212224836080 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212224836090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212224836090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212224836090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:48:39.207441 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4308): Terminating (SIGTERM) 22:48:39.247439 run iperf3-srv_10.42.42.10(pid=4309): Terminating (SIGTERM) 22:48:39.287586 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4312): Terminating (SIGTERM) 22:48:39.327954 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4315): Terminating (SIGTERM) 22:48:39.368164 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4318): Terminating (SIGTERM) 22:48:39.408561 --- ParallelTerminationStrategy: PID 4308 died... 22:48:39.427694 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4308): Terminated: ok {rc=0} 22:48:39.472132 --- ParallelTerminationStrategy: PID 4309 died... 22:48:39.490759 run iperf3-srv_10.42.42.10(pid=4309): Terminated {rc=256} 22:48:39.534980 --- ParallelTerminationStrategy: PID 4312 died... 22:48:39.553543 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4312): Terminated: ok {rc=0} 22:48:39.598312 --- ParallelTerminationStrategy: PID 4315 died... 22:48:39.617298 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4315): Terminated: ok {rc=0} 22:48:39.661805 --- ParallelTerminationStrategy: PID 4318 died... 22:48:39.680416 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4318): Terminated: ok {rc=0} 22:48:39.764355 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 22:48:40.913196 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:48:40.925271 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:48:40.997351 tst iperf3m4.py: using LAC 32036 22:48:41.125506 tst iperf3m4.py: using RAC 161 22:48:41.248213 tst iperf3m4.py: using CellId 32036 22:48:41.369353 tst iperf3m4.py: using BVCI 32037 22:48:41.480866 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:48:41.491916 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:48:41.502752 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:48:41.514988 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:48:41.526061 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:48:41.537092 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:48:41.548169 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:48:41.559020 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:48:41.570278 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:48:41.689579 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:48:41.810216 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:48:41.930159 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:48:42.046322 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:48:42.249554 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:48:42.553263 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4320): Launched 22:48:42.817516 run iperf3-srv_10.42.42.10(pid=4321): Launched 22:48:42.932362 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:48:43.136165 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:48:43.441856 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4322): Launched 22:48:43.706421 run iperf3-srv_10.42.42.10(pid=4323): Launched 22:48:43.820558 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:48:44.024327 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:48:44.330036 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4324): Launched 22:48:44.593194 run iperf3-srv_10.42.42.10(pid=4325): Launched 22:48:44.706889 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:48:44.908398 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:48:45.212673 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4326): Launched 22:48:45.476243 run iperf3-srv_10.42.42.10(pid=4327): Launched 22:48:45.590055 tst iperf3m4.py:8: start network... 22:48:45.793141 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:48:46.311694 run create_hlr_db(pid=4328): Launched 22:48:46.461662 bus /gobi_6: Setting Powered False 22:48:47.527206 run create_hlr_db(pid=4328): Terminated: ok {rc=0} 22:48:47.959413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4330): Launched 22:48:48.263029 run osmo-hlr_10.42.42.2(pid=4331): Launched 22:48:48.378895 run osmo-stp_10.42.42.5: Starting osmo-stp 22:48:48.917356 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4333): Launched 22:48:49.221687 run osmo-stp_10.42.42.5(pid=4334): Launched 22:48:49.338248 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:48:49.863772 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4336): Launched 22:48:49.980574 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:48:50.236712 run patchelf(pid=4337): Launched 22:48:50.406219 run osmo-stp_10.42.42.5(pid=4334): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4334)] 22:48:50.534738 run osmo-stp_10.42.42.5(pid=4334): stdout: | (launched: 2022-12-12_22:48:49.165887) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:48:50.664534 run osmo-stp_10.42.42.5(pid=4334): stderr: | [0;m[38;5;43m20221212224849337 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224849337 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224849337 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224849338 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224849340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224849340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224849340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:48:50.794336 run osmo-stp_10.42.42.5(pid=4334): stdout: | (launched: 2022-12-12_22:48:49.165887) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:48:50.918731 run osmo-stp_10.42.42.5(pid=4334): stderr: | [0;m[38;5;43m20221212224849337 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224849337 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224849337 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224849338 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224849340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224849340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224849340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:48:51.066032 run patchelf(pid=4337): Terminating (SIGINT) 22:48:51.237986 run patchelf(pid=4337): Terminated: ok {rc=0} 22:48:51.361418 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4334): Process ended prematurely: osmo-stp_10.42.42.5(pid=4334) [trial-2383↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4334)] [trial-2383↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8] 22:48:51.370706 tst iperf3m4.py:8: Test FAILED (10.5 sec) 22:48:51.398327 run osmo-hlr_10.42.42.2(pid=4331): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4331)] 22:48:51.446097 run osmo-hlr_10.42.42.2(pid=4331): stdout: | (launched: 2022-12-12_22:48:48.207561) 22:48:51.495472 run osmo-hlr_10.42.42.2(pid=4331): stderr: | [0;m[1;31m20221212224848386 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212224848386 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212224848386 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212224848386 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212224848386 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212224848386 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212224848398 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212224848407 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212224848407 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212224848407 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:48:51.545402 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4320): Terminating (SIGTERM) 22:48:51.585277 run iperf3-srv_10.42.42.10(pid=4321): Terminating (SIGTERM) 22:48:51.625101 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4322): Terminating (SIGTERM) 22:48:51.665044 run iperf3-srv_10.42.42.10(pid=4323): Terminating (SIGTERM) 22:48:51.704715 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4324): Terminating (SIGTERM) 22:48:51.744529 run iperf3-srv_10.42.42.10(pid=4325): Terminating (SIGTERM) 22:48:51.784247 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4326): Terminating (SIGTERM) 22:48:51.824325 run iperf3-srv_10.42.42.10(pid=4327): Terminating (SIGTERM) 22:48:51.863840 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4330): Terminating (SIGTERM) 22:48:51.903728 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4333): Terminating (SIGTERM) 22:48:51.943398 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4336): Terminating (SIGTERM) 22:48:51.983133 --- ParallelTerminationStrategy: PID 4320 died... 22:48:52.002112 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4320): Terminated: ok {rc=0} 22:48:52.046732 --- ParallelTerminationStrategy: PID 4321 died... 22:48:52.065348 run iperf3-srv_10.42.42.10(pid=4321): Terminated {rc=256} 22:48:52.109210 --- ParallelTerminationStrategy: PID 4322 died... 22:48:52.127666 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4322): Terminated: ok {rc=0} 22:48:52.171673 --- ParallelTerminationStrategy: PID 4323 died... 22:48:52.190017 run iperf3-srv_10.42.42.10(pid=4323): Terminated {rc=256} 22:48:52.233870 --- ParallelTerminationStrategy: PID 4324 died... 22:48:52.252511 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4324): Terminated: ok {rc=0} 22:48:52.296618 --- ParallelTerminationStrategy: PID 4325 died... 22:48:52.315211 run iperf3-srv_10.42.42.10(pid=4325): Terminated {rc=256} 22:48:52.359135 --- ParallelTerminationStrategy: PID 4326 died... 22:48:52.377757 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4326): Terminated: ok {rc=0} 22:48:52.421871 --- ParallelTerminationStrategy: PID 4327 died... 22:48:52.440445 run iperf3-srv_10.42.42.10(pid=4327): Terminated {rc=256} 22:48:52.484356 --- ParallelTerminationStrategy: PID 4330 died... 22:48:52.502946 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4330): Terminated: ok {rc=0} 22:48:52.546812 --- ParallelTerminationStrategy: PID 4333 died... 22:48:52.565486 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4333): Terminated: ok {rc=0} 22:48:52.610390 --- ParallelTerminationStrategy: PID 4336 died... 22:48:52.629053 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4336): Terminated: ok {rc=0} 22:48:52.715216 bus /gobi_4: Setting Powered False 22:48:53.816258 bus /gobi_4: Setting Powered False 22:48:54.931470 bus /gobi_1: Setting Powered False 22:48:56.029438 bus /gobi_1: Setting Powered False 22:48:57.146254 bus /gobi_0: Setting Powered False 22:48:58.243582 bus /gobi_0: Setting Powered False 22:48:59.359374 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-umtrx+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 22:49:00.461183 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:49:00.472513 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:49:00.542894 tst ping.py: using LAC 32037 22:49:00.661658 tst ping.py: using RAC 162 22:49:00.780923 tst ping.py: using CellId 32037 22:49:00.900599 tst ping.py: using BVCI 32038 22:49:01.012131 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:49:01.024006 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:49:01.035765 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:49:01.047894 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:49:01.060011 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:49:01.072443 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:49:01.084656 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:49:01.097678 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:49:01.214984 tst ping.py:19: start network... 22:49:01.441931 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:49:01.953821 run create_hlr_db(pid=4338): Launched 22:49:02.081185 bus /gobi_6: Setting Powered False 22:49:03.144220 run create_hlr_db(pid=4338): Terminated: ok {rc=0} 22:49:03.572911 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4340): Launched 22:49:03.890828 run osmo-hlr_10.42.42.2(pid=4341): Launched 22:49:04.011872 run osmo-stp_10.42.42.5: Starting osmo-stp 22:49:04.562633 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4343): Launched 22:49:04.877479 run osmo-stp_10.42.42.5(pid=4344): Launched 22:49:04.997844 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:49:05.545648 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4346): Launched 22:49:05.667336 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:49:05.936119 run patchelf(pid=4347): Launched 22:49:06.112530 run osmo-stp_10.42.42.5(pid=4344): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4344)] 22:49:06.247564 run osmo-stp_10.42.42.5(pid=4344): stdout: | (launched: 2022-12-12_22:49:04.820328) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:49:06.383624 run osmo-stp_10.42.42.5(pid=4344): stderr: | [0;m[38;5;43m20221212224905011 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224905012 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224905012 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224905012 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224905013 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224905013 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224905013 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:49:06.519525 run osmo-stp_10.42.42.5(pid=4344): stdout: | (launched: 2022-12-12_22:49:04.820328) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:49:06.650470 run osmo-stp_10.42.42.5(pid=4344): stderr: | [0;m[38;5;43m20221212224905011 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224905012 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224905012 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224905012 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224905013 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224905013 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224905013 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:49:06.804252 run patchelf(pid=4347): Terminating (SIGINT) 22:49:06.983785 run patchelf(pid=4347): Terminated: ok {rc=0} 22:49:07.112843 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=4344): Process ended prematurely: osmo-stp_10.42.42.5(pid=4344) [trial-2383↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4344)] [trial-2383↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22] 22:49:07.122909 tst ping.py:22: Test FAILED (6.7 sec) 22:49:07.151391 run osmo-hlr_10.42.42.2(pid=4341): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4341)] 22:49:07.201794 run osmo-hlr_10.42.42.2(pid=4341): stdout: | (launched: 2022-12-12_22:49:03.833484) 22:49:07.254046 run osmo-hlr_10.42.42.2(pid=4341): stderr: | [0;m[1;31m20221212224904029 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212224904029 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212224904029 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212224904029 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212224904029 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212224904029 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212224904043 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212224904051 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212224904051 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212224904051 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:49:07.306561 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4340): Terminating (SIGTERM) 22:49:07.348775 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4343): Terminating (SIGTERM) 22:49:07.391201 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4346): Terminating (SIGTERM) 22:49:07.433825 --- ParallelTerminationStrategy: PID 4340 died... 22:49:07.453899 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4340): Terminated: ok {rc=0} 22:49:07.500722 --- ParallelTerminationStrategy: PID 4343 died... 22:49:07.520604 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4343): Terminated: ok {rc=0} 22:49:07.567576 --- ParallelTerminationStrategy: PID 4346 died... 22:49:07.587510 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4346): Terminated: ok {rc=0} 22:49:07.674996 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-umtrx+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 22:49:08.763002 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:49:08.775460 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:49:08.850034 tst ping_idle_ping.py: using LAC 32038 22:49:08.976396 tst ping_idle_ping.py: using RAC 163 22:49:09.101858 tst ping_idle_ping.py: using CellId 32038 22:49:09.229307 tst ping_idle_ping.py: using BVCI 32039 22:49:09.346220 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:49:09.357713 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:49:09.368822 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:49:09.380131 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:49:09.391205 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:49:09.402452 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:49:09.413736 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:49:09.424880 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:49:09.546782 tst ping_idle_ping.py:24: start network... 22:49:09.762115 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:49:10.253639 run create_hlr_db(pid=4348): Launched 22:49:10.382988 bus /gobi_6: Setting Powered False 22:49:11.445567 run create_hlr_db(pid=4348): Terminated: ok {rc=0} 22:49:11.873053 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4350): Launched 22:49:12.173364 run osmo-hlr_10.42.42.2(pid=4351): Launched 22:49:12.290378 run osmo-stp_10.42.42.5: Starting osmo-stp 22:49:12.803501 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4353): Launched 22:49:13.102930 run osmo-stp_10.42.42.5(pid=4354): Launched 22:49:13.218193 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:49:13.735116 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4356): Launched 22:49:13.850020 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:49:14.102356 run patchelf(pid=4357): Launched 22:49:14.269501 run osmo-stp_10.42.42.5(pid=4354): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4354)] 22:49:14.396621 run osmo-stp_10.42.42.5(pid=4354): stdout: | (launched: 2022-12-12_22:49:13.048451) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:49:14.524607 run osmo-stp_10.42.42.5(pid=4354): stderr: | [0;m[38;5;43m20221212224913218 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224913218 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224913218 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224913219 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224913219 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224913219 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224913219 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:49:14.653376 run osmo-stp_10.42.42.5(pid=4354): stdout: | (launched: 2022-12-12_22:49:13.048451) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:49:14.775768 run osmo-stp_10.42.42.5(pid=4354): stderr: | [0;m[38;5;43m20221212224913218 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224913218 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224913218 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224913219 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224913219 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224913219 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224913219 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:49:14.920813 run patchelf(pid=4357): Terminating (SIGINT) 22:49:15.090661 run patchelf(pid=4357): Terminated: ok {rc=0} 22:49:15.212679 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=4354): Process ended prematurely: osmo-stp_10.42.42.5(pid=4354) [trial-2383↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4354)] [trial-2383↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 22:49:15.221551 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 22:49:15.248752 run osmo-hlr_10.42.42.2(pid=4351): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4351)] 22:49:15.296698 run osmo-hlr_10.42.42.2(pid=4351): stdout: | (launched: 2022-12-12_22:49:12.118725) 22:49:15.346192 run osmo-hlr_10.42.42.2(pid=4351): stderr: | [0;m[1;31m20221212224912294 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212224912294 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212224912294 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212224912294 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212224912294 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212224912294 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212224912307 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212224912318 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212224912318 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212224912318 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:49:15.396086 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4350): Terminating (SIGTERM) 22:49:15.435658 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4353): Terminating (SIGTERM) 22:49:15.475213 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4356): Terminating (SIGTERM) 22:49:15.515160 --- ParallelTerminationStrategy: PID 4350 died... 22:49:15.534055 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4350): Terminated: ok {rc=0} 22:49:15.578072 --- ParallelTerminationStrategy: PID 4353 died... 22:49:15.596312 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4353): Terminated: ok {rc=0} 22:49:15.640294 --- ParallelTerminationStrategy: PID 4356 died... 22:49:15.658736 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4356): Terminated: ok {rc=0} 22:49:15.741800 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2383 gprs:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 22:49:17.040696 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:49:17.054062 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 22:49:17.103906 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 22:49:17.161712 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 22:49:17.262255 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 22:49:17.297154 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 22:49:17.338938 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 22:49:17.935749 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2383 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 22:49:17.986490 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:49:17.997889 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 22:49:18.050012 tst cs_paging_gprs_active.py: using LAC 32039 22:49:18.178614 tst cs_paging_gprs_active.py: using RAC 164 22:49:18.307853 tst cs_paging_gprs_active.py: using CellId 32039 22:49:18.429984 tst cs_paging_gprs_active.py: using BVCI 32040 22:49:18.543162 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:49:18.557616 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:49:18.569566 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:49:18.581410 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:49:18.593013 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:49:18.604581 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:49:18.616368 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:49:18.627936 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:49:18.639812 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:49:18.756109 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:49:18.876694 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:49:19.095834 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:49:19.419457 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4361): Launched 22:49:19.701582 run iperf3-srv_10.42.42.10(pid=4362): Launched 22:49:19.823300 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:49:20.042710 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:49:20.369693 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4363): Launched 22:49:20.652898 run iperf3-srv_10.42.42.10(pid=4364): Launched 22:49:20.774300 tst cs_paging_gprs_active.py:38: start network... 22:49:20.991764 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:49:21.493410 run create_hlr_db(pid=4365): Launched 22:49:21.625930 bus /gobi_6: Setting Powered False 22:49:22.689452 run create_hlr_db(pid=4365): Terminated: ok {rc=0} 22:49:23.121443 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4367): Launched 22:49:23.426935 run osmo-hlr_10.42.42.2(pid=4368): Launched 22:49:23.543132 run osmo-stp_10.42.42.5: Starting osmo-stp 22:49:24.067084 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4370): Launched 22:49:24.371260 run osmo-stp_10.42.42.5(pid=4371): Launched 22:49:24.487459 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:49:25.009595 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4373): Launched 22:49:25.126406 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:49:25.384058 run patchelf(pid=4374): Launched 22:49:25.552894 run osmo-stp_10.42.42.5(pid=4371): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4371)] 22:49:25.681233 run osmo-stp_10.42.42.5(pid=4371): stdout: | (launched: 2022-12-12_22:49:24.315685) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:49:25.811412 run osmo-stp_10.42.42.5(pid=4371): stderr: | [0;m[38;5;43m20221212224924488 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224924488 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224924488 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224924488 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224924489 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224924489 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224924489 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:49:25.941533 run osmo-stp_10.42.42.5(pid=4371): stdout: | (launched: 2022-12-12_22:49:24.315685) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:49:26.066355 run osmo-stp_10.42.42.5(pid=4371): stderr: | [0;m[38;5;43m20221212224924488 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224924488 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224924488 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224924488 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224924489 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224924489 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224924489 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:49:26.214169 run patchelf(pid=4374): Terminating (SIGINT) 22:49:26.386122 run patchelf(pid=4374): Terminated: ok {rc=0} 22:49:26.509681 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=4371): Process ended prematurely: osmo-stp_10.42.42.5(pid=4371) [trial-2383↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4371)] [trial-2383↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 22:49:26.518947 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 22:49:26.546222 run osmo-hlr_10.42.42.2(pid=4368): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4368)] 22:49:26.594378 run osmo-hlr_10.42.42.2(pid=4368): stdout: | (launched: 2022-12-12_22:49:23.371179) 22:49:26.643708 run osmo-hlr_10.42.42.2(pid=4368): stderr: | [0;m[1;31m20221212224923547 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212224923547 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212224923547 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212224923547 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212224923547 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212224923547 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212224923583 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212224923592 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212224923593 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212224923593 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:49:26.693998 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4361): Terminating (SIGTERM) 22:49:26.733996 run iperf3-srv_10.42.42.10(pid=4362): Terminating (SIGTERM) 22:49:26.773895 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4363): Terminating (SIGTERM) 22:49:26.813893 run iperf3-srv_10.42.42.10(pid=4364): Terminating (SIGTERM) 22:49:26.853714 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4367): Terminating (SIGTERM) 22:49:26.893690 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4370): Terminating (SIGTERM) 22:49:26.933449 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4373): Terminating (SIGTERM) 22:49:26.973500 --- ParallelTerminationStrategy: PID 4361 died... 22:49:26.992477 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4361): Terminated: ok {rc=0} 22:49:27.037338 --- ParallelTerminationStrategy: PID 4362 died... 22:49:27.055767 run iperf3-srv_10.42.42.10(pid=4362): Terminated {rc=256} 22:49:27.100012 --- ParallelTerminationStrategy: PID 4363 died... 22:49:27.118569 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4363): Terminated: ok {rc=0} 22:49:27.162717 --- ParallelTerminationStrategy: PID 4364 died... 22:49:27.181161 run iperf3-srv_10.42.42.10(pid=4364): Terminated {rc=256} 22:49:27.226071 --- ParallelTerminationStrategy: PID 4367 died... 22:49:27.244306 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4367): Terminated: ok {rc=0} 22:49:27.287729 --- ParallelTerminationStrategy: PID 4370 died... 22:49:27.306021 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4370): Terminated: ok {rc=0} 22:49:27.349938 --- ParallelTerminationStrategy: PID 4373 died... 22:49:27.368142 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4373): Terminated: ok {rc=0} 22:49:27.453189 bus /gobi_0: Setting Powered False 22:49:28.553141 bus /gobi_0: Setting Powered False 22:49:29.667656 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 22:49:30.813930 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:49:30.825899 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 22:49:30.886630 tst iperf3.py: using LAC 32040 22:49:31.023780 tst iperf3.py: using RAC 165 22:49:31.200867 tst iperf3.py: using CellId 32040 22:49:31.334622 tst iperf3.py: using BVCI 32041 22:49:31.482362 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:49:31.496278 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:49:31.510822 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:49:31.524544 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:49:31.537515 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:49:31.549817 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:49:31.563280 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:49:31.575968 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:49:31.588760 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:49:31.711815 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:49:31.922183 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:49:32.288677 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4376): Launched 22:49:32.567139 run iperf3-srv_10.42.42.10(pid=4377): Launched 22:49:32.681674 tst iperf3.py:8: start network... 22:49:32.884703 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:49:33.353228 run create_hlr_db(pid=4378): Launched 22:49:33.468845 bus /gobi_6: Setting Powered False 22:49:34.529170 run create_hlr_db(pid=4378): Terminated: ok {rc=0} 22:49:34.968855 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4380): Launched 22:49:35.289287 run osmo-hlr_10.42.42.2(pid=4381): Launched 22:49:35.412209 run osmo-stp_10.42.42.5: Starting osmo-stp 22:49:35.968468 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4383): Launched 22:49:36.289517 run osmo-stp_10.42.42.5(pid=4384): Launched 22:49:36.414486 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:49:36.975908 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4386): Launched 22:49:37.099290 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:49:37.372484 run patchelf(pid=4387): Launched 22:49:37.552205 run osmo-stp_10.42.42.5(pid=4384): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4384)] 22:49:37.688925 run osmo-stp_10.42.42.5(pid=4384): stdout: | (launched: 2022-12-12_22:49:36.231159) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:49:37.827000 run osmo-stp_10.42.42.5(pid=4384): stderr: | [0;m[38;5;43m20221212224936424 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224936424 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224936424 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224936424 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224936425 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224936425 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224936425 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:49:37.965818 run osmo-stp_10.42.42.5(pid=4384): stdout: | (launched: 2022-12-12_22:49:36.231159) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:49:38.098068 run osmo-stp_10.42.42.5(pid=4384): stderr: | [0;m[38;5;43m20221212224936424 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224936424 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224936424 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224936424 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224936425 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224936425 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224936425 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:49:38.255011 run patchelf(pid=4387): Terminating (SIGINT) 22:49:38.437250 run patchelf(pid=4387): Terminated: ok {rc=0} 22:49:38.568553 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4384): Process ended prematurely: osmo-stp_10.42.42.5(pid=4384) [trial-2383↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4384)] [trial-2383↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 22:49:38.578772 tst iperf3.py:8: Test FAILED (7.8 sec) 22:49:38.607445 run osmo-hlr_10.42.42.2(pid=4381): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4381)] 22:49:38.657319 run osmo-hlr_10.42.42.2(pid=4381): stdout: | (launched: 2022-12-12_22:49:35.231114) 22:49:38.709152 run osmo-hlr_10.42.42.2(pid=4381): stderr: | [0;m[1;31m20221212224935431 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212224935431 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212224935431 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212224935431 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212224935431 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212224935431 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212224935444 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212224935453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212224935453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212224935453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:49:38.761171 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4376): Terminating (SIGTERM) 22:49:38.802762 run iperf3-srv_10.42.42.10(pid=4377): Terminating (SIGTERM) 22:49:38.844395 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4380): Terminating (SIGTERM) 22:49:38.886307 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4383): Terminating (SIGTERM) 22:49:38.928112 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4386): Terminating (SIGTERM) 22:49:38.969886 --- ParallelTerminationStrategy: PID 4376 died... 22:49:38.989970 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4376): Terminated: ok {rc=0} 22:49:39.036260 --- ParallelTerminationStrategy: PID 4377 died... 22:49:39.055837 run iperf3-srv_10.42.42.10(pid=4377): Terminated {rc=256} 22:49:39.101739 --- ParallelTerminationStrategy: PID 4380 died... 22:49:39.121350 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4380): Terminated: ok {rc=0} 22:49:39.167137 --- ParallelTerminationStrategy: PID 4383 died... 22:49:39.186728 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4383): Terminated: ok {rc=0} 22:49:39.232512 --- ParallelTerminationStrategy: PID 4386 died... 22:49:39.252150 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4386): Terminated: ok {rc=0} 22:49:39.339441 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 22:49:40.492177 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:49:40.504690 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 22:49:40.558215 tst iperf3m4.py: using LAC 32041 22:49:40.686426 tst iperf3m4.py: using RAC 166 22:49:40.813832 tst iperf3m4.py: using CellId 32041 22:49:40.941912 tst iperf3m4.py: using BVCI 32042 22:49:41.059389 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:49:41.071151 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:49:41.082718 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:49:41.094333 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:49:41.106052 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:49:41.117611 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:49:41.129313 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:49:41.140645 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:49:41.152486 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:49:41.271250 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:49:41.394398 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:49:41.511522 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:49:41.627263 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:49:41.831533 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:49:42.136344 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4389): Launched 22:49:42.400877 run iperf3-srv_10.42.42.10(pid=4390): Launched 22:49:42.515989 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:49:42.719861 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:49:43.023798 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4391): Launched 22:49:43.288725 run iperf3-srv_10.42.42.10(pid=4392): Launched 22:49:43.403084 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:49:43.606928 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:49:43.910501 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4393): Launched 22:49:44.173580 run iperf3-srv_10.42.42.10(pid=4394): Launched 22:49:44.288498 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:49:44.493877 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:49:44.799164 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4395): Launched 22:49:45.062577 run iperf3-srv_10.42.42.10(pid=4396): Launched 22:49:45.176571 tst iperf3m4.py:8: start network... 22:49:45.379471 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:49:45.853745 run create_hlr_db(pid=4397): Launched 22:49:46.020571 bus /gobi_6: Setting Powered False 22:49:47.103482 run create_hlr_db(pid=4397): Terminated: ok {rc=0} 22:49:47.569297 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4399): Launched 22:49:47.891720 run osmo-hlr_10.42.42.2(pid=4400): Launched 22:49:48.014458 run osmo-stp_10.42.42.5: Starting osmo-stp 22:49:48.571402 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4402): Launched 22:49:48.893555 run osmo-stp_10.42.42.5(pid=4403): Launched 22:49:49.017883 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:49:49.578139 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4405): Launched 22:49:49.701681 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:49:49.974472 run patchelf(pid=4406): Launched 22:49:50.154747 run osmo-stp_10.42.42.5(pid=4403): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4403)] 22:49:50.291384 run osmo-stp_10.42.42.5(pid=4403): stdout: | (launched: 2022-12-12_22:49:48.835009) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:49:50.429763 run osmo-stp_10.42.42.5(pid=4403): stderr: | [0;m[38;5;43m20221212224949027 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224949027 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224949027 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224949028 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224949028 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224949028 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224949028 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:49:50.569027 run osmo-stp_10.42.42.5(pid=4403): stdout: | (launched: 2022-12-12_22:49:48.835009) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:49:50.701518 run osmo-stp_10.42.42.5(pid=4403): stderr: | [0;m[38;5;43m20221212224949027 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212224949027 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212224949027 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212224949028 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212224949028 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212224949028 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212224949028 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:49:50.858276 run patchelf(pid=4406): Terminating (SIGINT) 22:49:51.040516 run patchelf(pid=4406): Terminated: ok {rc=0} 22:49:51.171493 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4403): Process ended prematurely: osmo-stp_10.42.42.5(pid=4403) [trial-2383↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4403)] [trial-2383↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 22:49:51.181667 tst iperf3m4.py:8: Test FAILED (10.7 sec) 22:49:51.210318 run osmo-hlr_10.42.42.2(pid=4400): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4400)] 22:49:51.259750 run osmo-hlr_10.42.42.2(pid=4400): stdout: | (launched: 2022-12-12_22:49:47.832683) 22:49:51.311022 run osmo-hlr_10.42.42.2(pid=4400): stderr: | [0;m[1;31m20221212224948030 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212224948030 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212224948030 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212224948030 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212224948030 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212224948030 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212224948046 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212224948054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212224948054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212224948054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:49:51.362566 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4389): Terminating (SIGTERM) 22:49:51.403741 run iperf3-srv_10.42.42.10(pid=4390): Terminating (SIGTERM) 22:49:51.445061 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4391): Terminating (SIGTERM) 22:49:51.486404 run iperf3-srv_10.42.42.10(pid=4392): Terminating (SIGTERM) 22:49:51.527505 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4393): Terminating (SIGTERM) 22:49:51.569703 run iperf3-srv_10.42.42.10(pid=4394): Terminating (SIGTERM) 22:49:51.611281 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4395): Terminating (SIGTERM) 22:49:51.652457 run iperf3-srv_10.42.42.10(pid=4396): Terminating (SIGTERM) 22:49:51.693583 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4399): Terminating (SIGTERM) 22:49:51.734871 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4402): Terminating (SIGTERM) 22:49:51.776036 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4405): Terminating (SIGTERM) 22:49:51.817572 --- ParallelTerminationStrategy: PID 4389 died... 22:49:51.837332 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4389): Terminated: ok {rc=0} 22:49:51.882931 --- ParallelTerminationStrategy: PID 4390 died... 22:49:51.902226 run iperf3-srv_10.42.42.10(pid=4390): Terminated {rc=256} 22:49:51.947339 --- ParallelTerminationStrategy: PID 4391 died... 22:49:51.966654 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4391): Terminated: ok {rc=0} 22:49:52.011955 --- ParallelTerminationStrategy: PID 4392 died... 22:49:52.031156 run iperf3-srv_10.42.42.10(pid=4392): Terminated {rc=256} 22:49:52.077087 --- ParallelTerminationStrategy: PID 4393 died... 22:49:52.096397 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4393): Terminated: ok {rc=0} 22:49:52.141805 --- ParallelTerminationStrategy: PID 4394 died... 22:49:52.161069 run iperf3-srv_10.42.42.10(pid=4394): Terminated {rc=256} 22:49:52.206233 --- ParallelTerminationStrategy: PID 4395 died... 22:49:52.225547 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4395): Terminated: ok {rc=0} 22:49:52.270928 --- ParallelTerminationStrategy: PID 4396 died... 22:49:52.290091 run iperf3-srv_10.42.42.10(pid=4396): Terminated {rc=256} 22:49:52.335209 --- ParallelTerminationStrategy: PID 4399 died... 22:49:52.354594 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4399): Terminated: ok {rc=0} 22:49:52.399993 --- ParallelTerminationStrategy: PID 4402 died... 22:49:52.419368 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4402): Terminated: ok {rc=0} 22:49:52.465083 --- ParallelTerminationStrategy: PID 4405 died... 22:49:52.484536 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4405): Terminated: ok {rc=0} 22:49:52.571280 bus /gobi_4: Setting Powered False 22:49:53.668792 bus /gobi_4: Setting Powered False 22:49:54.784871 bus /gobi_1: Setting Powered False 22:49:55.882604 bus /gobi_1: Setting Powered False 22:49:56.998000 bus /gobi_0: Setting Powered False 22:49:58.096707 bus /gobi_0: Setting Powered False 22:49:59.212619 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 22:50:00.314785 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:50:00.326745 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 22:50:00.378585 tst ping.py: using LAC 32042 22:50:00.497050 tst ping.py: using RAC 167 22:50:00.614511 tst ping.py: using CellId 32042 22:50:00.733795 tst ping.py: using BVCI 32043 22:50:00.850847 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:50:00.863318 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:50:00.876255 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:50:00.893747 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:50:00.906009 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:50:00.918266 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:50:00.930974 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:50:00.943306 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:50:01.067849 tst ping.py:19: start network... 22:50:01.304221 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:50:01.813371 run create_hlr_db(pid=4410): Launched 22:50:01.973782 bus /gobi_6: Setting Powered False 22:50:03.036206 run create_hlr_db(pid=4410): Terminated: ok {rc=0} 22:50:03.461102 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4412): Launched 22:50:03.758322 run osmo-hlr_10.42.42.2(pid=4413): Launched 22:50:03.871836 run osmo-stp_10.42.42.5: Starting osmo-stp 22:50:04.390992 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4415): Launched 22:50:04.688899 run osmo-stp_10.42.42.5(pid=4416): Launched 22:50:04.802909 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:50:05.317153 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4418): Launched 22:50:05.431897 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:50:05.683749 run patchelf(pid=4419): Launched 22:50:05.851137 run osmo-stp_10.42.42.5(pid=4416): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4416)] 22:50:05.978263 run osmo-stp_10.42.42.5(pid=4416): stdout: | (launched: 2022-12-12_22:50:04.634462) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:50:06.106793 run osmo-stp_10.42.42.5(pid=4416): stderr: | [0;m[38;5;43m20221212225004804 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225004804 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225004804 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225004805 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225004807 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225004807 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225004807 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:50:06.235059 run osmo-stp_10.42.42.5(pid=4416): stdout: | (launched: 2022-12-12_22:50:04.634462) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:50:06.357991 run osmo-stp_10.42.42.5(pid=4416): stderr: | [0;m[38;5;43m20221212225004804 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225004804 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225004804 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225004805 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225004807 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225004807 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225004807 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:50:06.503086 run patchelf(pid=4419): Terminating (SIGINT) 22:50:06.673776 run patchelf(pid=4419): Terminated: ok {rc=0} 22:50:06.795961 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=4416): Process ended prematurely: osmo-stp_10.42.42.5(pid=4416) [trial-2383↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4416)] [trial-2383↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 22:50:06.804702 tst ping.py:22: Test FAILED (6.5 sec) 22:50:06.831640 run osmo-hlr_10.42.42.2(pid=4413): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4413)] 22:50:06.878748 run osmo-hlr_10.42.42.2(pid=4413): stdout: | (launched: 2022-12-12_22:50:03.703742) 22:50:06.927835 run osmo-hlr_10.42.42.2(pid=4413): stderr: | [0;m[1;31m20221212225003881 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212225003881 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212225003881 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212225003881 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212225003882 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212225003882 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212225003891 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212225003901 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212225003901 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212225003901 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:50:06.977405 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4412): Terminating (SIGTERM) 22:50:07.017037 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4415): Terminating (SIGTERM) 22:50:07.056492 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4418): Terminating (SIGTERM) 22:50:07.096189 --- ParallelTerminationStrategy: PID 4412 died... 22:50:07.115052 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4412): Terminated: ok {rc=0} 22:50:07.159265 --- ParallelTerminationStrategy: PID 4415 died... 22:50:07.177723 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4415): Terminated: ok {rc=0} 22:50:07.222300 --- ParallelTerminationStrategy: PID 4418 died... 22:50:07.240688 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4418): Terminated: ok {rc=0} 22:50:07.323900 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 22:50:08.410284 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:50:08.423224 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 22:50:08.482731 tst ping_idle_ping.py: using LAC 32043 22:50:08.609838 tst ping_idle_ping.py: using RAC 168 22:50:08.733985 tst ping_idle_ping.py: using CellId 32043 22:50:08.857012 tst ping_idle_ping.py: using BVCI 32044 22:50:08.972567 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:50:08.984410 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:50:08.996054 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:50:09.008098 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:50:09.020275 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:50:09.032279 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:50:09.044366 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 22:50:09.056457 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 22:50:09.176637 tst ping_idle_ping.py:24: start network... 22:50:09.392937 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:50:09.887318 run create_hlr_db(pid=4420): Launched 22:50:10.015164 bus /gobi_6: Setting Powered False 22:50:11.078019 run create_hlr_db(pid=4420): Terminated: ok {rc=0} 22:50:11.505050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4422): Launched 22:50:11.803607 run osmo-hlr_10.42.42.2(pid=4423): Launched 22:50:11.918295 run osmo-stp_10.42.42.5: Starting osmo-stp 22:50:12.450285 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4425): Launched 22:50:12.749474 run osmo-stp_10.42.42.5(pid=4426): Launched 22:50:12.864258 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:50:13.382337 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4428): Launched 22:50:13.497381 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:50:13.749524 run patchelf(pid=4429): Launched 22:50:13.917609 run osmo-stp_10.42.42.5(pid=4426): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4426)] 22:50:14.045592 run osmo-stp_10.42.42.5(pid=4426): stdout: | (launched: 2022-12-12_22:50:12.694754) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:50:14.174718 run osmo-stp_10.42.42.5(pid=4426): stderr: | [0;m[38;5;43m20221212225012864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225012864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225012864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225012865 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225012866 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225012866 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225012866 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:50:14.304321 run osmo-stp_10.42.42.5(pid=4426): stdout: | (launched: 2022-12-12_22:50:12.694754) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:50:14.427678 run osmo-stp_10.42.42.5(pid=4426): stderr: | [0;m[38;5;43m20221212225012864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225012864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225012864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225012865 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225012866 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225012866 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225012866 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:50:14.573421 run patchelf(pid=4429): Terminating (SIGINT) 22:50:14.744089 run patchelf(pid=4429): Terminated: ok {rc=0} 22:50:14.867341 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=4426): Process ended prematurely: osmo-stp_10.42.42.5(pid=4426) [trial-2383↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4426)] [trial-2383↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 22:50:14.876152 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 22:50:14.903322 run osmo-hlr_10.42.42.2(pid=4423): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4423)] 22:50:14.950582 run osmo-hlr_10.42.42.2(pid=4423): stdout: | (launched: 2022-12-12_22:50:11.749564) 22:50:14.999722 run osmo-hlr_10.42.42.2(pid=4423): stderr: | [0;m[1;31m20221212225011925 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212225011925 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212225011925 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212225011925 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212225011925 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212225011925 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212225011938 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212225011946 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212225011946 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212225011946 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:50:15.049456 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4422): Terminating (SIGTERM) 22:50:15.089076 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4425): Terminating (SIGTERM) 22:50:15.128708 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4428): Terminating (SIGTERM) 22:50:15.168549 --- ParallelTerminationStrategy: PID 4422 died... 22:50:15.187724 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4422): Terminated: ok {rc=0} 22:50:15.232410 --- ParallelTerminationStrategy: PID 4425 died... 22:50:15.251091 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4425): Terminated: ok {rc=0} 22:50:15.295292 --- ParallelTerminationStrategy: PID 4428 died... 22:50:15.313802 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4428): Terminated: ok {rc=0} 22:50:15.399051 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2383 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 22:50:16.747879 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:50:16.756554 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 22:50:16.804204 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 22:50:16.851683 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 22:50:16.920356 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 22:50:16.973598 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 22:50:17.024347 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 22:50:17.555667 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2383 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 22:50:17.561544 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:50:17.573280 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 22:50:17.650444 tst switch_tch_pdch.py: using LAC 32044 22:50:17.787714 tst switch_tch_pdch.py: using RAC 169 22:50:17.914328 tst switch_tch_pdch.py: using CellId 32044 22:50:18.036255 tst switch_tch_pdch.py: using BVCI 32045 22:50:18.151550 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:50:18.163062 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:50:18.174452 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:50:18.185904 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:50:18.197384 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:50:18.208631 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:50:18.220135 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:50:18.231566 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:50:18.349059 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:50:18.464786 tst switch_tch_pdch.py:51: start network... 22:50:18.665042 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:50:19.125445 run create_hlr_db(pid=4433): Launched 22:50:19.240792 bus /gobi_6: Setting Powered False 22:50:20.299813 run create_hlr_db(pid=4433): Terminated: ok {rc=0} 22:50:20.734195 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4435): Launched 22:50:21.050745 run osmo-hlr_10.42.42.2(pid=4436): Launched 22:50:21.171547 run osmo-stp_10.42.42.5: Starting osmo-stp 22:50:21.715501 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4438): Launched 22:50:22.029590 run osmo-stp_10.42.42.5(pid=4439): Launched 22:50:22.151374 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:50:22.699440 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4441): Launched 22:50:22.820826 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:50:23.087824 run patchelf(pid=4442): Launched 22:50:23.264163 run osmo-stp_10.42.42.5(pid=4439): ERR: Terminated: ERROR {rc=1} [trial-2383↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4439)] 22:50:23.398338 run osmo-stp_10.42.42.5(pid=4439): stdout: | (launched: 2022-12-12_22:50:21.972463) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:50:23.533449 run osmo-stp_10.42.42.5(pid=4439): stderr: | [0;m[38;5;43m20221212225022163 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225022163 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225022163 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225022164 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225022164 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225022164 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225022164 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:50:23.669186 run osmo-stp_10.42.42.5(pid=4439): stdout: | (launched: 2022-12-12_22:50:21.972463) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:50:23.798568 run osmo-stp_10.42.42.5(pid=4439): stderr: | [0;m[38;5;43m20221212225022163 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225022163 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225022163 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225022164 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225022164 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225022164 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225022164 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:50:23.952676 run patchelf(pid=4442): Terminating (SIGINT) 22:50:24.130856 run patchelf(pid=4442): Terminated: ok {rc=0} 22:50:24.259216 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=4439): Process ended prematurely: osmo-stp_10.42.42.5(pid=4439) [trial-2383↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4439)] [trial-2383↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 22:50:24.268618 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 22:50:24.296179 run osmo-hlr_10.42.42.2(pid=4436): ERR: Terminated: ERROR {rc=237} [trial-2383↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4436)] 22:50:24.345608 run osmo-hlr_10.42.42.2(pid=4436): stdout: | (launched: 2022-12-12_22:50:20.993630) 22:50:24.396650 run osmo-hlr_10.42.42.2(pid=4436): stderr: | [0;m[1;31m20221212225021188 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212225021188 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212225021188 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212225021188 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212225021188 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212225021188 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212225021200 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212225021208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212225021209 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212225021209 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:50:24.448713 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4435): Terminating (SIGTERM) 22:50:24.490202 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4438): Terminating (SIGTERM) 22:50:24.531764 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4441): Terminating (SIGTERM) 22:50:24.573740 --- ParallelTerminationStrategy: PID 4435 died... 22:50:24.593572 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4435): Terminated: ok {rc=0} 22:50:24.639283 --- ParallelTerminationStrategy: PID 4438 died... 22:50:24.658665 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4438): Terminated: ok {rc=0} 22:50:24.704483 --- ParallelTerminationStrategy: PID 4441 died... 22:50:24.723765 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4441): Terminated: ok {rc=0} 22:50:24.811089 bus /gobi_0: Setting Powered False 22:50:25.909252 bus /gobi_0: Setting Powered False 22:50:27.024337 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2383 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 dynts:trx-umtrx+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 22:50:28.272931 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:50:28.278800 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 22:50:28.312013 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 22:50:28.346620 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 22:50:28.398794 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 22:50:28.431289 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 22:50:28.465548 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 22:50:29.018825 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2383 dynts:trx-umtrx+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 22:50:29.024405 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:50:29.035495 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 22:50:29.104327 tst switch_tch_pdch.py: using LAC 32045 22:50:29.229828 tst switch_tch_pdch.py: using RAC 170 22:50:29.356737 tst switch_tch_pdch.py: using CellId 32045 22:50:29.480896 tst switch_tch_pdch.py: using BVCI 32046 22:50:29.596594 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:50:29.608091 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:50:29.619569 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:50:29.630699 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:50:29.641784 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:50:29.653536 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:50:29.664924 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:50:29.676200 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 22:50:29.791883 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 22:50:29.907572 tst switch_tch_pdch.py:51: start network... 22:50:30.107406 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:50:30.541381 run create_hlr_db(pid=4446): Launched 22:50:30.655638 bus /gobi_6: Setting Powered False 22:50:31.719316 run create_hlr_db(pid=4446): Terminated: ok {rc=0} 22:50:32.124274 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4448): Launched 22:50:32.434087 run osmo-hlr_10.42.42.2(pid=4449): Launched 22:50:32.547879 run osmo-stp_10.42.42.5: Starting osmo-stp 22:50:33.033636 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4451): Launched 22:50:33.332214 run osmo-stp_10.42.42.5(pid=4452): Launched 22:50:33.446606 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:50:33.933569 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4454): Launched 22:50:34.048517 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:50:34.301087 run patchelf(pid=4455): Launched 22:50:34.467294 run osmo-stp_10.42.42.5(pid=4452): ERR: Terminated: ERROR {rc=1} [trial-2383↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4452)] 22:50:34.594080 run osmo-stp_10.42.42.5(pid=4452): stdout: | (launched: 2022-12-12_22:50:33.278063) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:50:34.721941 run osmo-stp_10.42.42.5(pid=4452): stderr: | [0;m[38;5;43m20221212225033447 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225033448 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225033448 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225033448 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225033449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225033449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225033449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:50:34.849575 run osmo-stp_10.42.42.5(pid=4452): stdout: | (launched: 2022-12-12_22:50:33.278063) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:50:34.971799 run osmo-stp_10.42.42.5(pid=4452): stderr: | [0;m[38;5;43m20221212225033447 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225033448 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225033448 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225033448 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225033449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225033449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225033449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:50:35.116017 run patchelf(pid=4455): Terminating (SIGINT) 22:50:35.285407 run patchelf(pid=4455): Terminated: ok {rc=0} 22:50:35.406982 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=4452): Process ended prematurely: osmo-stp_10.42.42.5(pid=4452) [trial-2383↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4452)] [trial-2383↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 22:50:35.415786 tst switch_tch_pdch.py:54: Test FAILED (6.4 sec) 22:50:35.442519 run osmo-hlr_10.42.42.2(pid=4449): ERR: Terminated: ERROR {rc=237} [trial-2383↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4449)] 22:50:35.489852 run osmo-hlr_10.42.42.2(pid=4449): stdout: | (launched: 2022-12-12_22:50:32.379954) 22:50:35.539007 run osmo-hlr_10.42.42.2(pid=4449): stderr: | [0;m[1;31m20221212225032555 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212225032555 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212225032555 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212225032555 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212225032555 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212225032555 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212225032567 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/dynts:trx-umtrx+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212225032575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212225032576 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212225032576 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:50:35.588695 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4448): Terminating (SIGTERM) 22:50:35.628769 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4451): Terminating (SIGTERM) 22:50:35.668539 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4454): Terminating (SIGTERM) 22:50:35.708466 --- ParallelTerminationStrategy: PID 4448 died... 22:50:35.727386 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4448): Terminated: ok {rc=0} 22:50:35.772049 --- ParallelTerminationStrategy: PID 4451 died... 22:50:35.790129 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4451): Terminated: ok {rc=0} 22:50:35.833809 --- ParallelTerminationStrategy: PID 4454 died... 22:50:35.852058 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4454): Terminated: ok {rc=0} 22:50:35.936610 bus /gobi_0: Setting Powered False 22:50:37.035401 bus /gobi_0: Setting Powered False 22:50:38.147497 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2383 dynts:trx-umtrx+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 nitb_sms:trx-lms --------------------------------------------------------------------- 22:50:39.400570 tst nitb_sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:50:39.404778 tst nitb_sms:trx-lms: Verifying 1 x bts (candidates: 11) 22:50:39.439001 tst nitb_sms:trx-lms: Verifying 1 x ip_address (candidates: 9) 22:50:39.446125 tst nitb_sms:trx-lms: Verifying 2 x modem (candidates: 12) 22:50:39.499601 tst nitb_sms:trx-lms: Reserving 1 x bts (candidates: 11) 22:50:39.533145 tst nitb_sms:trx-lms: Reserving 1 x ip_address (candidates: 9) 22:50:39.540140 tst nitb_sms:trx-lms: Reserving 2 x modem (candidates: 12) 22:50:40.078265 tst nitb_sms:trx-lms: RESERVED RESOURCES for nitb_sms: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 nitb_sms:trx-lms mo_mt_sms.py ---------------------------------------------- 22:50:40.083700 tst nitb_sms:trx-lms: Using 1 x ip_address (candidates: 1) 22:50:40.095033 tst nitb_sms:trx-lms: Using 1 x bts (candidates: 1) 22:50:40.142967 tst mo_mt_sms.py: using LAC 32046 22:50:40.260119 tst mo_mt_sms.py: using RAC 171 22:50:40.378212 tst mo_mt_sms.py: using CellId 32046 22:50:40.497063 tst mo_mt_sms.py: using BVCI 32047 22:50:40.604854 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 22:50:40.720747 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 22:50:40.834219 tst mo_mt_sms.py:9: start nitb and bts... 22:50:41.035068 run osmo-nitb_10.42.42.2: Starting osmo-nitb 22:50:41.639646 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=4460): Launched 22:50:41.936663 run osmo-nitb_10.42.42.2(pid=4461): Launched 22:50:42.102471 run osmo-nitb_10.42.42.2(pid=4461): ERR: Terminated: ERROR {rc=2} [trial-2383↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4461)] 22:50:42.236552 run osmo-nitb_10.42.42.2(pid=4461): stdout: | (launched: 2022-12-12_22:50:41.882563) 22:50:42.372042 run osmo-nitb_10.42.42.2(pid=4461): stderr: | (launched: 2022-12-12_22:50:41.926569) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:50:42.507974 run osmo-nitb_10.42.42.2(pid=4461): stdout: | (launched: 2022-12-12_22:50:41.882563) 22:50:42.638274 run osmo-nitb_10.42.42.2(pid=4461): stderr: | (launched: 2022-12-12_22:50:41.926569) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fa469b2b268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=4461): Process ended prematurely: osmo-nitb_10.42.42.2(pid=4461) [trial-2383↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4461)] 22:50:43.049393 tst osmo-nitb_10.42.42.2(pid=4461): stdout: | (launched: 2022-12-12_22:50:41.882563) 22:50:43.169877 tst osmo-nitb_10.42.42.2(pid=4461): stderr: | (launched: 2022-12-12_22:50:41.926569) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:50:43.312301 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=4461): Process ended prematurely: osmo-nitb_10.42.42.2(pid=4461) [trial-2383↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4461)] [trial-2383↪nitb_sms:trx-lms↪mo_mt_sms.py:11] 22:50:43.320601 tst mo_mt_sms.py:11: Test FAILED (3.2 sec) 22:50:43.327159 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=4460): Terminating (SIGTERM) 22:50:43.535874 --- ParallelTerminationStrategy: PID 4460 died... 22:50:43.556198 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=4460): Terminated: ok {rc=0} 22:50:43.639576 bus /sierra_3: Setting Powered False 22:50:44.738746 bus /sierra_3: Setting Powered False 22:50:45.882282 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 nitb_sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 sms:trx-lms --------------------------------------------------------------------- 22:50:47.108122 tst sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:50:47.114949 tst sms:trx-lms: Verifying 1 x bts (candidates: 11) 22:50:47.156457 tst sms:trx-lms: Verifying 6 x ip_address (candidates: 9) 22:50:47.185591 tst sms:trx-lms: Verifying 2 x modem (candidates: 12) 22:50:47.241901 tst sms:trx-lms: Reserving 1 x bts (candidates: 11) 22:50:47.277105 tst sms:trx-lms: Reserving 6 x ip_address (candidates: 9) 22:50:47.304127 tst sms:trx-lms: Reserving 2 x modem (candidates: 12) 22:50:47.843416 tst sms:trx-lms: RESERVED RESOURCES for sms: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 sms:trx-lms mo_mt_sms.py ---------------------------------------------- 22:50:47.849210 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 22:50:47.859975 tst sms:trx-lms: Using 1 x bts (candidates: 1) 22:50:47.908671 tst mo_mt_sms.py: using LAC 32047 22:50:48.028282 tst mo_mt_sms.py: using RAC 172 22:50:48.146015 tst mo_mt_sms.py: using CellId 32047 22:50:48.266065 tst mo_mt_sms.py: using BVCI 32048 22:50:48.375704 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 22:50:48.386190 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 22:50:48.396431 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 22:50:48.407550 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 22:50:48.418673 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 22:50:48.429858 tst sms:trx-lms: Using 1 x modem (candidates: 2) 22:50:48.549909 tst sms:trx-lms: Using 1 x modem (candidates: 2) 22:50:48.672072 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:50:49.162990 run create_hlr_db(pid=4465): Launched 22:50:49.291687 bus /sierra_2: Setting Powered False 22:50:50.353987 run create_hlr_db(pid=4465): Terminated: ok {rc=0} 22:50:50.779214 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4467): Launched 22:50:51.076854 run osmo-hlr_10.42.42.2(pid=4468): Launched 22:50:51.190871 run osmo-stp_10.42.42.5: Starting osmo-stp 22:50:51.714542 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4470): Launched 22:50:52.011226 run osmo-stp_10.42.42.5(pid=4471): Launched 22:50:52.124788 run osmo-msc_10.42.42.6: Starting osmo-msc 22:50:52.662747 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4473): Launched 22:50:52.960138 run osmo-msc_10.42.42.6(pid=4474): Launched 22:50:53.127249 run osmo-stp_10.42.42.5(pid=4471): ERR: Terminated: ERROR {rc=1} [trial-2383↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4471)] 22:50:53.254120 run osmo-stp_10.42.42.5(pid=4471): stdout: | (launched: 2022-12-12_22:50:51.957287) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:50:53.381287 run osmo-stp_10.42.42.5(pid=4471): stderr: | [0;m[38;5;43m20221212225052127 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225052127 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225052127 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225052128 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225052128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225052128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225052128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:50:53.504936 run osmo-stp_10.42.42.5(pid=4471): stdout: | (launched: 2022-12-12_22:50:51.957287) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:50:53.623335 run osmo-stp_10.42.42.5(pid=4471): stderr: | [0;m[38;5;43m20221212225052127 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225052127 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225052127 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225052128 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225052128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225052128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225052128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:50:53.764773 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=4471): Process ended prematurely: osmo-stp_10.42.42.5(pid=4471) [trial-2383↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4471)] [trial-2383↪sms:trx-lms↪mo_mt_sms.py:16] 22:50:53.773005 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 22:50:53.799224 run osmo-hlr_10.42.42.2(pid=4468): ERR: Terminated: ERROR {rc=237} [trial-2383↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4468)] 22:50:53.846644 run osmo-hlr_10.42.42.2(pid=4468): stdout: | (launched: 2022-12-12_22:50:51.022783) 22:50:53.895742 run osmo-hlr_10.42.42.2(pid=4468): stderr: | [0;m[1;31m20221212225051196 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212225051197 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212225051197 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212225051197 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212225051197 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212225051197 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212225051209 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/sms:trx-lms/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212225051218 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212225051219 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212225051219 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:50:53.964224 run osmo-msc_10.42.42.6(pid=4474): ERR: Terminated: ERROR {rc=2} [trial-2383↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4474)] 22:50:54.011371 run osmo-msc_10.42.42.6(pid=4474): stdout: | (launched: 2022-12-12_22:50:52.905660) 22:50:54.059924 run osmo-msc_10.42.42.6(pid=4474): stderr: | [0;m[38;5;43m20221212225053178 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212225053178 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f834a032c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212225053178 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212225053178 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212225053178 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212225053179 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212225053181 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212225053181 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212225053181 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212225053181 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:50:54.109451 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4467): Terminating (SIGTERM) 22:50:54.148731 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4470): Terminating (SIGTERM) 22:50:54.188093 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4473): Terminating (SIGTERM) 22:50:54.227904 --- ParallelTerminationStrategy: PID 4467 died... 22:50:54.246671 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4467): Terminated: ok {rc=0} 22:50:54.290418 --- ParallelTerminationStrategy: PID 4470 died... 22:50:54.308606 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4470): Terminated: ok {rc=0} 22:50:54.352797 --- ParallelTerminationStrategy: PID 4473 died... 22:50:54.371795 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4473): Terminated: ok {rc=0} 22:50:54.454306 bus /sierra_3: Setting Powered False 22:50:55.551360 bus /sierra_3: Setting Powered False 22:50:56.666183 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 nitb_ussd:trx-lms --------------------------------------------------------------------- 22:50:57.896695 tst nitb_ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:50:57.900854 tst nitb_ussd:trx-lms: Verifying 1 x bts (candidates: 11) 22:50:57.934921 tst nitb_ussd:trx-lms: Verifying 1 x ip_address (candidates: 9) 22:50:57.942051 tst nitb_ussd:trx-lms: Verifying 1 x modem (candidates: 12) 22:50:57.977929 tst nitb_ussd:trx-lms: Reserving 1 x bts (candidates: 11) 22:50:58.011746 tst nitb_ussd:trx-lms: Reserving 1 x ip_address (candidates: 9) 22:50:58.018847 tst nitb_ussd:trx-lms: Reserving 1 x modem (candidates: 12) 22:50:58.537931 tst nitb_ussd:trx-lms: RESERVED RESOURCES for nitb_ussd: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2383 nitb_ussd:trx-lms assert_extension.py ---------------------------------------------- 22:50:58.543262 tst nitb_ussd:trx-lms: Using 1 x ip_address (candidates: 1) 22:50:58.554519 tst nitb_ussd:trx-lms: Using 1 x bts (candidates: 1) 22:50:58.603603 tst assert_extension.py: using LAC 32048 22:50:58.730093 tst assert_extension.py: using RAC 173 22:50:58.856089 tst assert_extension.py: using CellId 32048 22:50:58.979797 tst assert_extension.py: using BVCI 32049 22:50:59.097312 tst nitb_ussd:trx-lms: Using 1 x modem (candidates: 1) 22:50:59.211354 tst assert_extension.py:10: start nitb and bts... 22:50:59.411784 run osmo-nitb_10.42.42.2: Starting osmo-nitb 22:51:00.020779 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=4479): Launched 22:51:00.317175 run osmo-nitb_10.42.42.2(pid=4480): Launched 22:51:00.482404 run osmo-nitb_10.42.42.2(pid=4480): ERR: Terminated: ERROR {rc=2} [trial-2383↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4480)] 22:51:00.616059 run osmo-nitb_10.42.42.2(pid=4480): stdout: | (launched: 2022-12-12_22:51:00.263050) 22:51:00.751135 run osmo-nitb_10.42.42.2(pid=4480): stderr: | (launched: 2022-12-12_22:51:00.307248) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:51:00.898899 run osmo-nitb_10.42.42.2(pid=4480): stdout: | (launched: 2022-12-12_22:51:00.263050) 22:51:01.046884 run osmo-nitb_10.42.42.2(pid=4480): stderr: | (launched: 2022-12-12_22:51:00.307248) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fa469b2b268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=4480): Process ended prematurely: osmo-nitb_10.42.42.2(pid=4480) [trial-2383↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4480)] 22:51:01.429810 tst osmo-nitb_10.42.42.2(pid=4480): stdout: | (launched: 2022-12-12_22:51:00.263050) 22:51:01.558275 tst osmo-nitb_10.42.42.2(pid=4480): stderr: | (launched: 2022-12-12_22:51:00.307248) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:51:01.751934 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=4480): Process ended prematurely: osmo-nitb_10.42.42.2(pid=4480) [trial-2383↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4480)] [trial-2383↪nitb_ussd:trx-lms↪assert_extension.py:12] 22:51:01.765589 tst assert_extension.py:12: Test FAILED (3.2 sec) 22:51:01.776366 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=4479): Terminating (SIGTERM) 22:51:01.999239 --- ParallelTerminationStrategy: PID 4479 died... 22:51:02.019751 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=4479): Terminated: ok {rc=0} 22:51:02.110218 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 nitb_ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 ussd:trx-lms --------------------------------------------------------------------- 22:51:03.287571 tst ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:51:03.291534 tst ussd:trx-lms: Verifying 1 x bts (candidates: 11) 22:51:03.324637 tst ussd:trx-lms: Verifying 6 x ip_address (candidates: 9) 22:51:03.350988 tst ussd:trx-lms: Verifying 1 x modem (candidates: 12) 22:51:03.384262 tst ussd:trx-lms: Reserving 1 x bts (candidates: 11) 22:51:03.416735 tst ussd:trx-lms: Reserving 6 x ip_address (candidates: 9) 22:51:03.442766 tst ussd:trx-lms: Reserving 1 x modem (candidates: 12) 22:51:03.975125 tst ussd:trx-lms: RESERVED RESOURCES for ussd: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2383 ussd:trx-lms assert_extension.py ---------------------------------------------- 22:51:03.981324 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 22:51:03.992752 tst ussd:trx-lms: Using 1 x bts (candidates: 1) 22:51:04.042034 tst assert_extension.py: using LAC 32049 22:51:04.166518 tst assert_extension.py: using RAC 174 22:51:04.289072 tst assert_extension.py: using CellId 32049 22:51:04.419002 tst assert_extension.py: using BVCI 32050 22:51:04.535387 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 22:51:04.546446 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 22:51:04.557269 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 22:51:04.568480 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 22:51:04.579515 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 22:51:04.590668 tst ussd:trx-lms: Using 1 x modem (candidates: 1) 22:51:04.706171 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:51:05.165725 run create_hlr_db(pid=4485): Launched 22:51:05.281298 bus /sierra_2: Setting Powered False 22:51:06.340805 run create_hlr_db(pid=4485): Terminated: ok {rc=0} 22:51:06.755372 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4487): Launched 22:51:07.053201 run osmo-hlr_10.42.42.2(pid=4488): Launched 22:51:07.166881 run osmo-stp_10.42.42.5: Starting osmo-stp 22:51:07.678308 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4490): Launched 22:51:07.975449 run osmo-stp_10.42.42.5(pid=4491): Launched 22:51:08.089356 run osmo-msc_10.42.42.6: Starting osmo-msc 22:51:08.626239 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4493): Launched 22:51:08.922668 run osmo-msc_10.42.42.6(pid=4494): Launched 22:51:09.088615 run osmo-stp_10.42.42.5(pid=4491): ERR: Terminated: ERROR {rc=1} [trial-2383↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4491)] 22:51:09.216115 run osmo-stp_10.42.42.5(pid=4491): stdout: | (launched: 2022-12-12_22:51:07.921041) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:51:09.343136 run osmo-stp_10.42.42.5(pid=4491): stderr: | [0;m[38;5;43m20221212225108091 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225108092 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225108092 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225108092 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225108093 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225108093 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225108093 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:51:09.466984 run osmo-stp_10.42.42.5(pid=4491): stdout: | (launched: 2022-12-12_22:51:07.921041) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:51:09.585533 run osmo-stp_10.42.42.5(pid=4491): stderr: | [0;m[38;5;43m20221212225108091 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225108092 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225108092 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225108092 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225108093 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225108093 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225108093 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:51:09.727375 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=4491): Process ended prematurely: osmo-stp_10.42.42.5(pid=4491) [trial-2383↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4491)] [trial-2383↪ussd:trx-lms↪assert_extension.py:17] 22:51:09.735585 tst assert_extension.py:17: Test FAILED (5.7 sec) 22:51:09.761501 run osmo-hlr_10.42.42.2(pid=4488): ERR: Terminated: ERROR {rc=237} [trial-2383↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4488)] 22:51:09.809127 run osmo-hlr_10.42.42.2(pid=4488): stdout: | (launched: 2022-12-12_22:51:06.998316) 22:51:09.857840 run osmo-hlr_10.42.42.2(pid=4488): stderr: | [0;m[1;31m20221212225107176 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212225107176 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212225107176 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212225107176 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212225107176 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212225107176 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212225107189 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/ussd:trx-lms/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212225107197 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212225107197 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212225107197 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:51:09.925991 run osmo-msc_10.42.42.6(pid=4494): ERR: Terminated: ERROR {rc=2} [trial-2383↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4494)] 22:51:09.973077 run osmo-msc_10.42.42.6(pid=4494): stdout: | (launched: 2022-12-12_22:51:08.868477) 22:51:10.021806 run osmo-msc_10.42.42.6(pid=4494): stderr: | [0;m[38;5;43m20221212225109139 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212225109139 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f71f10d8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212225109139 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212225109139 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212225109140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212225109140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212225109142 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212225109143 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212225109143 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212225109143 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:51:10.071005 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4487): Terminating (SIGTERM) 22:51:10.110314 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4490): Terminating (SIGTERM) 22:51:10.149834 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4493): Terminating (SIGTERM) 22:51:10.189212 --- ParallelTerminationStrategy: PID 4487 died... 22:51:10.208078 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4487): Terminated: ok {rc=0} 22:51:10.252278 --- ParallelTerminationStrategy: PID 4490 died... 22:51:10.270608 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4490): Terminated: ok {rc=0} 22:51:10.313887 --- ParallelTerminationStrategy: PID 4493 died... 22:51:10.332109 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4493): Terminated: ok {rc=0} 22:51:10.417384 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 22:51:11.623474 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:51:11.629747 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 22:51:11.663338 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 22:51:11.689943 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 22:51:11.741507 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 22:51:11.774885 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 22:51:11.801402 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 22:51:12.348694 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 22:51:12.398497 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:51:12.409460 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 22:51:12.480677 tst mo_mt_call.py: using LAC 32050 22:51:12.600298 tst mo_mt_call.py: using RAC 175 22:51:12.719209 tst mo_mt_call.py: using CellId 32050 22:51:12.846940 tst mo_mt_call.py: using BVCI 32051 22:51:12.959355 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:51:12.970410 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:51:12.981259 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:51:12.992262 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:51:13.003491 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:51:13.014702 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:51:13.135638 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:51:13.252146 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:51:13.754549 run create_hlr_db(pid=4500): Launched 22:51:13.884576 bus /sierra_2: Setting Powered False 22:51:14.948335 run create_hlr_db(pid=4500): Terminated: ok {rc=0} 22:51:15.396052 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4502): Launched 22:51:15.717573 run osmo-hlr_10.42.42.2(pid=4503): Launched 22:51:15.840807 run osmo-stp_10.42.42.5: Starting osmo-stp 22:51:16.575497 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4505): Launched 22:51:16.919012 run osmo-stp_10.42.42.5(pid=4506): Launched 22:51:17.048695 run osmo-msc_10.42.42.6: Starting osmo-msc 22:51:17.766006 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4508): Launched 22:51:18.087399 run osmo-msc_10.42.42.6(pid=4509): Launched 22:51:18.267138 run osmo-stp_10.42.42.5(pid=4506): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4506)] 22:51:18.402455 run osmo-stp_10.42.42.5(pid=4506): stdout: | (launched: 2022-12-12_22:51:16.853600) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:51:18.538523 run osmo-stp_10.42.42.5(pid=4506): stderr: | [0;m[38;5;43m20221212225117240 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225117240 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225117240 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225117249 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225117253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225117253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225117253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:51:18.674778 run osmo-stp_10.42.42.5(pid=4506): stdout: | (launched: 2022-12-12_22:51:16.853600) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:51:18.803033 run osmo-stp_10.42.42.5(pid=4506): stderr: | [0;m[38;5;43m20221212225117240 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225117240 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225117240 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225117249 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225117253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225117253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225117253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:51:18.956608 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4506): Process ended prematurely: osmo-stp_10.42.42.5(pid=4506) [trial-2383↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4506)] [trial-2383↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 22:51:18.966343 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 22:51:18.994002 run osmo-hlr_10.42.42.2(pid=4503): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4503)] 22:51:19.043900 run osmo-hlr_10.42.42.2(pid=4503): stdout: | (launched: 2022-12-12_22:51:15.659419) 22:51:19.095599 run osmo-hlr_10.42.42.2(pid=4503): stderr: | [0;m[1;31m20221212225115917 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212225115917 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212225115917 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212225115917 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212225115917 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212225115917 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212225115935 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212225115951 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212225115951 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212225115952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:51:19.167162 run osmo-msc_10.42.42.6(pid=4509): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4509)] 22:51:19.216629 run osmo-msc_10.42.42.6(pid=4509): stdout: | (launched: 2022-12-12_22:51:18.028906) 22:51:19.267857 run osmo-msc_10.42.42.6(pid=4509): stderr: | [0;m[38;5;43m20221212225118351 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212225118351 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa6181c9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212225118351 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212225118351 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212225118351 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212225118352 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212225118353 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212225118354 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212225118354 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212225118354 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:51:19.319604 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4502): Terminating (SIGTERM) 22:51:19.361340 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4505): Terminating (SIGTERM) 22:51:19.402695 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4508): Terminating (SIGTERM) 22:51:19.444130 --- ParallelTerminationStrategy: PID 4502 died... 22:51:19.463988 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4502): Terminated: ok {rc=0} 22:51:19.510285 --- ParallelTerminationStrategy: PID 4505 died... 22:51:19.529724 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4505): Terminated: ok {rc=0} 22:51:19.575187 --- ParallelTerminationStrategy: PID 4508 died... 22:51:19.594828 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4508): Terminated: ok {rc=0} 22:51:19.682287 bus /sierra_3: Setting Powered False 22:51:20.782788 bus /sierra_3: Setting Powered False 22:51:21.898244 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2383 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 22:51:23.047507 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:51:23.059869 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 22:51:23.134909 tst mo_mt_call_osmux.py: using LAC 32051 22:51:23.260931 tst mo_mt_call_osmux.py: using RAC 176 22:51:23.385839 tst mo_mt_call_osmux.py: using CellId 32051 22:51:23.517199 tst mo_mt_call_osmux.py: using BVCI 32052 22:51:23.635953 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:51:23.647728 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:51:23.659178 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:51:23.670606 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:51:23.682637 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:51:23.694256 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:51:23.815206 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:51:23.939511 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:51:24.441197 run create_hlr_db(pid=4511): Launched 22:51:24.573069 bus /sierra_2: Setting Powered False 22:51:25.637516 run create_hlr_db(pid=4511): Terminated: ok {rc=0} 22:51:26.086727 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4513): Launched 22:51:26.409467 run osmo-hlr_10.42.42.2(pid=4514): Launched 22:51:26.534030 run osmo-stp_10.42.42.5: Starting osmo-stp 22:51:27.092695 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4516): Launched 22:51:27.415651 run osmo-stp_10.42.42.5(pid=4517): Launched 22:51:27.539125 run osmo-msc_10.42.42.6: Starting osmo-msc 22:51:28.122822 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4519): Launched 22:51:28.444116 run osmo-msc_10.42.42.6(pid=4520): Launched 22:51:28.624893 run osmo-stp_10.42.42.5(pid=4517): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4517)] 22:51:28.760899 run osmo-stp_10.42.42.5(pid=4517): stdout: | (launched: 2022-12-12_22:51:27.356881) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:51:28.898085 run osmo-stp_10.42.42.5(pid=4517): stderr: | [0;m[38;5;43m20221212225127554 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225127554 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225127554 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225127554 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225127555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225127555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225127555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:51:29.033628 run osmo-stp_10.42.42.5(pid=4517): stdout: | (launched: 2022-12-12_22:51:27.356881) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:51:29.161974 run osmo-stp_10.42.42.5(pid=4517): stderr: | [0;m[38;5;43m20221212225127554 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225127554 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225127554 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225127554 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225127555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225127555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225127555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:51:29.315547 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4517): Process ended prematurely: osmo-stp_10.42.42.5(pid=4517) [trial-2383↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4517)] [trial-2383↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 22:51:29.325097 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 22:51:29.352588 run osmo-hlr_10.42.42.2(pid=4514): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4514)] 22:51:29.401956 run osmo-hlr_10.42.42.2(pid=4514): stdout: | (launched: 2022-12-12_22:51:26.350933) 22:51:29.453056 run osmo-hlr_10.42.42.2(pid=4514): stderr: | [0;m[1;31m20221212225126549 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212225126549 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212225126549 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212225126549 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212225126549 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212225126549 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212225126562 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212225126570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212225126570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212225126570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:51:29.524347 run osmo-msc_10.42.42.6(pid=4520): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4520)] 22:51:29.573616 run osmo-msc_10.42.42.6(pid=4520): stdout: | (launched: 2022-12-12_22:51:28.385983) 22:51:29.625099 run osmo-msc_10.42.42.6(pid=4520): stderr: | [0;m[38;5;43m20221212225128710 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212225128710 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f42cc522c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212225128710 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212225128711 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212225128711 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212225128711 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212225128713 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212225128713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212225128713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212225128713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:51:29.676255 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4513): Terminating (SIGTERM) 22:51:29.717380 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4516): Terminating (SIGTERM) 22:51:29.758517 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4519): Terminating (SIGTERM) 22:51:29.799928 --- ParallelTerminationStrategy: PID 4513 died... 22:51:29.819580 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4513): Terminated: ok {rc=0} 22:51:29.865223 --- ParallelTerminationStrategy: PID 4516 died... 22:51:29.884592 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4516): Terminated: ok {rc=0} 22:51:29.930011 --- ParallelTerminationStrategy: PID 4519 died... 22:51:29.949254 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4519): Terminated: ok {rc=0} 22:51:30.035271 bus /sierra_3: Setting Powered False 22:51:31.131272 bus /sierra_3: Setting Powered False 22:51:32.245776 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 22:51:33.498031 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:51:33.504801 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 22:51:33.538538 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 22:51:33.565963 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 22:51:33.618707 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 22:51:33.652500 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 22:51:33.679739 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 22:51:34.231023 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 22:51:34.282449 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:51:34.293951 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 22:51:34.364062 tst mo_mt_call.py: using LAC 32052 22:51:34.490565 tst mo_mt_call.py: using RAC 177 22:51:34.619815 tst mo_mt_call.py: using CellId 32052 22:51:34.746294 tst mo_mt_call.py: using BVCI 32053 22:51:34.863613 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:51:34.875146 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:51:34.886499 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:51:34.897854 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:51:34.909334 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:51:34.920642 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:51:35.037806 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:51:35.152811 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:51:35.623785 run create_hlr_db(pid=4525): Launched 22:51:35.741709 bus /sierra_2: Setting Powered False 22:51:36.802382 run create_hlr_db(pid=4525): Terminated: ok {rc=0} 22:51:37.243332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4527): Launched 22:51:37.566871 run osmo-hlr_10.42.42.2(pid=4528): Launched 22:51:37.691003 run osmo-stp_10.42.42.5: Starting osmo-stp 22:51:38.244514 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4530): Launched 22:51:38.565186 run osmo-stp_10.42.42.5(pid=4531): Launched 22:51:38.689566 run osmo-msc_10.42.42.6: Starting osmo-msc 22:51:39.273658 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4533): Launched 22:51:39.597695 run osmo-msc_10.42.42.6(pid=4534): Launched 22:51:39.779152 run osmo-stp_10.42.42.5(pid=4531): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4531)] 22:51:39.915666 run osmo-stp_10.42.42.5(pid=4531): stdout: | (launched: 2022-12-12_22:51:38.506952) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:51:40.053798 run osmo-stp_10.42.42.5(pid=4531): stderr: | [0;m[38;5;43m20221212225138699 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225138699 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225138700 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225138700 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225138701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225138701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225138701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:51:40.189846 run osmo-stp_10.42.42.5(pid=4531): stdout: | (launched: 2022-12-12_22:51:38.506952) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:51:40.318364 run osmo-stp_10.42.42.5(pid=4531): stderr: | [0;m[38;5;43m20221212225138699 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225138699 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225138700 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225138700 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225138701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225138701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225138701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:51:40.472166 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4531): Process ended prematurely: osmo-stp_10.42.42.5(pid=4531) [trial-2383↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4531)] [trial-2383↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 22:51:40.481777 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 22:51:40.509354 run osmo-hlr_10.42.42.2(pid=4528): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4528)] 22:51:40.559116 run osmo-hlr_10.42.42.2(pid=4528): stdout: | (launched: 2022-12-12_22:51:37.508212) 22:51:40.611067 run osmo-hlr_10.42.42.2(pid=4528): stderr: | [0;m[1;31m20221212225137707 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212225137707 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212225137707 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212225137708 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212225137708 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212225137708 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212225137719 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212225137727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212225137728 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212225137728 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:51:40.682961 run osmo-msc_10.42.42.6(pid=4534): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4534)] 22:51:40.733196 run osmo-msc_10.42.42.6(pid=4534): stdout: | (launched: 2022-12-12_22:51:39.538793) 22:51:40.784566 run osmo-msc_10.42.42.6(pid=4534): stderr: | [0;m[38;5;43m20221212225139864 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212225139864 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7efce5435c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212225139865 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212225139865 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212225139865 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212225139865 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212225139867 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212225139867 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212225139867 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212225139867 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:51:40.836356 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4527): Terminating (SIGTERM) 22:51:40.877620 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4530): Terminating (SIGTERM) 22:51:40.918960 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4533): Terminating (SIGTERM) 22:51:40.960477 --- ParallelTerminationStrategy: PID 4527 died... 22:51:40.980342 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4527): Terminated: ok {rc=0} 22:51:41.026559 --- ParallelTerminationStrategy: PID 4530 died... 22:51:41.045886 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4530): Terminated: ok {rc=0} 22:51:41.091474 --- ParallelTerminationStrategy: PID 4533 died... 22:51:41.110925 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4533): Terminated: ok {rc=0} 22:51:41.197899 bus /sierra_3: Setting Powered False 22:51:42.296920 bus /sierra_3: Setting Powered False 22:51:43.412260 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2383 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 22:51:44.559809 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:51:44.571961 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 22:51:44.643987 tst mo_mt_call_osmux.py: using LAC 32053 22:51:44.772192 tst mo_mt_call_osmux.py: using RAC 178 22:51:44.899124 tst mo_mt_call_osmux.py: using CellId 32053 22:51:45.027132 tst mo_mt_call_osmux.py: using BVCI 32054 22:51:45.144531 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:51:45.156205 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:51:45.167635 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:51:45.179007 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:51:45.190571 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:51:45.201929 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:51:45.319571 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:51:45.436204 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:51:45.937537 run create_hlr_db(pid=4536): Launched 22:51:46.137561 bus /sierra_2: Setting Powered False 22:51:47.199641 run create_hlr_db(pid=4536): Terminated: ok {rc=0} 22:51:47.660198 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4538): Launched 22:51:47.963617 run osmo-hlr_10.42.42.2(pid=4539): Launched 22:51:48.079496 run osmo-stp_10.42.42.5: Starting osmo-stp 22:51:48.618201 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4541): Launched 22:51:48.920928 run osmo-stp_10.42.42.5(pid=4542): Launched 22:51:49.037246 run osmo-msc_10.42.42.6: Starting osmo-msc 22:51:49.586876 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4544): Launched 22:51:49.889687 run osmo-msc_10.42.42.6(pid=4545): Launched 22:51:50.060427 run osmo-stp_10.42.42.5(pid=4542): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4542)] 22:51:50.190159 run osmo-stp_10.42.42.5(pid=4542): stdout: | (launched: 2022-12-12_22:51:48.865796) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:51:50.319536 run osmo-stp_10.42.42.5(pid=4542): stderr: | [0;m[38;5;43m20221212225149038 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225149038 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225149038 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225149038 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225149039 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225149039 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225149039 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:51:50.447303 run osmo-stp_10.42.42.5(pid=4542): stdout: | (launched: 2022-12-12_22:51:48.865796) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:51:50.568522 run osmo-stp_10.42.42.5(pid=4542): stderr: | [0;m[38;5;43m20221212225149038 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225149038 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225149038 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225149038 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225149039 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225149039 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225149039 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:51:50.714083 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4542): Process ended prematurely: osmo-stp_10.42.42.5(pid=4542) [trial-2383↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4542)] [trial-2383↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 22:51:50.722876 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 22:51:50.749549 run osmo-hlr_10.42.42.2(pid=4539): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4539)] 22:51:50.797418 run osmo-hlr_10.42.42.2(pid=4539): stdout: | (launched: 2022-12-12_22:51:47.908349) 22:51:50.846643 run osmo-hlr_10.42.42.2(pid=4539): stderr: | [0;m[1;31m20221212225148084 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212225148084 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212225148084 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212225148084 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212225148084 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212225148084 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212225148096 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212225148105 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212225148106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212225148106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:51:50.915917 run osmo-msc_10.42.42.6(pid=4545): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4545)] 22:51:50.963668 run osmo-msc_10.42.42.6(pid=4545): stdout: | (launched: 2022-12-12_22:51:49.834418) 22:51:51.013348 run osmo-msc_10.42.42.6(pid=4545): stderr: | [0;m[38;5;43m20221212225150106 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212225150106 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f84f3fcbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212225150106 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212225150107 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212225150107 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212225150107 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212225150109 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212225150109 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212225150109 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212225150109 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:51:51.062757 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4538): Terminating (SIGTERM) 22:51:51.102286 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4541): Terminating (SIGTERM) 22:51:51.141830 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4544): Terminating (SIGTERM) 22:51:51.181563 --- ParallelTerminationStrategy: PID 4538 died... 22:51:51.200501 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4538): Terminated: ok {rc=0} 22:51:51.244743 --- ParallelTerminationStrategy: PID 4541 died... 22:51:51.263263 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4541): Terminated: ok {rc=0} 22:51:51.307140 --- ParallelTerminationStrategy: PID 4544 died... 22:51:51.325722 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4544): Terminated: ok {rc=0} 22:51:51.411343 bus /sierra_3: Setting Powered False 22:51:52.511255 bus /sierra_3: Setting Powered False 22:51:53.626732 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 22:51:54.875830 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:51:54.882199 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 22:51:54.915532 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 22:51:54.941758 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 22:51:54.992229 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 22:51:55.025121 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 22:51:55.051741 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 22:51:55.601249 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 22:51:55.650205 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:51:55.661299 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 22:51:55.729729 tst mo_mt_call.py: using LAC 32054 22:51:55.860026 tst mo_mt_call.py: using RAC 179 22:51:55.986881 tst mo_mt_call.py: using CellId 32054 22:51:56.117400 tst mo_mt_call.py: using BVCI 32055 22:51:56.236203 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:51:56.247869 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:51:56.259102 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:51:56.270446 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:51:56.281880 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:51:56.293112 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:51:56.409535 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:51:56.528544 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:51:56.999556 run create_hlr_db(pid=4550): Launched 22:51:57.116694 bus /sierra_2: Setting Powered False 22:51:58.177454 run create_hlr_db(pid=4550): Terminated: ok {rc=0} 22:51:58.620588 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4552): Launched 22:51:58.943848 run osmo-hlr_10.42.42.2(pid=4553): Launched 22:51:59.067990 run osmo-stp_10.42.42.5: Starting osmo-stp 22:51:59.630069 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4555): Launched 22:51:59.951847 run osmo-stp_10.42.42.5(pid=4556): Launched 22:52:00.074747 run osmo-msc_10.42.42.6: Starting osmo-msc 22:52:00.658254 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4558): Launched 22:52:00.993827 run osmo-msc_10.42.42.6(pid=4559): Launched 22:52:01.259756 run osmo-stp_10.42.42.5(pid=4556): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4556)] 22:52:01.443325 run osmo-stp_10.42.42.5(pid=4556): stdout: | (launched: 2022-12-12_22:51:59.893526) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:52:01.738468 run osmo-stp_10.42.42.5(pid=4556): stderr: | [0;m[38;5;43m20221212225200088 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225200088 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225200088 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225200089 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225200089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225200089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225200089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:52:02.063121 run osmo-stp_10.42.42.5(pid=4556): stdout: | (launched: 2022-12-12_22:51:59.893526) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:52:02.252857 run osmo-stp_10.42.42.5(pid=4556): stderr: | [0;m[38;5;43m20221212225200088 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225200088 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225200088 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225200089 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225200089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225200089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225200089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:52:02.402072 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4556): Process ended prematurely: osmo-stp_10.42.42.5(pid=4556) [trial-2383↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4556)] [trial-2383↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 22:52:02.411216 tst mo_mt_call.py:8: Test FAILED (6.8 sec) 22:52:02.438555 run osmo-hlr_10.42.42.2(pid=4553): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4553)] 22:52:02.489659 run osmo-hlr_10.42.42.2(pid=4553): stdout: | (launched: 2022-12-12_22:51:58.885352) 22:52:02.540634 run osmo-hlr_10.42.42.2(pid=4553): stderr: | [0;m[1;31m20221212225159084 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212225159084 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212225159084 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212225159085 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212225159085 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212225159085 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212225159097 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212225159105 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212225159105 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212225159105 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:52:02.611119 run osmo-msc_10.42.42.6(pid=4559): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4559)] 22:52:02.659684 run osmo-msc_10.42.42.6(pid=4559): stdout: | (launched: 2022-12-12_22:52:00.929419) 22:52:02.709559 run osmo-msc_10.42.42.6(pid=4559): stderr: | [0;m[38;5;43m20221212225201631 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212225201632 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc37a0f5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212225201632 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212225201632 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212225201632 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212225201632 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212225201634 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212225201635 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212225201635 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212225201635 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:52:02.759812 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4552): Terminating (SIGTERM) 22:52:02.799961 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4555): Terminating (SIGTERM) 22:52:02.840553 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4558): Terminating (SIGTERM) 22:52:02.881232 --- ParallelTerminationStrategy: PID 4552 died... 22:52:02.900057 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4552): Terminated: ok {rc=0} 22:52:02.945612 --- ParallelTerminationStrategy: PID 4555 died... 22:52:02.964188 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4555): Terminated: ok {rc=0} 22:52:03.009510 --- ParallelTerminationStrategy: PID 4558 died... 22:52:03.028077 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4558): Terminated: ok {rc=0} 22:52:03.114789 bus /sierra_3: Setting Powered False 22:52:04.214005 bus /sierra_3: Setting Powered False 22:52:05.327161 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2383 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 22:52:06.471372 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:52:06.482942 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 22:52:06.551117 tst mo_mt_call_osmux.py: using LAC 32055 22:52:06.673143 tst mo_mt_call_osmux.py: using RAC 180 22:52:06.793267 tst mo_mt_call_osmux.py: using CellId 32055 22:52:06.914448 tst mo_mt_call_osmux.py: using BVCI 32056 22:52:07.027181 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:52:07.038174 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:52:07.049046 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:52:07.060223 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:52:07.071464 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:52:07.082621 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:52:07.200818 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:52:07.318558 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:52:07.788594 run create_hlr_db(pid=4561): Launched 22:52:07.904499 bus /sierra_2: Setting Powered False 22:52:08.964641 run create_hlr_db(pid=4561): Terminated: ok {rc=0} 22:52:09.405916 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4563): Launched 22:52:09.729671 run osmo-hlr_10.42.42.2(pid=4564): Launched 22:52:09.853822 run osmo-stp_10.42.42.5: Starting osmo-stp 22:52:10.411659 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4566): Launched 22:52:10.733762 run osmo-stp_10.42.42.5(pid=4567): Launched 22:52:10.857322 run osmo-msc_10.42.42.6: Starting osmo-msc 22:52:11.441945 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4569): Launched 22:52:11.764805 run osmo-msc_10.42.42.6(pid=4570): Launched 22:52:11.945223 run osmo-stp_10.42.42.5(pid=4567): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4567)] 22:52:12.080918 run osmo-stp_10.42.42.5(pid=4567): stdout: | (launched: 2022-12-12_22:52:10.675530) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:52:12.216899 run osmo-stp_10.42.42.5(pid=4567): stderr: | [0;m[38;5;43m20221212225210869 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225210869 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225210869 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225210869 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225210870 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225210870 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225210870 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:52:12.352276 run osmo-stp_10.42.42.5(pid=4567): stdout: | (launched: 2022-12-12_22:52:10.675530) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:52:12.480580 run osmo-stp_10.42.42.5(pid=4567): stderr: | [0;m[38;5;43m20221212225210869 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225210869 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225210869 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225210869 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225210870 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225210870 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225210870 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:52:12.634739 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4567): Process ended prematurely: osmo-stp_10.42.42.5(pid=4567) [trial-2383↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4567)] [trial-2383↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 22:52:12.644449 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 22:52:12.672212 run osmo-hlr_10.42.42.2(pid=4564): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4564)] 22:52:12.721816 run osmo-hlr_10.42.42.2(pid=4564): stdout: | (launched: 2022-12-12_22:52:09.671327) 22:52:12.773206 run osmo-hlr_10.42.42.2(pid=4564): stderr: | [0;m[1;31m20221212225209870 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212225209870 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212225209870 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212225209870 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212225209870 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212225209870 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212225209883 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212225209893 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212225209893 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212225209893 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:52:12.844403 run osmo-msc_10.42.42.6(pid=4570): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4570)] 22:52:12.893953 run osmo-msc_10.42.42.6(pid=4570): stdout: | (launched: 2022-12-12_22:52:11.706362) 22:52:12.945211 run osmo-msc_10.42.42.6(pid=4570): stderr: | [0;m[38;5;43m20221212225212028 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212225212028 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb9b9bc5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212225212028 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212225212028 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212225212028 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212225212029 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212225212030 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212225212031 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212225212031 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212225212031 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:52:12.996576 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4563): Terminating (SIGTERM) 22:52:13.037712 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4566): Terminating (SIGTERM) 22:52:13.078919 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4569): Terminating (SIGTERM) 22:52:13.120554 --- ParallelTerminationStrategy: PID 4563 died... 22:52:13.140479 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4563): Terminated: ok {rc=0} 22:52:13.186074 --- ParallelTerminationStrategy: PID 4566 died... 22:52:13.205507 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4566): Terminated: ok {rc=0} 22:52:13.250945 --- ParallelTerminationStrategy: PID 4569 died... 22:52:13.270343 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4569): Terminated: ok {rc=0} 22:52:13.357354 bus /sierra_3: Setting Powered False 22:52:14.455789 bus /sierra_3: Setting Powered False 22:52:15.571598 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 22:52:16.869424 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:52:16.876417 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 22:52:16.912057 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 22:52:16.940171 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 22:52:16.995110 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 22:52:17.036421 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 22:52:17.070018 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 22:52:17.602947 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 22:52:17.651901 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:52:17.662942 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 22:52:17.731160 tst mo_mt_call.py: using LAC 32056 22:52:17.852222 tst mo_mt_call.py: using RAC 181 22:52:17.974227 tst mo_mt_call.py: using CellId 32056 22:52:18.097565 tst mo_mt_call.py: using BVCI 32057 22:52:18.210469 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:52:18.221487 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:52:18.232230 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:52:18.243372 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:52:18.254640 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:52:18.266081 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 22:52:18.385082 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 22:52:18.503359 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:52:18.974153 run create_hlr_db(pid=4575): Launched 22:52:19.091252 bus /sierra_2: Setting Powered False 22:52:20.151507 run create_hlr_db(pid=4575): Terminated: ok {rc=0} 22:52:20.594154 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4577): Launched 22:52:20.917506 run osmo-hlr_10.42.42.2(pid=4578): Launched 22:52:21.041537 run osmo-stp_10.42.42.5: Starting osmo-stp 22:52:21.598478 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4580): Launched 22:52:21.921597 run osmo-stp_10.42.42.5(pid=4581): Launched 22:52:22.045277 run osmo-msc_10.42.42.6: Starting osmo-msc 22:52:22.631116 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4583): Launched 22:52:22.953665 run osmo-msc_10.42.42.6(pid=4584): Launched 22:52:23.134066 run osmo-stp_10.42.42.5(pid=4581): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4581)] 22:52:23.270678 run osmo-stp_10.42.42.5(pid=4581): stdout: | (launched: 2022-12-12_22:52:21.862947) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:52:23.407036 run osmo-stp_10.42.42.5(pid=4581): stderr: | [0;m[38;5;43m20221212225222056 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225222056 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225222056 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225222057 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225222057 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225222057 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225222058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:52:23.543185 run osmo-stp_10.42.42.5(pid=4581): stdout: | (launched: 2022-12-12_22:52:21.862947) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:52:23.672796 run osmo-stp_10.42.42.5(pid=4581): stderr: | [0;m[38;5;43m20221212225222056 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225222056 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225222056 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225222057 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225222057 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225222057 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225222058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:52:23.827804 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4581): Process ended prematurely: osmo-stp_10.42.42.5(pid=4581) [trial-2383↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4581)] [trial-2383↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 22:52:23.837640 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 22:52:23.865543 run osmo-hlr_10.42.42.2(pid=4578): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4578)] 22:52:23.915895 run osmo-hlr_10.42.42.2(pid=4578): stdout: | (launched: 2022-12-12_22:52:20.859095) 22:52:23.967705 run osmo-hlr_10.42.42.2(pid=4578): stderr: | [0;m[1;31m20221212225221058 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212225221058 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212225221058 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212225221058 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212225221058 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212225221058 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212225221070 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212225221078 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212225221079 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212225221079 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:52:24.039604 run osmo-msc_10.42.42.6(pid=4584): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4584)] 22:52:24.089338 run osmo-msc_10.42.42.6(pid=4584): stdout: | (launched: 2022-12-12_22:52:22.895451) 22:52:24.140489 run osmo-msc_10.42.42.6(pid=4584): stderr: | [0;m[38;5;43m20221212225223218 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212225223219 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f62c0c7ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212225223219 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212225223219 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212225223219 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212225223219 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212225223221 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212225223221 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212225223221 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212225223221 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:52:24.192066 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4577): Terminating (SIGTERM) 22:52:24.233598 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4580): Terminating (SIGTERM) 22:52:24.275004 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4583): Terminating (SIGTERM) 22:52:24.316933 --- ParallelTerminationStrategy: PID 4577 died... 22:52:24.337011 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4577): Terminated: ok {rc=0} 22:52:24.383425 --- ParallelTerminationStrategy: PID 4580 died... 22:52:24.402953 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4580): Terminated: ok {rc=0} 22:52:24.449514 --- ParallelTerminationStrategy: PID 4583 died... 22:52:24.469179 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4583): Terminated: ok {rc=0} 22:52:24.557107 bus /sierra_3: Setting Powered False 22:52:25.655854 bus /sierra_3: Setting Powered False 22:52:26.771801 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2383 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 22:52:27.918618 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:52:27.930279 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 22:52:27.999839 tst mo_mt_call_osmux.py: using LAC 32057 22:52:28.128909 tst mo_mt_call_osmux.py: using RAC 182 22:52:28.256810 tst mo_mt_call_osmux.py: using CellId 32057 22:52:28.384478 tst mo_mt_call_osmux.py: using BVCI 32058 22:52:28.502687 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:52:28.514403 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:52:28.525943 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:52:28.537763 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:52:28.549391 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 22:52:28.560725 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 22:52:28.680782 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 22:52:28.799231 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:52:29.271835 run create_hlr_db(pid=4586): Launched 22:52:29.390274 bus /sierra_2: Setting Powered False 22:52:30.450860 run create_hlr_db(pid=4586): Terminated: ok {rc=0} 22:52:30.922713 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4588): Launched 22:52:31.249356 run osmo-hlr_10.42.42.2(pid=4589): Launched 22:52:31.499532 run osmo-stp_10.42.42.5: Starting osmo-stp 22:52:32.226509 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4591): Launched 22:52:32.531470 run osmo-stp_10.42.42.5(pid=4592): Launched 22:52:32.648172 run osmo-msc_10.42.42.6: Starting osmo-msc 22:52:33.200361 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4594): Launched 22:52:33.505685 run osmo-msc_10.42.42.6(pid=4595): Launched 22:52:33.679273 run osmo-stp_10.42.42.5(pid=4592): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4592)] 22:52:33.811688 run osmo-stp_10.42.42.5(pid=4592): stdout: | (launched: 2022-12-12_22:52:32.476033) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:52:33.941756 run osmo-stp_10.42.42.5(pid=4592): stderr: | [0;m[38;5;43m20221212225232647 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225232647 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225232647 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225232648 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225232648 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225232648 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225232649 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:52:34.069238 run osmo-stp_10.42.42.5(pid=4592): stdout: | (launched: 2022-12-12_22:52:32.476033) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:52:34.190727 run osmo-stp_10.42.42.5(pid=4592): stderr: | [0;m[38;5;43m20221212225232647 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225232647 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225232647 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225232648 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225232648 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225232648 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225232649 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:52:34.336209 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4592): Process ended prematurely: osmo-stp_10.42.42.5(pid=4592) [trial-2383↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4592)] [trial-2383↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 22:52:34.345284 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 22:52:34.371822 run osmo-hlr_10.42.42.2(pid=4589): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4589)] 22:52:34.419657 run osmo-hlr_10.42.42.2(pid=4589): stdout: | (launched: 2022-12-12_22:52:31.186289) 22:52:34.468866 run osmo-hlr_10.42.42.2(pid=4589): stderr: | [0;m[1;31m20221212225231538 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212225231538 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212225231538 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212225231538 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212225231538 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212225231538 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212225231550 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212225231562 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212225231563 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212225231563 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:52:34.537897 run osmo-msc_10.42.42.6(pid=4595): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4595)] 22:52:34.585424 run osmo-msc_10.42.42.6(pid=4595): stdout: | (launched: 2022-12-12_22:52:33.449843) 22:52:34.634575 run osmo-msc_10.42.42.6(pid=4595): stderr: | [0;m[38;5;43m20221212225233723 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212225233723 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0471aa7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212225233723 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212225233723 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212225233723 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212225233723 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212225233725 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212225233726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212225233726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212225233726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:52:34.684236 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4588): Terminating (SIGTERM) 22:52:34.723665 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4591): Terminating (SIGTERM) 22:52:34.763299 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4594): Terminating (SIGTERM) 22:52:34.803114 --- ParallelTerminationStrategy: PID 4588 died... 22:52:34.821992 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4588): Terminated: ok {rc=0} 22:52:34.866221 --- ParallelTerminationStrategy: PID 4591 died... 22:52:34.884610 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4591): Terminated: ok {rc=0} 22:52:34.928839 --- ParallelTerminationStrategy: PID 4594 died... 22:52:34.947861 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4594): Terminated: ok {rc=0} 22:52:35.031997 bus /sierra_3: Setting Powered False 22:52:36.130323 bus /sierra_3: Setting Powered False 22:52:37.245999 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 22:52:38.503649 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:52:38.510727 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 22:52:38.544429 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 22:52:38.571523 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 22:52:38.623017 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 22:52:38.656573 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 22:52:38.683764 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 22:52:39.236150 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 22:52:39.287676 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:52:39.299199 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 22:52:39.368801 tst mo_mt_call.py: using LAC 32058 22:52:39.491118 tst mo_mt_call.py: using RAC 183 22:52:39.613638 tst mo_mt_call.py: using CellId 32058 22:52:39.742469 tst mo_mt_call.py: using BVCI 32059 22:52:39.862971 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:52:39.874821 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:52:39.886351 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:52:39.897892 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:52:39.909409 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:52:39.920564 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:52:40.037599 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:52:40.157601 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:52:40.659746 run create_hlr_db(pid=4601): Launched 22:52:40.789066 bus /sierra_2: Setting Powered False 22:52:41.852811 run create_hlr_db(pid=4601): Terminated: ok {rc=0} 22:52:42.286046 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4603): Launched 22:52:42.590095 run osmo-hlr_10.42.42.2(pid=4604): Launched 22:52:42.706511 run osmo-stp_10.42.42.5: Starting osmo-stp 22:52:43.242685 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4606): Launched 22:52:43.545598 run osmo-stp_10.42.42.5(pid=4607): Launched 22:52:43.662620 run osmo-msc_10.42.42.6: Starting osmo-msc 22:52:44.215067 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4609): Launched 22:52:44.518920 run osmo-msc_10.42.42.6(pid=4610): Launched 22:52:44.688917 run osmo-stp_10.42.42.5(pid=4607): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4607)] 22:52:44.817735 run osmo-stp_10.42.42.5(pid=4607): stdout: | (launched: 2022-12-12_22:52:43.490024) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:52:44.947440 run osmo-stp_10.42.42.5(pid=4607): stderr: | [0;m[38;5;43m20221212225243663 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225243663 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225243663 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225243663 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225243664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225243664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225243664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:52:45.074263 run osmo-stp_10.42.42.5(pid=4607): stdout: | (launched: 2022-12-12_22:52:43.490024) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:52:45.195471 run osmo-stp_10.42.42.5(pid=4607): stderr: | [0;m[38;5;43m20221212225243663 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225243663 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225243663 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225243663 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225243664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225243664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225243664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:52:45.340062 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4607): Process ended prematurely: osmo-stp_10.42.42.5(pid=4607) [trial-2383↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4607)] [trial-2383↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 22:52:45.349242 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 22:52:45.375903 run osmo-hlr_10.42.42.2(pid=4604): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4604)] 22:52:45.423948 run osmo-hlr_10.42.42.2(pid=4604): stdout: | (launched: 2022-12-12_22:52:42.534532) 22:52:45.473540 run osmo-hlr_10.42.42.2(pid=4604): stderr: | [0;m[1;31m20221212225242711 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212225242711 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212225242711 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212225242711 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212225242711 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212225242711 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212225242728 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212225242737 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212225242737 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212225242737 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:52:45.542487 run osmo-msc_10.42.42.6(pid=4610): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4610)] 22:52:45.590227 run osmo-msc_10.42.42.6(pid=4610): stdout: | (launched: 2022-12-12_22:52:44.463482) 22:52:45.639535 run osmo-msc_10.42.42.6(pid=4610): stderr: | [0;m[38;5;43m20221212225244741 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212225244741 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2379ae3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212225244741 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212225244741 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212225244742 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212225244742 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212225244744 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212225244744 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212225244744 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212225244744 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:52:45.689350 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4603): Terminating (SIGTERM) 22:52:45.729251 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4606): Terminating (SIGTERM) 22:52:45.769180 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4609): Terminating (SIGTERM) 22:52:45.809130 --- ParallelTerminationStrategy: PID 4603 died... 22:52:45.828242 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4603): Terminated: ok {rc=0} 22:52:45.875603 --- ParallelTerminationStrategy: PID 4606 died... 22:52:45.898234 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4606): Terminated: ok {rc=0} 22:52:45.957849 --- ParallelTerminationStrategy: PID 4609 died... 22:52:45.976892 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4609): Terminated: ok {rc=0} 22:52:46.071214 bus /sierra_3: Setting Powered False 22:52:47.173473 bus /sierra_3: Setting Powered False 22:52:48.286522 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2383 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 22:52:49.429048 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:52:49.440736 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 22:52:49.509763 tst mo_mt_call_osmux.py: using LAC 32059 22:52:49.631848 tst mo_mt_call_osmux.py: using RAC 184 22:52:49.752567 tst mo_mt_call_osmux.py: using CellId 32059 22:52:49.874417 tst mo_mt_call_osmux.py: using BVCI 32060 22:52:49.987918 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:52:49.998878 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:52:50.009961 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:52:50.021088 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:52:50.032120 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 22:52:50.043160 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:52:50.161499 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 22:52:50.282505 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:52:50.782937 run create_hlr_db(pid=4612): Launched 22:52:50.914612 bus /sierra_2: Setting Powered False 22:52:51.978656 run create_hlr_db(pid=4612): Terminated: ok {rc=0} 22:52:52.410134 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4614): Launched 22:52:52.713520 run osmo-hlr_10.42.42.2(pid=4615): Launched 22:52:52.830086 run osmo-stp_10.42.42.5: Starting osmo-stp 22:52:53.355283 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4617): Launched 22:52:53.659720 run osmo-stp_10.42.42.5(pid=4618): Launched 22:52:53.775825 run osmo-msc_10.42.42.6: Starting osmo-msc 22:52:54.324786 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4620): Launched 22:52:54.628758 run osmo-msc_10.42.42.6(pid=4621): Launched 22:52:54.800526 run osmo-stp_10.42.42.5(pid=4618): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4618)] 22:52:54.930816 run osmo-stp_10.42.42.5(pid=4618): stdout: | (launched: 2022-12-12_22:52:53.603302) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:52:55.060762 run osmo-stp_10.42.42.5(pid=4618): stderr: | [0;m[38;5;43m20221212225253775 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225253775 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225253775 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225253775 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225253778 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225253778 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225253778 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:52:55.187616 run osmo-stp_10.42.42.5(pid=4618): stdout: | (launched: 2022-12-12_22:52:53.603302) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:52:55.308579 run osmo-stp_10.42.42.5(pid=4618): stderr: | [0;m[38;5;43m20221212225253775 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225253775 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225253775 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225253775 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225253778 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225253778 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225253778 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:52:55.453354 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4618): Process ended prematurely: osmo-stp_10.42.42.5(pid=4618) [trial-2383↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4618)] [trial-2383↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 22:52:55.462709 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 22:52:55.489149 run osmo-hlr_10.42.42.2(pid=4615): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4615)] 22:52:55.536846 run osmo-hlr_10.42.42.2(pid=4615): stdout: | (launched: 2022-12-12_22:52:52.658052) 22:52:55.586455 run osmo-hlr_10.42.42.2(pid=4615): stderr: | [0;m[1;31m20221212225252836 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212225252836 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212225252836 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212225252836 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212225252836 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212225252836 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212225252848 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212225252858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212225252858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212225252858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:52:55.655282 run osmo-msc_10.42.42.6(pid=4621): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4621)] 22:52:55.702564 run osmo-msc_10.42.42.6(pid=4621): stdout: | (launched: 2022-12-12_22:52:54.573411) 22:52:55.751693 run osmo-msc_10.42.42.6(pid=4621): stderr: | [0;m[38;5;43m20221212225254849 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212225254849 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3a5486fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212225254849 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212225254849 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212225254849 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212225254850 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212225254851 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212225254852 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212225254852 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212225254852 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:52:55.801047 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4614): Terminating (SIGTERM) 22:52:55.841024 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4617): Terminating (SIGTERM) 22:52:55.880715 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4620): Terminating (SIGTERM) 22:52:55.920668 --- ParallelTerminationStrategy: PID 4614 died... 22:52:55.939640 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4614): Terminated: ok {rc=0} 22:52:55.984686 --- ParallelTerminationStrategy: PID 4617 died... 22:52:56.003304 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4617): Terminated: ok {rc=0} 22:52:56.046957 --- ParallelTerminationStrategy: PID 4620 died... 22:52:56.065448 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4620): Terminated: ok {rc=0} 22:52:56.149207 bus /sierra_3: Setting Powered False 22:52:57.245941 bus /sierra_3: Setting Powered False 22:52:58.360531 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 22:52:59.614488 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:52:59.621674 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 22:52:59.658827 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 22:52:59.685296 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 22:52:59.736556 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 22:52:59.771733 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 22:52:59.799753 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 22:53:00.350952 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 22:53:00.403659 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:53:00.415525 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 22:53:00.485635 tst mo_mt_call.py: using LAC 32060 22:53:00.611703 tst mo_mt_call.py: using RAC 185 22:53:00.738174 tst mo_mt_call.py: using CellId 32060 22:53:00.881665 tst mo_mt_call.py: using BVCI 32061 22:53:01.005072 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:53:01.017462 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:53:01.029552 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:53:01.042190 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:53:01.057585 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:53:01.070752 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:53:01.190973 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:53:01.313098 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:53:01.928448 run create_hlr_db(pid=4626): Launched 22:53:02.085367 bus /sierra_2: Setting Powered False 22:53:03.145443 run create_hlr_db(pid=4626): Terminated: ok {rc=0} 22:53:03.572351 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4628): Launched 22:53:03.877189 run osmo-hlr_10.42.42.2(pid=4629): Launched 22:53:03.993632 run osmo-stp_10.42.42.5: Starting osmo-stp 22:53:04.531192 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4631): Launched 22:53:04.834912 run osmo-stp_10.42.42.5(pid=4632): Launched 22:53:04.951644 run osmo-msc_10.42.42.6: Starting osmo-msc 22:53:05.501540 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4634): Launched 22:53:05.806344 run osmo-msc_10.42.42.6(pid=4635): Launched 22:53:05.976729 run osmo-stp_10.42.42.5(pid=4632): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4632)] 22:53:06.106885 run osmo-stp_10.42.42.5(pid=4632): stdout: | (launched: 2022-12-12_22:53:04.779445) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:53:06.235677 run osmo-stp_10.42.42.5(pid=4632): stderr: | [0;m[38;5;43m20221212225304950 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225304951 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225304951 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225304951 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225304952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225304952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225304952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:53:06.362592 run osmo-stp_10.42.42.5(pid=4632): stdout: | (launched: 2022-12-12_22:53:04.779445) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:53:06.483739 run osmo-stp_10.42.42.5(pid=4632): stderr: | [0;m[38;5;43m20221212225304950 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225304951 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225304951 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225304951 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225304952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225304952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225304952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:53:06.628658 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4632): Process ended prematurely: osmo-stp_10.42.42.5(pid=4632) [trial-2383↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4632)] [trial-2383↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 22:53:06.637797 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 22:53:06.664506 run osmo-hlr_10.42.42.2(pid=4629): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4629)] 22:53:06.712591 run osmo-hlr_10.42.42.2(pid=4629): stdout: | (launched: 2022-12-12_22:53:03.821818) 22:53:06.762022 run osmo-hlr_10.42.42.2(pid=4629): stderr: | [0;m[1;31m20221212225303999 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212225303999 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212225303999 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212225303999 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212225303999 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212225303999 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212225304011 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212225304020 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212225304021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212225304021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:53:06.830755 run osmo-msc_10.42.42.6(pid=4635): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4635)] 22:53:06.878556 run osmo-msc_10.42.42.6(pid=4635): stdout: | (launched: 2022-12-12_22:53:05.750838) 22:53:06.927906 run osmo-msc_10.42.42.6(pid=4635): stderr: | [0;m[38;5;43m20221212225306022 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212225306023 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f360e953c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212225306023 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212225306023 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212225306023 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212225306023 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212225306025 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212225306025 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212225306025 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212225306025 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:53:06.977706 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4628): Terminating (SIGTERM) 22:53:07.017138 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4631): Terminating (SIGTERM) 22:53:07.056880 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4634): Terminating (SIGTERM) 22:53:07.096621 --- ParallelTerminationStrategy: PID 4628 died... 22:53:07.115547 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4628): Terminated: ok {rc=0} 22:53:07.159839 --- ParallelTerminationStrategy: PID 4631 died... 22:53:07.178345 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4631): Terminated: ok {rc=0} 22:53:07.222340 --- ParallelTerminationStrategy: PID 4634 died... 22:53:07.240774 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4634): Terminated: ok {rc=0} 22:53:07.326209 bus /sierra_3: Setting Powered False 22:53:08.425272 bus /sierra_3: Setting Powered False 22:53:09.540801 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2383 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 22:53:10.690351 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:53:10.702799 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 22:53:10.774546 tst mo_mt_call_osmux.py: using LAC 32061 22:53:10.903493 tst mo_mt_call_osmux.py: using RAC 186 22:53:11.033417 tst mo_mt_call_osmux.py: using CellId 32061 22:53:11.161024 tst mo_mt_call_osmux.py: using BVCI 32062 22:53:11.278994 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:53:11.290675 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:53:11.302174 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:53:11.313610 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:53:11.325076 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 22:53:11.336471 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:53:11.453514 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:53:11.571999 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:53:12.046241 run create_hlr_db(pid=4637): Launched 22:53:12.165133 bus /sierra_2: Setting Powered False 22:53:13.226202 run create_hlr_db(pid=4637): Terminated: ok {rc=0} 22:53:13.670076 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4639): Launched 22:53:13.994174 run osmo-hlr_10.42.42.2(pid=4640): Launched 22:53:14.117695 run osmo-stp_10.42.42.5: Starting osmo-stp 22:53:14.675195 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4642): Launched 22:53:14.997923 run osmo-stp_10.42.42.5(pid=4643): Launched 22:53:15.121047 run osmo-msc_10.42.42.6: Starting osmo-msc 22:53:15.711872 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4645): Launched 22:53:16.080117 run osmo-msc_10.42.42.6(pid=4646): Launched 22:53:16.472036 run osmo-stp_10.42.42.5(pid=4643): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4643)] 22:53:16.613436 run osmo-stp_10.42.42.5(pid=4643): stdout: | (launched: 2022-12-12_22:53:14.939240) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:53:16.774374 run osmo-stp_10.42.42.5(pid=4643): stderr: | [0;m[38;5;43m20221212225315132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225315132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225315132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225315132 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225315133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225315133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225315133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:53:16.962260 run osmo-stp_10.42.42.5(pid=4643): stdout: | (launched: 2022-12-12_22:53:14.939240) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:53:17.101762 run osmo-stp_10.42.42.5(pid=4643): stderr: | [0;m[38;5;43m20221212225315132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225315132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225315132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225315132 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225315133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225315133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225315133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:53:17.258812 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4643): Process ended prematurely: osmo-stp_10.42.42.5(pid=4643) [trial-2383↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4643)] [trial-2383↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 22:53:17.268781 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 22:53:17.297181 run osmo-hlr_10.42.42.2(pid=4640): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4640)] 22:53:17.347711 run osmo-hlr_10.42.42.2(pid=4640): stdout: | (launched: 2022-12-12_22:53:13.935511) 22:53:17.399810 run osmo-hlr_10.42.42.2(pid=4640): stderr: | [0;m[1;31m20221212225314136 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212225314136 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212225314136 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212225314136 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212225314136 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212225314136 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212225314179 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212225314188 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212225314188 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212225314188 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:53:17.471942 run osmo-msc_10.42.42.6(pid=4646): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4646)] 22:53:17.522185 run osmo-msc_10.42.42.6(pid=4646): stdout: | (launched: 2022-12-12_22:53:16.015524) 22:53:17.573512 run osmo-msc_10.42.42.6(pid=4646): stderr: | [0;m[38;5;43m20221212225316437 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212225316437 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8741c3fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212225316438 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212225316438 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212225316438 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212225316438 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212225316440 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212225316440 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212225316440 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212225316440 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:53:17.625335 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4639): Terminating (SIGTERM) 22:53:17.666757 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4642): Terminating (SIGTERM) 22:53:17.708217 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4645): Terminating (SIGTERM) 22:53:17.749924 --- ParallelTerminationStrategy: PID 4639 died... 22:53:17.769889 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4639): Terminated: ok {rc=0} 22:53:17.815619 --- ParallelTerminationStrategy: PID 4642 died... 22:53:17.835084 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4642): Terminated: ok {rc=0} 22:53:17.881083 --- ParallelTerminationStrategy: PID 4645 died... 22:53:17.900303 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4645): Terminated: ok {rc=0} 22:53:17.987469 bus /sierra_3: Setting Powered False 22:53:19.086621 bus /sierra_3: Setting Powered False 22:53:20.204103 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 voice:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 22:53:21.459353 tst voice:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:53:21.465936 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 22:53:21.499276 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 22:53:21.526120 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 22:53:21.578345 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 22:53:21.612555 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 22:53:21.638625 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 22:53:22.184423 tst voice:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 22:53:22.234160 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:53:22.244912 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:53:22.313767 tst mo_mt_call.py: using LAC 32062 22:53:22.435193 tst mo_mt_call.py: using RAC 187 22:53:22.557269 tst mo_mt_call.py: using CellId 32062 22:53:22.678241 tst mo_mt_call.py: using BVCI 32063 22:53:22.797307 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:53:22.808793 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:53:22.820114 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:53:22.831486 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:53:22.842915 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:53:22.854299 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 22:53:22.972389 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 22:53:23.089635 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:53:23.562406 run create_hlr_db(pid=4652): Launched 22:53:23.679158 bus /sierra_2: Setting Powered False 22:53:24.739334 run create_hlr_db(pid=4652): Terminated: ok {rc=0} 22:53:25.161952 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4654): Launched 22:53:25.466234 run osmo-hlr_10.42.42.2(pid=4655): Launched 22:53:25.582855 run osmo-stp_10.42.42.5: Starting osmo-stp 22:53:26.122278 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4657): Launched 22:53:26.425830 run osmo-stp_10.42.42.5(pid=4658): Launched 22:53:26.542315 run osmo-msc_10.42.42.6: Starting osmo-msc 22:53:27.092291 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4660): Launched 22:53:27.397721 run osmo-msc_10.42.42.6(pid=4661): Launched 22:53:27.570209 run osmo-stp_10.42.42.5(pid=4658): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4658)] 22:53:27.699988 run osmo-stp_10.42.42.5(pid=4658): stdout: | (launched: 2022-12-12_22:53:26.370786) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:53:27.829699 run osmo-stp_10.42.42.5(pid=4658): stderr: | [0;m[38;5;43m20221212225326542 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225326542 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225326543 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225326543 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225326543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225326544 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225326544 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:53:27.956440 run osmo-stp_10.42.42.5(pid=4658): stdout: | (launched: 2022-12-12_22:53:26.370786) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:53:28.077591 run osmo-stp_10.42.42.5(pid=4658): stderr: | [0;m[38;5;43m20221212225326542 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225326542 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225326543 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225326543 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225326543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225326544 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225326544 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:53:28.222558 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4658): Process ended prematurely: osmo-stp_10.42.42.5(pid=4658) [trial-2383↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4658)] [trial-2383↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 22:53:28.231195 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 22:53:28.257784 run osmo-hlr_10.42.42.2(pid=4655): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4655)] 22:53:28.305602 run osmo-hlr_10.42.42.2(pid=4655): stdout: | (launched: 2022-12-12_22:53:25.410681) 22:53:28.354805 run osmo-hlr_10.42.42.2(pid=4655): stderr: | [0;m[1;31m20221212225325588 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212225325588 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212225325588 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212225325588 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212225325588 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212225325589 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212225325600 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212225325608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212225325609 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212225325609 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:53:28.423030 run osmo-msc_10.42.42.6(pid=4661): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4661)] 22:53:28.470290 run osmo-msc_10.42.42.6(pid=4661): stdout: | (launched: 2022-12-12_22:53:27.341952) 22:53:28.519012 run osmo-msc_10.42.42.6(pid=4661): stderr: | [0;m[38;5;43m20221212225327615 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212225327615 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f09e4013c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212225327615 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212225327615 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212225327615 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212225327615 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212225327617 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212225327617 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212225327618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212225327618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:53:28.568182 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4654): Terminating (SIGTERM) 22:53:28.607235 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4657): Terminating (SIGTERM) 22:53:28.646313 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4660): Terminating (SIGTERM) 22:53:28.685712 --- ParallelTerminationStrategy: PID 4654 died... 22:53:28.704308 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4654): Terminated: ok {rc=0} 22:53:28.748205 --- ParallelTerminationStrategy: PID 4657 died... 22:53:28.766493 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4657): Terminated: ok {rc=0} 22:53:28.810034 --- ParallelTerminationStrategy: PID 4660 died... 22:53:28.828217 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4660): Terminated: ok {rc=0} 22:53:28.912641 bus /sierra_3: Setting Powered False 22:53:30.010816 bus /sierra_3: Setting Powered False 22:53:31.129621 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2383 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 22:53:32.280905 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:53:32.292383 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:53:32.362253 tst mo_mt_call_osmux.py: using LAC 32063 22:53:32.489144 tst mo_mt_call_osmux.py: using RAC 188 22:53:32.608224 tst mo_mt_call_osmux.py: using CellId 32063 22:53:32.727025 tst mo_mt_call_osmux.py: using BVCI 32064 22:53:32.839420 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:53:32.850186 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:53:32.860783 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:53:32.871745 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:53:32.882667 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 22:53:32.893650 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 22:53:33.012779 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 22:53:33.131373 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:53:33.603012 run create_hlr_db(pid=4663): Launched 22:53:33.719602 bus /sierra_2: Setting Powered False 22:53:34.779489 run create_hlr_db(pid=4663): Terminated: ok {rc=0} 22:53:35.202727 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4665): Launched 22:53:35.506292 run osmo-hlr_10.42.42.2(pid=4666): Launched 22:53:35.622215 run osmo-stp_10.42.42.5: Starting osmo-stp 22:53:36.147177 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4668): Launched 22:53:36.451752 run osmo-stp_10.42.42.5(pid=4669): Launched 22:53:36.569112 run osmo-msc_10.42.42.6: Starting osmo-msc 22:53:37.119343 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4671): Launched 22:53:37.423212 run osmo-msc_10.42.42.6(pid=4672): Launched 22:53:37.595727 run osmo-stp_10.42.42.5(pid=4669): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4669)] 22:53:37.724822 run osmo-stp_10.42.42.5(pid=4669): stdout: | (launched: 2022-12-12_22:53:36.396204) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:53:37.855158 run osmo-stp_10.42.42.5(pid=4669): stderr: | [0;m[38;5;43m20221212225336567 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225336567 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225336567 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225336568 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225336568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225336568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225336568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:53:37.982784 run osmo-stp_10.42.42.5(pid=4669): stdout: | (launched: 2022-12-12_22:53:36.396204) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:53:38.104181 run osmo-stp_10.42.42.5(pid=4669): stderr: | [0;m[38;5;43m20221212225336567 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225336567 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225336567 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225336568 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225336568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225336568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225336568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:53:38.249637 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4669): Process ended prematurely: osmo-stp_10.42.42.5(pid=4669) [trial-2383↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4669)] [trial-2383↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 22:53:38.258695 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 22:53:38.285418 run osmo-hlr_10.42.42.2(pid=4666): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4666)] 22:53:38.333839 run osmo-hlr_10.42.42.2(pid=4666): stdout: | (launched: 2022-12-12_22:53:35.451102) 22:53:38.383182 run osmo-hlr_10.42.42.2(pid=4666): stderr: | [0;m[1;31m20221212225335628 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212225335628 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212225335628 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212225335628 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212225335628 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212225335629 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212225335645 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212225335653 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212225335654 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212225335654 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:53:38.451695 run osmo-msc_10.42.42.6(pid=4672): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4672)] 22:53:38.499720 run osmo-msc_10.42.42.6(pid=4672): stdout: | (launched: 2022-12-12_22:53:37.367911) 22:53:38.549005 run osmo-msc_10.42.42.6(pid=4672): stderr: | [0;m[38;5;43m20221212225337638 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212225337638 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd94cd58c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212225337638 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212225337638 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212225337639 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212225337639 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212225337641 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212225337641 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212225337641 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212225337641 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:53:38.598599 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4665): Terminating (SIGTERM) 22:53:38.638364 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4668): Terminating (SIGTERM) 22:53:38.678165 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4671): Terminating (SIGTERM) 22:53:38.718275 --- ParallelTerminationStrategy: PID 4665 died... 22:53:38.737186 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4665): Terminated: ok {rc=0} 22:53:38.781827 --- ParallelTerminationStrategy: PID 4668 died... 22:53:38.800310 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4668): Terminated: ok {rc=0} 22:53:38.844930 --- ParallelTerminationStrategy: PID 4671 died... 22:53:38.863699 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4671): Terminated: ok {rc=0} 22:53:38.949939 bus /sierra_3: Setting Powered False 22:53:40.048871 bus /sierra_3: Setting Powered False 22:53:41.163560 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 voice:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 emergency:trx-lms --------------------------------------------------------------------- 22:53:42.414932 tst emergency:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:53:42.420710 tst emergency:trx-lms: Verifying 1 x bts (candidates: 11) 22:53:42.455806 tst emergency:trx-lms: Verifying 6 x ip_address (candidates: 9) 22:53:42.483347 tst emergency:trx-lms: Verifying 4 x modem (candidates: 12) 22:53:42.568829 tst emergency:trx-lms: Reserving 1 x bts (candidates: 11) 22:53:42.602475 tst emergency:trx-lms: Reserving 6 x ip_address (candidates: 9) 22:53:42.628733 tst emergency:trx-lms: Reserving 4 x modem (candidates: 12) 22:53:43.210760 tst emergency:trx-lms: RESERVED RESOURCES for emergency: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2383 emergency:trx-lms emergency_mo_mt_call.py ---------------------------------------------- 22:53:43.215739 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 22:53:43.226276 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 22:53:43.274304 tst emergency_mo_mt_call.py: using LAC 32064 22:53:43.392507 tst emergency_mo_mt_call.py: using RAC 189 22:53:43.508255 tst emergency_mo_mt_call.py: using CellId 32064 22:53:43.624904 tst emergency_mo_mt_call.py: using BVCI 32065 22:53:43.733473 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 22:53:43.743938 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 22:53:43.754390 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 22:53:43.765026 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 22:53:43.776087 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 22:53:43.786689 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 22:53:43.905086 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 22:53:44.022561 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:53:44.485844 run create_hlr_db(pid=4677): Launched 22:53:44.600902 bus /sierra_2: Setting Powered False 22:53:45.660502 run create_hlr_db(pid=4677): Terminated: ok {rc=0} 22:53:46.111623 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4679): Launched 22:53:46.449670 run osmo-hlr_10.42.42.2(pid=4689): Launched 22:53:46.743421 run osmo-stp_10.42.42.5: Starting osmo-stp 22:53:47.583074 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4731): Launched 22:53:48.016634 run osmo-stp_10.42.42.5(pid=4752): Launched 22:53:48.296237 tst emergency_mo_mt_call.py: using MSISDN 8010 22:53:48.552412 run osmo-msc_10.42.42.6: Starting osmo-msc 22:53:49.211200 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4880): Launched 22:53:49.603986 run osmo-msc_10.42.42.6(pid=4930): Launched 22:53:50.008138 run osmo-stp_10.42.42.5(pid=4752): ERR: Terminated: ERROR {rc=1} [trial-2383↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4752)] 22:53:50.227551 run osmo-stp_10.42.42.5(pid=4752): stdout: | (launched: 2022-12-12_22:53:47.929388) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:53:50.429386 run osmo-stp_10.42.42.5(pid=4752): stderr: | [0;m[38;5;43m20221212225348236 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225348236 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225348237 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225348237 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225348237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225348238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225348238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:53:50.616571 run osmo-stp_10.42.42.5(pid=4752): stdout: | (launched: 2022-12-12_22:53:47.929388) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:53:50.749759 run osmo-stp_10.42.42.5(pid=4752): stderr: | [0;m[38;5;43m20221212225348236 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225348236 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225348237 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225348237 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225348237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225348238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225348238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:53:50.908716 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=4752): Process ended prematurely: osmo-stp_10.42.42.5(pid=4752) [trial-2383↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4752)] [trial-2383↪emergency:trx-lms↪emergency_mo_mt_call.py:19] 22:53:50.918889 tst emergency_mo_mt_call.py:19: Test FAILED (7.7 sec) 22:53:50.947580 run osmo-hlr_10.42.42.2(pid=4689): ERR: Terminated: ERROR {rc=237} [trial-2383↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4689)] 22:53:50.999863 run osmo-hlr_10.42.42.2(pid=4689): stdout: | (launched: 2022-12-12_22:53:46.368514) 22:53:51.053291 run osmo-hlr_10.42.42.2(pid=4689): stderr: | [0;m[1;31m20221212225346698 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212225346698 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212225346698 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212225346698 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212225346698 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212225346698 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212225346718 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/emergency:trx-lms/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212225346734 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212225346735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212225346735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:53:51.128386 run osmo-msc_10.42.42.6(pid=4930): ERR: Terminated: ERROR {rc=2} [trial-2383↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4930)] 22:53:51.180043 run osmo-msc_10.42.42.6(pid=4930): stdout: | (launched: 2022-12-12_22:53:49.522737) 22:53:51.232820 run osmo-msc_10.42.42.6(pid=4930): stderr: | [0;m[38;5;43m20221212225350189 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212225350190 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fbfdd983c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212225350190 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212225350190 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212225350190 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212225350190 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212225350192 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212225350201 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212225350201 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212225350201 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:53:51.287969 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4679): Terminating (SIGTERM) 22:53:51.330874 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4731): Terminating (SIGTERM) 22:53:51.374901 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4880): Terminating (SIGTERM) 22:53:51.420352 --- ParallelTerminationStrategy: PID 4679 died... 22:53:51.441288 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4679): Terminated: ok {rc=0} 22:53:51.490945 --- ParallelTerminationStrategy: PID 4731 died... 22:53:51.511660 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4731): Terminated: ok {rc=0} 22:53:51.559193 --- ParallelTerminationStrategy: PID 4880 died... 22:53:51.579805 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4880): Terminated: ok {rc=0} 22:53:51.671400 bus /sierra_3: Setting Powered False 22:53:52.774969 bus /sierra_3: Setting Powered False 22:53:53.895897 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2383 emergency:trx-lms emergency_preemptive_call.py ---------------------------------------------- 22:53:54.986176 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 22:53:54.998908 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 22:53:55.050839 tst emergency_preemptive_call.py: using LAC 32065 22:53:55.180695 tst emergency_preemptive_call.py: using RAC 190 22:53:55.309388 tst emergency_preemptive_call.py: using CellId 32065 22:53:55.437168 tst emergency_preemptive_call.py: using BVCI 32066 22:53:55.557450 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 22:53:55.569777 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 22:53:55.582031 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 22:53:55.594485 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 22:53:55.606448 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 22:53:55.619310 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 22:53:55.743647 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 22:53:55.871653 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 22:53:55.984235 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 22:53:56.095839 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:53:56.582655 run create_hlr_db(pid=4961): Launched 22:53:56.741452 bus /sierra_2: Setting Powered False 22:53:57.804412 run create_hlr_db(pid=4961): Terminated: ok {rc=0} 22:53:58.253716 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4963): Launched 22:53:58.581072 run osmo-hlr_10.42.42.2(pid=4964): Launched 22:53:58.827638 run osmo-stp_10.42.42.5: Starting osmo-stp 22:53:59.565728 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4966): Launched 22:53:59.894832 run osmo-stp_10.42.42.5(pid=4967): Launched 22:54:00.151943 tst emergency_preemptive_call.py: using MSISDN 8011 22:54:00.465059 run osmo-msc_10.42.42.6: Starting osmo-msc 22:54:01.073392 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4969): Launched 22:54:01.419399 run osmo-msc_10.42.42.6(pid=4970): Launched 22:54:01.870839 run osmo-stp_10.42.42.5(pid=4967): ERR: Terminated: ERROR {rc=1} [trial-2383↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4967)] 22:54:02.227215 run osmo-stp_10.42.42.5(pid=4967): stdout: | (launched: 2022-12-12_22:53:59.830934) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:54:02.425199 run osmo-stp_10.42.42.5(pid=4967): stderr: | [0;m[38;5;43m20221212225400169 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225400169 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225400170 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225400170 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225400171 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225400171 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225400171 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:54:02.584655 run osmo-stp_10.42.42.5(pid=4967): stdout: | (launched: 2022-12-12_22:53:59.830934) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:54:02.739020 run osmo-stp_10.42.42.5(pid=4967): stderr: | [0;m[38;5;43m20221212225400169 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225400169 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225400170 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225400170 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225400171 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225400171 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225400171 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:54:02.921869 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=4967): Process ended prematurely: osmo-stp_10.42.42.5(pid=4967) [trial-2383↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4967)] [trial-2383↪emergency:trx-lms↪emergency_preemptive_call.py:32] 22:54:02.933849 tst emergency_preemptive_call.py:32: Test FAILED (7.9 sec) 22:54:02.968427 run osmo-hlr_10.42.42.2(pid=4964): ERR: Terminated: ERROR {rc=237} [trial-2383↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4964)] 22:54:03.028657 run osmo-hlr_10.42.42.2(pid=4964): stdout: | (launched: 2022-12-12_22:53:58.517422) 22:54:03.090412 run osmo-hlr_10.42.42.2(pid=4964): stderr: | [0;m[1;31m20221212225358877 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212225358877 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212225358877 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212225358877 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212225358877 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212225358877 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212225358901 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/emergency:trx-lms/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212225358912 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212225358913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212225358913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:54:03.176745 run osmo-msc_10.42.42.6(pid=4970): ERR: Terminated: ERROR {rc=2} [trial-2383↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4970)] 22:54:03.235636 run osmo-msc_10.42.42.6(pid=4970): stdout: | (launched: 2022-12-12_22:54:01.355717) 22:54:03.298783 run osmo-msc_10.42.42.6(pid=4970): stderr: | [0;m[38;5;43m20221212225401802 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212225401803 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe52bca5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212225401803 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212225401803 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212225401803 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212225401803 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212225401815 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212225401815 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212225401815 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212225401816 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:54:03.361397 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4963): Terminating (SIGTERM) 22:54:03.409533 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4966): Terminating (SIGTERM) 22:54:03.453867 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4969): Terminating (SIGTERM) 22:54:03.497103 --- ParallelTerminationStrategy: PID 4963 died... 22:54:03.517716 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4963): Terminated: ok {rc=0} 22:54:03.564270 --- ParallelTerminationStrategy: PID 4966 died... 22:54:03.584383 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4966): Terminated: ok {rc=0} 22:54:03.630863 --- ParallelTerminationStrategy: PID 4969 died... 22:54:03.650860 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4969): Terminated: ok {rc=0} 22:54:03.741062 bus /sierra_9: Setting Powered False 22:54:04.842132 bus /sierra_9: Setting Powered False 22:54:05.962237 bus /sierra_8: Setting Powered False 22:54:07.065368 bus /sierra_8: Setting Powered False 22:54:08.187761 bus /sierra_3: Setting Powered False 22:54:09.293172 bus /sierra_3: Setting Powered False 22:54:10.416139 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 emergency:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 gprs:trx-lms --------------------------------------------------------------------- 22:54:11.704783 tst gprs:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:54:11.710440 tst gprs:trx-lms: Verifying 1 x bts (candidates: 11) 22:54:11.744530 tst gprs:trx-lms: Verifying 9 x ip_address (candidates: 9) 22:54:11.783888 tst gprs:trx-lms: Verifying 4 x modem (candidates: 12) 22:54:11.879873 tst gprs:trx-lms: Reserving 1 x bts (candidates: 11) 22:54:11.913568 tst gprs:trx-lms: Reserving 9 x ip_address (candidates: 9) 22:54:11.952591 tst gprs:trx-lms: Reserving 4 x modem (candidates: 12) 22:54:12.539207 tst gprs:trx-lms: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2383 gprs:trx-lms cs_paging_gprs_active.py ---------------------------------------------- 22:54:12.593741 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:54:12.604793 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 22:54:12.655866 tst cs_paging_gprs_active.py: using LAC 32066 22:54:12.785455 tst cs_paging_gprs_active.py: using RAC 191 22:54:12.914361 tst cs_paging_gprs_active.py: using CellId 32066 22:54:13.042965 tst cs_paging_gprs_active.py: using BVCI 32067 22:54:13.163103 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:54:13.174235 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:54:13.185046 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:54:13.195895 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:54:13.206773 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:54:13.217582 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:54:13.228491 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:54:13.239477 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:54:13.250470 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 22:54:13.364734 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 22:54:13.479846 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:54:13.700197 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:54:14.026633 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4976): Launched 22:54:14.309131 run iperf3-srv_10.42.42.10(pid=4977): Launched 22:54:14.432145 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:54:14.651286 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:54:14.977564 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4978): Launched 22:54:15.261312 run iperf3-srv_10.42.42.10(pid=4979): Launched 22:54:15.383424 tst cs_paging_gprs_active.py:38: start network... 22:54:15.602845 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:54:16.164741 run create_hlr_db(pid=4980): Launched 22:54:16.354509 bus /sierra_2: Setting Powered False 22:54:17.416528 run create_hlr_db(pid=4980): Terminated: ok {rc=0} 22:54:17.940900 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4982): Launched 22:54:18.266184 run osmo-hlr_10.42.42.2(pid=4983): Launched 22:54:18.389512 run osmo-stp_10.42.42.5: Starting osmo-stp 22:54:18.953334 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4987): Launched 22:54:19.278741 run osmo-stp_10.42.42.5(pid=4988): Launched 22:54:19.401854 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:54:19.965867 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4990): Launched 22:54:20.090276 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:54:20.364608 run patchelf(pid=4991): Launched 22:54:20.545090 run osmo-stp_10.42.42.5(pid=4988): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4988)] 22:54:20.682848 run osmo-stp_10.42.42.5(pid=4988): stdout: | (launched: 2022-12-12_22:54:19.219705) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:54:20.821553 run osmo-stp_10.42.42.5(pid=4988): stderr: | [0;m[38;5;43m20221212225419411 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225419411 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225419412 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225419412 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225419413 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225419413 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225419413 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:54:20.959974 run osmo-stp_10.42.42.5(pid=4988): stdout: | (launched: 2022-12-12_22:54:19.219705) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:54:21.093050 run osmo-stp_10.42.42.5(pid=4988): stderr: | [0;m[38;5;43m20221212225419411 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225419411 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225419412 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225419412 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225419413 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225419413 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225419413 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:54:21.250781 run patchelf(pid=4991): Terminating (SIGINT) 22:54:21.433215 run patchelf(pid=4991): Terminated: ok {rc=0} 22:54:21.564374 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=4988): Process ended prematurely: osmo-stp_10.42.42.5(pid=4988) [trial-2383↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4988)] [trial-2383↪gprs:trx-lms↪cs_paging_gprs_active.py:38] 22:54:21.574423 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 22:54:21.602843 run osmo-hlr_10.42.42.2(pid=4983): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-lms↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4983)] 22:54:21.652910 run osmo-hlr_10.42.42.2(pid=4983): stdout: | (launched: 2022-12-12_22:54:18.207409) 22:54:21.705280 run osmo-hlr_10.42.42.2(pid=4983): stderr: | [0;m[1;31m20221212225418408 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212225418408 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212225418408 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212225418408 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212225418408 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212225418408 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212225418420 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-lms/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212225418429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212225418429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212225418429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:54:21.757550 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4976): Terminating (SIGTERM) 22:54:21.799310 run iperf3-srv_10.42.42.10(pid=4977): Terminating (SIGTERM) 22:54:21.841108 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4978): Terminating (SIGTERM) 22:54:21.883054 run iperf3-srv_10.42.42.10(pid=4979): Terminating (SIGTERM) 22:54:21.924772 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4982): Terminating (SIGTERM) 22:54:21.966784 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4987): Terminating (SIGTERM) 22:54:22.008515 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4990): Terminating (SIGTERM) 22:54:22.050602 --- ParallelTerminationStrategy: PID 4976 died... 22:54:22.070668 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4976): Terminated: ok {rc=0} 22:54:22.116875 --- ParallelTerminationStrategy: PID 4977 died... 22:54:22.136429 run iperf3-srv_10.42.42.10(pid=4977): Terminated {rc=256} 22:54:22.182497 --- ParallelTerminationStrategy: PID 4978 died... 22:54:22.202013 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4978): Terminated: ok {rc=0} 22:54:22.247992 --- ParallelTerminationStrategy: PID 4979 died... 22:54:22.267465 run iperf3-srv_10.42.42.10(pid=4979): Terminated {rc=256} 22:54:22.313552 --- ParallelTerminationStrategy: PID 4982 died... 22:54:22.333174 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4982): Terminated: ok {rc=0} 22:54:22.379501 --- ParallelTerminationStrategy: PID 4987 died... 22:54:22.399036 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4987): Terminated: ok {rc=0} 22:54:22.444858 --- ParallelTerminationStrategy: PID 4990 died... 22:54:22.464816 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4990): Terminated: ok {rc=0} 22:54:22.552655 bus /gobi_0: Setting Powered False 22:54:23.652283 bus /gobi_0: Setting Powered False 22:54:24.771474 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-lms iperf3.py ---------------------------------------------- 22:54:25.916563 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:54:25.927690 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 22:54:25.979668 tst iperf3.py: using LAC 32067 22:54:26.101577 tst iperf3.py: using RAC 192 22:54:26.230367 tst iperf3.py: using CellId 32067 22:54:26.359950 tst iperf3.py: using BVCI 32068 22:54:26.478573 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:54:26.489778 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:54:26.500611 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:54:26.511621 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:54:26.522441 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:54:26.533180 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:54:26.544023 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:54:26.554836 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:54:26.565771 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 22:54:26.681581 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:54:26.887385 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:54:27.194862 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4992): Launched 22:54:27.461269 run iperf3-srv_10.42.42.10(pid=4993): Launched 22:54:27.576847 tst iperf3.py:8: start network... 22:54:27.782762 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:54:28.257258 run create_hlr_db(pid=4994): Launched 22:54:28.375473 bus /gobi_6: Setting Powered False 22:54:29.435604 run create_hlr_db(pid=4994): Terminated: ok {rc=0} 22:54:29.862180 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4996): Launched 22:54:30.168358 run osmo-hlr_10.42.42.2(pid=4997): Launched 22:54:30.286590 run osmo-stp_10.42.42.5: Starting osmo-stp 22:54:30.818586 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4999): Launched 22:54:31.173901 run osmo-stp_10.42.42.5(pid=5000): Launched 22:54:31.420192 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:54:32.046399 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5002): Launched 22:54:32.184401 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:54:32.461527 run patchelf(pid=5003): Launched 22:54:32.643842 run osmo-stp_10.42.42.5(pid=5000): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5000)] 22:54:32.782949 run osmo-stp_10.42.42.5(pid=5000): stdout: | (launched: 2022-12-12_22:54:31.109550) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:54:32.922940 run osmo-stp_10.42.42.5(pid=5000): stderr: | [0;m[38;5;43m20221212225431405 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225431405 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225431406 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225431406 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225431406 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225431407 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225431407 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:54:33.062816 run osmo-stp_10.42.42.5(pid=5000): stdout: | (launched: 2022-12-12_22:54:31.109550) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:54:33.196776 run osmo-stp_10.42.42.5(pid=5000): stderr: | [0;m[38;5;43m20221212225431405 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225431405 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225431406 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225431406 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225431406 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225431407 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225431407 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:54:33.355365 run patchelf(pid=5003): Terminating (SIGINT) 22:54:33.540151 run patchelf(pid=5003): Terminated: ok {rc=0} 22:54:33.673242 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5000): Process ended prematurely: osmo-stp_10.42.42.5(pid=5000) [trial-2383↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5000)] [trial-2383↪gprs:trx-lms↪iperf3.py:8] 22:54:33.683299 tst iperf3.py:8: Test FAILED (7.8 sec) 22:54:33.712139 run osmo-hlr_10.42.42.2(pid=4997): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-lms↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4997)] 22:54:33.762174 run osmo-hlr_10.42.42.2(pid=4997): stdout: | (launched: 2022-12-12_22:54:30.112332) 22:54:33.813792 run osmo-hlr_10.42.42.2(pid=4997): stderr: | [0;m[1;31m20221212225430289 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212225430289 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212225430289 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212225430289 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212225430289 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212225430289 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212225430301 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-lms/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212225430309 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212225430310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212225430310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:54:33.865755 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4992): Terminating (SIGTERM) 22:54:33.907331 run iperf3-srv_10.42.42.10(pid=4993): Terminating (SIGTERM) 22:54:33.949075 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4996): Terminating (SIGTERM) 22:54:33.990761 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4999): Terminating (SIGTERM) 22:54:34.032460 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5002): Terminating (SIGTERM) 22:54:34.074306 --- ParallelTerminationStrategy: PID 4992 died... 22:54:34.094371 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4992): Terminated: ok {rc=0} 22:54:34.140339 --- ParallelTerminationStrategy: PID 4993 died... 22:54:34.159860 run iperf3-srv_10.42.42.10(pid=4993): Terminated {rc=256} 22:54:34.206206 --- ParallelTerminationStrategy: PID 4996 died... 22:54:34.225661 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4996): Terminated: ok {rc=0} 22:54:34.271403 --- ParallelTerminationStrategy: PID 4999 died... 22:54:34.290987 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4999): Terminated: ok {rc=0} 22:54:34.336686 --- ParallelTerminationStrategy: PID 5002 died... 22:54:34.356160 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5002): Terminated: ok {rc=0} 22:54:34.442534 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-lms iperf3m4.py ---------------------------------------------- 22:54:35.588666 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:54:35.599775 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 22:54:35.646650 tst iperf3m4.py: using LAC 32068 22:54:35.765362 tst iperf3m4.py: using RAC 193 22:54:35.887649 tst iperf3m4.py: using CellId 32068 22:54:36.006370 tst iperf3m4.py: using BVCI 32069 22:54:36.119586 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:54:36.130177 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:54:36.140417 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:54:36.150948 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:54:36.161536 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:54:36.171980 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:54:36.182641 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:54:36.193206 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:54:36.203879 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 22:54:36.320024 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 22:54:36.444910 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 22:54:36.566102 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 22:54:36.687408 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:54:36.908191 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:54:37.233908 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5007): Launched 22:54:37.515345 run iperf3-srv_10.42.42.10(pid=5008): Launched 22:54:37.637374 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:54:37.856071 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:54:38.180138 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5009): Launched 22:54:38.461704 run iperf3-srv_10.42.42.10(pid=5010): Launched 22:54:38.583096 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:54:38.802651 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:54:39.127534 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5011): Launched 22:54:39.408110 run iperf3-srv_10.42.42.10(pid=5012): Launched 22:54:39.529577 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:54:39.748024 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:54:40.072521 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5013): Launched 22:54:40.353912 run iperf3-srv_10.42.42.10(pid=5014): Launched 22:54:40.475003 tst iperf3m4.py:8: start network... 22:54:40.693899 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:54:41.197285 run create_hlr_db(pid=5015): Launched 22:54:41.329116 bus /gobi_6: Setting Powered False 22:54:42.393672 run create_hlr_db(pid=5015): Terminated: ok {rc=0} 22:54:42.827061 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5017): Launched 22:54:43.132799 run osmo-hlr_10.42.42.2(pid=5018): Launched 22:54:43.250131 run osmo-stp_10.42.42.5: Starting osmo-stp 22:54:43.790705 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5020): Launched 22:54:44.095289 run osmo-stp_10.42.42.5(pid=5021): Launched 22:54:44.212060 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:54:44.736660 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5023): Launched 22:54:44.854034 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:54:45.111487 run patchelf(pid=5024): Launched 22:54:45.281260 run osmo-stp_10.42.42.5(pid=5021): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5021)] 22:54:45.410327 run osmo-stp_10.42.42.5(pid=5021): stdout: | (launched: 2022-12-12_22:54:44.039504) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:54:45.540475 run osmo-stp_10.42.42.5(pid=5021): stderr: | [0;m[38;5;43m20221212225444208 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225444209 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225444209 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225444209 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225444211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225444212 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225444212 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:54:45.670720 run osmo-stp_10.42.42.5(pid=5021): stdout: | (launched: 2022-12-12_22:54:44.039504) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:54:45.795489 run osmo-stp_10.42.42.5(pid=5021): stderr: | [0;m[38;5;43m20221212225444208 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225444209 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225444209 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225444209 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225444211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225444212 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225444212 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:54:45.964255 run patchelf(pid=5024): Terminating (SIGINT) 22:54:46.152636 run patchelf(pid=5024): Terminated: ok {rc=0} 22:54:46.289409 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5021): Process ended prematurely: osmo-stp_10.42.42.5(pid=5021) [trial-2383↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5021)] [trial-2383↪gprs:trx-lms↪iperf3m4.py:8] 22:54:46.300159 tst iperf3m4.py:8: Test FAILED (10.7 sec) 22:54:46.329938 run osmo-hlr_10.42.42.2(pid=5018): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-lms↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5018)] 22:54:46.381606 run osmo-hlr_10.42.42.2(pid=5018): stdout: | (launched: 2022-12-12_22:54:43.077153) 22:54:46.434922 run osmo-hlr_10.42.42.2(pid=5018): stderr: | [0;m[1;31m20221212225443251 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212225443251 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212225443251 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212225443251 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212225443251 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212225443251 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212225443263 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-lms/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212225443271 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212225443271 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212225443271 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:54:46.489073 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5007): Terminating (SIGTERM) 22:54:46.532203 run iperf3-srv_10.42.42.10(pid=5008): Terminating (SIGTERM) 22:54:46.576578 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5009): Terminating (SIGTERM) 22:54:46.619008 run iperf3-srv_10.42.42.10(pid=5010): Terminating (SIGTERM) 22:54:46.665356 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5011): Terminating (SIGTERM) 22:54:46.715276 run iperf3-srv_10.42.42.10(pid=5012): Terminating (SIGTERM) 22:54:46.769181 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5013): Terminating (SIGTERM) 22:54:46.821396 run iperf3-srv_10.42.42.10(pid=5014): Terminating (SIGTERM) 22:54:46.875904 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5017): Terminating (SIGTERM) 22:54:46.925111 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5020): Terminating (SIGTERM) 22:54:46.975673 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5023): Terminating (SIGTERM) 22:54:47.020539 --- ParallelTerminationStrategy: PID 5007 died... 22:54:47.039919 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5007): Terminated: ok {rc=0} 22:54:47.086185 --- ParallelTerminationStrategy: PID 5008 died... 22:54:47.105422 run iperf3-srv_10.42.42.10(pid=5008): Terminated {rc=256} 22:54:47.151681 --- ParallelTerminationStrategy: PID 5009 died... 22:54:47.170953 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5009): Terminated: ok {rc=0} 22:54:47.217288 --- ParallelTerminationStrategy: PID 5010 died... 22:54:47.236211 run iperf3-srv_10.42.42.10(pid=5010): Terminated {rc=256} 22:54:47.282885 --- ParallelTerminationStrategy: PID 5011 died... 22:54:47.301443 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5011): Terminated: ok {rc=0} 22:54:47.345180 --- ParallelTerminationStrategy: PID 5012 died... 22:54:47.363426 run iperf3-srv_10.42.42.10(pid=5012): Terminated {rc=256} 22:54:47.407039 --- ParallelTerminationStrategy: PID 5013 died... 22:54:47.425418 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5013): Terminated: ok {rc=0} 22:54:47.469232 --- ParallelTerminationStrategy: PID 5014 died... 22:54:47.487582 run iperf3-srv_10.42.42.10(pid=5014): Terminated {rc=256} 22:54:47.531248 --- ParallelTerminationStrategy: PID 5017 died... 22:54:47.549692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5017): Terminated: ok {rc=0} 22:54:47.593972 --- ParallelTerminationStrategy: PID 5020 died... 22:54:47.612315 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5020): Terminated: ok {rc=0} 22:54:47.656258 --- ParallelTerminationStrategy: PID 5023 died... 22:54:47.674668 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5023): Terminated: ok {rc=0} 22:54:47.760111 bus /gobi_4: Setting Powered False 22:54:48.857309 bus /gobi_4: Setting Powered False 22:54:49.970791 bus /gobi_1: Setting Powered False 22:54:51.068187 bus /gobi_1: Setting Powered False 22:54:52.180458 bus /gobi_0: Setting Powered False 22:54:53.275876 bus /gobi_0: Setting Powered False 22:54:54.390881 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-lms ping.py ---------------------------------------------- 22:54:55.492464 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:54:55.503468 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 22:54:55.552135 tst ping.py: using LAC 32069 22:54:55.673452 tst ping.py: using RAC 194 22:54:55.798475 tst ping.py: using CellId 32069 22:54:55.921107 tst ping.py: using BVCI 32070 22:54:56.036295 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:54:56.047432 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:54:56.058555 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:54:56.069577 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:54:56.080300 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:54:56.091042 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:54:56.101924 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:54:56.112666 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 22:54:56.230379 tst ping.py:19: start network... 22:54:56.443908 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:54:56.935748 run create_hlr_db(pid=5026): Launched 22:54:57.064337 bus /gobi_6: Setting Powered False 22:54:58.127523 run create_hlr_db(pid=5026): Terminated: ok {rc=0} 22:54:58.569864 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5028): Launched 22:54:58.886828 run osmo-hlr_10.42.42.2(pid=5029): Launched 22:54:59.008588 run osmo-stp_10.42.42.5: Starting osmo-stp 22:54:59.556420 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5031): Launched 22:54:59.873960 run osmo-stp_10.42.42.5(pid=5032): Launched 22:54:59.994842 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:55:00.543679 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5034): Launched 22:55:00.665357 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:55:00.954443 run patchelf(pid=5035): Launched 22:55:01.144837 run osmo-stp_10.42.42.5(pid=5032): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5032)] 22:55:01.293162 run osmo-stp_10.42.42.5(pid=5032): stdout: | (launched: 2022-12-12_22:54:59.816458) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:55:01.427311 run osmo-stp_10.42.42.5(pid=5032): stderr: | [0;m[38;5;43m20221212225500008 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225500008 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225500008 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225500008 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225500009 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225500009 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225500009 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:55:01.563931 run osmo-stp_10.42.42.5(pid=5032): stdout: | (launched: 2022-12-12_22:54:59.816458) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:55:01.694683 run osmo-stp_10.42.42.5(pid=5032): stderr: | [0;m[38;5;43m20221212225500008 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225500008 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225500008 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225500008 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225500009 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225500009 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225500009 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:55:01.848193 run patchelf(pid=5035): Terminating (SIGINT) 22:55:02.027435 run patchelf(pid=5035): Terminated: ok {rc=0} 22:55:02.157448 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=5032): Process ended prematurely: osmo-stp_10.42.42.5(pid=5032) [trial-2383↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5032)] [trial-2383↪gprs:trx-lms↪ping.py:22] 22:55:02.167384 tst ping.py:22: Test FAILED (6.7 sec) 22:55:02.198135 run osmo-hlr_10.42.42.2(pid=5029): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-lms↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5029)] 22:55:02.248706 run osmo-hlr_10.42.42.2(pid=5029): stdout: | (launched: 2022-12-12_22:54:58.829342) 22:55:02.299228 run osmo-hlr_10.42.42.2(pid=5029): stderr: | [0;m[1;31m20221212225459025 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212225459026 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212225459026 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212225459026 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212225459026 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212225459026 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212225459038 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-lms/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212225459047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212225459047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212225459047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:55:02.350039 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5028): Terminating (SIGTERM) 22:55:02.390552 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5031): Terminating (SIGTERM) 22:55:02.431097 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5034): Terminating (SIGTERM) 22:55:02.471965 --- ParallelTerminationStrategy: PID 5028 died... 22:55:02.490678 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5028): Terminated: ok {rc=0} 22:55:02.536229 --- ParallelTerminationStrategy: PID 5031 died... 22:55:02.554784 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5031): Terminated: ok {rc=0} 22:55:02.600332 --- ParallelTerminationStrategy: PID 5034 died... 22:55:02.618984 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5034): Terminated: ok {rc=0} 22:55:02.705968 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-lms ping_idle_ping.py ---------------------------------------------- 22:55:03.794559 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:55:03.806201 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 22:55:03.858083 tst ping_idle_ping.py: using LAC 32070 22:55:03.978326 tst ping_idle_ping.py: using RAC 195 22:55:04.098692 tst ping_idle_ping.py: using CellId 32070 22:55:04.218237 tst ping_idle_ping.py: using BVCI 32071 22:55:04.327772 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:55:04.338277 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:55:04.348721 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:55:04.360002 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:55:04.371094 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:55:04.382278 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:55:04.393471 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 22:55:04.404670 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 22:55:04.526062 tst ping_idle_ping.py:24: start network... 22:55:04.742810 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:55:05.239826 run create_hlr_db(pid=5039): Launched 22:55:05.369819 bus /gobi_6: Setting Powered False 22:55:06.432892 run create_hlr_db(pid=5039): Terminated: ok {rc=0} 22:55:06.862221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5041): Launched 22:55:07.164801 run osmo-hlr_10.42.42.2(pid=5042): Launched 22:55:07.279771 run osmo-stp_10.42.42.5: Starting osmo-stp 22:55:07.805839 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5044): Launched 22:55:08.105378 run osmo-stp_10.42.42.5(pid=5045): Launched 22:55:08.220069 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:55:08.737292 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5047): Launched 22:55:08.852481 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:55:09.106447 run patchelf(pid=5048): Launched 22:55:09.273607 run osmo-stp_10.42.42.5(pid=5045): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5045)] 22:55:09.401284 run osmo-stp_10.42.42.5(pid=5045): stdout: | (launched: 2022-12-12_22:55:08.050460) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:55:09.529961 run osmo-stp_10.42.42.5(pid=5045): stderr: | [0;m[38;5;43m20221212225508221 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225508221 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225508221 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225508221 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225508222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225508222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225508222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:55:09.659246 run osmo-stp_10.42.42.5(pid=5045): stdout: | (launched: 2022-12-12_22:55:08.050460) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:55:09.782199 run osmo-stp_10.42.42.5(pid=5045): stderr: | [0;m[38;5;43m20221212225508221 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225508221 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225508221 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225508221 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225508222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225508222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225508222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:55:09.928089 run patchelf(pid=5048): Terminating (SIGINT) 22:55:10.098343 run patchelf(pid=5048): Terminated: ok {rc=0} 22:55:10.220850 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=5045): Process ended prematurely: osmo-stp_10.42.42.5(pid=5045) [trial-2383↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5045)] [trial-2383↪gprs:trx-lms↪ping_idle_ping.py:27] 22:55:10.229754 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 22:55:10.256532 run osmo-hlr_10.42.42.2(pid=5042): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-lms↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5042)] 22:55:10.304056 run osmo-hlr_10.42.42.2(pid=5042): stdout: | (launched: 2022-12-12_22:55:07.109837) 22:55:10.352938 run osmo-hlr_10.42.42.2(pid=5042): stderr: | [0;m[1;31m20221212225507284 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212225507284 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212225507285 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212225507285 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212225507285 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212225507285 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212225507300 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-lms/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212225507311 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212225507311 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212225507311 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:55:10.402534 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5041): Terminating (SIGTERM) 22:55:10.442103 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5044): Terminating (SIGTERM) 22:55:10.481422 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5047): Terminating (SIGTERM) 22:55:10.521502 --- ParallelTerminationStrategy: PID 5041 died... 22:55:10.540380 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5041): Terminated: ok {rc=0} 22:55:10.584619 --- ParallelTerminationStrategy: PID 5044 died... 22:55:10.603113 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5044): Terminated: ok {rc=0} 22:55:10.647392 --- ParallelTerminationStrategy: PID 5047 died... 22:55:10.665914 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5047): Terminated: ok {rc=0} 22:55:10.749124 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2383 gprs:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 gprs:trx-lms+mod-bts0-egprs --------------------------------------------------------------------- 22:55:12.053236 tst gprs:trx-lms+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:55:12.059521 tst gprs:trx-lms+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 22:55:12.094502 tst gprs:trx-lms+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 22:55:12.134092 tst gprs:trx-lms+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 22:55:12.223933 tst gprs:trx-lms+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 22:55:12.257074 tst gprs:trx-lms+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 22:55:12.295409 tst gprs:trx-lms+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 22:55:12.888852 tst gprs:trx-lms+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2383 gprs:trx-lms+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 22:55:12.940281 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:12.951317 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:55:13.001336 tst cs_paging_gprs_active.py: using LAC 32071 22:55:13.122229 tst cs_paging_gprs_active.py: using RAC 196 22:55:13.248762 tst cs_paging_gprs_active.py: using CellId 32071 22:55:13.369948 tst cs_paging_gprs_active.py: using BVCI 32072 22:55:13.484142 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:13.494968 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:13.505643 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:13.516598 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:13.527619 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:13.538665 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:13.549844 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:13.560899 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:13.572271 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:55:13.687673 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:55:13.807559 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:55:14.013918 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:55:14.321241 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5052): Launched 22:55:14.587668 run iperf3-srv_10.42.42.10(pid=5053): Launched 22:55:14.703018 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:55:14.909430 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:55:15.216697 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5054): Launched 22:55:15.483749 run iperf3-srv_10.42.42.10(pid=5055): Launched 22:55:15.598891 tst cs_paging_gprs_active.py:38: start network... 22:55:15.804219 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:55:16.306260 run create_hlr_db(pid=5056): Launched 22:55:16.493447 bus /gobi_6: Setting Powered False 22:55:17.554410 run create_hlr_db(pid=5056): Terminated: ok {rc=0} 22:55:17.998732 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5058): Launched 22:55:18.324788 run osmo-hlr_10.42.42.2(pid=5059): Launched 22:55:18.450048 run osmo-stp_10.42.42.5: Starting osmo-stp 22:55:19.009697 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5061): Launched 22:55:19.334485 run osmo-stp_10.42.42.5(pid=5062): Launched 22:55:19.458825 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:55:20.022948 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5064): Launched 22:55:20.147893 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:55:20.422666 run patchelf(pid=5065): Launched 22:55:20.604625 run osmo-stp_10.42.42.5(pid=5062): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5062)] 22:55:20.742633 run osmo-stp_10.42.42.5(pid=5062): stdout: | (launched: 2022-12-12_22:55:19.275879) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:55:20.882374 run osmo-stp_10.42.42.5(pid=5062): stderr: | [0;m[38;5;43m20221212225519470 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225519470 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225519470 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225519471 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225519471 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225519471 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225519471 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:55:21.021785 run osmo-stp_10.42.42.5(pid=5062): stdout: | (launched: 2022-12-12_22:55:19.275879) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:55:21.156120 run osmo-stp_10.42.42.5(pid=5062): stderr: | [0;m[38;5;43m20221212225519470 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225519470 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225519470 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225519471 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225519471 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225519471 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225519471 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:55:21.314472 run patchelf(pid=5065): Terminating (SIGINT) 22:55:21.498168 run patchelf(pid=5065): Terminated: ok {rc=0} 22:55:21.630677 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=5062): Process ended prematurely: osmo-stp_10.42.42.5(pid=5062) [trial-2383↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5062)] [trial-2383↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 22:55:21.640642 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 22:55:21.669148 run osmo-hlr_10.42.42.2(pid=5059): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5059)] 22:55:21.719818 run osmo-hlr_10.42.42.2(pid=5059): stdout: | (launched: 2022-12-12_22:55:18.265705) 22:55:21.771649 run osmo-hlr_10.42.42.2(pid=5059): stderr: | [0;m[1;31m20221212225518464 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212225518464 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212225518464 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212225518464 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212225518464 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212225518464 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212225518480 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-lms+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212225518490 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212225518490 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212225518490 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:55:21.823808 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5052): Terminating (SIGTERM) 22:55:21.865379 run iperf3-srv_10.42.42.10(pid=5053): Terminating (SIGTERM) 22:55:21.906940 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5054): Terminating (SIGTERM) 22:55:21.948637 run iperf3-srv_10.42.42.10(pid=5055): Terminating (SIGTERM) 22:55:21.990124 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5058): Terminating (SIGTERM) 22:55:22.031870 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5061): Terminating (SIGTERM) 22:55:22.073533 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5064): Terminating (SIGTERM) 22:55:22.115477 --- ParallelTerminationStrategy: PID 5052 died... 22:55:22.135492 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5052): Terminated: ok {rc=0} 22:55:22.181672 --- ParallelTerminationStrategy: PID 5053 died... 22:55:22.201232 run iperf3-srv_10.42.42.10(pid=5053): Terminated {rc=256} 22:55:22.246910 --- ParallelTerminationStrategy: PID 5054 died... 22:55:22.266306 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5054): Terminated: ok {rc=0} 22:55:22.311870 --- ParallelTerminationStrategy: PID 5055 died... 22:55:22.331154 run iperf3-srv_10.42.42.10(pid=5055): Terminated {rc=256} 22:55:22.376601 --- ParallelTerminationStrategy: PID 5058 died... 22:55:22.396072 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5058): Terminated: ok {rc=0} 22:55:22.441746 --- ParallelTerminationStrategy: PID 5061 died... 22:55:22.461457 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5061): Terminated: ok {rc=0} 22:55:22.507272 --- ParallelTerminationStrategy: PID 5064 died... 22:55:22.526845 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5064): Terminated: ok {rc=0} 22:55:22.614578 bus /gobi_0: Setting Powered False 22:55:23.712657 bus /gobi_0: Setting Powered False 22:55:24.826811 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-lms+mod-bts0-egprs iperf3.py ---------------------------------------------- 22:55:25.975796 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:25.987975 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:55:26.038547 tst iperf3.py: using LAC 32072 22:55:26.167961 tst iperf3.py: using RAC 197 22:55:26.296051 tst iperf3.py: using CellId 32072 22:55:26.425384 tst iperf3.py: using BVCI 32073 22:55:26.544018 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:26.555369 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:26.566468 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:26.577685 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:26.588719 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:26.599819 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:26.611139 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:26.622239 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:26.633576 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:55:26.749347 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:55:26.956399 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:55:27.263695 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5066): Launched 22:55:27.531891 run iperf3-srv_10.42.42.10(pid=5067): Launched 22:55:27.647146 tst iperf3.py:8: start network... 22:55:27.853373 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:55:28.325080 run create_hlr_db(pid=5068): Launched 22:55:28.441268 bus /gobi_6: Setting Powered False 22:55:29.501793 run create_hlr_db(pid=5068): Terminated: ok {rc=0} 22:55:29.946350 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5070): Launched 22:55:30.269454 run osmo-hlr_10.42.42.2(pid=5071): Launched 22:55:30.394583 run osmo-stp_10.42.42.5: Starting osmo-stp 22:55:30.986890 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5073): Launched 22:55:31.334131 run osmo-stp_10.42.42.5(pid=5074): Launched 22:55:31.597285 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:55:32.232762 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5076): Launched 22:55:32.358664 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:55:32.632895 run patchelf(pid=5077): Launched 22:55:32.814100 run osmo-stp_10.42.42.5(pid=5074): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5074)] 22:55:32.951525 run osmo-stp_10.42.42.5(pid=5074): stdout: | (launched: 2022-12-12_22:55:31.269259) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:55:33.090033 run osmo-stp_10.42.42.5(pid=5074): stderr: | [0;m[38;5;43m20221212225531499 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225531499 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225531499 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225531500 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225531504 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225531505 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225531505 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:55:33.228890 run osmo-stp_10.42.42.5(pid=5074): stdout: | (launched: 2022-12-12_22:55:31.269259) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:55:33.362256 run osmo-stp_10.42.42.5(pid=5074): stderr: | [0;m[38;5;43m20221212225531499 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225531499 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225531499 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225531500 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225531504 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225531505 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225531505 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:55:33.519806 run patchelf(pid=5077): Terminating (SIGINT) 22:55:33.703213 run patchelf(pid=5077): Terminated: ok {rc=0} 22:55:33.835110 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5074): Process ended prematurely: osmo-stp_10.42.42.5(pid=5074) [trial-2383↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5074)] [trial-2383↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8] 22:55:33.845170 tst iperf3.py:8: Test FAILED (7.9 sec) 22:55:33.873318 run osmo-hlr_10.42.42.2(pid=5071): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5071)] 22:55:33.922775 run osmo-hlr_10.42.42.2(pid=5071): stdout: | (launched: 2022-12-12_22:55:30.210642) 22:55:33.973851 run osmo-hlr_10.42.42.2(pid=5071): stderr: | [0;m[1;31m20221212225530411 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212225530411 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212225530411 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212225530411 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212225530411 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212225530411 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212225530423 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-lms+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212225530433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212225530433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212225530433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:55:34.025367 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5066): Terminating (SIGTERM) 22:55:34.066625 run iperf3-srv_10.42.42.10(pid=5067): Terminating (SIGTERM) 22:55:34.107900 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5070): Terminating (SIGTERM) 22:55:34.149313 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5073): Terminating (SIGTERM) 22:55:34.190632 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5076): Terminating (SIGTERM) 22:55:34.232062 --- ParallelTerminationStrategy: PID 5066 died... 22:55:34.251900 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5066): Terminated: ok {rc=0} 22:55:34.297591 --- ParallelTerminationStrategy: PID 5067 died... 22:55:34.316637 run iperf3-srv_10.42.42.10(pid=5067): Terminated {rc=256} 22:55:34.362228 --- ParallelTerminationStrategy: PID 5070 died... 22:55:34.381606 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5070): Terminated: ok {rc=0} 22:55:34.426873 --- ParallelTerminationStrategy: PID 5073 died... 22:55:34.446339 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5073): Terminated: ok {rc=0} 22:55:34.491944 --- ParallelTerminationStrategy: PID 5076 died... 22:55:34.511399 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5076): Terminated: ok {rc=0} 22:55:34.598768 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-lms+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 22:55:35.749164 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:35.761099 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:55:35.813261 tst iperf3m4.py: using LAC 32073 22:55:35.945772 tst iperf3m4.py: using RAC 198 22:55:36.072555 tst iperf3m4.py: using CellId 32073 22:55:36.194101 tst iperf3m4.py: using BVCI 32074 22:55:36.308092 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:36.319091 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:36.329910 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:36.341418 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:36.352717 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:36.364043 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:36.375566 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:36.386890 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:36.398400 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:55:36.520237 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:55:36.640315 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:55:36.756547 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:55:36.878212 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:55:37.098758 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:55:37.425894 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5078): Launched 22:55:37.709301 run iperf3-srv_10.42.42.10(pid=5079): Launched 22:55:37.832404 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:55:38.052002 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:55:38.377963 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5080): Launched 22:55:38.660292 run iperf3-srv_10.42.42.10(pid=5081): Launched 22:55:38.783084 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:55:39.002205 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:55:39.328625 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5082): Launched 22:55:39.613112 run iperf3-srv_10.42.42.10(pid=5083): Launched 22:55:39.735497 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:55:39.954825 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:55:40.280781 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5084): Launched 22:55:40.563440 run iperf3-srv_10.42.42.10(pid=5085): Launched 22:55:40.685545 tst iperf3m4.py:8: start network... 22:55:40.905087 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:55:41.411472 run create_hlr_db(pid=5086): Launched 22:55:41.543741 bus /gobi_6: Setting Powered False 22:55:42.608228 run create_hlr_db(pid=5086): Terminated: ok {rc=0} 22:55:43.042147 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5088): Launched 22:55:43.346843 run osmo-hlr_10.42.42.2(pid=5089): Launched 22:55:43.463772 run osmo-stp_10.42.42.5: Starting osmo-stp 22:55:44.003486 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5091): Launched 22:55:44.308248 run osmo-stp_10.42.42.5(pid=5092): Launched 22:55:44.425654 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:55:44.951957 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5094): Launched 22:55:45.068571 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:55:45.325943 run patchelf(pid=5095): Launched 22:55:45.495990 run osmo-stp_10.42.42.5(pid=5092): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5092)] 22:55:45.625131 run osmo-stp_10.42.42.5(pid=5092): stdout: | (launched: 2022-12-12_22:55:44.252434) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:55:45.755167 run osmo-stp_10.42.42.5(pid=5092): stderr: | [0;m[38;5;43m20221212225544423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225544423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225544424 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225544424 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225544425 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225544425 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225544425 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:55:45.927844 run osmo-stp_10.42.42.5(pid=5092): stdout: | (launched: 2022-12-12_22:55:44.252434) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:55:46.065908 run osmo-stp_10.42.42.5(pid=5092): stderr: | [0;m[38;5;43m20221212225544423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225544423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225544424 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225544424 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225544425 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225544425 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225544425 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:55:46.229188 run patchelf(pid=5095): Terminating (SIGINT) 22:55:46.418541 run patchelf(pid=5095): Terminated: ok {rc=0} 22:55:46.554809 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5092): Process ended prematurely: osmo-stp_10.42.42.5(pid=5092) [trial-2383↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5092)] [trial-2383↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8] 22:55:46.565968 tst iperf3m4.py:8: Test FAILED (10.9 sec) 22:55:46.595777 run osmo-hlr_10.42.42.2(pid=5089): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5089)] 22:55:46.646805 run osmo-hlr_10.42.42.2(pid=5089): stdout: | (launched: 2022-12-12_22:55:43.290976) 22:55:46.701235 run osmo-hlr_10.42.42.2(pid=5089): stderr: | [0;m[1;31m20221212225543469 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212225543469 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212225543469 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212225543469 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212225543469 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212225543469 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212225543482 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-lms+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212225543492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212225543493 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212225543493 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:55:46.754365 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5078): Terminating (SIGTERM) 22:55:46.797741 run iperf3-srv_10.42.42.10(pid=5079): Terminating (SIGTERM) 22:55:46.841902 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5080): Terminating (SIGTERM) 22:55:46.886973 run iperf3-srv_10.42.42.10(pid=5081): Terminating (SIGTERM) 22:55:46.932476 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5082): Terminating (SIGTERM) 22:55:46.975493 run iperf3-srv_10.42.42.10(pid=5083): Terminating (SIGTERM) 22:55:47.018263 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5084): Terminating (SIGTERM) 22:55:47.060771 run iperf3-srv_10.42.42.10(pid=5085): Terminating (SIGTERM) 22:55:47.104811 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5088): Terminating (SIGTERM) 22:55:47.147675 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5091): Terminating (SIGTERM) 22:55:47.190274 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5094): Terminating (SIGTERM) 22:55:47.232410 --- ParallelTerminationStrategy: PID 5078 died... 22:55:47.252092 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5078): Terminated: ok {rc=0} 22:55:47.297892 --- ParallelTerminationStrategy: PID 5079 died... 22:55:47.317460 run iperf3-srv_10.42.42.10(pid=5079): Terminated {rc=256} 22:55:47.363434 --- ParallelTerminationStrategy: PID 5080 died... 22:55:47.383091 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5080): Terminated: ok {rc=0} 22:55:47.428655 --- ParallelTerminationStrategy: PID 5081 died... 22:55:47.448290 run iperf3-srv_10.42.42.10(pid=5081): Terminated {rc=256} 22:55:47.494140 --- ParallelTerminationStrategy: PID 5082 died... 22:55:47.514084 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5082): Terminated: ok {rc=0} 22:55:47.559823 --- ParallelTerminationStrategy: PID 5083 died... 22:55:47.579287 run iperf3-srv_10.42.42.10(pid=5083): Terminated {rc=256} 22:55:47.624768 --- ParallelTerminationStrategy: PID 5084 died... 22:55:47.644120 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5084): Terminated: ok {rc=0} 22:55:47.689817 --- ParallelTerminationStrategy: PID 5085 died... 22:55:47.709465 run iperf3-srv_10.42.42.10(pid=5085): Terminated {rc=256} 22:55:47.755432 --- ParallelTerminationStrategy: PID 5088 died... 22:55:47.775217 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5088): Terminated: ok {rc=0} 22:55:47.820869 --- ParallelTerminationStrategy: PID 5091 died... 22:55:47.840724 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5091): Terminated: ok {rc=0} 22:55:47.887145 --- ParallelTerminationStrategy: PID 5094 died... 22:55:47.907930 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5094): Terminated: ok {rc=0} 22:55:47.995049 bus /gobi_4: Setting Powered False 22:55:49.091136 bus /gobi_4: Setting Powered False 22:55:50.206705 bus /gobi_1: Setting Powered False 22:55:51.307215 bus /gobi_1: Setting Powered False 22:55:52.425133 bus /gobi_0: Setting Powered False 22:55:53.521806 bus /gobi_0: Setting Powered False 22:55:54.635976 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-lms+mod-bts0-egprs ping.py ---------------------------------------------- 22:55:55.737110 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:55.748348 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:55:55.801197 tst ping.py: using LAC 32074 22:55:55.919838 tst ping.py: using RAC 199 22:55:56.040872 tst ping.py: using CellId 32074 22:55:56.158887 tst ping.py: using BVCI 32075 22:55:56.267683 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:56.278544 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:56.289135 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:56.299963 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:56.310894 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:56.321770 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:56.332703 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:55:56.343624 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:55:56.458133 tst ping.py:19: start network... 22:55:56.659710 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:55:57.122628 run create_hlr_db(pid=5096): Launched 22:55:57.237233 bus /gobi_6: Setting Powered False 22:55:58.297481 run create_hlr_db(pid=5096): Terminated: ok {rc=0} 22:55:58.713446 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5098): Launched 22:55:59.014000 run osmo-hlr_10.42.42.2(pid=5099): Launched 22:55:59.128472 run osmo-stp_10.42.42.5: Starting osmo-stp 22:55:59.649051 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5101): Launched 22:55:59.968490 run osmo-stp_10.42.42.5(pid=5102): Launched 22:56:00.089859 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:56:00.637946 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5104): Launched 22:56:00.759734 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:56:01.052402 run patchelf(pid=5105): Launched 22:56:01.240861 run osmo-stp_10.42.42.5(pid=5102): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5102)] 22:56:01.378933 run osmo-stp_10.42.42.5(pid=5102): stdout: | (launched: 2022-12-12_22:55:59.911029) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:56:01.518660 run osmo-stp_10.42.42.5(pid=5102): stderr: | [0;m[38;5;43m20221212225600100 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225600101 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225600101 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225600101 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225600102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225600102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225600102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:56:01.658232 run osmo-stp_10.42.42.5(pid=5102): stdout: | (launched: 2022-12-12_22:55:59.911029) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:56:01.791723 run osmo-stp_10.42.42.5(pid=5102): stderr: | [0;m[38;5;43m20221212225600100 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225600101 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225600101 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225600101 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225600102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225600102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225600102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:56:01.951920 run patchelf(pid=5105): Terminating (SIGINT) 22:56:02.134965 run patchelf(pid=5105): Terminated: ok {rc=0} 22:56:02.265588 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=5102): Process ended prematurely: osmo-stp_10.42.42.5(pid=5102) [trial-2383↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5102)] [trial-2383↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22] 22:56:02.275282 tst ping.py:22: Test FAILED (6.5 sec) 22:56:02.303318 run osmo-hlr_10.42.42.2(pid=5099): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-lms+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5099)] 22:56:02.353139 run osmo-hlr_10.42.42.2(pid=5099): stdout: | (launched: 2022-12-12_22:55:58.959051) 22:56:02.404570 run osmo-hlr_10.42.42.2(pid=5099): stderr: | [0;m[1;31m20221212225559136 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212225559137 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212225559137 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212225559137 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212225559137 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212225559137 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212225559149 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-lms+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212225559157 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212225559157 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212225559158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:56:02.456296 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5098): Terminating (SIGTERM) 22:56:02.497599 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5101): Terminating (SIGTERM) 22:56:02.539130 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5104): Terminating (SIGTERM) 22:56:02.581080 --- ParallelTerminationStrategy: PID 5098 died... 22:56:02.600791 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5098): Terminated: ok {rc=0} 22:56:02.646568 --- ParallelTerminationStrategy: PID 5101 died... 22:56:02.666172 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5101): Terminated: ok {rc=0} 22:56:02.711628 --- ParallelTerminationStrategy: PID 5104 died... 22:56:02.731350 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5104): Terminated: ok {rc=0} 22:56:02.818280 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-lms+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 22:56:03.905854 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:56:03.918441 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 22:56:03.972690 tst ping_idle_ping.py: using LAC 32075 22:56:04.099033 tst ping_idle_ping.py: using RAC 200 22:56:04.227658 tst ping_idle_ping.py: using CellId 32075 22:56:04.354584 tst ping_idle_ping.py: using BVCI 32076 22:56:04.472011 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:56:04.483493 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:56:04.494682 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:56:04.506502 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:56:04.517876 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:56:04.529245 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:56:04.540638 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 22:56:04.551994 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 22:56:04.670777 tst ping_idle_ping.py:24: start network... 22:56:04.873219 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:56:05.339055 run create_hlr_db(pid=5106): Launched 22:56:05.454826 bus /gobi_6: Setting Powered False 22:56:06.514927 run create_hlr_db(pid=5106): Terminated: ok {rc=0} 22:56:06.954796 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5108): Launched 22:56:07.275739 run osmo-hlr_10.42.42.2(pid=5109): Launched 22:56:07.398836 run osmo-stp_10.42.42.5: Starting osmo-stp 22:56:07.951283 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5111): Launched 22:56:08.271738 run osmo-stp_10.42.42.5(pid=5112): Launched 22:56:08.394611 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:56:08.948439 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5114): Launched 22:56:09.071241 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:56:09.341432 run patchelf(pid=5115): Launched 22:56:09.519818 run osmo-stp_10.42.42.5(pid=5112): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5112)] 22:56:09.656934 run osmo-stp_10.42.42.5(pid=5112): stdout: | (launched: 2022-12-12_22:56:08.213713) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:56:09.795396 run osmo-stp_10.42.42.5(pid=5112): stderr: | [0;m[38;5;43m20221212225608406 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225608406 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225608406 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225608406 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225608409 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225608409 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225608409 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:56:09.933323 run osmo-stp_10.42.42.5(pid=5112): stdout: | (launched: 2022-12-12_22:56:08.213713) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:56:10.065271 run osmo-stp_10.42.42.5(pid=5112): stderr: | [0;m[38;5;43m20221212225608406 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225608406 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225608406 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225608406 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225608409 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225608409 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225608409 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:56:10.221612 run patchelf(pid=5115): Terminating (SIGINT) 22:56:10.403515 run patchelf(pid=5115): Terminated: ok {rc=0} 22:56:10.534502 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=5112): Process ended prematurely: osmo-stp_10.42.42.5(pid=5112) [trial-2383↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5112)] [trial-2383↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27] 22:56:10.543918 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 22:56:10.571867 run osmo-hlr_10.42.42.2(pid=5109): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5109)] 22:56:10.621699 run osmo-hlr_10.42.42.2(pid=5109): stdout: | (launched: 2022-12-12_22:56:07.217799) 22:56:10.673356 run osmo-hlr_10.42.42.2(pid=5109): stderr: | [0;m[1;31m20221212225607414 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212225607414 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212225607414 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212225607415 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212225607415 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212225607415 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212225607427 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-lms+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212225607435 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212225607435 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212225607435 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:56:10.725368 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5108): Terminating (SIGTERM) 22:56:10.767419 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5111): Terminating (SIGTERM) 22:56:10.809406 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5114): Terminating (SIGTERM) 22:56:10.851414 --- ParallelTerminationStrategy: PID 5108 died... 22:56:10.871437 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5108): Terminated: ok {rc=0} 22:56:10.917630 --- ParallelTerminationStrategy: PID 5111 died... 22:56:10.937180 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5111): Terminated: ok {rc=0} 22:56:10.983896 --- ParallelTerminationStrategy: PID 5114 died... 22:56:11.003655 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5114): Terminated: ok {rc=0} 22:56:11.090946 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2383 gprs:trx-lms+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 gprs:trx-lms+mod-bts0-dynts-ipa --------------------------------------------------------------------- 22:56:12.393418 tst gprs:trx-lms+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:56:12.399387 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 22:56:12.432736 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 22:56:12.471182 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 22:56:12.556486 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 22:56:12.589920 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 22:56:12.628072 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 22:56:13.218921 tst gprs:trx-lms+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2383 gprs:trx-lms+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 22:56:13.269191 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:13.279965 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:56:13.348523 tst cs_paging_gprs_active.py: using LAC 32076 22:56:13.469414 tst cs_paging_gprs_active.py: using RAC 201 22:56:13.595914 tst cs_paging_gprs_active.py: using CellId 32076 22:56:13.718134 tst cs_paging_gprs_active.py: using BVCI 32077 22:56:13.832311 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:13.843173 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:13.853852 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:13.864653 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:13.875482 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:13.886411 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:13.897570 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:13.908332 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:13.919347 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:56:14.039722 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:56:14.156010 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:56:14.361687 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:56:14.668330 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5120): Launched 22:56:14.935579 run iperf3-srv_10.42.42.10(pid=5121): Launched 22:56:15.050337 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:56:15.255571 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:56:15.562061 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5122): Launched 22:56:15.832342 run iperf3-srv_10.42.42.10(pid=5123): Launched 22:56:15.981736 tst cs_paging_gprs_active.py:38: start network... 22:56:16.207377 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:56:16.761693 run create_hlr_db(pid=5124): Launched 22:56:16.915899 bus /gobi_6: Setting Powered False 22:56:17.979547 run create_hlr_db(pid=5124): Terminated: ok {rc=0} 22:56:18.443471 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5126): Launched 22:56:18.748217 run osmo-hlr_10.42.42.2(pid=5127): Launched 22:56:18.864329 run osmo-stp_10.42.42.5: Starting osmo-stp 22:56:19.400711 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5129): Launched 22:56:19.705453 run osmo-stp_10.42.42.5(pid=5130): Launched 22:56:19.822753 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:56:20.352312 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5132): Launched 22:56:20.478271 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:56:20.760102 run patchelf(pid=5133): Launched 22:56:20.941719 run osmo-stp_10.42.42.5(pid=5130): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5130)] 22:56:21.079196 run osmo-stp_10.42.42.5(pid=5130): stdout: | (launched: 2022-12-12_22:56:19.649849) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:56:21.219216 run osmo-stp_10.42.42.5(pid=5130): stderr: | [0;m[38;5;43m20221212225619819 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225619819 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225619819 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225619820 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225619822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225619822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225619822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:56:21.358841 run osmo-stp_10.42.42.5(pid=5130): stdout: | (launched: 2022-12-12_22:56:19.649849) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:56:21.492372 run osmo-stp_10.42.42.5(pid=5130): stderr: | [0;m[38;5;43m20221212225619819 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225619819 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225619819 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225619820 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225619822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225619822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225619822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:56:21.651843 run patchelf(pid=5133): Terminating (SIGINT) 22:56:21.835968 run patchelf(pid=5133): Terminated: ok {rc=0} 22:56:21.968325 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=5130): Process ended prematurely: osmo-stp_10.42.42.5(pid=5130) [trial-2383↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5130)] [trial-2383↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 22:56:21.978478 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 22:56:22.006828 run osmo-hlr_10.42.42.2(pid=5127): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5127)] 22:56:22.056425 run osmo-hlr_10.42.42.2(pid=5127): stdout: | (launched: 2022-12-12_22:56:18.692315) 22:56:22.107688 run osmo-hlr_10.42.42.2(pid=5127): stderr: | [0;m[1;31m20221212225618870 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212225618870 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212225618870 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212225618870 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212225618871 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212225618871 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212225618884 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-lms+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212225618893 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212225618893 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212225618893 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:56:22.159455 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5120): Terminating (SIGTERM) 22:56:22.201215 run iperf3-srv_10.42.42.10(pid=5121): Terminating (SIGTERM) 22:56:22.243153 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5122): Terminating (SIGTERM) 22:56:22.285033 run iperf3-srv_10.42.42.10(pid=5123): Terminating (SIGTERM) 22:56:22.327106 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5126): Terminating (SIGTERM) 22:56:22.368905 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5129): Terminating (SIGTERM) 22:56:22.410707 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5132): Terminating (SIGTERM) 22:56:22.452883 --- ParallelTerminationStrategy: PID 5120 died... 22:56:22.473052 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5120): Terminated: ok {rc=0} 22:56:22.519222 --- ParallelTerminationStrategy: PID 5121 died... 22:56:22.538806 run iperf3-srv_10.42.42.10(pid=5121): Terminated {rc=256} 22:56:22.585399 --- ParallelTerminationStrategy: PID 5122 died... 22:56:22.604699 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5122): Terminated: ok {rc=0} 22:56:22.650390 --- ParallelTerminationStrategy: PID 5123 died... 22:56:22.669842 run iperf3-srv_10.42.42.10(pid=5123): Terminated {rc=256} 22:56:22.715376 --- ParallelTerminationStrategy: PID 5126 died... 22:56:22.734840 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5126): Terminated: ok {rc=0} 22:56:22.780583 --- ParallelTerminationStrategy: PID 5129 died... 22:56:22.800190 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5129): Terminated: ok {rc=0} 22:56:22.845754 --- ParallelTerminationStrategy: PID 5132 died... 22:56:22.865224 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5132): Terminated: ok {rc=0} 22:56:22.951471 bus /gobi_0: Setting Powered False 22:56:24.049382 bus /gobi_0: Setting Powered False 22:56:25.163934 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-lms+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 22:56:26.309499 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:26.320939 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:56:26.393679 tst iperf3.py: using LAC 32077 22:56:26.513552 tst iperf3.py: using RAC 202 22:56:26.632799 tst iperf3.py: using CellId 32077 22:56:26.751780 tst iperf3.py: using BVCI 32078 22:56:26.863532 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:26.874434 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:26.884942 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:26.895833 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:26.906840 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:26.917824 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:26.928831 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:26.939597 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:26.950789 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:56:27.068797 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:56:27.288840 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:56:27.616120 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5135): Launched 22:56:27.901309 run iperf3-srv_10.42.42.10(pid=5136): Launched 22:56:28.023310 tst iperf3.py:8: start network... 22:56:28.242507 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:56:28.745464 run create_hlr_db(pid=5137): Launched 22:56:28.879013 bus /gobi_6: Setting Powered False 22:56:29.942896 run create_hlr_db(pid=5137): Terminated: ok {rc=0} 22:56:30.394807 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5139): Launched 22:56:30.719446 run osmo-hlr_10.42.42.2(pid=5140): Launched 22:56:30.856907 run osmo-stp_10.42.42.5: Starting osmo-stp 22:56:31.505568 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5142): Launched 22:56:31.851705 run osmo-stp_10.42.42.5(pid=5143): Launched 22:56:32.152610 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:56:32.718457 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5145): Launched 22:56:32.842641 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:56:33.116755 run patchelf(pid=5146): Launched 22:56:33.297404 run osmo-stp_10.42.42.5(pid=5143): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5143)] 22:56:33.435091 run osmo-stp_10.42.42.5(pid=5143): stdout: | (launched: 2022-12-12_22:56:31.786759) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:56:33.573957 run osmo-stp_10.42.42.5(pid=5143): stderr: | [0;m[38;5;43m20221212225632035 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225632035 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225632036 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225632036 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225632038 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225632038 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225632038 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:56:33.712920 run osmo-stp_10.42.42.5(pid=5143): stdout: | (launched: 2022-12-12_22:56:31.786759) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:56:33.847161 run osmo-stp_10.42.42.5(pid=5143): stderr: | [0;m[38;5;43m20221212225632035 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225632035 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225632036 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225632036 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225632038 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225632038 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225632038 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:56:34.004890 run patchelf(pid=5146): Terminating (SIGINT) 22:56:34.188362 run patchelf(pid=5146): Terminated: ok {rc=0} 22:56:34.320147 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5143): Process ended prematurely: osmo-stp_10.42.42.5(pid=5143) [trial-2383↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5143)] [trial-2383↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8] 22:56:34.330206 tst iperf3.py:8: Test FAILED (8.1 sec) 22:56:34.358733 run osmo-hlr_10.42.42.2(pid=5140): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5140)] 22:56:34.408223 run osmo-hlr_10.42.42.2(pid=5140): stdout: | (launched: 2022-12-12_22:56:30.660270) 22:56:34.459348 run osmo-hlr_10.42.42.2(pid=5140): stderr: | [0;m[1;31m20221212225630902 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212225630902 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212225630902 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212225630902 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212225630902 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212225630902 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212225630923 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212225630931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212225630932 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212225630932 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:56:34.510708 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5135): Terminating (SIGTERM) 22:56:34.551978 run iperf3-srv_10.42.42.10(pid=5136): Terminating (SIGTERM) 22:56:34.593306 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5139): Terminating (SIGTERM) 22:56:34.634712 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5142): Terminating (SIGTERM) 22:56:34.676189 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5145): Terminating (SIGTERM) 22:56:34.717946 --- ParallelTerminationStrategy: PID 5135 died... 22:56:34.737971 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5135): Terminated: ok {rc=0} 22:56:34.784249 --- ParallelTerminationStrategy: PID 5136 died... 22:56:34.803884 run iperf3-srv_10.42.42.10(pid=5136): Terminated {rc=256} 22:56:34.849409 --- ParallelTerminationStrategy: PID 5139 died... 22:56:34.868822 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5139): Terminated: ok {rc=0} 22:56:34.915015 --- ParallelTerminationStrategy: PID 5142 died... 22:56:34.934567 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5142): Terminated: ok {rc=0} 22:56:34.981060 --- ParallelTerminationStrategy: PID 5145 died... 22:56:35.000653 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5145): Terminated: ok {rc=0} 22:56:35.087448 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-lms+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 22:56:36.237704 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:36.249805 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:56:36.321623 tst iperf3m4.py: using LAC 32078 22:56:36.450562 tst iperf3m4.py: using RAC 203 22:56:36.579566 tst iperf3m4.py: using CellId 32078 22:56:36.708720 tst iperf3m4.py: using BVCI 32079 22:56:36.823028 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:36.834123 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:36.844818 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:36.855923 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:36.866799 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:36.878026 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:36.889291 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:36.899983 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:36.914281 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:56:37.034989 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:56:37.157718 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:56:37.275780 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:56:37.395017 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:56:37.615365 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:56:37.943073 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5147): Launched 22:56:38.225551 run iperf3-srv_10.42.42.10(pid=5148): Launched 22:56:38.347836 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:56:38.568611 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:56:38.896852 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5149): Launched 22:56:39.178061 run iperf3-srv_10.42.42.10(pid=5150): Launched 22:56:39.299632 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:56:39.518476 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:56:39.845138 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5151): Launched 22:56:40.127001 run iperf3-srv_10.42.42.10(pid=5152): Launched 22:56:40.248795 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:56:40.468020 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:56:40.794013 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5153): Launched 22:56:41.076023 run iperf3-srv_10.42.42.10(pid=5154): Launched 22:56:41.197677 tst iperf3m4.py:8: start network... 22:56:41.416481 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:56:41.922627 run create_hlr_db(pid=5155): Launched 22:56:42.053814 bus /gobi_6: Setting Powered False 22:56:43.117901 run create_hlr_db(pid=5155): Terminated: ok {rc=0} 22:56:43.551336 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5157): Launched 22:56:43.856524 run osmo-hlr_10.42.42.2(pid=5158): Launched 22:56:43.973525 run osmo-stp_10.42.42.5: Starting osmo-stp 22:56:44.515336 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5160): Launched 22:56:44.819832 run osmo-stp_10.42.42.5(pid=5161): Launched 22:56:44.937060 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:56:45.462499 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5163): Launched 22:56:45.579434 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:56:45.849264 run patchelf(pid=5164): Launched 22:56:46.035027 run osmo-stp_10.42.42.5(pid=5161): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5161)] 22:56:46.167082 run osmo-stp_10.42.42.5(pid=5161): stdout: | (launched: 2022-12-12_22:56:44.763461) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:56:46.301207 run osmo-stp_10.42.42.5(pid=5161): stderr: | [0;m[38;5;43m20221212225644936 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225644936 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225644937 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225644937 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225644937 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225644937 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225644938 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:56:46.436079 run osmo-stp_10.42.42.5(pid=5161): stdout: | (launched: 2022-12-12_22:56:44.763461) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:56:46.564703 run osmo-stp_10.42.42.5(pid=5161): stderr: | [0;m[38;5;43m20221212225644936 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225644936 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225644937 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225644937 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225644937 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225644937 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225644938 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:56:46.717658 run patchelf(pid=5164): Terminating (SIGINT) 22:56:46.895037 run patchelf(pid=5164): Terminated: ok {rc=0} 22:56:47.023110 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5161): Process ended prematurely: osmo-stp_10.42.42.5(pid=5161) [trial-2383↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5161)] [trial-2383↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8] 22:56:47.033680 tst iperf3m4.py:8: Test FAILED (10.8 sec) 22:56:47.064547 run osmo-hlr_10.42.42.2(pid=5158): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5158)] 22:56:47.114460 run osmo-hlr_10.42.42.2(pid=5158): stdout: | (launched: 2022-12-12_22:56:43.800427) 22:56:47.165649 run osmo-hlr_10.42.42.2(pid=5158): stderr: | [0;m[1;31m20221212225643982 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212225643982 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212225643982 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212225643982 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212225643982 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212225643982 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212225643994 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212225644003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212225644003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212225644004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:56:47.217435 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5147): Terminating (SIGTERM) 22:56:47.257774 run iperf3-srv_10.42.42.10(pid=5148): Terminating (SIGTERM) 22:56:47.298259 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5149): Terminating (SIGTERM) 22:56:47.338929 run iperf3-srv_10.42.42.10(pid=5150): Terminating (SIGTERM) 22:56:47.379255 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5151): Terminating (SIGTERM) 22:56:47.419845 run iperf3-srv_10.42.42.10(pid=5152): Terminating (SIGTERM) 22:56:47.460182 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5153): Terminating (SIGTERM) 22:56:47.501277 run iperf3-srv_10.42.42.10(pid=5154): Terminating (SIGTERM) 22:56:47.541906 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5157): Terminating (SIGTERM) 22:56:47.582451 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5160): Terminating (SIGTERM) 22:56:47.622908 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5163): Terminating (SIGTERM) 22:56:47.663785 --- ParallelTerminationStrategy: PID 5147 died... 22:56:47.682904 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5147): Terminated: ok {rc=0} 22:56:47.728231 --- ParallelTerminationStrategy: PID 5148 died... 22:56:47.746800 run iperf3-srv_10.42.42.10(pid=5148): Terminated {rc=256} 22:56:47.792146 --- ParallelTerminationStrategy: PID 5149 died... 22:56:47.810877 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5149): Terminated: ok {rc=0} 22:56:47.856301 --- ParallelTerminationStrategy: PID 5150 died... 22:56:47.874887 run iperf3-srv_10.42.42.10(pid=5150): Terminated {rc=256} 22:56:47.920104 --- ParallelTerminationStrategy: PID 5151 died... 22:56:47.938593 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5151): Terminated: ok {rc=0} 22:56:47.983905 --- ParallelTerminationStrategy: PID 5152 died... 22:56:48.002405 run iperf3-srv_10.42.42.10(pid=5152): Terminated {rc=256} 22:56:48.047545 --- ParallelTerminationStrategy: PID 5153 died... 22:56:48.066046 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5153): Terminated: ok {rc=0} 22:56:48.111235 --- ParallelTerminationStrategy: PID 5154 died... 22:56:48.129808 run iperf3-srv_10.42.42.10(pid=5154): Terminated {rc=256} 22:56:48.174831 --- ParallelTerminationStrategy: PID 5157 died... 22:56:48.193317 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5157): Terminated: ok {rc=0} 22:56:48.237630 --- ParallelTerminationStrategy: PID 5160 died... 22:56:48.256856 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5160): Terminated: ok {rc=0} 22:56:48.301999 --- ParallelTerminationStrategy: PID 5163 died... 22:56:48.320588 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5163): Terminated: ok {rc=0} 22:56:48.407355 bus /gobi_4: Setting Powered False 22:56:49.506926 bus /gobi_4: Setting Powered False 22:56:50.623540 bus /gobi_1: Setting Powered False 22:56:51.721655 bus /gobi_1: Setting Powered False 22:56:52.835750 bus /gobi_0: Setting Powered False 22:56:53.934061 bus /gobi_0: Setting Powered False 22:56:55.051838 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-lms+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 22:56:56.154475 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:56.165914 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:56:56.238286 tst ping.py: using LAC 32079 22:56:56.357181 tst ping.py: using RAC 204 22:56:56.473837 tst ping.py: using CellId 32079 22:56:56.589972 tst ping.py: using BVCI 32080 22:56:56.701122 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:56.712266 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:56.722885 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:56.733879 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:56.744629 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:56.755582 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:56.766640 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:56:56.777688 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:56:56.892538 tst ping.py:19: start network... 22:56:57.092763 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:56:57.555471 run create_hlr_db(pid=5165): Launched 22:56:57.669305 bus /gobi_6: Setting Powered False 22:56:58.729617 run create_hlr_db(pid=5165): Terminated: ok {rc=0} 22:56:59.165662 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5167): Launched 22:56:59.484718 run osmo-hlr_10.42.42.2(pid=5168): Launched 22:56:59.610070 run osmo-stp_10.42.42.5: Starting osmo-stp 22:57:00.162308 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5170): Launched 22:57:00.480408 run osmo-stp_10.42.42.5(pid=5171): Launched 22:57:00.602937 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:57:01.197127 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5173): Launched 22:57:01.331040 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:57:01.610543 run patchelf(pid=5174): Launched 22:57:01.804014 run osmo-stp_10.42.42.5(pid=5171): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5171)] 22:57:01.939617 run osmo-stp_10.42.42.5(pid=5171): stdout: | (launched: 2022-12-12_22:57:00.422271) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:57:02.072586 run osmo-stp_10.42.42.5(pid=5171): stderr: | [0;m[38;5;43m20221212225700617 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225700617 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225700617 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225700617 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225700618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225700618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225700618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:57:02.205951 run osmo-stp_10.42.42.5(pid=5171): stdout: | (launched: 2022-12-12_22:57:00.422271) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:57:02.329738 run osmo-stp_10.42.42.5(pid=5171): stderr: | [0;m[38;5;43m20221212225700617 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225700617 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225700617 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225700617 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225700618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225700618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225700618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:57:02.475118 run patchelf(pid=5174): Terminating (SIGINT) 22:57:02.645440 run patchelf(pid=5174): Terminated: ok {rc=0} 22:57:02.768639 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=5171): Process ended prematurely: osmo-stp_10.42.42.5(pid=5171) [trial-2383↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5171)] [trial-2383↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22] 22:57:02.777839 tst ping.py:22: Test FAILED (6.6 sec) 22:57:02.805264 run osmo-hlr_10.42.42.2(pid=5168): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5168)] 22:57:02.853652 run osmo-hlr_10.42.42.2(pid=5168): stdout: | (launched: 2022-12-12_22:56:59.426851) 22:57:02.903672 run osmo-hlr_10.42.42.2(pid=5168): stderr: | [0;m[1;31m20221212225659625 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212225659625 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212225659625 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212225659625 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212225659625 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212225659626 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212225659638 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-lms+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212225659646 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212225659646 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212225659646 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:57:02.954097 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5167): Terminating (SIGTERM) 22:57:02.994229 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5170): Terminating (SIGTERM) 22:57:03.034243 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5173): Terminating (SIGTERM) 22:57:03.075118 --- ParallelTerminationStrategy: PID 5167 died... 22:57:03.094073 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5167): Terminated: ok {rc=0} 22:57:03.138846 --- ParallelTerminationStrategy: PID 5170 died... 22:57:03.157743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5170): Terminated: ok {rc=0} 22:57:03.203288 --- ParallelTerminationStrategy: PID 5173 died... 22:57:03.222164 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5173): Terminated: ok {rc=0} 22:57:03.308373 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-lms+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 22:57:04.395955 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:57:04.407548 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 22:57:04.478163 tst ping_idle_ping.py: using LAC 32080 22:57:04.598994 tst ping_idle_ping.py: using RAC 205 22:57:04.718196 tst ping_idle_ping.py: using CellId 32080 22:57:04.836856 tst ping_idle_ping.py: using BVCI 32081 22:57:04.946366 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:57:04.957376 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:57:04.967926 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:57:04.978831 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:57:04.989774 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:57:05.000709 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:57:05.011793 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 22:57:05.022551 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 22:57:05.143778 tst ping_idle_ping.py:24: start network... 22:57:05.359701 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:57:05.858041 run create_hlr_db(pid=5175): Launched 22:57:05.988792 bus /gobi_6: Setting Powered False 22:57:07.052678 run create_hlr_db(pid=5175): Terminated: ok {rc=0} 22:57:07.482672 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5177): Launched 22:57:07.783679 run osmo-hlr_10.42.42.2(pid=5178): Launched 22:57:07.899589 run osmo-stp_10.42.42.5: Starting osmo-stp 22:57:08.434427 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5180): Launched 22:57:08.733462 run osmo-stp_10.42.42.5(pid=5181): Launched 22:57:08.849273 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:57:09.370173 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5183): Launched 22:57:09.485163 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:57:09.738922 run patchelf(pid=5184): Launched 22:57:09.906719 run osmo-stp_10.42.42.5(pid=5181): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5181)] 22:57:10.035290 run osmo-stp_10.42.42.5(pid=5181): stdout: | (launched: 2022-12-12_22:57:08.678518) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:57:10.164196 run osmo-stp_10.42.42.5(pid=5181): stderr: | [0;m[38;5;43m20221212225708849 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225708849 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225708849 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225708850 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225708850 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225708850 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225708850 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:57:10.293154 run osmo-stp_10.42.42.5(pid=5181): stdout: | (launched: 2022-12-12_22:57:08.678518) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:57:10.416155 run osmo-stp_10.42.42.5(pid=5181): stderr: | [0;m[38;5;43m20221212225708849 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225708849 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225708849 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225708850 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225708850 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225708850 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225708850 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:57:10.562313 run patchelf(pid=5184): Terminating (SIGINT) 22:57:10.732760 run patchelf(pid=5184): Terminated: ok {rc=0} 22:57:10.855393 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=5181): Process ended prematurely: osmo-stp_10.42.42.5(pid=5181) [trial-2383↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5181)] [trial-2383↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 22:57:10.864185 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 22:57:10.891065 run osmo-hlr_10.42.42.2(pid=5178): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5178)] 22:57:10.939533 run osmo-hlr_10.42.42.2(pid=5178): stdout: | (launched: 2022-12-12_22:57:07.728671) 22:57:10.988647 run osmo-hlr_10.42.42.2(pid=5178): stderr: | [0;m[1;31m20221212225707907 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212225707907 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212225707907 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212225707907 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212225707907 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212225707907 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212225707920 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-lms+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212225707931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212225707931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212225707931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:57:11.038214 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5177): Terminating (SIGTERM) 22:57:11.078003 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5180): Terminating (SIGTERM) 22:57:11.117709 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5183): Terminating (SIGTERM) 22:57:11.157675 --- ParallelTerminationStrategy: PID 5177 died... 22:57:11.176679 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5177): Terminated: ok {rc=0} 22:57:11.221070 --- ParallelTerminationStrategy: PID 5180 died... 22:57:11.239784 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5180): Terminated: ok {rc=0} 22:57:11.283521 --- ParallelTerminationStrategy: PID 5183 died... 22:57:11.301890 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5183): Terminated: ok {rc=0} 22:57:11.387001 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2383 gprs:trx-lms+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 gprs:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 22:57:12.684373 tst gprs:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:57:12.690461 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 22:57:12.723607 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 22:57:12.761950 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 22:57:12.848807 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 22:57:12.882269 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 22:57:12.920347 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 22:57:13.510380 tst gprs:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2383 gprs:trx-lms+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 22:57:13.560706 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:57:13.571749 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:57:13.641424 tst cs_paging_gprs_active.py: using LAC 32081 22:57:13.764047 tst cs_paging_gprs_active.py: using RAC 206 22:57:13.886400 tst cs_paging_gprs_active.py: using CellId 32081 22:57:14.009135 tst cs_paging_gprs_active.py: using BVCI 32082 22:57:14.122727 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:57:14.133693 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:57:14.144310 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:57:14.155290 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:57:14.166412 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:57:14.177579 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:57:14.188809 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:57:14.199969 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:57:14.211196 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:57:14.332348 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:57:14.458111 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 22:57:14.679032 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:57:15.005959 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5188): Launched 22:57:15.288927 run iperf3-srv_10.42.42.10(pid=5189): Launched 22:57:15.411386 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 22:57:15.630756 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:57:15.977752 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5190): Launched 22:57:16.284186 run iperf3-srv_10.42.42.10(pid=5191): Launched 22:57:16.421860 tst cs_paging_gprs_active.py:38: start network... 22:57:16.646258 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:57:17.164136 run create_hlr_db(pid=5192): Launched 22:57:17.305257 bus /gobi_6: Setting Powered False 22:57:18.369158 run create_hlr_db(pid=5192): Terminated: ok {rc=0} 22:57:18.802085 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5194): Launched 22:57:19.108038 run osmo-hlr_10.42.42.2(pid=5195): Launched 22:57:19.224617 run osmo-stp_10.42.42.5: Starting osmo-stp 22:57:19.765989 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5197): Launched 22:57:20.072282 run osmo-stp_10.42.42.5(pid=5198): Launched 22:57:20.190068 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:57:20.718179 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5200): Launched 22:57:20.835764 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:57:21.093150 run patchelf(pid=5201): Launched 22:57:21.265372 run osmo-stp_10.42.42.5(pid=5198): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5198)] 22:57:21.394680 run osmo-stp_10.42.42.5(pid=5198): stdout: | (launched: 2022-12-12_22:57:20.016105) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:57:21.525614 run osmo-stp_10.42.42.5(pid=5198): stderr: | [0;m[38;5;43m20221212225720190 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225720190 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225720191 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225720191 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225720191 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225720192 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225720192 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:57:21.656512 run osmo-stp_10.42.42.5(pid=5198): stdout: | (launched: 2022-12-12_22:57:20.016105) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:57:21.782262 run osmo-stp_10.42.42.5(pid=5198): stderr: | [0;m[38;5;43m20221212225720190 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225720190 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225720191 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225720191 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225720191 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225720192 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225720192 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:57:21.931311 run patchelf(pid=5201): Terminating (SIGINT) 22:57:22.104423 run patchelf(pid=5201): Terminated: ok {rc=0} 22:57:22.229808 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=5198): Process ended prematurely: osmo-stp_10.42.42.5(pid=5198) [trial-2383↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5198)] [trial-2383↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 22:57:22.239076 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 22:57:22.266438 run osmo-hlr_10.42.42.2(pid=5195): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5195)] 22:57:22.313424 run osmo-hlr_10.42.42.2(pid=5195): stdout: | (launched: 2022-12-12_22:57:19.051683) 22:57:22.362236 run osmo-hlr_10.42.42.2(pid=5195): stderr: | [0;m[1;31m20221212225719226 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212225719226 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212225719226 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212225719226 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212225719226 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212225719226 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212225719239 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-lms+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212225719250 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212225719250 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212225719250 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:57:22.411443 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5188): Terminating (SIGTERM) 22:57:22.450821 run iperf3-srv_10.42.42.10(pid=5189): Terminating (SIGTERM) 22:57:22.490272 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5190): Terminating (SIGTERM) 22:57:22.529540 run iperf3-srv_10.42.42.10(pid=5191): Terminating (SIGTERM) 22:57:22.568683 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5194): Terminating (SIGTERM) 22:57:22.607786 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5197): Terminating (SIGTERM) 22:57:22.646820 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5200): Terminating (SIGTERM) 22:57:22.686276 --- ParallelTerminationStrategy: PID 5188 died... 22:57:22.705162 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5188): Terminated: ok {rc=0} 22:57:22.749093 --- ParallelTerminationStrategy: PID 5189 died... 22:57:22.767432 run iperf3-srv_10.42.42.10(pid=5189): Terminated {rc=256} 22:57:22.810873 --- ParallelTerminationStrategy: PID 5190 died... 22:57:22.829192 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5190): Terminated: ok {rc=0} 22:57:22.873342 --- ParallelTerminationStrategy: PID 5191 died... 22:57:22.891742 run iperf3-srv_10.42.42.10(pid=5191): Terminated {rc=256} 22:57:22.935507 --- ParallelTerminationStrategy: PID 5194 died... 22:57:22.953913 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5194): Terminated: ok {rc=0} 22:57:22.997534 --- ParallelTerminationStrategy: PID 5197 died... 22:57:23.015966 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5197): Terminated: ok {rc=0} 22:57:23.059764 --- ParallelTerminationStrategy: PID 5200 died... 22:57:23.078156 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5200): Terminated: ok {rc=0} 22:57:23.161118 bus /gobi_0: Setting Powered False 22:57:24.258771 bus /gobi_0: Setting Powered False 22:57:25.375022 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-lms+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 22:57:26.519693 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:57:26.531083 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:57:26.601414 tst iperf3.py: using LAC 32082 22:57:26.727649 tst iperf3.py: using RAC 207 22:57:26.849120 tst iperf3.py: using CellId 32082 22:57:26.968163 tst iperf3.py: using BVCI 32083 22:57:27.079961 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:57:27.090779 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:57:27.101467 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:57:27.112804 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:57:27.123732 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:57:27.134619 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:57:27.145498 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:57:27.156597 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:57:27.167707 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:57:27.287018 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 22:57:27.506820 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:57:27.834138 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5202): Launched 22:57:28.116788 run iperf3-srv_10.42.42.10(pid=5203): Launched 22:57:28.239005 tst iperf3.py:8: start network... 22:57:28.458058 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:57:28.962233 run create_hlr_db(pid=5204): Launched 22:57:29.093954 bus /gobi_6: Setting Powered False 22:57:30.158509 run create_hlr_db(pid=5204): Terminated: ok {rc=0} 22:57:30.594204 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5206): Launched 22:57:30.926891 run osmo-hlr_10.42.42.2(pid=5207): Launched 22:57:31.243554 run osmo-stp_10.42.42.5: Starting osmo-stp 22:57:31.922266 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5209): Launched 22:57:32.265374 run osmo-stp_10.42.42.5(pid=5210): Launched 22:57:32.391095 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:57:32.918275 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5212): Launched 22:57:33.034841 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:57:33.293016 run patchelf(pid=5213): Launched 22:57:33.463411 run osmo-stp_10.42.42.5(pid=5210): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5210)] 22:57:33.592470 run osmo-stp_10.42.42.5(pid=5210): stdout: | (launched: 2022-12-12_22:57:32.201216) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:57:33.723037 run osmo-stp_10.42.42.5(pid=5210): stderr: | [0;m[38;5;43m20221212225732393 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225732393 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225732393 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225732394 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225732394 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225732394 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225732394 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:57:33.853394 run osmo-stp_10.42.42.5(pid=5210): stdout: | (launched: 2022-12-12_22:57:32.201216) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:57:33.977865 run osmo-stp_10.42.42.5(pid=5210): stderr: | [0;m[38;5;43m20221212225732393 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225732393 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225732393 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225732394 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225732394 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225732394 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225732394 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:57:34.126025 run patchelf(pid=5213): Terminating (SIGINT) 22:57:34.299346 run patchelf(pid=5213): Terminated: ok {rc=0} 22:57:34.423779 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5210): Process ended prematurely: osmo-stp_10.42.42.5(pid=5210) [trial-2383↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5210)] [trial-2383↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8] 22:57:34.433053 tst iperf3.py:8: Test FAILED (8.0 sec) 22:57:34.460254 run osmo-hlr_10.42.42.2(pid=5207): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5207)] 22:57:34.507163 run osmo-hlr_10.42.42.2(pid=5207): stdout: | (launched: 2022-12-12_22:57:30.850146) 22:57:34.556066 run osmo-hlr_10.42.42.2(pid=5207): stderr: | [0;m[1;31m20221212225731220 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212225731220 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212225731220 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212225731221 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212225731221 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212225731221 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212225731253 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212225731269 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212225731270 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212225731270 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:57:34.605340 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5202): Terminating (SIGTERM) 22:57:34.644816 run iperf3-srv_10.42.42.10(pid=5203): Terminating (SIGTERM) 22:57:34.684035 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5206): Terminating (SIGTERM) 22:57:34.723480 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5209): Terminating (SIGTERM) 22:57:34.762705 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5212): Terminating (SIGTERM) 22:57:34.802398 --- ParallelTerminationStrategy: PID 5202 died... 22:57:34.821228 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5202): Terminated: ok {rc=0} 22:57:34.865229 --- ParallelTerminationStrategy: PID 5203 died... 22:57:34.883410 run iperf3-srv_10.42.42.10(pid=5203): Terminated {rc=256} 22:57:34.927442 --- ParallelTerminationStrategy: PID 5206 died... 22:57:34.945845 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5206): Terminated: ok {rc=0} 22:57:34.989317 --- ParallelTerminationStrategy: PID 5209 died... 22:57:35.007746 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5209): Terminated: ok {rc=0} 22:57:35.051412 --- ParallelTerminationStrategy: PID 5212 died... 22:57:35.069637 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5212): Terminated: ok {rc=0} 22:57:35.155223 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-lms+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 22:57:36.310601 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:57:36.322680 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:57:36.394783 tst iperf3m4.py: using LAC 32083 22:57:36.524087 tst iperf3m4.py: using RAC 208 22:57:36.651564 tst iperf3m4.py: using CellId 32083 22:57:36.774937 tst iperf3m4.py: using BVCI 32084 22:57:36.888647 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:57:36.899618 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:57:36.910521 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:57:36.921781 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:57:36.932611 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:57:36.943571 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:57:36.954580 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:57:36.965470 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:57:36.976663 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:57:37.098437 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:57:37.221223 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:57:37.342813 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:57:37.460720 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 22:57:37.668693 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:57:37.977282 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5214): Launched 22:57:38.246516 run iperf3-srv_10.42.42.10(pid=5215): Launched 22:57:38.361925 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 22:57:38.567233 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:57:38.874702 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5216): Launched 22:57:39.141426 run iperf3-srv_10.42.42.10(pid=5217): Launched 22:57:39.257561 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 22:57:39.464083 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:57:39.774114 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5218): Launched 22:57:40.050048 run iperf3-srv_10.42.42.10(pid=5219): Launched 22:57:40.173150 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 22:57:40.394303 run iperf3-srv_10.42.42.10: Starting iperf3-srv 22:57:40.721869 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5220): Launched 22:57:41.005907 run iperf3-srv_10.42.42.10(pid=5221): Launched 22:57:41.127673 tst iperf3m4.py:8: start network... 22:57:41.346986 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:57:41.852009 run create_hlr_db(pid=5222): Launched 22:57:41.984116 bus /gobi_6: Setting Powered False 22:57:43.048751 run create_hlr_db(pid=5222): Terminated: ok {rc=0} 22:57:43.485190 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5224): Launched 22:57:43.791665 run osmo-hlr_10.42.42.2(pid=5225): Launched 22:57:43.909613 run osmo-stp_10.42.42.5: Starting osmo-stp 22:57:44.437415 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5227): Launched 22:57:44.743704 run osmo-stp_10.42.42.5(pid=5228): Launched 22:57:44.861530 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:57:45.390069 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5230): Launched 22:57:45.506953 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:57:45.765501 run patchelf(pid=5231): Launched 22:57:45.975343 run osmo-stp_10.42.42.5(pid=5228): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5228)] 22:57:46.132864 run osmo-stp_10.42.42.5(pid=5228): stdout: | (launched: 2022-12-12_22:57:44.687470) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:57:46.309319 run osmo-stp_10.42.42.5(pid=5228): stderr: | [0;m[38;5;43m20221212225744858 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225744858 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225744858 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225744859 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225744859 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225744859 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225744859 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:57:46.478019 run osmo-stp_10.42.42.5(pid=5228): stdout: | (launched: 2022-12-12_22:57:44.687470) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:57:46.617242 run osmo-stp_10.42.42.5(pid=5228): stderr: | [0;m[38;5;43m20221212225744858 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225744858 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225744858 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225744859 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225744859 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225744859 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225744859 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:57:46.782009 run patchelf(pid=5231): Terminating (SIGINT) 22:57:46.973147 run patchelf(pid=5231): Terminated: ok {rc=0} 22:57:47.111358 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5228): Process ended prematurely: osmo-stp_10.42.42.5(pid=5228) [trial-2383↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5228)] [trial-2383↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8] 22:57:47.122706 tst iperf3m4.py:8: Test FAILED (10.8 sec) 22:57:47.154729 run osmo-hlr_10.42.42.2(pid=5225): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5225)] 22:57:47.207965 run osmo-hlr_10.42.42.2(pid=5225): stdout: | (launched: 2022-12-12_22:57:43.735574) 22:57:47.261461 run osmo-hlr_10.42.42.2(pid=5225): stderr: | [0;m[1;31m20221212225743914 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212225743914 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212225743914 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212225743914 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212225743914 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212225743914 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212225743926 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212225743936 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212225743936 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212225743936 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:57:47.314461 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5214): Terminating (SIGTERM) 22:57:47.357004 run iperf3-srv_10.42.42.10(pid=5215): Terminating (SIGTERM) 22:57:47.399527 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5216): Terminating (SIGTERM) 22:57:47.442457 run iperf3-srv_10.42.42.10(pid=5217): Terminating (SIGTERM) 22:57:47.484837 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5218): Terminating (SIGTERM) 22:57:47.527400 run iperf3-srv_10.42.42.10(pid=5219): Terminating (SIGTERM) 22:57:47.570203 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5220): Terminating (SIGTERM) 22:57:47.613156 run iperf3-srv_10.42.42.10(pid=5221): Terminating (SIGTERM) 22:57:47.655403 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5224): Terminating (SIGTERM) 22:57:47.697529 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5227): Terminating (SIGTERM) 22:57:47.739249 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5230): Terminating (SIGTERM) 22:57:47.781374 --- ParallelTerminationStrategy: PID 5214 died... 22:57:47.801376 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5214): Terminated: ok {rc=0} 22:57:47.847741 --- ParallelTerminationStrategy: PID 5215 died... 22:57:47.867256 run iperf3-srv_10.42.42.10(pid=5215): Terminated {rc=256} 22:57:47.913178 --- ParallelTerminationStrategy: PID 5216 died... 22:57:47.932701 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5216): Terminated: ok {rc=0} 22:57:47.978938 --- ParallelTerminationStrategy: PID 5217 died... 22:57:47.998612 run iperf3-srv_10.42.42.10(pid=5217): Terminated {rc=256} 22:57:48.044439 --- ParallelTerminationStrategy: PID 5218 died... 22:57:48.063968 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5218): Terminated: ok {rc=0} 22:57:48.109691 --- ParallelTerminationStrategy: PID 5219 died... 22:57:48.129404 run iperf3-srv_10.42.42.10(pid=5219): Terminated {rc=256} 22:57:48.175111 --- ParallelTerminationStrategy: PID 5220 died... 22:57:48.194771 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5220): Terminated: ok {rc=0} 22:57:48.240735 --- ParallelTerminationStrategy: PID 5221 died... 22:57:48.260412 run iperf3-srv_10.42.42.10(pid=5221): Terminated {rc=256} 22:57:48.307029 --- ParallelTerminationStrategy: PID 5224 died... 22:57:48.326867 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5224): Terminated: ok {rc=0} 22:57:48.372837 --- ParallelTerminationStrategy: PID 5227 died... 22:57:48.392802 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5227): Terminated: ok {rc=0} 22:57:48.439020 --- ParallelTerminationStrategy: PID 5230 died... 22:57:48.458744 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5230): Terminated: ok {rc=0} 22:57:48.547369 bus /gobi_4: Setting Powered False 22:57:49.645173 bus /gobi_4: Setting Powered False 22:57:50.758509 bus /gobi_1: Setting Powered False 22:57:51.855907 bus /gobi_1: Setting Powered False 22:57:52.980733 bus /gobi_0: Setting Powered False 22:57:54.079533 bus /gobi_0: Setting Powered False 22:57:55.192102 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-lms+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 22:57:56.294147 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:57:56.306054 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:57:56.377655 tst ping.py: using LAC 32084 22:57:56.502523 tst ping.py: using RAC 209 22:57:56.627502 tst ping.py: using CellId 32084 22:57:56.752920 tst ping.py: using BVCI 32085 22:57:56.871398 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:57:56.882813 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:57:56.894348 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:57:56.905492 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:57:56.916516 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:57:56.927635 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:57:56.938880 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:57:56.949972 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:57:57.066833 tst ping.py:19: start network... 22:57:57.270024 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:57:57.735197 run create_hlr_db(pid=5232): Launched 22:57:57.850173 bus /gobi_6: Setting Powered False 22:57:58.910062 run create_hlr_db(pid=5232): Terminated: ok {rc=0} 22:57:59.348740 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5234): Launched 22:57:59.669110 run osmo-hlr_10.42.42.2(pid=5235): Launched 22:57:59.792088 run osmo-stp_10.42.42.5: Starting osmo-stp 22:58:00.345647 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5237): Launched 22:58:00.665845 run osmo-stp_10.42.42.5(pid=5238): Launched 22:58:00.787457 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:58:01.407539 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5240): Launched 22:58:01.579371 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:58:01.922374 run patchelf(pid=5241): Launched 22:58:02.105252 run osmo-stp_10.42.42.5(pid=5238): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5238)] 22:58:02.237830 run osmo-stp_10.42.42.5(pid=5238): stdout: | (launched: 2022-12-12_22:58:00.607319) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:58:02.372322 run osmo-stp_10.42.42.5(pid=5238): stderr: | [0;m[38;5;43m20221212225800799 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225800799 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225800800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225800800 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225800801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225800801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225800801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:58:02.504303 run osmo-stp_10.42.42.5(pid=5238): stdout: | (launched: 2022-12-12_22:58:00.607319) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:58:02.629138 run osmo-stp_10.42.42.5(pid=5238): stderr: | [0;m[38;5;43m20221212225800799 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225800799 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225800800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225800800 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225800801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225800801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225800801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:58:02.776560 run patchelf(pid=5241): Terminating (SIGINT) 22:58:02.948595 run patchelf(pid=5241): Terminated: ok {rc=0} 22:58:03.072747 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=5238): Process ended prematurely: osmo-stp_10.42.42.5(pid=5238) [trial-2383↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5238)] [trial-2383↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22] 22:58:03.081894 tst ping.py:22: Test FAILED (6.8 sec) 22:58:03.110425 run osmo-hlr_10.42.42.2(pid=5235): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5235)] 22:58:03.158587 run osmo-hlr_10.42.42.2(pid=5235): stdout: | (launched: 2022-12-12_22:57:59.610618) 22:58:03.208625 run osmo-hlr_10.42.42.2(pid=5235): stderr: | [0;m[1;31m20221212225759808 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212225759808 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212225759808 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212225759808 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212225759808 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212225759808 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212225759819 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-lms+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212225759827 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212225759827 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212225759827 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:58:03.258781 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5234): Terminating (SIGTERM) 22:58:03.299261 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5237): Terminating (SIGTERM) 22:58:03.339621 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5240): Terminating (SIGTERM) 22:58:03.380339 --- ParallelTerminationStrategy: PID 5234 died... 22:58:03.399434 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5234): Terminated: ok {rc=0} 22:58:03.445224 --- ParallelTerminationStrategy: PID 5237 died... 22:58:03.464027 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5237): Terminated: ok {rc=0} 22:58:03.509766 --- ParallelTerminationStrategy: PID 5240 died... 22:58:03.528726 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5240): Terminated: ok {rc=0} 22:58:03.615622 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-lms+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 22:58:04.703461 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:58:04.715564 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 22:58:04.785827 tst ping_idle_ping.py: using LAC 32085 22:58:04.906630 tst ping_idle_ping.py: using RAC 210 22:58:05.032166 tst ping_idle_ping.py: using CellId 32085 22:58:05.151568 tst ping_idle_ping.py: using BVCI 32086 22:58:05.262790 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:58:05.273888 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:58:05.284554 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:58:05.295836 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:58:05.306801 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:58:05.317755 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:58:05.328782 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 22:58:05.339744 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 22:58:05.454140 tst ping_idle_ping.py:24: start network... 22:58:05.656340 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:58:06.125756 run create_hlr_db(pid=5242): Launched 22:58:06.241228 bus /gobi_6: Setting Powered False 22:58:07.301856 run create_hlr_db(pid=5242): Terminated: ok {rc=0} 22:58:07.741317 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5244): Launched 22:58:08.061498 run osmo-hlr_10.42.42.2(pid=5245): Launched 22:58:08.185115 run osmo-stp_10.42.42.5: Starting osmo-stp 22:58:08.741432 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5247): Launched 22:58:09.064018 run osmo-stp_10.42.42.5(pid=5248): Launched 22:58:09.186283 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:58:09.738705 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5250): Launched 22:58:09.862367 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:58:10.132319 run patchelf(pid=5251): Launched 22:58:10.310734 run osmo-stp_10.42.42.5(pid=5248): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5248)] 22:58:10.446710 run osmo-stp_10.42.42.5(pid=5248): stdout: | (launched: 2022-12-12_22:58:09.005382) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:58:10.584253 run osmo-stp_10.42.42.5(pid=5248): stderr: | [0;m[38;5;43m20221212225809199 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225809199 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225809199 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225809199 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225809200 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225809200 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225809200 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:58:10.721401 run osmo-stp_10.42.42.5(pid=5248): stdout: | (launched: 2022-12-12_22:58:09.005382) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:58:10.852664 run osmo-stp_10.42.42.5(pid=5248): stderr: | [0;m[38;5;43m20221212225809199 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225809199 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225809199 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225809199 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225809200 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225809200 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225809200 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:58:11.007724 run patchelf(pid=5251): Terminating (SIGINT) 22:58:11.189054 run patchelf(pid=5251): Terminated: ok {rc=0} 22:58:11.319079 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=5248): Process ended prematurely: osmo-stp_10.42.42.5(pid=5248) [trial-2383↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5248)] [trial-2383↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 22:58:11.328415 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 22:58:11.356728 run osmo-hlr_10.42.42.2(pid=5245): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5245)] 22:58:11.406919 run osmo-hlr_10.42.42.2(pid=5245): stdout: | (launched: 2022-12-12_22:58:08.003122) 22:58:11.459209 run osmo-hlr_10.42.42.2(pid=5245): stderr: | [0;m[1;31m20221212225808200 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212225808200 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212225808200 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212225808200 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212225808200 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212225808200 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212225808212 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-lms+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212225808220 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212225808220 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212225808220 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:58:11.511399 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5244): Terminating (SIGTERM) 22:58:11.553198 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5247): Terminating (SIGTERM) 22:58:11.594983 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5250): Terminating (SIGTERM) 22:58:11.637098 --- ParallelTerminationStrategy: PID 5244 died... 22:58:11.657076 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5244): Terminated: ok {rc=0} 22:58:11.703355 --- ParallelTerminationStrategy: PID 5247 died... 22:58:11.723117 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5247): Terminated: ok {rc=0} 22:58:11.768718 --- ParallelTerminationStrategy: PID 5250 died... 22:58:11.788415 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5250): Terminated: ok {rc=0} 22:58:11.875177 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2383 gprs:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 22:58:13.176687 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:58:13.183185 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 22:58:13.216893 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 22:58:13.251362 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 22:58:13.303227 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 22:58:13.335790 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 22:58:13.370006 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 22:58:13.926310 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2383 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 22:58:13.931260 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:58:13.942432 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 22:58:14.010769 tst switch_tch_pdch.py: using LAC 32086 22:58:14.129295 tst switch_tch_pdch.py: using RAC 211 22:58:14.248732 tst switch_tch_pdch.py: using CellId 32086 22:58:14.375866 tst switch_tch_pdch.py: using BVCI 32087 22:58:14.494667 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:58:14.506736 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:58:14.518344 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:58:14.530090 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:58:14.541576 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:58:14.553059 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:58:14.564590 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 22:58:14.576094 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:58:14.692286 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 22:58:14.813248 tst switch_tch_pdch.py:51: start network... 22:58:15.014689 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:58:15.476537 run create_hlr_db(pid=5256): Launched 22:58:15.592054 bus /gobi_6: Setting Powered False 22:58:16.656130 run create_hlr_db(pid=5256): Terminated: ok {rc=0} 22:58:17.119320 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5258): Launched 22:58:17.448373 run osmo-hlr_10.42.42.2(pid=5259): Launched 22:58:17.570909 run osmo-stp_10.42.42.5: Starting osmo-stp 22:58:18.126080 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5261): Launched 22:58:18.444330 run osmo-stp_10.42.42.5(pid=5262): Launched 22:58:18.565989 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:58:19.116651 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5264): Launched 22:58:19.238593 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:58:19.507848 run patchelf(pid=5265): Launched 22:58:19.685687 run osmo-stp_10.42.42.5(pid=5262): ERR: Terminated: ERROR {rc=1} [trial-2383↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5262)] 22:58:19.821176 run osmo-stp_10.42.42.5(pid=5262): stdout: | (launched: 2022-12-12_22:58:18.386402) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:58:19.957608 run osmo-stp_10.42.42.5(pid=5262): stderr: | [0;m[38;5;43m20221212225818581 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225818582 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225818582 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225818582 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225818583 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225818583 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225818583 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:58:20.094366 run osmo-stp_10.42.42.5(pid=5262): stdout: | (launched: 2022-12-12_22:58:18.386402) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:58:20.224937 run osmo-stp_10.42.42.5(pid=5262): stderr: | [0;m[38;5;43m20221212225818581 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225818582 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225818582 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225818582 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225818583 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225818583 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225818583 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:58:20.379296 run patchelf(pid=5265): Terminating (SIGINT) 22:58:20.559663 run patchelf(pid=5265): Terminated: ok {rc=0} 22:58:20.689590 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=5262): Process ended prematurely: osmo-stp_10.42.42.5(pid=5262) [trial-2383↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5262)] [trial-2383↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 22:58:20.698962 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 22:58:20.726647 run osmo-hlr_10.42.42.2(pid=5259): ERR: Terminated: ERROR {rc=237} [trial-2383↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5259)] 22:58:20.775473 run osmo-hlr_10.42.42.2(pid=5259): stdout: | (launched: 2022-12-12_22:58:17.390553) 22:58:20.826721 run osmo-hlr_10.42.42.2(pid=5259): stderr: | [0;m[1;31m20221212225817591 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212225817591 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212225817591 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212225817591 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212225817591 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212225817591 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212225817604 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212225817614 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212225817614 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212225817614 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:58:20.878068 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5258): Terminating (SIGTERM) 22:58:20.919001 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5261): Terminating (SIGTERM) 22:58:20.960239 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5264): Terminating (SIGTERM) 22:58:21.001860 --- ParallelTerminationStrategy: PID 5258 died... 22:58:21.021628 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5258): Terminated: ok {rc=0} 22:58:21.067278 --- ParallelTerminationStrategy: PID 5261 died... 22:58:21.086808 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5261): Terminated: ok {rc=0} 22:58:21.132800 --- ParallelTerminationStrategy: PID 5264 died... 22:58:21.152580 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5264): Terminated: ok {rc=0} 22:58:21.238030 bus /gobi_0: Setting Powered False 22:58:22.334997 bus /gobi_0: Setting Powered False 22:58:23.449913 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2383 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 dynts:trx-lms+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 22:58:24.698549 tst dynts:trx-lms+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:58:24.706219 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 22:58:24.740271 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 22:58:24.775571 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 22:58:24.830647 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 22:58:24.863850 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 22:58:24.897914 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 22:58:25.455237 tst dynts:trx-lms+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2383 dynts:trx-lms+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 22:58:25.460812 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:58:25.472740 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 22:58:25.543562 tst switch_tch_pdch.py: using LAC 32087 22:58:25.669733 tst switch_tch_pdch.py: using RAC 212 22:58:25.793271 tst switch_tch_pdch.py: using CellId 32087 22:58:25.910697 tst switch_tch_pdch.py: using BVCI 32088 22:58:26.020218 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:58:26.031287 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:58:26.042120 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:58:26.053219 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:58:26.063992 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:58:26.074888 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:58:26.085996 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 22:58:26.096883 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 22:58:26.217466 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 22:58:26.336911 tst switch_tch_pdch.py:51: start network... 22:58:26.553351 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:58:27.019836 run create_hlr_db(pid=5269): Launched 22:58:27.149806 bus /gobi_6: Setting Powered False 22:58:28.213164 run create_hlr_db(pid=5269): Terminated: ok {rc=0} 22:58:28.629513 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5271): Launched 22:58:28.949164 run osmo-hlr_10.42.42.2(pid=5272): Launched 22:58:29.070169 run osmo-stp_10.42.42.5: Starting osmo-stp 22:58:29.595264 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5274): Launched 22:58:29.912911 run osmo-stp_10.42.42.5(pid=5275): Launched 22:58:30.034824 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 22:58:30.556017 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5277): Launched 22:58:30.678136 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 22:58:30.953877 run patchelf(pid=5278): Launched 22:58:31.192276 run osmo-stp_10.42.42.5(pid=5275): ERR: Terminated: ERROR {rc=1} [trial-2383↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5275)] 22:58:31.365726 run osmo-stp_10.42.42.5(pid=5275): stdout: | (launched: 2022-12-12_22:58:29.855087) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:58:31.517403 run osmo-stp_10.42.42.5(pid=5275): stderr: | [0;m[38;5;43m20221212225830046 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225830046 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225830046 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225830046 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225830047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225830047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225830047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:58:31.657287 run osmo-stp_10.42.42.5(pid=5275): stdout: | (launched: 2022-12-12_22:58:29.855087) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:58:31.791283 run osmo-stp_10.42.42.5(pid=5275): stderr: | [0;m[38;5;43m20221212225830046 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225830046 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225830046 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225830046 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225830047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225830047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225830047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:58:31.949671 run patchelf(pid=5278): Terminating (SIGINT) 22:58:32.134250 run patchelf(pid=5278): Terminated: ok {rc=0} 22:58:32.266432 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=5275): Process ended prematurely: osmo-stp_10.42.42.5(pid=5275) [trial-2383↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5275)] [trial-2383↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 22:58:32.275914 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 22:58:32.303763 run osmo-hlr_10.42.42.2(pid=5272): ERR: Terminated: ERROR {rc=237} [trial-2383↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5272)] 22:58:32.353253 run osmo-hlr_10.42.42.2(pid=5272): stdout: | (launched: 2022-12-12_22:58:28.890996) 22:58:32.404315 run osmo-hlr_10.42.42.2(pid=5272): stderr: | [0;m[1;31m20221212225829092 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212225829092 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212225829092 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212225829092 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212225829092 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212225829092 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212225829105 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/dynts:trx-lms+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212225829113 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212225829113 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212225829113 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:58:32.455769 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5271): Terminating (SIGTERM) 22:58:32.496797 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5274): Terminating (SIGTERM) 22:58:32.538215 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5277): Terminating (SIGTERM) 22:58:32.579588 --- ParallelTerminationStrategy: PID 5271 died... 22:58:32.599325 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5271): Terminated: ok {rc=0} 22:58:32.644725 --- ParallelTerminationStrategy: PID 5274 died... 22:58:32.664312 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5274): Terminated: ok {rc=0} 22:58:32.709703 --- ParallelTerminationStrategy: PID 5277 died... 22:58:32.728918 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5277): Terminated: ok {rc=0} 22:58:32.815232 bus /gobi_0: Setting Powered False 22:58:33.912777 bus /gobi_0: Setting Powered False 22:58:35.028561 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2383 dynts:trx-lms+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 nitb_sms:trx-lms-limenet-micro --------------------------------------------------------------------- 22:58:36.275333 tst nitb_sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:58:36.279089 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 22:58:36.308298 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 22:58:36.314942 tst nitb_sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 22:58:36.370404 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 22:58:36.400192 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 22:58:36.406945 tst nitb_sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 22:58:36.938753 tst nitb_sms:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_sms: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 nitb_sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 22:58:36.943613 tst nitb_sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 22:58:36.954531 tst nitb_sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 22:58:37.001589 tst mo_mt_sms.py: using LAC 32088 22:58:37.119767 tst mo_mt_sms.py: using RAC 213 22:58:37.235257 tst mo_mt_sms.py: using CellId 32088 22:58:37.351560 tst mo_mt_sms.py: using BVCI 32089 22:58:37.460532 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 22:58:37.579147 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 22:58:37.693377 tst mo_mt_sms.py:9: start nitb and bts... 22:58:37.896149 run osmo-nitb_10.42.42.2: Starting osmo-nitb 22:58:38.506647 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=5284): Launched 22:58:38.806976 run osmo-nitb_10.42.42.2(pid=5285): Launched 22:58:38.973139 run osmo-nitb_10.42.42.2(pid=5285): ERR: Terminated: ERROR {rc=2} [trial-2383↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5285)] 22:58:39.107618 run osmo-nitb_10.42.42.2(pid=5285): stdout: | (launched: 2022-12-12_22:58:38.752454) 22:58:39.243663 run osmo-nitb_10.42.42.2(pid=5285): stderr: | (launched: 2022-12-12_22:58:38.796777) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:58:39.379808 run osmo-nitb_10.42.42.2(pid=5285): stdout: | (launched: 2022-12-12_22:58:38.752454) 22:58:39.510184 run osmo-nitb_10.42.42.2(pid=5285): stderr: | (launched: 2022-12-12_22:58:38.796777) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fa469b2b268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=5285): Process ended prematurely: osmo-nitb_10.42.42.2(pid=5285) [trial-2383↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5285)] 22:58:39.920110 tst osmo-nitb_10.42.42.2(pid=5285): stdout: | (launched: 2022-12-12_22:58:38.752454) 22:58:40.041993 tst osmo-nitb_10.42.42.2(pid=5285): stderr: | (launched: 2022-12-12_22:58:38.796777) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:58:40.185270 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=5285): Process ended prematurely: osmo-nitb_10.42.42.2(pid=5285) [trial-2383↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5285)] [trial-2383↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11] 22:58:40.193671 tst mo_mt_sms.py:11: Test FAILED (3.2 sec) 22:58:40.200416 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=5284): Terminating (SIGTERM) 22:58:40.409412 --- ParallelTerminationStrategy: PID 5284 died... 22:58:40.429625 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=5284): Terminated: ok {rc=0} 22:58:40.514442 bus /sierra_3: Setting Powered False 22:58:41.613497 bus /sierra_3: Setting Powered False 22:58:42.729762 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 nitb_sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 sms:trx-lms-limenet-micro --------------------------------------------------------------------- 22:58:43.923064 tst sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:58:43.927167 tst sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 22:58:43.956724 tst sms:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 22:58:43.982974 tst sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 22:58:44.035722 tst sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 22:58:44.064688 tst sms:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 22:58:44.090808 tst sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 22:58:44.635305 tst sms:trx-lms-limenet-micro: RESERVED RESOURCES for sms: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 22:58:44.640137 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 22:58:44.650847 tst sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 22:58:44.694500 tst mo_mt_sms.py: using LAC 32089 22:58:44.814748 tst mo_mt_sms.py: using RAC 214 22:58:44.934482 tst mo_mt_sms.py: using CellId 32089 22:58:45.052238 tst mo_mt_sms.py: using BVCI 32090 22:58:45.162565 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 22:58:45.173267 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 22:58:45.183745 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 22:58:45.194563 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 22:58:45.205513 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 22:58:45.216206 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 22:58:45.335720 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 22:58:45.454509 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:58:45.961086 run create_hlr_db(pid=5290): Launched 22:58:46.134136 bus /sierra_2: Setting Powered False 22:58:47.194104 run create_hlr_db(pid=5290): Terminated: ok {rc=0} 22:58:47.645312 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5292): Launched 22:58:47.964506 run osmo-hlr_10.42.42.2(pid=5293): Launched 22:58:48.085674 run osmo-stp_10.42.42.5: Starting osmo-stp 22:58:48.634326 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5295): Launched 22:58:48.953081 run osmo-stp_10.42.42.5(pid=5296): Launched 22:58:49.075944 run osmo-msc_10.42.42.6: Starting osmo-msc 22:58:49.657531 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5298): Launched 22:58:49.977797 run osmo-msc_10.42.42.6(pid=5299): Launched 22:58:50.157490 run osmo-stp_10.42.42.5(pid=5296): ERR: Terminated: ERROR {rc=1} [trial-2383↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5296)] 22:58:50.292581 run osmo-stp_10.42.42.5(pid=5296): stdout: | (launched: 2022-12-12_22:58:48.895020) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:58:50.428538 run osmo-stp_10.42.42.5(pid=5296): stderr: | [0;m[38;5;43m20221212225849086 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225849086 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225849086 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225849087 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225849087 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225849087 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225849087 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:58:50.563380 run osmo-stp_10.42.42.5(pid=5296): stdout: | (launched: 2022-12-12_22:58:48.895020) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:58:50.690632 run osmo-stp_10.42.42.5(pid=5296): stderr: | [0;m[38;5;43m20221212225849086 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225849086 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225849086 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225849087 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225849087 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225849087 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225849087 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:58:50.844056 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=5296): Process ended prematurely: osmo-stp_10.42.42.5(pid=5296) [trial-2383↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5296)] [trial-2383↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16] 22:58:50.852864 tst mo_mt_sms.py:16: Test FAILED (6.2 sec) 22:58:50.880418 run osmo-hlr_10.42.42.2(pid=5293): ERR: Terminated: ERROR {rc=237} [trial-2383↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5293)] 22:58:50.930390 run osmo-hlr_10.42.42.2(pid=5293): stdout: | (launched: 2022-12-12_22:58:47.906578) 22:58:50.981899 run osmo-hlr_10.42.42.2(pid=5293): stderr: | [0;m[1;31m20221212225848106 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212225848106 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212225848106 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212225848106 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212225848107 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212225848107 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212225848120 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/sms:trx-lms-limenet-micro/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212225848128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212225848128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212225848128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:58:51.054206 run osmo-msc_10.42.42.6(pid=5299): ERR: Terminated: ERROR {rc=2} [trial-2383↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5299)] 22:58:51.104515 run osmo-msc_10.42.42.6(pid=5299): stdout: | (launched: 2022-12-12_22:58:49.919674) 22:58:51.156197 run osmo-msc_10.42.42.6(pid=5299): stderr: | [0;m[38;5;43m20221212225850242 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212225850242 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f77b8e24c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212225850242 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212225850242 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212225850242 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212225850242 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212225850244 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212225850244 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212225850245 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212225850245 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:58:51.208285 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5292): Terminating (SIGTERM) 22:58:51.250001 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5295): Terminating (SIGTERM) 22:58:51.291737 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5298): Terminating (SIGTERM) 22:58:51.333843 --- ParallelTerminationStrategy: PID 5292 died... 22:58:51.353689 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5292): Terminated: ok {rc=0} 22:58:51.399560 --- ParallelTerminationStrategy: PID 5295 died... 22:58:51.419093 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5295): Terminated: ok {rc=0} 22:58:51.464801 --- ParallelTerminationStrategy: PID 5298 died... 22:58:51.484280 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5298): Terminated: ok {rc=0} 22:58:51.571209 bus /sierra_3: Setting Powered False 22:58:52.670518 bus /sierra_3: Setting Powered False 22:58:53.785953 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 nitb_ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 22:58:55.007578 tst nitb_ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:58:55.011407 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 22:58:55.041119 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 22:58:55.047945 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 22:58:55.084122 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 22:58:55.115303 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 22:58:55.122309 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 22:58:55.637686 tst nitb_ussd:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_ussd: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2383 nitb_ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 22:58:55.643665 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 22:58:55.655221 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 22:58:55.701758 tst assert_extension.py: using LAC 32090 22:58:55.828904 tst assert_extension.py: using RAC 215 22:58:55.956140 tst assert_extension.py: using CellId 32090 22:58:56.083089 tst assert_extension.py: using BVCI 32091 22:58:56.200146 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 22:58:56.314784 tst assert_extension.py:10: start nitb and bts... 22:58:56.517229 run osmo-nitb_10.42.42.2: Starting osmo-nitb 22:58:57.130744 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=5304): Launched 22:58:57.431349 run osmo-nitb_10.42.42.2(pid=5305): Launched 22:58:57.598177 run osmo-nitb_10.42.42.2(pid=5305): ERR: Terminated: ERROR {rc=2} [trial-2383↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5305)] 22:58:57.733155 run osmo-nitb_10.42.42.2(pid=5305): stdout: | (launched: 2022-12-12_22:58:57.376244) 22:58:57.869173 run osmo-nitb_10.42.42.2(pid=5305): stderr: | (launched: 2022-12-12_22:58:57.420884) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:58:58.005405 run osmo-nitb_10.42.42.2(pid=5305): stdout: | (launched: 2022-12-12_22:58:57.376244) 22:58:58.135733 run osmo-nitb_10.42.42.2(pid=5305): stderr: | (launched: 2022-12-12_22:58:57.420884) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fa469b2b268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=5305): Process ended prematurely: osmo-nitb_10.42.42.2(pid=5305) [trial-2383↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5305)] 22:58:58.545112 tst osmo-nitb_10.42.42.2(pid=5305): stdout: | (launched: 2022-12-12_22:58:57.376244) 22:58:58.666299 tst osmo-nitb_10.42.42.2(pid=5305): stderr: | (launched: 2022-12-12_22:58:57.420884) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 22:58:58.809586 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=5305): Process ended prematurely: osmo-nitb_10.42.42.2(pid=5305) [trial-2383↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5305)] [trial-2383↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12] 22:58:58.817928 tst assert_extension.py:12: Test FAILED (3.2 sec) 22:58:58.824400 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=5304): Terminating (SIGTERM) 22:58:59.033710 --- ParallelTerminationStrategy: PID 5304 died... 22:58:59.054603 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=5304): Terminated: ok {rc=0} 22:58:59.139673 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 nitb_ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 22:59:00.319503 tst ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:59:00.323677 tst ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 22:59:00.353517 tst ussd:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 22:59:00.381203 tst ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 22:59:00.416633 tst ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 22:59:00.446356 tst ussd:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 22:59:00.473508 tst ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 22:59:01.003812 tst ussd:trx-lms-limenet-micro: RESERVED RESOURCES for ussd: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2383 ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 22:59:01.010604 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 22:59:01.023904 tst ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 22:59:01.072345 tst assert_extension.py: using LAC 32091 22:59:01.213954 tst assert_extension.py: using RAC 216 22:59:01.340512 tst assert_extension.py: using CellId 32091 22:59:01.463269 tst assert_extension.py: using BVCI 32092 22:59:01.578209 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 22:59:01.590053 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 22:59:01.601859 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 22:59:01.614634 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 22:59:01.628673 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 22:59:01.641521 tst ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 22:59:01.776186 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:59:02.305323 run create_hlr_db(pid=5309): Launched 22:59:02.421957 bus /sierra_2: Setting Powered False 22:59:03.481857 run create_hlr_db(pid=5309): Terminated: ok {rc=0} 22:59:03.900065 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5311): Launched 22:59:04.199895 run osmo-hlr_10.42.42.2(pid=5312): Launched 22:59:04.315123 run osmo-stp_10.42.42.5: Starting osmo-stp 22:59:04.832566 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5314): Launched 22:59:05.132806 run osmo-stp_10.42.42.5(pid=5315): Launched 22:59:05.247790 run osmo-msc_10.42.42.6: Starting osmo-msc 22:59:05.790181 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5317): Launched 22:59:06.089770 run osmo-msc_10.42.42.6(pid=5318): Launched 22:59:06.259176 run osmo-stp_10.42.42.5(pid=5315): ERR: Terminated: ERROR {rc=1} [trial-2383↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5315)] 22:59:06.386664 run osmo-stp_10.42.42.5(pid=5315): stdout: | (launched: 2022-12-12_22:59:05.077835) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:59:06.513753 run osmo-stp_10.42.42.5(pid=5315): stderr: | [0;m[38;5;43m20221212225905247 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225905247 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225905247 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225905248 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225905250 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225905250 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225905250 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:59:06.638852 run osmo-stp_10.42.42.5(pid=5315): stdout: | (launched: 2022-12-12_22:59:05.077835) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:59:06.758161 run osmo-stp_10.42.42.5(pid=5315): stderr: | [0;m[38;5;43m20221212225905247 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225905247 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225905247 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225905248 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225905250 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225905250 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225905250 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:59:06.900832 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=5315): Process ended prematurely: osmo-stp_10.42.42.5(pid=5315) [trial-2383↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5315)] [trial-2383↪ussd:trx-lms-limenet-micro↪assert_extension.py:17] 22:59:06.909572 tst assert_extension.py:17: Test FAILED (5.9 sec) 22:59:06.935964 run osmo-hlr_10.42.42.2(pid=5312): ERR: Terminated: ERROR {rc=237} [trial-2383↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5312)] 22:59:06.983460 run osmo-hlr_10.42.42.2(pid=5312): stdout: | (launched: 2022-12-12_22:59:04.144852) 22:59:07.032375 run osmo-hlr_10.42.42.2(pid=5312): stderr: | [0;m[1;31m20221212225904323 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212225904323 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212225904323 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212225904323 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212225904323 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212225904323 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212225904336 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/ussd:trx-lms-limenet-micro/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212225904344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212225904344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212225904344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:59:07.100739 run osmo-msc_10.42.42.6(pid=5318): ERR: Terminated: ERROR {rc=2} [trial-2383↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5318)] 22:59:07.147891 run osmo-msc_10.42.42.6(pid=5318): stdout: | (launched: 2022-12-12_22:59:06.034773) 22:59:07.196622 run osmo-msc_10.42.42.6(pid=5318): stderr: | [0;m[38;5;43m20221212225906307 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212225906307 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2c81adfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212225906307 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212225906307 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212225906308 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212225906308 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212225906310 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212225906311 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212225906311 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212225906311 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:59:07.245871 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5311): Terminating (SIGTERM) 22:59:07.285020 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5314): Terminating (SIGTERM) 22:59:07.324166 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5317): Terminating (SIGTERM) 22:59:07.363940 --- ParallelTerminationStrategy: PID 5311 died... 22:59:07.382917 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5311): Terminated: ok {rc=0} 22:59:07.427237 --- ParallelTerminationStrategy: PID 5314 died... 22:59:07.445836 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5314): Terminated: ok {rc=0} 22:59:07.489843 --- ParallelTerminationStrategy: PID 5317 died... 22:59:07.508411 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5317): Terminated: ok {rc=0} 22:59:07.593305 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 22:59:08.799041 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:59:08.805440 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 22:59:08.835612 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 22:59:08.862015 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 22:59:08.915534 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 22:59:08.945927 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 22:59:08.973714 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 22:59:09.523982 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 22:59:09.577068 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:59:09.588889 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 22:59:09.656492 tst mo_mt_call.py: using LAC 32092 22:59:09.789824 tst mo_mt_call.py: using RAC 217 22:59:09.918428 tst mo_mt_call.py: using CellId 32092 22:59:10.047429 tst mo_mt_call.py: using BVCI 32093 22:59:10.161410 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:59:10.172726 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:59:10.183958 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:59:10.195418 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:59:10.207082 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:59:10.218521 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:59:10.333437 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:59:10.449833 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:59:10.926768 run create_hlr_db(pid=5324): Launched 22:59:11.043834 bus /sierra_2: Setting Powered False 22:59:12.104215 run create_hlr_db(pid=5324): Terminated: ok {rc=0} 22:59:12.550146 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5326): Launched 22:59:12.877107 run osmo-hlr_10.42.42.2(pid=5327): Launched 22:59:13.002859 run osmo-stp_10.42.42.5: Starting osmo-stp 22:59:13.562339 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5329): Launched 22:59:13.887973 run osmo-stp_10.42.42.5(pid=5330): Launched 22:59:14.012549 run osmo-msc_10.42.42.6: Starting osmo-msc 22:59:14.600886 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5332): Launched 22:59:14.926658 run osmo-msc_10.42.42.6(pid=5333): Launched 22:59:15.109162 run osmo-stp_10.42.42.5(pid=5330): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5330)] 22:59:15.245714 run osmo-stp_10.42.42.5(pid=5330): stdout: | (launched: 2022-12-12_22:59:13.828295) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:59:15.383708 run osmo-stp_10.42.42.5(pid=5330): stderr: | [0;m[38;5;43m20221212225914022 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225914022 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225914022 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225914022 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225914023 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225914023 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225914023 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:59:15.520103 run osmo-stp_10.42.42.5(pid=5330): stdout: | (launched: 2022-12-12_22:59:13.828295) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:59:15.649963 run osmo-stp_10.42.42.5(pid=5330): stderr: | [0;m[38;5;43m20221212225914022 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225914022 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225914022 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225914022 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225914023 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225914023 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225914023 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:59:15.804905 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5330): Process ended prematurely: osmo-stp_10.42.42.5(pid=5330) [trial-2383↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5330)] [trial-2383↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 22:59:15.814715 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 22:59:15.854077 run osmo-hlr_10.42.42.2(pid=5327): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5327)] 22:59:15.907921 run osmo-hlr_10.42.42.2(pid=5327): stdout: | (launched: 2022-12-12_22:59:12.817563) 22:59:15.960906 run osmo-hlr_10.42.42.2(pid=5327): stderr: | [0;m[1;31m20221212225913018 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212225913018 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212225913018 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212225913018 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212225913018 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212225913018 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212225913036 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212225913045 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212225913045 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212225913045 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:59:16.034547 run osmo-msc_10.42.42.6(pid=5333): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5333)] 22:59:16.085920 run osmo-msc_10.42.42.6(pid=5333): stdout: | (launched: 2022-12-12_22:59:14.867278) 22:59:16.138827 run osmo-msc_10.42.42.6(pid=5333): stderr: | [0;m[38;5;43m20221212225915193 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212225915193 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fdeeb374c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212225915193 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212225915193 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212225915193 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212225915194 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212225915195 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212225915196 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212225915196 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212225915196 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:59:16.192045 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5326): Terminating (SIGTERM) 22:59:16.235594 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5329): Terminating (SIGTERM) 22:59:16.280588 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5332): Terminating (SIGTERM) 22:59:16.325468 --- ParallelTerminationStrategy: PID 5326 died... 22:59:16.346043 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5326): Terminated: ok {rc=0} 22:59:16.394860 --- ParallelTerminationStrategy: PID 5329 died... 22:59:16.415752 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5329): Terminated: ok {rc=0} 22:59:16.463157 --- ParallelTerminationStrategy: PID 5332 died... 22:59:16.483534 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5332): Terminated: ok {rc=0} 22:59:16.585783 bus /sierra_3: Setting Powered False 22:59:17.692654 bus /sierra_3: Setting Powered False 22:59:18.806916 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2383 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 22:59:19.956342 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:59:19.968942 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 22:59:20.037274 tst mo_mt_call_osmux.py: using LAC 32093 22:59:20.162630 tst mo_mt_call_osmux.py: using RAC 218 22:59:20.291674 tst mo_mt_call_osmux.py: using CellId 32093 22:59:20.418586 tst mo_mt_call_osmux.py: using BVCI 32094 22:59:20.537359 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:59:20.549220 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:59:20.561083 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:59:20.572667 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:59:20.584423 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 22:59:20.596081 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:59:20.712017 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 22:59:20.833110 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:59:21.339447 run create_hlr_db(pid=5335): Launched 22:59:21.470955 bus /sierra_2: Setting Powered False 22:59:22.534757 run create_hlr_db(pid=5335): Terminated: ok {rc=0} 22:59:22.970392 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5337): Launched 22:59:23.277438 run osmo-hlr_10.42.42.2(pid=5338): Launched 22:59:23.396044 run osmo-stp_10.42.42.5: Starting osmo-stp 22:59:23.938068 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5340): Launched 22:59:24.243944 run osmo-stp_10.42.42.5(pid=5341): Launched 22:59:24.361210 run osmo-msc_10.42.42.6: Starting osmo-msc 22:59:24.917510 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5343): Launched 22:59:25.226157 run osmo-msc_10.42.42.6(pid=5344): Launched 22:59:25.398851 run osmo-stp_10.42.42.5(pid=5341): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5341)] 22:59:25.528284 run osmo-stp_10.42.42.5(pid=5341): stdout: | (launched: 2022-12-12_22:59:24.187590) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:59:25.658194 run osmo-stp_10.42.42.5(pid=5341): stderr: | [0;m[38;5;43m20221212225924359 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225924359 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225924360 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225924360 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225924361 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225924361 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225924361 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:59:25.786091 run osmo-stp_10.42.42.5(pid=5341): stdout: | (launched: 2022-12-12_22:59:24.187590) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:59:25.907696 run osmo-stp_10.42.42.5(pid=5341): stderr: | [0;m[38;5;43m20221212225924359 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225924359 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225924360 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225924360 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225924361 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225924361 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225924361 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:59:26.053892 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5341): Process ended prematurely: osmo-stp_10.42.42.5(pid=5341) [trial-2383↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5341)] [trial-2383↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 22:59:26.062809 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 22:59:26.089742 run osmo-hlr_10.42.42.2(pid=5338): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5338)] 22:59:26.137530 run osmo-hlr_10.42.42.2(pid=5338): stdout: | (launched: 2022-12-12_22:59:23.221318) 22:59:26.186427 run osmo-hlr_10.42.42.2(pid=5338): stderr: | [0;m[1;31m20221212225923398 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212225923398 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212225923398 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212225923398 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212225923398 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212225923398 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212225923411 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212225923421 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212225923422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212225923422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:59:26.254903 run osmo-msc_10.42.42.6(pid=5344): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5344)] 22:59:26.301876 run osmo-msc_10.42.42.6(pid=5344): stdout: | (launched: 2022-12-12_22:59:25.169900) 22:59:26.350674 run osmo-msc_10.42.42.6(pid=5344): stderr: | [0;m[38;5;43m20221212225925442 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212225925442 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f411ea3ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212225925442 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212225925442 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212225925442 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212225925443 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212225925444 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212225925445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212225925445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212225925445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:59:26.399997 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5337): Terminating (SIGTERM) 22:59:26.439332 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5340): Terminating (SIGTERM) 22:59:26.478844 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5343): Terminating (SIGTERM) 22:59:26.518894 --- ParallelTerminationStrategy: PID 5337 died... 22:59:26.538039 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5337): Terminated: ok {rc=0} 22:59:26.582178 --- ParallelTerminationStrategy: PID 5340 died... 22:59:26.600487 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5340): Terminated: ok {rc=0} 22:59:26.644820 --- ParallelTerminationStrategy: PID 5343 died... 22:59:26.663857 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5343): Terminated: ok {rc=0} 22:59:26.750138 bus /sierra_3: Setting Powered False 22:59:27.848397 bus /sierra_3: Setting Powered False 22:59:28.961511 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 22:59:30.202284 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:59:30.209794 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 22:59:30.239739 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 22:59:30.267041 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 22:59:30.319446 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 22:59:30.349867 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 22:59:30.377200 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 22:59:30.948654 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 22:59:31.002300 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:59:31.014784 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 22:59:31.083720 tst mo_mt_call.py: using LAC 32094 22:59:31.251127 tst mo_mt_call.py: using RAC 219 22:59:31.383979 tst mo_mt_call.py: using CellId 32094 22:59:31.517435 tst mo_mt_call.py: using BVCI 32095 22:59:31.645527 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:59:31.658137 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:59:31.671020 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:59:31.683379 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:59:31.695954 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:59:31.708539 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:59:31.832285 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:59:31.959426 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:59:32.487817 run create_hlr_db(pid=5349): Launched 22:59:32.607795 bus /sierra_2: Setting Powered False 22:59:33.669432 run create_hlr_db(pid=5349): Terminated: ok {rc=0} 22:59:34.114681 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5351): Launched 22:59:34.442185 run osmo-hlr_10.42.42.2(pid=5352): Launched 22:59:34.569288 run osmo-stp_10.42.42.5: Starting osmo-stp 22:59:35.131376 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5356): Launched 22:59:35.458896 run osmo-stp_10.42.42.5(pid=5357): Launched 22:59:35.583846 run osmo-msc_10.42.42.6: Starting osmo-msc 22:59:36.173420 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5359): Launched 22:59:36.501669 run osmo-msc_10.42.42.6(pid=5360): Launched 22:59:36.686095 run osmo-stp_10.42.42.5(pid=5357): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5357)] 22:59:36.824673 run osmo-stp_10.42.42.5(pid=5357): stdout: | (launched: 2022-12-12_22:59:35.399018) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:59:36.965905 run osmo-stp_10.42.42.5(pid=5357): stderr: | [0;m[38;5;43m20221212225935591 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225935591 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225935592 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225935592 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225935593 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225935593 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225935593 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:59:37.103532 run osmo-stp_10.42.42.5(pid=5357): stdout: | (launched: 2022-12-12_22:59:35.399018) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:59:37.235028 run osmo-stp_10.42.42.5(pid=5357): stderr: | [0;m[38;5;43m20221212225935591 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225935591 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225935592 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225935592 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225935593 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225935593 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225935593 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:59:37.391576 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5357): Process ended prematurely: osmo-stp_10.42.42.5(pid=5357) [trial-2383↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5357)] [trial-2383↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 22:59:37.401152 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 22:59:37.429121 run osmo-hlr_10.42.42.2(pid=5352): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5352)] 22:59:37.478830 run osmo-hlr_10.42.42.2(pid=5352): stdout: | (launched: 2022-12-12_22:59:34.381584) 22:59:37.530583 run osmo-hlr_10.42.42.2(pid=5352): stderr: | [0;m[1;31m20221212225934587 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212225934587 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212225934587 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212225934587 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212225934587 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212225934587 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212225934599 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212225934608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212225934608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212225934608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:59:37.602315 run osmo-msc_10.42.42.6(pid=5360): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5360)] 22:59:37.651815 run osmo-msc_10.42.42.6(pid=5360): stdout: | (launched: 2022-12-12_22:59:36.441856) 22:59:37.702875 run osmo-msc_10.42.42.6(pid=5360): stderr: | [0;m[38;5;43m20221212225936765 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212225936765 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8ee9531c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212225936765 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212225936765 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212225936765 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212225936765 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212225936767 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212225936767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212225936768 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212225936768 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:59:37.754684 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5351): Terminating (SIGTERM) 22:59:37.795977 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5356): Terminating (SIGTERM) 22:59:37.837337 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5359): Terminating (SIGTERM) 22:59:37.879279 --- ParallelTerminationStrategy: PID 5351 died... 22:59:37.899273 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5351): Terminated: ok {rc=0} 22:59:37.944918 --- ParallelTerminationStrategy: PID 5356 died... 22:59:37.964403 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5356): Terminated: ok {rc=0} 22:59:38.009880 --- ParallelTerminationStrategy: PID 5359 died... 22:59:38.029334 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5359): Terminated: ok {rc=0} 22:59:38.115467 bus /sierra_3: Setting Powered False 22:59:39.211692 bus /sierra_3: Setting Powered False 22:59:40.326933 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2383 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 22:59:41.472524 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:59:41.484492 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 22:59:41.550497 tst mo_mt_call_osmux.py: using LAC 32095 22:59:41.673738 tst mo_mt_call_osmux.py: using RAC 220 22:59:41.794430 tst mo_mt_call_osmux.py: using CellId 32095 22:59:41.917649 tst mo_mt_call_osmux.py: using BVCI 32096 22:59:42.037894 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:59:42.049693 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:59:42.061204 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:59:42.073401 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:59:42.085615 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 22:59:42.097852 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:59:42.221123 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 22:59:42.339344 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:59:42.816216 run create_hlr_db(pid=5362): Launched 22:59:42.935017 bus /sierra_2: Setting Powered False 22:59:43.995725 run create_hlr_db(pid=5362): Terminated: ok {rc=0} 22:59:44.422496 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5364): Launched 22:59:44.729089 run osmo-hlr_10.42.42.2(pid=5365): Launched 22:59:44.847466 run osmo-stp_10.42.42.5: Starting osmo-stp 22:59:45.380176 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5367): Launched 22:59:45.687314 run osmo-stp_10.42.42.5(pid=5368): Launched 22:59:45.805291 run osmo-msc_10.42.42.6: Starting osmo-msc 22:59:46.437853 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5370): Launched 22:59:46.753897 run osmo-msc_10.42.42.6(pid=5371): Launched 22:59:47.080805 run osmo-stp_10.42.42.5(pid=5368): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5368)] 22:59:47.285120 run osmo-stp_10.42.42.5(pid=5368): stdout: | (launched: 2022-12-12_22:59:45.631287) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:59:47.437683 run osmo-stp_10.42.42.5(pid=5368): stderr: | [0;m[38;5;43m20221212225945803 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225945803 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225945804 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225945804 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225945804 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225945805 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225945805 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:59:47.573449 run osmo-stp_10.42.42.5(pid=5368): stdout: | (launched: 2022-12-12_22:59:45.631287) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:59:47.703157 run osmo-stp_10.42.42.5(pid=5368): stderr: | [0;m[38;5;43m20221212225945803 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225945803 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225945804 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225945804 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225945804 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225945805 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225945805 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:59:47.858517 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5368): Process ended prematurely: osmo-stp_10.42.42.5(pid=5368) [trial-2383↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5368)] [trial-2383↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 22:59:47.867910 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 22:59:47.895631 run osmo-hlr_10.42.42.2(pid=5365): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5365)] 22:59:47.945186 run osmo-hlr_10.42.42.2(pid=5365): stdout: | (launched: 2022-12-12_22:59:44.672749) 22:59:47.996372 run osmo-hlr_10.42.42.2(pid=5365): stderr: | [0;m[1;31m20221212225944852 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212225944852 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212225944852 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212225944853 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212225944853 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212225944853 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212225944864 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212225944873 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212225944873 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212225944873 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:59:48.067890 run osmo-msc_10.42.42.6(pid=5371): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5371)] 22:59:48.117345 run osmo-msc_10.42.42.6(pid=5371): stdout: | (launched: 2022-12-12_22:59:46.695097) 22:59:48.168464 run osmo-msc_10.42.42.6(pid=5371): stderr: | [0;m[38;5;43m20221212225947202 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212225947202 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fda59359c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212225947202 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212225947202 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212225947202 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212225947203 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212225947204 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212225947205 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212225947205 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212225947205 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:59:48.219897 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5364): Terminating (SIGTERM) 22:59:48.260872 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5367): Terminating (SIGTERM) 22:59:48.302464 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5370): Terminating (SIGTERM) 22:59:48.344311 --- ParallelTerminationStrategy: PID 5364 died... 22:59:48.364238 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5364): Terminated: ok {rc=0} 22:59:48.410145 --- ParallelTerminationStrategy: PID 5367 died... 22:59:48.429780 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5367): Terminated: ok {rc=0} 22:59:48.475858 --- ParallelTerminationStrategy: PID 5370 died... 22:59:48.495564 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5370): Terminated: ok {rc=0} 22:59:48.583740 bus /sierra_3: Setting Powered False 22:59:49.682457 bus /sierra_3: Setting Powered False 22:59:50.796604 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 22:59:52.042813 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 22:59:52.050855 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 22:59:52.080531 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 22:59:52.108087 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 22:59:52.160367 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 22:59:52.190203 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 22:59:52.217267 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 22:59:52.770696 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 22:59:52.823050 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:59:52.834792 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 22:59:52.901786 tst mo_mt_call.py: using LAC 32096 22:59:53.031644 tst mo_mt_call.py: using RAC 221 22:59:53.161943 tst mo_mt_call.py: using CellId 32096 22:59:53.289369 tst mo_mt_call.py: using BVCI 32097 22:59:53.408717 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:59:53.420411 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:59:53.431852 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:59:53.443378 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:59:53.454930 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 22:59:53.466440 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:59:53.583767 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 22:59:53.702770 run osmo-hlr_10.42.42.2: Starting osmo-hlr 22:59:54.210611 run create_hlr_db(pid=5376): Launched 22:59:54.343507 bus /sierra_2: Setting Powered False 22:59:55.408083 run create_hlr_db(pid=5376): Terminated: ok {rc=0} 22:59:55.861834 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5378): Launched 22:59:56.189994 run osmo-hlr_10.42.42.2(pid=5379): Launched 22:59:56.314270 run osmo-stp_10.42.42.5: Starting osmo-stp 22:59:56.882123 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5381): Launched 22:59:57.208201 run osmo-stp_10.42.42.5(pid=5382): Launched 22:59:57.333140 run osmo-msc_10.42.42.6: Starting osmo-msc 22:59:57.930728 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5384): Launched 22:59:58.257472 run osmo-msc_10.42.42.6(pid=5385): Launched 22:59:58.441657 run osmo-stp_10.42.42.5(pid=5382): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5382)] 22:59:58.579945 run osmo-stp_10.42.42.5(pid=5382): stdout: | (launched: 2022-12-12_22:59:57.148785) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:59:58.718816 run osmo-stp_10.42.42.5(pid=5382): stderr: | [0;m[38;5;43m20221212225957343 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225957343 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225957343 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225957344 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225957344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225957344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225957344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:59:58.856565 run osmo-stp_10.42.42.5(pid=5382): stdout: | (launched: 2022-12-12_22:59:57.148785) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 22:59:58.986777 run osmo-stp_10.42.42.5(pid=5382): stderr: | [0;m[38;5;43m20221212225957343 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212225957343 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212225957343 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212225957344 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212225957344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212225957344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212225957344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 22:59:59.142512 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5382): Process ended prematurely: osmo-stp_10.42.42.5(pid=5382) [trial-2383↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5382)] [trial-2383↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 22:59:59.151854 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 22:59:59.179837 run osmo-hlr_10.42.42.2(pid=5379): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5379)] 22:59:59.229719 run osmo-hlr_10.42.42.2(pid=5379): stdout: | (launched: 2022-12-12_22:59:56.130461) 22:59:59.281397 run osmo-hlr_10.42.42.2(pid=5379): stderr: | [0;m[1;31m20221212225956329 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212225956329 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212225956329 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212225956329 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212225956329 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212225956329 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212225956342 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212225956350 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212225956350 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212225956350 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 22:59:59.354119 run osmo-msc_10.42.42.6(pid=5385): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5385)] 22:59:59.404135 run osmo-msc_10.42.42.6(pid=5385): stdout: | (launched: 2022-12-12_22:59:58.197899) 22:59:59.455485 run osmo-msc_10.42.42.6(pid=5385): stderr: | [0;m[38;5;43m20221212225958523 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212225958523 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc0217b6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212225958524 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212225958524 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212225958524 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212225958524 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212225958526 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212225958526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212225958526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212225958526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 22:59:59.507471 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5378): Terminating (SIGTERM) 22:59:59.548866 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5381): Terminating (SIGTERM) 22:59:59.590370 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5384): Terminating (SIGTERM) 22:59:59.632031 --- ParallelTerminationStrategy: PID 5378 died... 22:59:59.652038 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5378): Terminated: ok {rc=0} 22:59:59.698243 --- ParallelTerminationStrategy: PID 5381 died... 22:59:59.717728 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5381): Terminated: ok {rc=0} 22:59:59.763021 --- ParallelTerminationStrategy: PID 5384 died... 22:59:59.782436 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5384): Terminated: ok {rc=0} 22:59:59.868856 bus /sierra_3: Setting Powered False 23:00:00.971957 bus /sierra_3: Setting Powered False 23:00:02.088824 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2383 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 23:00:03.246924 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:00:03.259315 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 23:00:03.328405 tst mo_mt_call_osmux.py: using LAC 32097 23:00:03.457532 tst mo_mt_call_osmux.py: using RAC 222 23:00:03.585723 tst mo_mt_call_osmux.py: using CellId 32097 23:00:03.714477 tst mo_mt_call_osmux.py: using BVCI 32098 23:00:03.829258 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:00:03.840655 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:00:03.851927 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:00:03.863456 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:00:03.875085 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:00:03.886562 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 23:00:04.007479 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 23:00:04.124058 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:00:04.599874 run create_hlr_db(pid=5397): Launched 23:00:04.717583 bus /sierra_2: Setting Powered False 23:00:05.778323 run create_hlr_db(pid=5397): Terminated: ok {rc=0} 23:00:06.223311 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5400): Launched 23:00:06.549153 run osmo-hlr_10.42.42.2(pid=5401): Launched 23:00:06.675022 run osmo-stp_10.42.42.5: Starting osmo-stp 23:00:07.244890 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5403): Launched 23:00:07.571915 run osmo-stp_10.42.42.5(pid=5404): Launched 23:00:07.698803 run osmo-msc_10.42.42.6: Starting osmo-msc 23:00:08.287826 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5406): Launched 23:00:08.612678 run osmo-msc_10.42.42.6(pid=5407): Launched 23:00:08.793935 run osmo-stp_10.42.42.5(pid=5404): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5404)] 23:00:08.931105 run osmo-stp_10.42.42.5(pid=5404): stdout: | (launched: 2022-12-12_23:00:07.512167) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:00:09.068464 run osmo-stp_10.42.42.5(pid=5404): stderr: | [0;m[38;5;43m20221212230007704 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230007704 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230007704 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230007705 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230007707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230007707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230007707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:00:09.204490 run osmo-stp_10.42.42.5(pid=5404): stdout: | (launched: 2022-12-12_23:00:07.512167) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:00:09.333433 run osmo-stp_10.42.42.5(pid=5404): stderr: | [0;m[38;5;43m20221212230007704 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230007704 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230007704 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230007705 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230007707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230007707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230007707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:00:09.488497 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5404): Process ended prematurely: osmo-stp_10.42.42.5(pid=5404) [trial-2383↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5404)] [trial-2383↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 23:00:09.498001 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 23:00:09.525736 run osmo-hlr_10.42.42.2(pid=5401): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5401)] 23:00:09.575317 run osmo-hlr_10.42.42.2(pid=5401): stdout: | (launched: 2022-12-12_23:00:06.489768) 23:00:09.626443 run osmo-hlr_10.42.42.2(pid=5401): stderr: | [0;m[1;31m20221212230006687 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212230006687 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212230006687 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212230006687 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212230006687 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212230006687 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212230006700 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212230006710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212230006710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212230006711 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:00:09.698167 run osmo-msc_10.42.42.6(pid=5407): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5407)] 23:00:09.747592 run osmo-msc_10.42.42.6(pid=5407): stdout: | (launched: 2022-12-12_23:00:08.553055) 23:00:09.798565 run osmo-msc_10.42.42.6(pid=5407): stderr: | [0;m[38;5;43m20221212230008879 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212230008879 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8dab340c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212230008879 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212230008879 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212230008879 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212230008879 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212230008881 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212230008882 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212230008882 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212230008882 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:00:09.849932 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5400): Terminating (SIGTERM) 23:00:09.891415 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5403): Terminating (SIGTERM) 23:00:09.932778 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5406): Terminating (SIGTERM) 23:00:09.974445 --- ParallelTerminationStrategy: PID 5400 died... 23:00:09.994379 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5400): Terminated: ok {rc=0} 23:00:10.039977 --- ParallelTerminationStrategy: PID 5403 died... 23:00:10.059353 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5403): Terminated: ok {rc=0} 23:00:10.104720 --- ParallelTerminationStrategy: PID 5406 died... 23:00:10.124304 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5406): Terminated: ok {rc=0} 23:00:10.211544 bus /sierra_3: Setting Powered False 23:00:11.310333 bus /sierra_3: Setting Powered False 23:00:12.423959 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 23:00:13.675544 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:00:13.682768 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 23:00:13.716342 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 23:00:13.743899 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 23:00:13.795452 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 23:00:13.827347 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 23:00:13.857416 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 23:00:14.406776 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 23:00:14.458679 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:00:14.470146 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 23:00:14.538370 tst mo_mt_call.py: using LAC 32098 23:00:14.659662 tst mo_mt_call.py: using RAC 223 23:00:14.779227 tst mo_mt_call.py: using CellId 32098 23:00:14.898941 tst mo_mt_call.py: using BVCI 32099 23:00:15.010963 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:00:15.022398 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:00:15.033449 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:00:15.044716 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:00:15.056096 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:00:15.067368 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 23:00:15.187350 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 23:00:15.305359 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:00:15.784707 run create_hlr_db(pid=5763): Launched 23:00:15.905796 bus /sierra_2: Setting Powered False 23:00:16.968141 run create_hlr_db(pid=5763): Terminated: ok {rc=0} 23:00:17.405932 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5765): Launched 23:00:17.714614 run osmo-hlr_10.42.42.2(pid=5766): Launched 23:00:17.832463 run osmo-stp_10.42.42.5: Starting osmo-stp 23:00:18.360249 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5768): Launched 23:00:18.667165 run osmo-stp_10.42.42.5(pid=5769): Launched 23:00:18.785428 run osmo-msc_10.42.42.6: Starting osmo-msc 23:00:19.339536 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5771): Launched 23:00:19.648177 run osmo-msc_10.42.42.6(pid=5772): Launched 23:00:19.821448 run osmo-stp_10.42.42.5(pid=5769): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5769)] 23:00:19.952328 run osmo-stp_10.42.42.5(pid=5769): stdout: | (launched: 2022-12-12_23:00:18.610298) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:00:20.082672 run osmo-stp_10.42.42.5(pid=5769): stderr: | [0;m[38;5;43m20221212230018780 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230018781 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230018781 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230018781 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230018783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230018784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230018784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:00:20.211074 run osmo-stp_10.42.42.5(pid=5769): stdout: | (launched: 2022-12-12_23:00:18.610298) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:00:20.332914 run osmo-stp_10.42.42.5(pid=5769): stderr: | [0;m[38;5;43m20221212230018780 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230018781 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230018781 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230018781 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230018783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230018784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230018784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:00:20.479479 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5769): Process ended prematurely: osmo-stp_10.42.42.5(pid=5769) [trial-2383↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5769)] [trial-2383↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 23:00:20.488514 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 23:00:20.515398 run osmo-hlr_10.42.42.2(pid=5766): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5766)] 23:00:20.563205 run osmo-hlr_10.42.42.2(pid=5766): stdout: | (launched: 2022-12-12_23:00:17.658446) 23:00:20.612460 run osmo-hlr_10.42.42.2(pid=5766): stderr: | [0;m[1;31m20221212230017837 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212230017838 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212230017838 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212230017838 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212230017838 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212230017838 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212230017861 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212230017870 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212230017870 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212230017870 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:00:20.681198 run osmo-msc_10.42.42.6(pid=5772): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5772)] 23:00:20.728497 run osmo-msc_10.42.42.6(pid=5772): stdout: | (launched: 2022-12-12_23:00:19.591830) 23:00:20.777658 run osmo-msc_10.42.42.6(pid=5772): stderr: | [0;m[38;5;43m20221212230019866 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212230019866 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6806a0ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212230019866 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212230019866 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212230019866 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212230019866 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212230019868 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212230019868 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212230019869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212230019869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:00:20.827222 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5765): Terminating (SIGTERM) 23:00:20.866753 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5768): Terminating (SIGTERM) 23:00:20.906277 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5771): Terminating (SIGTERM) 23:00:20.946373 --- ParallelTerminationStrategy: PID 5765 died... 23:00:20.965474 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5765): Terminated: ok {rc=0} 23:00:21.009696 --- ParallelTerminationStrategy: PID 5768 died... 23:00:21.028063 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5768): Terminated: ok {rc=0} 23:00:21.072137 --- ParallelTerminationStrategy: PID 5771 died... 23:00:21.090780 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5771): Terminated: ok {rc=0} 23:00:21.175059 bus /sierra_3: Setting Powered False 23:00:22.274552 bus /sierra_3: Setting Powered False 23:00:23.386742 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2383 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 23:00:24.543524 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:00:24.556473 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 23:00:24.628030 tst mo_mt_call_osmux.py: using LAC 32099 23:00:24.757688 tst mo_mt_call_osmux.py: using RAC 224 23:00:24.891917 tst mo_mt_call_osmux.py: using CellId 32099 23:00:25.026247 tst mo_mt_call_osmux.py: using BVCI 32100 23:00:25.151036 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:00:25.164039 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:00:25.176546 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:00:25.189222 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:00:25.201455 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:00:25.214563 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 23:00:25.338911 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 23:00:25.465212 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:00:25.991120 run create_hlr_db(pid=5949): Launched 23:00:26.163567 bus /sierra_2: Setting Powered False 23:00:27.229702 run create_hlr_db(pid=5949): Terminated: ok {rc=0} 23:00:27.707709 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5951): Launched 23:00:28.040789 run osmo-hlr_10.42.42.2(pid=5952): Launched 23:00:28.268800 run osmo-stp_10.42.42.5: Starting osmo-stp 23:00:28.874746 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5955): Launched 23:00:29.208404 run osmo-stp_10.42.42.5(pid=5956): Launched 23:00:29.335486 run osmo-msc_10.42.42.6: Starting osmo-msc 23:00:29.938150 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5958): Launched 23:00:30.271496 run osmo-msc_10.42.42.6(pid=5959): Launched 23:00:30.458883 run osmo-stp_10.42.42.5(pid=5956): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5956)] 23:00:30.598466 run osmo-stp_10.42.42.5(pid=5956): stdout: | (launched: 2022-12-12_23:00:29.147739) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:00:30.738845 run osmo-stp_10.42.42.5(pid=5956): stderr: | [0;m[38;5;43m20221212230029344 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230029344 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230029345 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230029345 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230029346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230029346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230029346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:00:30.898558 run osmo-stp_10.42.42.5(pid=5956): stdout: | (launched: 2022-12-12_23:00:29.147739) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:00:31.032444 run osmo-stp_10.42.42.5(pid=5956): stderr: | [0;m[38;5;43m20221212230029344 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230029344 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230029345 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230029345 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230029346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230029346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230029346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:00:31.193271 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5956): Process ended prematurely: osmo-stp_10.42.42.5(pid=5956) [trial-2383↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5956)] [trial-2383↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 23:00:31.203375 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 23:00:31.231934 run osmo-hlr_10.42.42.2(pid=5952): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5952)] 23:00:31.282840 run osmo-hlr_10.42.42.2(pid=5952): stdout: | (launched: 2022-12-12_23:00:27.982317) 23:00:31.335525 run osmo-hlr_10.42.42.2(pid=5952): stderr: | [0;m[1;31m20221212230028287 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212230028287 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212230028287 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212230028287 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212230028287 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212230028287 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212230028304 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212230028315 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212230028315 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212230028315 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:00:31.409451 run osmo-msc_10.42.42.6(pid=5959): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5959)] 23:00:31.460242 run osmo-msc_10.42.42.6(pid=5959): stdout: | (launched: 2022-12-12_23:00:30.210785) 23:00:31.512689 run osmo-msc_10.42.42.6(pid=5959): stderr: | [0;m[38;5;43m20221212230030537 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212230030537 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4bd4275c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212230030537 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212230030537 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212230030537 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212230030537 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212230030539 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212230030539 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212230030540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212230030540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:00:31.565407 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5951): Terminating (SIGTERM) 23:00:31.609398 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5955): Terminating (SIGTERM) 23:00:31.652553 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5958): Terminating (SIGTERM) 23:00:31.696748 --- ParallelTerminationStrategy: PID 5951 died... 23:00:31.717143 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5951): Terminated: ok {rc=0} 23:00:31.763952 --- ParallelTerminationStrategy: PID 5955 died... 23:00:31.784226 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5955): Terminated: ok {rc=0} 23:00:31.831331 --- ParallelTerminationStrategy: PID 5958 died... 23:00:31.851520 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5958): Terminated: ok {rc=0} 23:00:31.941039 bus /sierra_3: Setting Powered False 23:00:33.037326 bus /sierra_3: Setting Powered False 23:00:34.152700 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 23:00:35.396194 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:00:35.402662 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 23:00:35.432345 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 23:00:35.459243 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 23:00:35.511523 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 23:00:35.540732 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 23:00:35.567240 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 23:00:36.124028 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 23:00:36.178653 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:00:36.190526 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 23:00:36.258579 tst mo_mt_call.py: using LAC 32100 23:00:36.391410 tst mo_mt_call.py: using RAC 225 23:00:36.526744 tst mo_mt_call.py: using CellId 32100 23:00:36.650727 tst mo_mt_call.py: using BVCI 32101 23:00:36.767562 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:00:36.779472 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:00:36.790919 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:00:36.802561 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:00:36.814271 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:00:36.825762 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 23:00:36.946544 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 23:00:37.065871 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:00:37.553164 run create_hlr_db(pid=5964): Launched 23:00:37.673248 bus /sierra_2: Setting Powered False 23:00:38.735688 run create_hlr_db(pid=5964): Terminated: ok {rc=0} 23:00:39.192541 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5966): Launched 23:00:39.525656 run osmo-hlr_10.42.42.2(pid=5967): Launched 23:00:39.657359 run osmo-stp_10.42.42.5: Starting osmo-stp 23:00:40.238876 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5969): Launched 23:00:40.572037 run osmo-stp_10.42.42.5(pid=5970): Launched 23:00:40.699203 run osmo-msc_10.42.42.6: Starting osmo-msc 23:00:41.301397 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5972): Launched 23:00:41.636071 run osmo-msc_10.42.42.6(pid=5973): Launched 23:00:41.823142 run osmo-stp_10.42.42.5(pid=5970): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5970)] 23:00:41.963387 run osmo-stp_10.42.42.5(pid=5970): stdout: | (launched: 2022-12-12_23:00:40.511064) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:00:42.104318 run osmo-stp_10.42.42.5(pid=5970): stderr: | [0;m[38;5;43m20221212230040706 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230040707 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230040707 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230040707 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230040708 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230040708 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230040708 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:00:42.243240 run osmo-stp_10.42.42.5(pid=5970): stdout: | (launched: 2022-12-12_23:00:40.511064) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:00:42.375445 run osmo-stp_10.42.42.5(pid=5970): stderr: | [0;m[38;5;43m20221212230040706 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230040707 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230040707 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230040707 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230040708 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230040708 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230040708 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:00:42.533503 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5970): Process ended prematurely: osmo-stp_10.42.42.5(pid=5970) [trial-2383↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5970)] [trial-2383↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 23:00:42.543106 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 23:00:42.571133 run osmo-hlr_10.42.42.2(pid=5967): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5967)] 23:00:42.621087 run osmo-hlr_10.42.42.2(pid=5967): stdout: | (launched: 2022-12-12_23:00:39.464860) 23:00:42.672701 run osmo-hlr_10.42.42.2(pid=5967): stderr: | [0;m[1;31m20221212230039666 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212230039666 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212230039666 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212230039666 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212230039666 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212230039666 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212230039679 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212230039690 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212230039690 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212230039690 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:00:42.744832 run osmo-msc_10.42.42.6(pid=5973): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5973)] 23:00:42.794975 run osmo-msc_10.42.42.6(pid=5973): stdout: | (launched: 2022-12-12_23:00:41.574787) 23:00:42.846487 run osmo-msc_10.42.42.6(pid=5973): stderr: | [0;m[38;5;43m20221212230041898 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212230041898 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc298a79c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212230041899 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212230041899 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212230041899 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212230041899 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212230041902 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212230041903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212230041903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212230041903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:00:42.898684 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5966): Terminating (SIGTERM) 23:00:42.940616 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5969): Terminating (SIGTERM) 23:00:42.982306 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5972): Terminating (SIGTERM) 23:00:43.024246 --- ParallelTerminationStrategy: PID 5966 died... 23:00:43.044079 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5966): Terminated: ok {rc=0} 23:00:43.090956 --- ParallelTerminationStrategy: PID 5969 died... 23:00:43.110612 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5969): Terminated: ok {rc=0} 23:00:43.156511 --- ParallelTerminationStrategy: PID 5972 died... 23:00:43.176140 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5972): Terminated: ok {rc=0} 23:00:43.263546 bus /sierra_3: Setting Powered False 23:00:44.361665 bus /sierra_3: Setting Powered False 23:00:45.476776 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2383 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 23:00:46.622878 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:00:46.636074 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 23:00:46.705610 tst mo_mt_call_osmux.py: using LAC 32101 23:00:46.882328 tst mo_mt_call_osmux.py: using RAC 226 23:00:47.009984 tst mo_mt_call_osmux.py: using CellId 32101 23:00:47.141660 tst mo_mt_call_osmux.py: using BVCI 32102 23:00:47.265787 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:00:47.278188 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:00:47.290386 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:00:47.301998 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:00:47.313725 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:00:47.325458 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 23:00:47.444544 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 23:00:47.566039 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:00:48.053454 run create_hlr_db(pid=5975): Launched 23:00:48.175031 bus /sierra_2: Setting Powered False 23:00:49.237783 run create_hlr_db(pid=5975): Terminated: ok {rc=0} 23:00:49.693723 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5977): Launched 23:00:50.028824 run osmo-hlr_10.42.42.2(pid=5978): Launched 23:00:50.157678 run osmo-stp_10.42.42.5: Starting osmo-stp 23:00:50.735277 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5980): Launched 23:00:51.069105 run osmo-stp_10.42.42.5(pid=5981): Launched 23:00:51.195752 run osmo-msc_10.42.42.6: Starting osmo-msc 23:00:51.802064 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5983): Launched 23:00:52.135303 run osmo-msc_10.42.42.6(pid=5984): Launched 23:00:52.320576 run osmo-stp_10.42.42.5(pid=5981): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5981)] 23:00:52.460036 run osmo-stp_10.42.42.5(pid=5981): stdout: | (launched: 2022-12-12_23:00:51.008242) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:00:52.600329 run osmo-stp_10.42.42.5(pid=5981): stderr: | [0;m[38;5;43m20221212230051204 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230051204 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230051205 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230051205 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230051206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230051206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230051206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:00:52.739627 run osmo-stp_10.42.42.5(pid=5981): stdout: | (launched: 2022-12-12_23:00:51.008242) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:00:52.871641 run osmo-stp_10.42.42.5(pid=5981): stderr: | [0;m[38;5;43m20221212230051204 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230051204 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230051205 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230051205 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230051206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230051206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230051206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:00:53.030229 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5981): Process ended prematurely: osmo-stp_10.42.42.5(pid=5981) [trial-2383↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5981)] [trial-2383↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 23:00:53.040066 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 23:00:53.068294 run osmo-hlr_10.42.42.2(pid=5978): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5978)] 23:00:53.118239 run osmo-hlr_10.42.42.2(pid=5978): stdout: | (launched: 2022-12-12_23:00:49.967847) 23:00:53.169784 run osmo-hlr_10.42.42.2(pid=5978): stderr: | [0;m[1;31m20221212230050170 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212230050170 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212230050170 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212230050170 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212230050170 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212230050170 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212230050184 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212230050192 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212230050192 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212230050192 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:00:53.241927 run osmo-msc_10.42.42.6(pid=5984): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5984)] 23:00:53.291600 run osmo-msc_10.42.42.6(pid=5984): stdout: | (launched: 2022-12-12_23:00:52.074599) 23:00:53.342978 run osmo-msc_10.42.42.6(pid=5984): stderr: | [0;m[38;5;43m20221212230052398 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212230052399 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f07b70c5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212230052399 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212230052399 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212230052399 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212230052399 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212230052401 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212230052401 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212230052401 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212230052402 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:00:53.395125 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5977): Terminating (SIGTERM) 23:00:53.436444 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5980): Terminating (SIGTERM) 23:00:53.477969 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5983): Terminating (SIGTERM) 23:00:53.519706 --- ParallelTerminationStrategy: PID 5977 died... 23:00:53.539827 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5977): Terminated: ok {rc=0} 23:00:53.586098 --- ParallelTerminationStrategy: PID 5980 died... 23:00:53.605917 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5980): Terminated: ok {rc=0} 23:00:53.652169 --- ParallelTerminationStrategy: PID 5983 died... 23:00:53.672040 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5983): Terminated: ok {rc=0} 23:00:53.760476 bus /sierra_3: Setting Powered False 23:00:54.860621 bus /sierra_3: Setting Powered False 23:00:55.976989 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 23:00:57.235760 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:00:57.243322 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 23:00:57.273890 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 23:00:57.301853 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 23:00:57.354203 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 23:00:57.384155 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 23:00:57.411581 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 23:00:57.968357 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 23:00:58.021587 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:00:58.033522 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 23:00:58.100449 tst mo_mt_call.py: using LAC 32102 23:00:58.233948 tst mo_mt_call.py: using RAC 227 23:00:58.364322 tst mo_mt_call.py: using CellId 32102 23:00:58.494297 tst mo_mt_call.py: using BVCI 32103 23:00:58.615052 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:00:58.626984 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:00:58.638672 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:00:58.650384 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:00:58.662293 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:00:58.674441 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:00:58.797361 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:00:58.925409 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:00:59.413609 run create_hlr_db(pid=5989): Launched 23:00:59.536221 bus /sierra_2: Setting Powered False 23:01:00.598507 run create_hlr_db(pid=5989): Terminated: ok {rc=0} 23:01:01.065814 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5991): Launched 23:01:01.463871 run osmo-hlr_10.42.42.2(pid=5992): Launched 23:01:01.677158 run osmo-stp_10.42.42.5: Starting osmo-stp 23:01:02.370895 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5994): Launched 23:01:02.686538 run osmo-stp_10.42.42.5(pid=5995): Launched 23:01:02.806179 run osmo-msc_10.42.42.6: Starting osmo-msc 23:01:03.369802 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5997): Launched 23:01:03.684650 run osmo-msc_10.42.42.6(pid=5998): Launched 23:01:03.861250 run osmo-stp_10.42.42.5(pid=5995): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5995)] 23:01:03.993268 run osmo-stp_10.42.42.5(pid=5995): stdout: | (launched: 2022-12-12_23:01:02.629264) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:01:04.125386 run osmo-stp_10.42.42.5(pid=5995): stderr: | [0;m[38;5;43m20221212230102801 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230102802 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230102802 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230102802 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230102803 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230102803 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230102803 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:01:04.255433 run osmo-stp_10.42.42.5(pid=5995): stdout: | (launched: 2022-12-12_23:01:02.629264) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:01:04.379440 run osmo-stp_10.42.42.5(pid=5995): stderr: | [0;m[38;5;43m20221212230102801 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230102802 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230102802 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230102802 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230102803 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230102803 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230102803 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:01:04.528255 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5995): Process ended prematurely: osmo-stp_10.42.42.5(pid=5995) [trial-2383↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5995)] [trial-2383↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 23:01:04.537293 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 23:01:04.564231 run osmo-hlr_10.42.42.2(pid=5992): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5992)] 23:01:04.611967 run osmo-hlr_10.42.42.2(pid=5992): stdout: | (launched: 2022-12-12_23:01:01.399746) 23:01:04.661236 run osmo-hlr_10.42.42.2(pid=5992): stderr: | [0;m[1;31m20221212230101760 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212230101760 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212230101760 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212230101760 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212230101760 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212230101760 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212230101814 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212230101832 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212230101833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212230101833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:01:04.730063 run osmo-msc_10.42.42.6(pid=5998): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5998)] 23:01:04.777399 run osmo-msc_10.42.42.6(pid=5998): stdout: | (launched: 2022-12-12_23:01:03.626898) 23:01:04.826566 run osmo-msc_10.42.42.6(pid=5998): stderr: | [0;m[38;5;43m20221212230103903 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212230103903 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8b5b7bec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212230103903 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212230103903 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212230103903 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212230103903 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212230103905 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212230103906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212230103906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212230103906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:01:04.875899 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5991): Terminating (SIGTERM) 23:01:04.915487 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5994): Terminating (SIGTERM) 23:01:04.955588 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5997): Terminating (SIGTERM) 23:01:04.995420 --- ParallelTerminationStrategy: PID 5991 died... 23:01:05.014250 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5991): Terminated: ok {rc=0} 23:01:05.058565 --- ParallelTerminationStrategy: PID 5994 died... 23:01:05.077143 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5994): Terminated: ok {rc=0} 23:01:05.121487 --- ParallelTerminationStrategy: PID 5997 died... 23:01:05.140311 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5997): Terminated: ok {rc=0} 23:01:05.225321 bus /sierra_3: Setting Powered False 23:01:06.324328 bus /sierra_3: Setting Powered False 23:01:07.440250 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2383 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 23:01:08.587398 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:01:08.599598 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 23:01:08.666654 tst mo_mt_call_osmux.py: using LAC 32103 23:01:08.790404 tst mo_mt_call_osmux.py: using RAC 228 23:01:08.916416 tst mo_mt_call_osmux.py: using CellId 32103 23:01:09.039952 tst mo_mt_call_osmux.py: using BVCI 32104 23:01:09.156615 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:01:09.168120 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:01:09.179314 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:01:09.190873 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:01:09.202558 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:01:09.214120 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:01:09.336570 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:01:09.457093 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:01:09.945428 run create_hlr_db(pid=6000): Launched 23:01:10.064870 bus /sierra_2: Setting Powered False 23:01:11.126951 run create_hlr_db(pid=6000): Terminated: ok {rc=0} 23:01:11.562574 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6002): Launched 23:01:11.877715 run osmo-hlr_10.42.42.2(pid=6003): Launched 23:01:11.999837 run osmo-stp_10.42.42.5: Starting osmo-stp 23:01:12.541421 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6005): Launched 23:01:12.856808 run osmo-stp_10.42.42.5(pid=6006): Launched 23:01:12.978134 run osmo-msc_10.42.42.6: Starting osmo-msc 23:01:13.544022 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6008): Launched 23:01:13.857598 run osmo-msc_10.42.42.6(pid=6009): Launched 23:01:14.035566 run osmo-stp_10.42.42.5(pid=6006): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6006)] 23:01:14.168679 run osmo-stp_10.42.42.5(pid=6006): stdout: | (launched: 2022-12-12_23:01:12.798982) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:01:14.301542 run osmo-stp_10.42.42.5(pid=6006): stderr: | [0;m[38;5;43m20221212230112972 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230112972 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230112973 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230112973 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230112974 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230112974 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230112974 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:01:14.432912 run osmo-stp_10.42.42.5(pid=6006): stdout: | (launched: 2022-12-12_23:01:12.798982) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:01:14.557635 run osmo-stp_10.42.42.5(pid=6006): stderr: | [0;m[38;5;43m20221212230112972 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230112972 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230112973 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230112973 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230112974 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230112974 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230112974 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:01:14.707218 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6006): Process ended prematurely: osmo-stp_10.42.42.5(pid=6006) [trial-2383↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6006)] [trial-2383↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 23:01:14.716274 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 23:01:14.743475 run osmo-hlr_10.42.42.2(pid=6003): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6003)] 23:01:14.791136 run osmo-hlr_10.42.42.2(pid=6003): stdout: | (launched: 2022-12-12_23:01:11.820234) 23:01:14.840459 run osmo-hlr_10.42.42.2(pid=6003): stderr: | [0;m[1;31m20221212230112001 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212230112001 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212230112001 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212230112001 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212230112001 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212230112001 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212230112028 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212230112037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212230112038 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212230112038 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:01:14.909487 run osmo-msc_10.42.42.6(pid=6009): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6009)] 23:01:14.957128 run osmo-msc_10.42.42.6(pid=6009): stdout: | (launched: 2022-12-12_23:01:13.800264) 23:01:15.006295 run osmo-msc_10.42.42.6(pid=6009): stderr: | [0;m[38;5;43m20221212230114073 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212230114074 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8c11661c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212230114074 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212230114074 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212230114074 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212230114074 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212230114076 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212230114076 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212230114076 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212230114076 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:01:15.055964 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6002): Terminating (SIGTERM) 23:01:15.095522 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6005): Terminating (SIGTERM) 23:01:15.135226 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6008): Terminating (SIGTERM) 23:01:15.175430 --- ParallelTerminationStrategy: PID 6002 died... 23:01:15.194695 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6002): Terminated: ok {rc=0} 23:01:15.239041 --- ParallelTerminationStrategy: PID 6005 died... 23:01:15.257896 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6005): Terminated: ok {rc=0} 23:01:15.302857 --- ParallelTerminationStrategy: PID 6008 died... 23:01:15.321814 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6008): Terminated: ok {rc=0} 23:01:15.407625 bus /sierra_3: Setting Powered False 23:01:16.513404 bus /sierra_3: Setting Powered False 23:01:17.638434 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 23:01:18.892943 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:01:18.899593 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 23:01:18.929844 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 23:01:18.957423 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 23:01:19.011625 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 23:01:19.041732 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 23:01:19.069156 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 23:01:19.620416 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 23:01:19.673803 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:01:19.685488 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:01:19.754077 tst mo_mt_call.py: using LAC 32104 23:01:19.887194 tst mo_mt_call.py: using RAC 229 23:01:20.021273 tst mo_mt_call.py: using CellId 32104 23:01:20.152826 tst mo_mt_call.py: using BVCI 32105 23:01:20.275086 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:01:20.286648 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:01:20.298056 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:01:20.309408 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:01:20.320782 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:01:20.332270 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 23:01:20.449804 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 23:01:20.572134 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:01:21.090592 run create_hlr_db(pid=6015): Launched 23:01:21.225050 bus /sierra_2: Setting Powered False 23:01:22.290940 run create_hlr_db(pid=6015): Terminated: ok {rc=0} 23:01:22.738308 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6017): Launched 23:01:23.053335 run osmo-hlr_10.42.42.2(pid=6018): Launched 23:01:23.173365 run osmo-stp_10.42.42.5: Starting osmo-stp 23:01:23.724230 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6020): Launched 23:01:24.037573 run osmo-stp_10.42.42.5(pid=6021): Launched 23:01:24.158308 run osmo-msc_10.42.42.6: Starting osmo-msc 23:01:24.725051 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6023): Launched 23:01:25.039212 run osmo-msc_10.42.42.6(pid=6024): Launched 23:01:25.215472 run osmo-stp_10.42.42.5(pid=6021): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6021)] 23:01:25.348324 run osmo-stp_10.42.42.5(pid=6021): stdout: | (launched: 2022-12-12_23:01:23.979766) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:01:25.480709 run osmo-stp_10.42.42.5(pid=6021): stderr: | [0;m[38;5;43m20221212230124155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230124155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230124155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230124155 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230124156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230124156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230124156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:01:25.610785 run osmo-stp_10.42.42.5(pid=6021): stdout: | (launched: 2022-12-12_23:01:23.979766) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:01:25.734691 run osmo-stp_10.42.42.5(pid=6021): stderr: | [0;m[38;5;43m20221212230124155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230124155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230124155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230124155 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230124156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230124156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230124156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:01:25.883171 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6021): Process ended prematurely: osmo-stp_10.42.42.5(pid=6021) [trial-2383↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6021)] [trial-2383↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 23:01:25.892345 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 23:01:25.919300 run osmo-hlr_10.42.42.2(pid=6018): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6018)] 23:01:25.967021 run osmo-hlr_10.42.42.2(pid=6018): stdout: | (launched: 2022-12-12_23:01:22.995970) 23:01:26.016087 run osmo-hlr_10.42.42.2(pid=6018): stderr: | [0;m[1;31m20221212230123176 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212230123176 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212230123176 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212230123176 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212230123176 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212230123176 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212230123187 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212230123195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212230123196 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212230123196 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:01:26.084980 run osmo-msc_10.42.42.6(pid=6024): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6024)] 23:01:26.132503 run osmo-msc_10.42.42.6(pid=6024): stdout: | (launched: 2022-12-12_23:01:24.981297) 23:01:26.181706 run osmo-msc_10.42.42.6(pid=6024): stderr: | [0;m[38;5;43m20221212230125254 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212230125254 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fbdc46fbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212230125254 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212230125254 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212230125254 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212230125255 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212230125256 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212230125257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212230125257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212230125257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:01:26.231341 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6017): Terminating (SIGTERM) 23:01:26.270765 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6020): Terminating (SIGTERM) 23:01:26.310557 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6023): Terminating (SIGTERM) 23:01:26.350576 --- ParallelTerminationStrategy: PID 6017 died... 23:01:26.369733 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6017): Terminated: ok {rc=0} 23:01:26.414044 --- ParallelTerminationStrategy: PID 6020 died... 23:01:26.432610 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6020): Terminated: ok {rc=0} 23:01:26.477406 --- ParallelTerminationStrategy: PID 6023 died... 23:01:26.496073 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6023): Terminated: ok {rc=0} 23:01:26.582796 bus /sierra_3: Setting Powered False 23:01:27.683484 bus /sierra_3: Setting Powered False 23:01:28.799362 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2383 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 23:01:29.949942 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:01:29.962310 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:01:30.037970 tst mo_mt_call_osmux.py: using LAC 32105 23:01:30.170355 tst mo_mt_call_osmux.py: using RAC 230 23:01:30.301619 tst mo_mt_call_osmux.py: using CellId 32105 23:01:30.430642 tst mo_mt_call_osmux.py: using BVCI 32106 23:01:30.552260 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:01:30.564031 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:01:30.575575 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:01:30.587274 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:01:30.598872 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:01:30.610389 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 23:01:30.730324 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 23:01:30.861270 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:01:31.373630 run create_hlr_db(pid=6026): Launched 23:01:31.538204 bus /sierra_2: Setting Powered False 23:01:32.600513 run create_hlr_db(pid=6026): Terminated: ok {rc=0} 23:01:33.056760 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6028): Launched 23:01:33.388804 run osmo-hlr_10.42.42.2(pid=6029): Launched 23:01:33.517622 run osmo-stp_10.42.42.5: Starting osmo-stp 23:01:34.089369 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6031): Launched 23:01:34.422490 run osmo-stp_10.42.42.5(pid=6032): Launched 23:01:34.548922 run osmo-msc_10.42.42.6: Starting osmo-msc 23:01:35.150493 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6034): Launched 23:01:35.484598 run osmo-msc_10.42.42.6(pid=6035): Launched 23:01:35.670186 run osmo-stp_10.42.42.5(pid=6032): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6032)] 23:01:35.809834 run osmo-stp_10.42.42.5(pid=6032): stdout: | (launched: 2022-12-12_23:01:34.361563) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:01:35.950956 run osmo-stp_10.42.42.5(pid=6032): stderr: | [0;m[38;5;43m20221212230134557 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230134557 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230134557 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230134557 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230134558 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230134558 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230134558 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:01:36.090323 run osmo-stp_10.42.42.5(pid=6032): stdout: | (launched: 2022-12-12_23:01:34.361563) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:01:36.223427 run osmo-stp_10.42.42.5(pid=6032): stderr: | [0;m[38;5;43m20221212230134557 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230134557 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230134557 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230134557 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230134558 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230134558 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230134558 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:01:36.381896 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6032): Process ended prematurely: osmo-stp_10.42.42.5(pid=6032) [trial-2383↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6032)] [trial-2383↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 23:01:36.391584 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 23:01:36.419897 run osmo-hlr_10.42.42.2(pid=6029): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6029)] 23:01:36.470732 run osmo-hlr_10.42.42.2(pid=6029): stdout: | (launched: 2022-12-12_23:01:33.328168) 23:01:36.523529 run osmo-hlr_10.42.42.2(pid=6029): stderr: | [0;m[1;31m20221212230133532 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212230133532 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212230133532 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212230133532 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212230133532 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212230133532 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212230133545 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212230133553 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212230133553 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212230133553 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:01:36.596713 run osmo-msc_10.42.42.6(pid=6035): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6035)] 23:01:36.647170 run osmo-msc_10.42.42.6(pid=6035): stdout: | (launched: 2022-12-12_23:01:35.423581) 23:01:36.699340 run osmo-msc_10.42.42.6(pid=6035): stderr: | [0;m[38;5;43m20221212230135749 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212230135749 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc86b030c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212230135749 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212230135749 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212230135750 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212230135750 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212230135751 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212230135752 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212230135752 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212230135752 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:01:36.751928 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6028): Terminating (SIGTERM) 23:01:36.793713 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6031): Terminating (SIGTERM) 23:01:36.835621 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6034): Terminating (SIGTERM) 23:01:36.877935 --- ParallelTerminationStrategy: PID 6028 died... 23:01:36.898473 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6028): Terminated: ok {rc=0} 23:01:36.945011 --- ParallelTerminationStrategy: PID 6031 died... 23:01:36.964807 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6031): Terminated: ok {rc=0} 23:01:37.011101 --- ParallelTerminationStrategy: PID 6034 died... 23:01:37.030775 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6034): Terminated: ok {rc=0} 23:01:37.118459 bus /sierra_3: Setting Powered False 23:01:38.217920 bus /sierra_3: Setting Powered False 23:01:39.336212 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 emergency:trx-lms-limenet-micro --------------------------------------------------------------------- 23:01:40.585896 tst emergency:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:01:40.590606 tst emergency:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 23:01:40.620570 tst emergency:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 23:01:40.648265 tst emergency:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 23:01:40.735085 tst emergency:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 23:01:40.764849 tst emergency:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 23:01:40.792669 tst emergency:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 23:01:41.378845 tst emergency:trx-lms-limenet-micro: RESERVED RESOURCES for emergency: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2383 emergency:trx-lms-limenet-micro emergency_mo_mt_call.py ---------------------------------------------- 23:01:41.384043 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:01:41.395475 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 23:01:41.441447 tst emergency_mo_mt_call.py: using LAC 32106 23:01:41.586034 tst emergency_mo_mt_call.py: using RAC 231 23:01:41.718320 tst emergency_mo_mt_call.py: using CellId 32106 23:01:41.847078 tst emergency_mo_mt_call.py: using BVCI 32107 23:01:41.967555 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:01:41.979109 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:01:41.990386 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:01:42.001685 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:01:42.012851 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:01:42.024152 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 23:01:42.140123 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 23:01:42.262249 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:01:42.769177 run create_hlr_db(pid=6041): Launched 23:01:42.903093 bus /sierra_2: Setting Powered False 23:01:43.967622 run create_hlr_db(pid=6041): Terminated: ok {rc=0} 23:01:44.423247 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6043): Launched 23:01:44.751052 run osmo-hlr_10.42.42.2(pid=6044): Launched 23:01:44.876225 run osmo-stp_10.42.42.5: Starting osmo-stp 23:01:45.437540 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6047): Launched 23:01:45.765647 run osmo-stp_10.42.42.5(pid=6048): Launched 23:01:45.976040 tst emergency_mo_mt_call.py: using MSISDN 8012 23:01:46.290387 run osmo-msc_10.42.42.6: Starting osmo-msc 23:01:46.960061 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6050): Launched 23:01:47.302932 run osmo-msc_10.42.42.6(pid=6051): Launched 23:01:47.488193 run osmo-stp_10.42.42.5(pid=6048): ERR: Terminated: ERROR {rc=1} [trial-2383↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6048)] 23:01:47.620622 run osmo-stp_10.42.42.5(pid=6048): stdout: | (launched: 2022-12-12_23:01:45.705714) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:01:47.751146 run osmo-stp_10.42.42.5(pid=6048): stderr: | [0;m[38;5;43m20221212230145954 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230145954 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230145955 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230145955 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230145957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230145957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230145958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:01:47.879397 run osmo-stp_10.42.42.5(pid=6048): stdout: | (launched: 2022-12-12_23:01:45.705714) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:01:48.002048 run osmo-stp_10.42.42.5(pid=6048): stderr: | [0;m[38;5;43m20221212230145954 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230145954 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230145955 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230145955 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230145957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230145957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230145958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:01:48.148707 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=6048): Process ended prematurely: osmo-stp_10.42.42.5(pid=6048) [trial-2383↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6048)] [trial-2383↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19] 23:01:48.157096 tst emergency_mo_mt_call.py:19: Test FAILED (6.8 sec) 23:01:48.184128 run osmo-hlr_10.42.42.2(pid=6044): ERR: Terminated: ERROR {rc=237} [trial-2383↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6044)] 23:01:48.233202 run osmo-hlr_10.42.42.2(pid=6044): stdout: | (launched: 2022-12-12_23:01:44.691261) 23:01:48.283349 run osmo-hlr_10.42.42.2(pid=6044): stderr: | [0;m[1;31m20221212230144890 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212230144890 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212230144890 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212230144890 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212230144890 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212230144890 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212230144903 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/emergency:trx-lms-limenet-micro/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212230144911 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212230144912 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212230144912 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:01:48.353325 run osmo-msc_10.42.42.6(pid=6051): ERR: Terminated: ERROR {rc=2} [trial-2383↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6051)] 23:01:48.401659 run osmo-msc_10.42.42.6(pid=6051): stdout: | (launched: 2022-12-12_23:01:47.242955) 23:01:48.451576 run osmo-msc_10.42.42.6(pid=6051): stderr: | [0;m[38;5;43m20221212230147528 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212230147528 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7a62527c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212230147528 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212230147528 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212230147528 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212230147528 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212230147530 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212230147531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212230147531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212230147531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:01:48.502260 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6043): Terminating (SIGTERM) 23:01:48.542593 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6047): Terminating (SIGTERM) 23:01:48.583092 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6050): Terminating (SIGTERM) 23:01:48.623775 --- ParallelTerminationStrategy: PID 6043 died... 23:01:48.642452 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6043): Terminated: ok {rc=0} 23:01:48.687485 --- ParallelTerminationStrategy: PID 6047 died... 23:01:48.706197 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6047): Terminated: ok {rc=0} 23:01:48.750641 --- ParallelTerminationStrategy: PID 6050 died... 23:01:48.769740 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6050): Terminated: ok {rc=0} 23:01:48.853705 bus /sierra_3: Setting Powered False 23:01:49.951663 bus /sierra_3: Setting Powered False 23:01:51.066519 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2383 emergency:trx-lms-limenet-micro emergency_preemptive_call.py ---------------------------------------------- 23:01:52.152042 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:01:52.164384 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 23:01:52.213198 tst emergency_preemptive_call.py: using LAC 32107 23:01:52.342404 tst emergency_preemptive_call.py: using RAC 232 23:01:52.472766 tst emergency_preemptive_call.py: using CellId 32107 23:01:52.602411 tst emergency_preemptive_call.py: using BVCI 32108 23:01:52.722724 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:01:52.734266 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:01:52.745396 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:01:52.756543 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:01:52.767675 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:01:52.778771 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 23:01:52.900539 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 23:01:53.018301 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 23:01:53.135901 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 23:01:53.251767 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:01:53.730505 run create_hlr_db(pid=6053): Launched 23:01:53.850033 bus /sierra_2: Setting Powered False 23:01:54.911367 run create_hlr_db(pid=6053): Terminated: ok {rc=0} 23:01:55.360294 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6055): Launched 23:01:55.687509 run osmo-hlr_10.42.42.2(pid=6056): Launched 23:01:55.813275 run osmo-stp_10.42.42.5: Starting osmo-stp 23:01:56.377355 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6058): Launched 23:01:56.706760 run osmo-stp_10.42.42.5(pid=6059): Launched 23:01:56.839676 tst emergency_preemptive_call.py: using MSISDN 8013 23:01:57.008303 run osmo-msc_10.42.42.6: Starting osmo-msc 23:01:57.595402 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6061): Launched 23:01:57.923808 run osmo-msc_10.42.42.6(pid=6062): Launched 23:01:58.098497 run osmo-stp_10.42.42.5(pid=6059): ERR: Terminated: ERROR {rc=1} [trial-2383↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6059)] 23:01:58.231671 run osmo-stp_10.42.42.5(pid=6059): stdout: | (launched: 2022-12-12_23:01:56.646207) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:01:58.362683 run osmo-stp_10.42.42.5(pid=6059): stderr: | [0;m[38;5;43m20221212230156843 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230156844 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230156844 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230156844 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230156845 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230156845 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230156845 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:01:58.491283 run osmo-stp_10.42.42.5(pid=6059): stdout: | (launched: 2022-12-12_23:01:56.646207) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:01:58.614155 run osmo-stp_10.42.42.5(pid=6059): stderr: | [0;m[38;5;43m20221212230156843 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230156844 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230156844 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230156844 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230156845 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230156845 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230156845 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:01:58.761241 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=6059): Process ended prematurely: osmo-stp_10.42.42.5(pid=6059) [trial-2383↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6059)] [trial-2383↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32] 23:01:58.769918 tst emergency_preemptive_call.py:32: Test FAILED (6.6 sec) 23:01:58.796741 run osmo-hlr_10.42.42.2(pid=6056): ERR: Terminated: ERROR {rc=237} [trial-2383↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6056)] 23:01:58.845517 run osmo-hlr_10.42.42.2(pid=6056): stdout: | (launched: 2022-12-12_23:01:55.627971) 23:01:58.895604 run osmo-hlr_10.42.42.2(pid=6056): stderr: | [0;m[1;31m20221212230155830 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212230155830 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212230155830 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212230155830 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212230155830 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212230155830 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212230155845 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/emergency:trx-lms-limenet-micro/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212230155853 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212230155853 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212230155853 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:01:58.965491 run osmo-msc_10.42.42.6(pid=6062): ERR: Terminated: ERROR {rc=2} [trial-2383↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6062)] 23:01:59.013814 run osmo-msc_10.42.42.6(pid=6062): stdout: | (launched: 2022-12-12_23:01:57.863664) 23:01:59.063582 run osmo-msc_10.42.42.6(pid=6062): stderr: | [0;m[38;5;43m20221212230158136 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212230158137 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0fce3c7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212230158137 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212230158137 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212230158137 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212230158137 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212230158139 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212230158139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212230158139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212230158140 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:01:59.113965 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6055): Terminating (SIGTERM) 23:01:59.154421 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6058): Terminating (SIGTERM) 23:01:59.194327 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6061): Terminating (SIGTERM) 23:01:59.235391 --- ParallelTerminationStrategy: PID 6055 died... 23:01:59.254723 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6055): Terminated: ok {rc=0} 23:01:59.299742 --- ParallelTerminationStrategy: PID 6058 died... 23:01:59.318574 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6058): Terminated: ok {rc=0} 23:01:59.363274 --- ParallelTerminationStrategy: PID 6061 died... 23:01:59.382100 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6061): Terminated: ok {rc=0} 23:01:59.468100 bus /sierra_9: Setting Powered False 23:02:00.567266 bus /sierra_9: Setting Powered False 23:02:01.683559 bus /sierra_8: Setting Powered False 23:02:02.782399 bus /sierra_8: Setting Powered False 23:02:03.894990 bus /sierra_3: Setting Powered False 23:02:04.992856 bus /sierra_3: Setting Powered False 23:02:06.109599 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 emergency:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 gprs:trx-lms-limenet-micro --------------------------------------------------------------------- 23:02:07.388271 tst gprs:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:02:07.392930 tst gprs:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 23:02:07.423194 tst gprs:trx-lms-limenet-micro: Verifying 9 x ip_address (candidates: 9) 23:02:07.463029 tst gprs:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 23:02:07.554015 tst gprs:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 23:02:07.584547 tst gprs:trx-lms-limenet-micro: Reserving 9 x ip_address (candidates: 9) 23:02:07.624264 tst gprs:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 23:02:08.216890 tst gprs:trx-lms-limenet-micro: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2383 gprs:trx-lms-limenet-micro cs_paging_gprs_active.py ---------------------------------------------- 23:02:08.270831 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 23:02:08.282233 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 23:02:08.328234 tst cs_paging_gprs_active.py: using LAC 32108 23:02:08.462912 tst cs_paging_gprs_active.py: using RAC 233 23:02:08.596230 tst cs_paging_gprs_active.py: using CellId 32108 23:02:08.728261 tst cs_paging_gprs_active.py: using BVCI 32109 23:02:08.850579 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 23:02:08.862062 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 23:02:08.873176 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 23:02:08.884330 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 23:02:08.895369 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 23:02:08.906484 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 23:02:08.918196 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 23:02:08.929250 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 23:02:08.940469 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 23:02:09.057725 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 23:02:09.180163 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 23:02:09.407195 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:02:09.742532 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6067): Launched 23:02:10.034270 run iperf3-srv_10.42.42.10(pid=6068): Launched 23:02:10.161140 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 23:02:10.386851 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:02:10.721869 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6069): Launched 23:02:11.014243 run iperf3-srv_10.42.42.10(pid=6070): Launched 23:02:11.140529 tst cs_paging_gprs_active.py:38: start network... 23:02:11.365960 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:02:11.883512 run create_hlr_db(pid=6071): Launched 23:02:12.019881 bus /sierra_2: Setting Powered False 23:02:13.085387 run create_hlr_db(pid=6071): Terminated: ok {rc=0} 23:02:13.549648 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6073): Launched 23:02:13.885883 run osmo-hlr_10.42.42.2(pid=6074): Launched 23:02:14.013990 run osmo-stp_10.42.42.5: Starting osmo-stp 23:02:14.593359 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6076): Launched 23:02:14.928266 run osmo-stp_10.42.42.5(pid=6077): Launched 23:02:15.056027 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:02:15.632782 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6079): Launched 23:02:15.761906 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:02:16.059129 run patchelf(pid=6080): Launched 23:02:16.256907 run osmo-stp_10.42.42.5(pid=6077): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6077)] 23:02:16.396144 run osmo-stp_10.42.42.5(pid=6077): stdout: | (launched: 2022-12-12_23:02:14.866778) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:02:16.536763 run osmo-stp_10.42.42.5(pid=6077): stderr: | [0;m[38;5;43m20221212230215062 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230215062 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230215063 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230215063 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230215063 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230215063 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230215064 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:02:16.677648 run osmo-stp_10.42.42.5(pid=6077): stdout: | (launched: 2022-12-12_23:02:14.866778) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:02:16.812924 run osmo-stp_10.42.42.5(pid=6077): stderr: | [0;m[38;5;43m20221212230215062 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230215062 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230215063 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230215063 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230215063 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230215063 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230215064 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:02:16.972011 run patchelf(pid=6080): Terminating (SIGINT) 23:02:17.157575 run patchelf(pid=6080): Terminated: ok {rc=0} 23:02:17.289363 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=6077): Process ended prematurely: osmo-stp_10.42.42.5(pid=6077) [trial-2383↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6077)] [trial-2383↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38] 23:02:17.299254 tst cs_paging_gprs_active.py:38: Test FAILED (9.1 sec) 23:02:17.328822 run osmo-hlr_10.42.42.2(pid=6074): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6074)] 23:02:17.377529 run osmo-hlr_10.42.42.2(pid=6074): stdout: | (launched: 2022-12-12_23:02:13.824622) 23:02:17.428031 run osmo-hlr_10.42.42.2(pid=6074): stderr: | [0;m[1;31m20221212230214028 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212230214028 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212230214028 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212230214028 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212230214028 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212230214028 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212230214041 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-lms-limenet-micro/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212230214050 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212230214051 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212230214051 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:02:17.478842 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6067): Terminating (SIGTERM) 23:02:17.519718 run iperf3-srv_10.42.42.10(pid=6068): Terminating (SIGTERM) 23:02:17.560390 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6069): Terminating (SIGTERM) 23:02:17.601430 run iperf3-srv_10.42.42.10(pid=6070): Terminating (SIGTERM) 23:02:17.642058 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6073): Terminating (SIGTERM) 23:02:17.682904 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6076): Terminating (SIGTERM) 23:02:17.723874 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6079): Terminating (SIGTERM) 23:02:17.765472 --- ParallelTerminationStrategy: PID 6067 died... 23:02:17.784488 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6067): Terminated: ok {rc=0} 23:02:17.830601 --- ParallelTerminationStrategy: PID 6068 died... 23:02:17.849484 run iperf3-srv_10.42.42.10(pid=6068): Terminated {rc=256} 23:02:17.895117 --- ParallelTerminationStrategy: PID 6069 died... 23:02:17.913943 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6069): Terminated: ok {rc=0} 23:02:17.959610 --- ParallelTerminationStrategy: PID 6070 died... 23:02:17.978373 run iperf3-srv_10.42.42.10(pid=6070): Terminated {rc=256} 23:02:18.024060 --- ParallelTerminationStrategy: PID 6073 died... 23:02:18.042848 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6073): Terminated: ok {rc=0} 23:02:18.088548 --- ParallelTerminationStrategy: PID 6076 died... 23:02:18.107475 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6076): Terminated: ok {rc=0} 23:02:18.153212 --- ParallelTerminationStrategy: PID 6079 died... 23:02:18.171835 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6079): Terminated: ok {rc=0} 23:02:18.259037 bus /gobi_0: Setting Powered False 23:02:19.359079 bus /gobi_0: Setting Powered False 23:02:20.475616 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-lms-limenet-micro iperf3.py ---------------------------------------------- 23:02:21.623812 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 23:02:21.635420 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 23:02:21.683943 tst iperf3.py: using LAC 32109 23:02:21.807585 tst iperf3.py: using RAC 234 23:02:21.932901 tst iperf3.py: using CellId 32109 23:02:22.058453 tst iperf3.py: using BVCI 32110 23:02:22.175228 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 23:02:22.186190 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 23:02:22.196806 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 23:02:22.207740 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 23:02:22.218584 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 23:02:22.229505 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 23:02:22.240402 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 23:02:22.251401 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 23:02:22.262378 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 23:02:22.379885 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 23:02:22.591172 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:02:22.905457 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6081): Launched 23:02:23.179952 run iperf3-srv_10.42.42.10(pid=6082): Launched 23:02:23.299809 tst iperf3.py:8: start network... 23:02:23.509957 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:02:23.994530 run create_hlr_db(pid=6083): Launched 23:02:24.115100 bus /gobi_6: Setting Powered False 23:02:25.181370 run create_hlr_db(pid=6083): Terminated: ok {rc=0} 23:02:25.643879 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6085): Launched 23:02:25.977477 run osmo-hlr_10.42.42.2(pid=6086): Launched 23:02:26.111399 run osmo-stp_10.42.42.5: Starting osmo-stp 23:02:26.691309 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6088): Launched 23:02:27.027856 run osmo-stp_10.42.42.5(pid=6089): Launched 23:02:27.155994 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:02:27.733682 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6091): Launched 23:02:27.861780 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:02:28.146382 run patchelf(pid=6092): Launched 23:02:28.331991 run osmo-stp_10.42.42.5(pid=6089): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6089)] 23:02:28.472841 run osmo-stp_10.42.42.5(pid=6089): stdout: | (launched: 2022-12-12_23:02:26.966146) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:02:28.615839 run osmo-stp_10.42.42.5(pid=6089): stderr: | [0;m[38;5;43m20221212230227161 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230227161 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230227162 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230227162 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230227162 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230227162 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230227162 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:02:28.758109 run osmo-stp_10.42.42.5(pid=6089): stdout: | (launched: 2022-12-12_23:02:26.966146) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:02:28.894668 run osmo-stp_10.42.42.5(pid=6089): stderr: | [0;m[38;5;43m20221212230227161 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230227161 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230227162 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230227162 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230227162 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230227162 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230227162 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:02:29.056762 run patchelf(pid=6092): Terminating (SIGINT) 23:02:29.245088 run patchelf(pid=6092): Terminated: ok {rc=0} 23:02:29.380116 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6089): Process ended prematurely: osmo-stp_10.42.42.5(pid=6089) [trial-2383↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6089)] [trial-2383↪gprs:trx-lms-limenet-micro↪iperf3.py:8] 23:02:29.390543 tst iperf3.py:8: Test FAILED (7.8 sec) 23:02:29.419354 run osmo-hlr_10.42.42.2(pid=6086): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-lms-limenet-micro↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6086)] 23:02:29.469265 run osmo-hlr_10.42.42.2(pid=6086): stdout: | (launched: 2022-12-12_23:02:25.916027) 23:02:29.520843 run osmo-hlr_10.42.42.2(pid=6086): stderr: | [0;m[1;31m20221212230226115 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212230226115 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212230226115 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212230226115 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212230226115 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212230226115 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212230226130 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-lms-limenet-micro/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212230226140 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212230226140 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212230226140 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:02:29.572795 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6081): Terminating (SIGTERM) 23:02:29.614366 run iperf3-srv_10.42.42.10(pid=6082): Terminating (SIGTERM) 23:02:29.656018 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6085): Terminating (SIGTERM) 23:02:29.697910 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6088): Terminating (SIGTERM) 23:02:29.739491 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6091): Terminating (SIGTERM) 23:02:29.781541 --- ParallelTerminationStrategy: PID 6081 died... 23:02:29.801783 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6081): Terminated: ok {rc=0} 23:02:29.848485 --- ParallelTerminationStrategy: PID 6082 died... 23:02:29.868155 run iperf3-srv_10.42.42.10(pid=6082): Terminated {rc=256} 23:02:29.914091 --- ParallelTerminationStrategy: PID 6085 died... 23:02:29.934200 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6085): Terminated: ok {rc=0} 23:02:29.980445 --- ParallelTerminationStrategy: PID 6088 died... 23:02:29.999891 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6088): Terminated: ok {rc=0} 23:02:30.046278 --- ParallelTerminationStrategy: PID 6091 died... 23:02:30.065968 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6091): Terminated: ok {rc=0} 23:02:30.153558 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-lms-limenet-micro iperf3m4.py ---------------------------------------------- 23:02:31.303492 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 23:02:31.316156 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 23:02:31.365366 tst iperf3m4.py: using LAC 32110 23:02:31.493334 tst iperf3m4.py: using RAC 235 23:02:31.663680 tst iperf3m4.py: using CellId 32110 23:02:31.789881 tst iperf3m4.py: using BVCI 32111 23:02:31.912286 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 23:02:31.925830 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 23:02:31.939215 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 23:02:31.951417 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 23:02:31.964445 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 23:02:31.978925 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 23:02:31.991876 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 23:02:32.011190 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 23:02:32.030626 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 23:02:32.154370 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 23:02:32.285769 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 23:02:32.406460 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 23:02:32.533853 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 23:02:32.760229 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:02:33.095430 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6093): Launched 23:02:33.384705 run iperf3-srv_10.42.42.10(pid=6095): Launched 23:02:33.510080 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 23:02:33.735656 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:02:34.070715 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6096): Launched 23:02:34.359609 run iperf3-srv_10.42.42.10(pid=6097): Launched 23:02:34.485932 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 23:02:34.710926 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:02:35.045211 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6098): Launched 23:02:35.333680 run iperf3-srv_10.42.42.10(pid=6099): Launched 23:02:35.461026 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 23:02:35.687238 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:02:36.024509 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6100): Launched 23:02:36.313879 run iperf3-srv_10.42.42.10(pid=6101): Launched 23:02:36.439656 tst iperf3m4.py:8: start network... 23:02:36.665655 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:02:37.187030 run create_hlr_db(pid=6102): Launched 23:02:37.321569 bus /gobi_6: Setting Powered False 23:02:38.386928 run create_hlr_db(pid=6102): Terminated: ok {rc=0} 23:02:38.833686 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6104): Launched 23:02:39.149682 run osmo-hlr_10.42.42.2(pid=6105): Launched 23:02:39.270020 run osmo-stp_10.42.42.5: Starting osmo-stp 23:02:39.932039 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6107): Launched 23:02:40.240009 run osmo-stp_10.42.42.5(pid=6108): Launched 23:02:40.359416 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:02:40.892719 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6110): Launched 23:02:41.010602 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:02:41.271128 run patchelf(pid=6111): Launched 23:02:41.442403 run osmo-stp_10.42.42.5(pid=6108): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6108)] 23:02:41.573082 run osmo-stp_10.42.42.5(pid=6108): stdout: | (launched: 2022-12-12_23:02:40.183843) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:02:41.704773 run osmo-stp_10.42.42.5(pid=6108): stderr: | [0;m[38;5;43m20221212230240356 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230240357 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230240357 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230240357 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230240358 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230240358 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230240358 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:02:41.836331 run osmo-stp_10.42.42.5(pid=6108): stdout: | (launched: 2022-12-12_23:02:40.183843) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:02:41.962681 run osmo-stp_10.42.42.5(pid=6108): stderr: | [0;m[38;5;43m20221212230240356 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230240357 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230240357 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230240357 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230240358 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230240358 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230240358 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:02:42.112363 run patchelf(pid=6111): Terminating (SIGINT) 23:02:42.286940 run patchelf(pid=6111): Terminated: ok {rc=0} 23:02:42.412257 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6108): Process ended prematurely: osmo-stp_10.42.42.5(pid=6108) [trial-2383↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6108)] [trial-2383↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8] 23:02:42.421849 tst iperf3m4.py:8: Test FAILED (11.2 sec) 23:02:42.449496 run osmo-hlr_10.42.42.2(pid=6105): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-lms-limenet-micro↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6105)] 23:02:42.497300 run osmo-hlr_10.42.42.2(pid=6105): stdout: | (launched: 2022-12-12_23:02:39.091330) 23:02:42.546664 run osmo-hlr_10.42.42.2(pid=6105): stderr: | [0;m[1;31m20221212230239268 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212230239268 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212230239268 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212230239268 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212230239268 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212230239268 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212230239281 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-lms-limenet-micro/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212230239289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212230239289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212230239289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:02:42.596865 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6093): Terminating (SIGTERM) 23:02:42.636611 run iperf3-srv_10.42.42.10(pid=6095): Terminating (SIGTERM) 23:02:42.676223 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6096): Terminating (SIGTERM) 23:02:42.715579 run iperf3-srv_10.42.42.10(pid=6097): Terminating (SIGTERM) 23:02:42.755396 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6098): Terminating (SIGTERM) 23:02:42.794907 run iperf3-srv_10.42.42.10(pid=6099): Terminating (SIGTERM) 23:02:42.834311 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6100): Terminating (SIGTERM) 23:02:42.873723 run iperf3-srv_10.42.42.10(pid=6101): Terminating (SIGTERM) 23:02:42.913036 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6104): Terminating (SIGTERM) 23:02:42.952536 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6107): Terminating (SIGTERM) 23:02:42.991816 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6110): Terminating (SIGTERM) 23:02:43.031563 --- ParallelTerminationStrategy: PID 6093 died... 23:02:43.050544 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6093): Terminated: ok {rc=0} 23:02:43.094732 --- ParallelTerminationStrategy: PID 6095 died... 23:02:43.113337 run iperf3-srv_10.42.42.10(pid=6095): Terminated {rc=256} 23:02:43.157857 --- ParallelTerminationStrategy: PID 6096 died... 23:02:43.176259 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6096): Terminated: ok {rc=0} 23:02:43.220151 --- ParallelTerminationStrategy: PID 6097 died... 23:02:43.238639 run iperf3-srv_10.42.42.10(pid=6097): Terminated {rc=256} 23:02:43.282298 --- ParallelTerminationStrategy: PID 6098 died... 23:02:43.300649 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6098): Terminated: ok {rc=0} 23:02:43.345424 --- ParallelTerminationStrategy: PID 6099 died... 23:02:43.363683 run iperf3-srv_10.42.42.10(pid=6099): Terminated {rc=256} 23:02:43.407629 --- ParallelTerminationStrategy: PID 6100 died... 23:02:43.426223 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6100): Terminated: ok {rc=0} 23:02:43.470146 --- ParallelTerminationStrategy: PID 6101 died... 23:02:43.488630 run iperf3-srv_10.42.42.10(pid=6101): Terminated {rc=256} 23:02:43.532400 --- ParallelTerminationStrategy: PID 6104 died... 23:02:43.550904 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6104): Terminated: ok {rc=0} 23:02:43.595331 --- ParallelTerminationStrategy: PID 6107 died... 23:02:43.613629 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6107): Terminated: ok {rc=0} 23:02:43.657373 --- ParallelTerminationStrategy: PID 6110 died... 23:02:43.675798 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6110): Terminated: ok {rc=0} 23:02:43.761821 bus /gobi_4: Setting Powered False 23:02:44.859795 bus /gobi_4: Setting Powered False 23:02:45.986824 bus /gobi_1: Setting Powered False 23:02:47.098658 bus /gobi_1: Setting Powered False 23:02:48.214821 bus /gobi_0: Setting Powered False 23:02:49.312879 bus /gobi_0: Setting Powered False 23:02:50.428430 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-lms-limenet-micro ping.py ---------------------------------------------- 23:02:51.531159 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 23:02:51.543107 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 23:02:51.592881 tst ping.py: using LAC 32111 23:02:51.718795 tst ping.py: using RAC 236 23:02:51.842784 tst ping.py: using CellId 32111 23:02:51.960149 tst ping.py: using BVCI 32112 23:02:52.070862 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 23:02:52.081809 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 23:02:52.092574 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 23:02:52.103934 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 23:02:52.115040 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 23:02:52.126233 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 23:02:52.137343 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 23:02:52.148300 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 23:02:52.267291 tst ping.py:19: start network... 23:02:52.484284 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:02:52.981893 run create_hlr_db(pid=6112): Launched 23:02:53.114644 bus /gobi_6: Setting Powered False 23:02:54.177778 run create_hlr_db(pid=6112): Terminated: ok {rc=0} 23:02:54.608932 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6114): Launched 23:02:54.913676 run osmo-hlr_10.42.42.2(pid=6115): Launched 23:02:55.031106 run osmo-stp_10.42.42.5: Starting osmo-stp 23:02:55.571692 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6117): Launched 23:02:55.877031 run osmo-stp_10.42.42.5(pid=6118): Launched 23:02:55.993627 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:02:56.519001 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6120): Launched 23:02:56.636225 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:02:56.894271 run patchelf(pid=6121): Launched 23:02:57.063041 run osmo-stp_10.42.42.5(pid=6118): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6118)] 23:02:57.192884 run osmo-stp_10.42.42.5(pid=6118): stdout: | (launched: 2022-12-12_23:02:55.820744) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:02:57.323384 run osmo-stp_10.42.42.5(pid=6118): stderr: | [0;m[38;5;43m20221212230255995 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230255995 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230255995 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230255996 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230255996 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230255996 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230255996 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:02:57.454312 run osmo-stp_10.42.42.5(pid=6118): stdout: | (launched: 2022-12-12_23:02:55.820744) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:02:57.579177 run osmo-stp_10.42.42.5(pid=6118): stderr: | [0;m[38;5;43m20221212230255995 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230255995 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230255995 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230255996 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230255996 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230255996 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230255996 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:02:57.727246 run patchelf(pid=6121): Terminating (SIGINT) 23:02:57.900229 run patchelf(pid=6121): Terminated: ok {rc=0} 23:02:58.024761 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=6118): Process ended prematurely: osmo-stp_10.42.42.5(pid=6118) [trial-2383↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6118)] [trial-2383↪gprs:trx-lms-limenet-micro↪ping.py:22] 23:02:58.033780 tst ping.py:22: Test FAILED (6.5 sec) 23:02:58.060577 run osmo-hlr_10.42.42.2(pid=6115): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-lms-limenet-micro↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6115)] 23:02:58.108826 run osmo-hlr_10.42.42.2(pid=6115): stdout: | (launched: 2022-12-12_23:02:54.858482) 23:02:58.158589 run osmo-hlr_10.42.42.2(pid=6115): stderr: | [0;m[1;31m20221212230255037 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212230255037 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212230255037 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212230255037 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212230255037 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212230255038 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212230255050 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-lms-limenet-micro/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212230255058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212230255058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212230255058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:02:58.208716 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6114): Terminating (SIGTERM) 23:02:58.248348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6117): Terminating (SIGTERM) 23:02:58.287982 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6120): Terminating (SIGTERM) 23:02:58.327889 --- ParallelTerminationStrategy: PID 6114 died... 23:02:58.346878 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6114): Terminated: ok {rc=0} 23:02:58.391474 --- ParallelTerminationStrategy: PID 6117 died... 23:02:58.410148 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6117): Terminated: ok {rc=0} 23:02:58.454778 --- ParallelTerminationStrategy: PID 6120 died... 23:02:58.473283 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6120): Terminated: ok {rc=0} 23:02:58.556203 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-lms-limenet-micro ping_idle_ping.py ---------------------------------------------- 23:02:59.640353 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 23:02:59.652025 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 23:02:59.698412 tst ping_idle_ping.py: using LAC 32112 23:02:59.822138 tst ping_idle_ping.py: using RAC 237 23:02:59.944676 tst ping_idle_ping.py: using CellId 32112 23:03:00.073581 tst ping_idle_ping.py: using BVCI 32113 23:03:00.192241 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 23:03:00.203762 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 23:03:00.215107 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 23:03:00.226747 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 23:03:00.238242 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 23:03:00.249845 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 23:03:00.261599 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 23:03:00.273216 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 23:03:00.393649 tst ping_idle_ping.py:24: start network... 23:03:00.612589 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:03:01.124021 run create_hlr_db(pid=6122): Launched 23:03:01.277969 bus /gobi_6: Setting Powered False 23:03:02.351213 run create_hlr_db(pid=6122): Terminated: ok {rc=0} 23:03:02.784935 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6125): Launched 23:03:03.089993 run osmo-hlr_10.42.42.2(pid=6126): Launched 23:03:03.206074 run osmo-stp_10.42.42.5: Starting osmo-stp 23:03:03.746906 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6128): Launched 23:03:04.051630 run osmo-stp_10.42.42.5(pid=6129): Launched 23:03:04.168829 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:03:04.694510 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6131): Launched 23:03:04.811884 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:03:05.069602 run patchelf(pid=6132): Launched 23:03:05.240526 run osmo-stp_10.42.42.5(pid=6129): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6129)] 23:03:05.370776 run osmo-stp_10.42.42.5(pid=6129): stdout: | (launched: 2022-12-12_23:03:03.995612) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:03:05.501932 run osmo-stp_10.42.42.5(pid=6129): stderr: | [0;m[38;5;43m20221212230304166 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230304166 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230304167 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230304167 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230304168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230304168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230304168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:03:05.633878 run osmo-stp_10.42.42.5(pid=6129): stdout: | (launched: 2022-12-12_23:03:03.995612) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:03:05.759419 run osmo-stp_10.42.42.5(pid=6129): stderr: | [0;m[38;5;43m20221212230304166 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230304166 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230304167 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230304167 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230304168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230304168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230304168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:03:05.908187 run patchelf(pid=6132): Terminating (SIGINT) 23:03:06.082287 run patchelf(pid=6132): Terminated: ok {rc=0} 23:03:06.207642 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=6129): Process ended prematurely: osmo-stp_10.42.42.5(pid=6129) [trial-2383↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6129)] [trial-2383↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27] 23:03:06.216764 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 23:03:06.243895 run osmo-hlr_10.42.42.2(pid=6126): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6126)] 23:03:06.291537 run osmo-hlr_10.42.42.2(pid=6126): stdout: | (launched: 2022-12-12_23:03:03.034284) 23:03:06.340938 run osmo-hlr_10.42.42.2(pid=6126): stderr: | [0;m[1;31m20221212230303213 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212230303213 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212230303213 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212230303213 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212230303213 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212230303213 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212230303225 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-lms-limenet-micro/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212230303235 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212230303236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212230303236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:03:06.390766 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6125): Terminating (SIGTERM) 23:03:06.430270 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6128): Terminating (SIGTERM) 23:03:06.469847 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6131): Terminating (SIGTERM) 23:03:06.509666 --- ParallelTerminationStrategy: PID 6125 died... 23:03:06.528582 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6125): Terminated: ok {rc=0} 23:03:06.572993 --- ParallelTerminationStrategy: PID 6128 died... 23:03:06.591589 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6128): Terminated: ok {rc=0} 23:03:06.635859 --- ParallelTerminationStrategy: PID 6131 died... 23:03:06.654276 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6131): Terminated: ok {rc=0} 23:03:06.739304 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2383 gprs:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 gprs:trx-lms-limenet-micro+mod-bts0-egprs --------------------------------------------------------------------- 23:03:08.036883 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:03:08.042308 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 23:03:08.071920 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 23:03:08.110646 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 23:03:08.196550 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 23:03:08.225650 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 23:03:08.264528 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 23:03:08.859227 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2383 gprs:trx-lms-limenet-micro+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 23:03:08.913584 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:03:08.925151 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:03:08.973410 tst cs_paging_gprs_active.py: using LAC 32113 23:03:09.104287 tst cs_paging_gprs_active.py: using RAC 238 23:03:09.233336 tst cs_paging_gprs_active.py: using CellId 32113 23:03:09.363120 tst cs_paging_gprs_active.py: using BVCI 32114 23:03:09.485371 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:03:09.497091 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:03:09.508463 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:03:09.519719 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:03:09.531444 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:03:09.542781 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:03:09.554287 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:03:09.565546 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:03:09.576871 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:03:09.694770 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:03:09.811693 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 23:03:10.020804 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:03:10.331509 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6137): Launched 23:03:10.601516 run iperf3-srv_10.42.42.10(pid=6138): Launched 23:03:10.719139 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 23:03:10.929368 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:03:11.242894 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6139): Launched 23:03:11.513253 run iperf3-srv_10.42.42.10(pid=6140): Launched 23:03:11.629631 tst cs_paging_gprs_active.py:38: start network... 23:03:11.837470 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:03:12.317434 run create_hlr_db(pid=6141): Launched 23:03:12.438447 bus /gobi_6: Setting Powered False 23:03:13.499887 run create_hlr_db(pid=6141): Terminated: ok {rc=0} 23:03:13.949054 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6143): Launched 23:03:14.278453 run osmo-hlr_10.42.42.2(pid=6144): Launched 23:03:14.404404 run osmo-stp_10.42.42.5: Starting osmo-stp 23:03:14.974914 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6146): Launched 23:03:15.303649 run osmo-stp_10.42.42.5(pid=6147): Launched 23:03:15.430377 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:03:16.025955 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6149): Launched 23:03:16.159346 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:03:16.433727 run patchelf(pid=6150): Launched 23:03:16.630404 run osmo-stp_10.42.42.5(pid=6147): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6147)] 23:03:16.767575 run osmo-stp_10.42.42.5(pid=6147): stdout: | (launched: 2022-12-12_23:03:15.243407) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:03:16.905659 run osmo-stp_10.42.42.5(pid=6147): stderr: | [0;m[38;5;43m20221212230315439 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230315439 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230315440 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230315440 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230315441 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230315441 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230315441 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:03:17.044258 run osmo-stp_10.42.42.5(pid=6147): stdout: | (launched: 2022-12-12_23:03:15.243407) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:03:17.177732 run osmo-stp_10.42.42.5(pid=6147): stderr: | [0;m[38;5;43m20221212230315439 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230315439 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230315440 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230315440 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230315441 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230315441 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230315441 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:03:17.330375 run patchelf(pid=6150): Terminating (SIGINT) 23:03:17.505857 run patchelf(pid=6150): Terminated: ok {rc=0} 23:03:17.633090 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=6147): Process ended prematurely: osmo-stp_10.42.42.5(pid=6147) [trial-2383↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6147)] [trial-2383↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 23:03:17.642882 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 23:03:17.670888 run osmo-hlr_10.42.42.2(pid=6144): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6144)] 23:03:17.719479 run osmo-hlr_10.42.42.2(pid=6144): stdout: | (launched: 2022-12-12_23:03:14.218649) 23:03:17.769467 run osmo-hlr_10.42.42.2(pid=6144): stderr: | [0;m[1;31m20221212230314418 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212230314418 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212230314418 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212230314419 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212230314419 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212230314419 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212230314431 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-lms-limenet-micro+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212230314439 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212230314439 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212230314439 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:03:17.820388 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6137): Terminating (SIGTERM) 23:03:17.860407 run iperf3-srv_10.42.42.10(pid=6138): Terminating (SIGTERM) 23:03:17.900187 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6139): Terminating (SIGTERM) 23:03:17.940182 run iperf3-srv_10.42.42.10(pid=6140): Terminating (SIGTERM) 23:03:17.980064 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6143): Terminating (SIGTERM) 23:03:18.020114 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6146): Terminating (SIGTERM) 23:03:18.060171 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6149): Terminating (SIGTERM) 23:03:18.100863 --- ParallelTerminationStrategy: PID 6137 died... 23:03:18.120067 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6137): Terminated: ok {rc=0} 23:03:18.165126 --- ParallelTerminationStrategy: PID 6138 died... 23:03:18.183980 run iperf3-srv_10.42.42.10(pid=6138): Terminated {rc=256} 23:03:18.228758 --- ParallelTerminationStrategy: PID 6139 died... 23:03:18.247461 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6139): Terminated: ok {rc=0} 23:03:18.292132 --- ParallelTerminationStrategy: PID 6140 died... 23:03:18.310827 run iperf3-srv_10.42.42.10(pid=6140): Terminated {rc=256} 23:03:18.355504 --- ParallelTerminationStrategy: PID 6143 died... 23:03:18.374343 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6143): Terminated: ok {rc=0} 23:03:18.418962 --- ParallelTerminationStrategy: PID 6146 died... 23:03:18.437871 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6146): Terminated: ok {rc=0} 23:03:18.482618 --- ParallelTerminationStrategy: PID 6149 died... 23:03:18.501487 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6149): Terminated: ok {rc=0} 23:03:18.587363 bus /gobi_0: Setting Powered False 23:03:19.686971 bus /gobi_0: Setting Powered False 23:03:20.803517 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3.py ---------------------------------------------- 23:03:21.954520 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:03:21.966799 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:03:22.014497 tst iperf3.py: using LAC 32114 23:03:22.149669 tst iperf3.py: using RAC 239 23:03:22.282240 tst iperf3.py: using CellId 32114 23:03:22.410895 tst iperf3.py: using BVCI 32115 23:03:22.530678 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:03:22.542425 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:03:22.553957 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:03:22.565456 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:03:22.576610 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:03:22.588065 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:03:22.599540 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:03:22.610887 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:03:22.622416 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:03:22.737934 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 23:03:22.946366 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:03:23.257871 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6151): Launched 23:03:23.526658 run iperf3-srv_10.42.42.10(pid=6152): Launched 23:03:23.643018 tst iperf3.py:8: start network... 23:03:23.850373 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:03:24.328629 run create_hlr_db(pid=6153): Launched 23:03:24.449377 bus /gobi_6: Setting Powered False 23:03:25.510279 run create_hlr_db(pid=6153): Terminated: ok {rc=0} 23:03:25.958118 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6155): Launched 23:03:26.287262 run osmo-hlr_10.42.42.2(pid=6156): Launched 23:03:26.415006 run osmo-stp_10.42.42.5: Starting osmo-stp 23:03:26.981765 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6158): Launched 23:03:27.310617 run osmo-stp_10.42.42.5(pid=6159): Launched 23:03:27.435908 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:03:28.006629 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6161): Launched 23:03:28.131524 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:03:28.407952 run patchelf(pid=6162): Launched 23:03:28.590276 run osmo-stp_10.42.42.5(pid=6159): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6159)] 23:03:28.728654 run osmo-stp_10.42.42.5(pid=6159): stdout: | (launched: 2022-12-12_23:03:27.250642) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:03:28.868411 run osmo-stp_10.42.42.5(pid=6159): stderr: | [0;m[38;5;43m20221212230327444 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230327444 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230327444 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230327444 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230327445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230327445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230327445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:03:29.008694 run osmo-stp_10.42.42.5(pid=6159): stdout: | (launched: 2022-12-12_23:03:27.250642) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:03:29.143435 run osmo-stp_10.42.42.5(pid=6159): stderr: | [0;m[38;5;43m20221212230327444 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230327444 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230327444 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230327444 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230327445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230327445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230327445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:03:29.302623 run patchelf(pid=6162): Terminating (SIGINT) 23:03:29.487589 run patchelf(pid=6162): Terminated: ok {rc=0} 23:03:29.620390 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6159): Process ended prematurely: osmo-stp_10.42.42.5(pid=6159) [trial-2383↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6159)] [trial-2383↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8] 23:03:29.630816 tst iperf3.py:8: Test FAILED (7.7 sec) 23:03:29.659462 run osmo-hlr_10.42.42.2(pid=6156): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6156)] 23:03:29.709428 run osmo-hlr_10.42.42.2(pid=6156): stdout: | (launched: 2022-12-12_23:03:26.227243) 23:03:29.761450 run osmo-hlr_10.42.42.2(pid=6156): stderr: | [0;m[1;31m20221212230326425 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212230326425 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212230326425 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212230326425 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212230326425 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212230326425 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212230326437 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212230326446 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212230326446 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212230326447 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:03:29.813794 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6151): Terminating (SIGTERM) 23:03:29.855573 run iperf3-srv_10.42.42.10(pid=6152): Terminating (SIGTERM) 23:03:29.897219 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6155): Terminating (SIGTERM) 23:03:29.938760 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6158): Terminating (SIGTERM) 23:03:29.980672 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6161): Terminating (SIGTERM) 23:03:30.023351 --- ParallelTerminationStrategy: PID 6151 died... 23:03:30.043451 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6151): Terminated: ok {rc=0} 23:03:30.089577 --- ParallelTerminationStrategy: PID 6152 died... 23:03:30.108895 run iperf3-srv_10.42.42.10(pid=6152): Terminated {rc=256} 23:03:30.154523 --- ParallelTerminationStrategy: PID 6155 died... 23:03:30.173933 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6155): Terminated: ok {rc=0} 23:03:30.219671 --- ParallelTerminationStrategy: PID 6158 died... 23:03:30.239127 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6158): Terminated: ok {rc=0} 23:03:30.284787 --- ParallelTerminationStrategy: PID 6161 died... 23:03:30.304703 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6161): Terminated: ok {rc=0} 23:03:30.392306 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 23:03:31.539718 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:03:31.552553 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:03:31.601263 tst iperf3m4.py: using LAC 32115 23:03:31.726104 tst iperf3m4.py: using RAC 240 23:03:31.850751 tst iperf3m4.py: using CellId 32115 23:03:31.978337 tst iperf3m4.py: using BVCI 32116 23:03:32.140704 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:03:32.156593 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:03:32.172269 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:03:32.187437 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:03:32.201264 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:03:32.216917 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:03:32.233407 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:03:32.248142 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:03:32.261017 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:03:32.389139 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:03:32.511900 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:03:32.633638 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:03:32.751285 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 23:03:32.959728 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:03:33.269525 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6163): Launched 23:03:33.540794 run iperf3-srv_10.42.42.10(pid=6164): Launched 23:03:33.657174 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 23:03:33.865327 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:03:34.176497 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6165): Launched 23:03:34.445113 run iperf3-srv_10.42.42.10(pid=6166): Launched 23:03:34.561495 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 23:03:34.768322 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:03:35.079672 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6167): Launched 23:03:35.349225 run iperf3-srv_10.42.42.10(pid=6168): Launched 23:03:35.464725 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 23:03:35.671296 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:03:35.981066 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6169): Launched 23:03:36.249802 run iperf3-srv_10.42.42.10(pid=6170): Launched 23:03:36.365906 tst iperf3m4.py:8: start network... 23:03:36.573363 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:03:37.052228 run create_hlr_db(pid=6171): Launched 23:03:37.171706 bus /gobi_6: Setting Powered False 23:03:38.232407 run create_hlr_db(pid=6171): Terminated: ok {rc=0} 23:03:38.680035 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6173): Launched 23:03:39.008850 run osmo-hlr_10.42.42.2(pid=6174): Launched 23:03:39.136180 run osmo-stp_10.42.42.5: Starting osmo-stp 23:03:39.706459 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6176): Launched 23:03:40.035876 run osmo-stp_10.42.42.5(pid=6177): Launched 23:03:40.161684 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:03:40.728477 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6179): Launched 23:03:40.853830 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:03:41.132241 run patchelf(pid=6180): Launched 23:03:41.314844 run osmo-stp_10.42.42.5(pid=6177): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6177)] 23:03:41.453596 run osmo-stp_10.42.42.5(pid=6177): stdout: | (launched: 2022-12-12_23:03:39.975243) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:03:41.593813 run osmo-stp_10.42.42.5(pid=6177): stderr: | [0;m[38;5;43m20221212230340169 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230340170 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230340170 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230340170 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230340171 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230340171 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230340171 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:03:41.733677 run osmo-stp_10.42.42.5(pid=6177): stdout: | (launched: 2022-12-12_23:03:39.975243) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:03:41.867705 run osmo-stp_10.42.42.5(pid=6177): stderr: | [0;m[38;5;43m20221212230340169 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230340170 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230340170 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230340170 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230340171 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230340171 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230340171 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:03:42.027504 run patchelf(pid=6180): Terminating (SIGINT) 23:03:42.212449 run patchelf(pid=6180): Terminated: ok {rc=0} 23:03:42.345847 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6177): Process ended prematurely: osmo-stp_10.42.42.5(pid=6177) [trial-2383↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6177)] [trial-2383↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8] 23:03:42.356197 tst iperf3m4.py:8: Test FAILED (10.9 sec) 23:03:42.385004 run osmo-hlr_10.42.42.2(pid=6174): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6174)] 23:03:42.434885 run osmo-hlr_10.42.42.2(pid=6174): stdout: | (launched: 2022-12-12_23:03:38.947974) 23:03:42.486526 run osmo-hlr_10.42.42.2(pid=6174): stderr: | [0;m[1;31m20221212230339148 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212230339149 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212230339149 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212230339149 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212230339149 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212230339149 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212230339160 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212230339169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212230339169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212230339170 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:03:42.538632 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6163): Terminating (SIGTERM) 23:03:42.580559 run iperf3-srv_10.42.42.10(pid=6164): Terminating (SIGTERM) 23:03:42.622547 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6165): Terminating (SIGTERM) 23:03:42.664589 run iperf3-srv_10.42.42.10(pid=6166): Terminating (SIGTERM) 23:03:42.706477 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6167): Terminating (SIGTERM) 23:03:42.748305 run iperf3-srv_10.42.42.10(pid=6168): Terminating (SIGTERM) 23:03:42.790077 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6169): Terminating (SIGTERM) 23:03:42.831696 run iperf3-srv_10.42.42.10(pid=6170): Terminating (SIGTERM) 23:03:42.873623 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6173): Terminating (SIGTERM) 23:03:42.915915 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6176): Terminating (SIGTERM) 23:03:42.957708 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6179): Terminating (SIGTERM) 23:03:42.999797 --- ParallelTerminationStrategy: PID 6163 died... 23:03:43.020016 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6163): Terminated: ok {rc=0} 23:03:43.066170 --- ParallelTerminationStrategy: PID 6164 died... 23:03:43.085733 run iperf3-srv_10.42.42.10(pid=6164): Terminated {rc=256} 23:03:43.131978 --- ParallelTerminationStrategy: PID 6165 died... 23:03:43.151648 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6165): Terminated: ok {rc=0} 23:03:43.197739 --- ParallelTerminationStrategy: PID 6166 died... 23:03:43.217109 run iperf3-srv_10.42.42.10(pid=6166): Terminated {rc=256} 23:03:43.263191 --- ParallelTerminationStrategy: PID 6167 died... 23:03:43.282908 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6167): Terminated: ok {rc=0} 23:03:43.328828 --- ParallelTerminationStrategy: PID 6168 died... 23:03:43.348686 run iperf3-srv_10.42.42.10(pid=6168): Terminated {rc=256} 23:03:43.394591 --- ParallelTerminationStrategy: PID 6169 died... 23:03:43.414245 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6169): Terminated: ok {rc=0} 23:03:43.459969 --- ParallelTerminationStrategy: PID 6170 died... 23:03:43.479335 run iperf3-srv_10.42.42.10(pid=6170): Terminated {rc=256} 23:03:43.525190 --- ParallelTerminationStrategy: PID 6173 died... 23:03:43.544701 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6173): Terminated: ok {rc=0} 23:03:43.590699 --- ParallelTerminationStrategy: PID 6176 died... 23:03:43.610435 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6176): Terminated: ok {rc=0} 23:03:43.656281 --- ParallelTerminationStrategy: PID 6179 died... 23:03:43.675946 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6179): Terminated: ok {rc=0} 23:03:43.763256 bus /gobi_4: Setting Powered False 23:03:44.859995 bus /gobi_4: Setting Powered False 23:03:45.982918 bus /gobi_1: Setting Powered False 23:03:47.080834 bus /gobi_1: Setting Powered False 23:03:48.199697 bus /gobi_0: Setting Powered False 23:03:49.298473 bus /gobi_0: Setting Powered False 23:03:50.414336 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping.py ---------------------------------------------- 23:03:51.517725 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:03:51.529951 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:03:51.578203 tst ping.py: using LAC 32116 23:03:51.705465 tst ping.py: using RAC 241 23:03:51.833300 tst ping.py: using CellId 32116 23:03:51.959052 tst ping.py: using BVCI 32117 23:03:52.077960 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:03:52.089647 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:03:52.101050 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:03:52.112511 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:03:52.123899 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:03:52.135243 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:03:52.146790 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:03:52.158204 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:03:52.275213 tst ping.py:19: start network... 23:03:52.479452 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:03:52.948877 run create_hlr_db(pid=6181): Launched 23:03:53.066663 bus /gobi_6: Setting Powered False 23:03:54.130392 run create_hlr_db(pid=6181): Terminated: ok {rc=0} 23:03:54.559876 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6183): Launched 23:03:54.862341 run osmo-hlr_10.42.42.2(pid=6184): Launched 23:03:54.978283 run osmo-stp_10.42.42.5: Starting osmo-stp 23:03:55.500497 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6186): Launched 23:03:55.803408 run osmo-stp_10.42.42.5(pid=6187): Launched 23:03:55.919255 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:03:56.442365 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6189): Launched 23:03:56.558680 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:03:56.815624 run patchelf(pid=6190): Launched 23:03:56.985242 run osmo-stp_10.42.42.5(pid=6187): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6187)] 23:03:57.114353 run osmo-stp_10.42.42.5(pid=6187): stdout: | (launched: 2022-12-12_23:03:55.747900) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:03:57.244791 run osmo-stp_10.42.42.5(pid=6187): stderr: | [0;m[38;5;43m20221212230355918 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230355918 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230355918 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230355918 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230355919 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230355919 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230355919 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:03:57.375686 run osmo-stp_10.42.42.5(pid=6187): stdout: | (launched: 2022-12-12_23:03:55.747900) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:03:57.500277 run osmo-stp_10.42.42.5(pid=6187): stderr: | [0;m[38;5;43m20221212230355918 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230355918 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230355918 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230355918 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230355919 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230355919 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230355919 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:03:57.647571 run patchelf(pid=6190): Terminating (SIGINT) 23:03:57.819712 run patchelf(pid=6190): Terminated: ok {rc=0} 23:03:57.943507 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=6187): Process ended prematurely: osmo-stp_10.42.42.5(pid=6187) [trial-2383↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6187)] [trial-2383↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22] 23:03:57.952315 tst ping.py:22: Test FAILED (6.4 sec) 23:03:57.979097 run osmo-hlr_10.42.42.2(pid=6184): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6184)] 23:03:58.026984 run osmo-hlr_10.42.42.2(pid=6184): stdout: | (launched: 2022-12-12_23:03:54.807123) 23:03:58.076423 run osmo-hlr_10.42.42.2(pid=6184): stderr: | [0;m[1;31m20221212230354984 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212230354984 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212230354984 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212230354984 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212230354984 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212230354984 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212230355011 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212230355022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212230355022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212230355022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:03:58.126192 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6183): Terminating (SIGTERM) 23:03:58.165974 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6186): Terminating (SIGTERM) 23:03:58.205739 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6189): Terminating (SIGTERM) 23:03:58.245717 --- ParallelTerminationStrategy: PID 6183 died... 23:03:58.264829 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6183): Terminated: ok {rc=0} 23:03:58.309287 --- ParallelTerminationStrategy: PID 6186 died... 23:03:58.327722 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6186): Terminated: ok {rc=0} 23:03:58.371985 --- ParallelTerminationStrategy: PID 6189 died... 23:03:58.390631 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6189): Terminated: ok {rc=0} 23:03:58.475254 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 23:03:59.563488 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:03:59.575825 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:03:59.625517 tst ping_idle_ping.py: using LAC 32117 23:03:59.753411 tst ping_idle_ping.py: using RAC 242 23:03:59.879553 tst ping_idle_ping.py: using CellId 32117 23:04:00.007847 tst ping_idle_ping.py: using BVCI 32118 23:04:00.126491 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:04:00.138164 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:04:00.149628 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:04:00.161058 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:04:00.172352 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:04:00.183745 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:04:00.195592 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:04:00.207304 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:04:00.326076 tst ping_idle_ping.py:24: start network... 23:04:00.544847 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:04:01.062208 run create_hlr_db(pid=6191): Launched 23:04:01.212185 bus /gobi_6: Setting Powered False 23:04:02.279552 run create_hlr_db(pid=6191): Terminated: ok {rc=0} 23:04:02.728130 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6193): Launched 23:04:03.050948 run osmo-hlr_10.42.42.2(pid=6194): Launched 23:04:03.173821 run osmo-stp_10.42.42.5: Starting osmo-stp 23:04:03.734560 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6196): Launched 23:04:04.058768 run osmo-stp_10.42.42.5(pid=6197): Launched 23:04:04.183067 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:04:04.742150 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6199): Launched 23:04:04.865698 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:04:05.139714 run patchelf(pid=6200): Launched 23:04:05.319815 run osmo-stp_10.42.42.5(pid=6197): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6197)] 23:04:05.457057 run osmo-stp_10.42.42.5(pid=6197): stdout: | (launched: 2022-12-12_23:04:03.999941) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:04:05.595420 run osmo-stp_10.42.42.5(pid=6197): stderr: | [0;m[38;5;43m20221212230404194 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230404194 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230404194 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230404195 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230404195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230404195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230404195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:04:05.733816 run osmo-stp_10.42.42.5(pid=6197): stdout: | (launched: 2022-12-12_23:04:03.999941) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:04:05.866105 run osmo-stp_10.42.42.5(pid=6197): stderr: | [0;m[38;5;43m20221212230404194 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230404194 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230404194 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230404195 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230404195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230404195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230404195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:04:06.023643 run patchelf(pid=6200): Terminating (SIGINT) 23:04:06.206067 run patchelf(pid=6200): Terminated: ok {rc=0} 23:04:06.337045 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=6197): Process ended prematurely: osmo-stp_10.42.42.5(pid=6197) [trial-2383↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6197)] [trial-2383↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27] 23:04:06.346690 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 23:04:06.374623 run osmo-hlr_10.42.42.2(pid=6194): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6194)] 23:04:06.424469 run osmo-hlr_10.42.42.2(pid=6194): stdout: | (launched: 2022-12-12_23:04:02.991919) 23:04:06.476203 run osmo-hlr_10.42.42.2(pid=6194): stderr: | [0;m[1;31m20221212230403190 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212230403190 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212230403190 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212230403190 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212230403190 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212230403190 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212230403202 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212230403210 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212230403211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212230403211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:04:06.528269 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6193): Terminating (SIGTERM) 23:04:06.569861 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6196): Terminating (SIGTERM) 23:04:06.611233 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6199): Terminating (SIGTERM) 23:04:06.652898 --- ParallelTerminationStrategy: PID 6193 died... 23:04:06.672749 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6193): Terminated: ok {rc=0} 23:04:06.718935 --- ParallelTerminationStrategy: PID 6196 died... 23:04:06.738434 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6196): Terminated: ok {rc=0} 23:04:06.784245 --- ParallelTerminationStrategy: PID 6199 died... 23:04:06.803792 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6199): Terminated: ok {rc=0} 23:04:06.890987 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2383 gprs:trx-lms-limenet-micro+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa --------------------------------------------------------------------- 23:04:08.201265 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:04:08.208094 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 23:04:08.238215 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 23:04:08.277409 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 23:04:08.365693 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 23:04:08.395486 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 23:04:08.434963 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 23:04:09.034961 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2383 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 23:04:09.087742 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:04:09.099334 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:04:09.166693 tst cs_paging_gprs_active.py: using LAC 32118 23:04:09.297424 tst cs_paging_gprs_active.py: using RAC 243 23:04:09.431960 tst cs_paging_gprs_active.py: using CellId 32118 23:04:09.561563 tst cs_paging_gprs_active.py: using BVCI 32119 23:04:09.681417 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:04:09.693026 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:04:09.704384 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:04:09.715918 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:04:09.727394 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:04:09.738757 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:04:09.750295 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:04:09.761713 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:04:09.773285 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:04:09.890836 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:04:10.013747 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 23:04:10.236122 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:04:10.565268 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6205): Launched 23:04:10.851020 run iperf3-srv_10.42.42.10(pid=6206): Launched 23:04:10.974045 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 23:04:11.195371 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:04:11.525941 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6207): Launched 23:04:11.810979 run iperf3-srv_10.42.42.10(pid=6208): Launched 23:04:11.934506 tst cs_paging_gprs_active.py:38: start network... 23:04:12.156260 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:04:12.667632 run create_hlr_db(pid=6209): Launched 23:04:12.800816 bus /gobi_6: Setting Powered False 23:04:13.865607 run create_hlr_db(pid=6209): Terminated: ok {rc=0} 23:04:14.323263 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6211): Launched 23:04:14.652619 run osmo-hlr_10.42.42.2(pid=6212): Launched 23:04:14.777260 run osmo-stp_10.42.42.5: Starting osmo-stp 23:04:15.347763 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6214): Launched 23:04:15.678176 run osmo-stp_10.42.42.5(pid=6215): Launched 23:04:15.803969 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:04:16.437910 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6217): Launched 23:04:16.577250 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:04:16.865625 run patchelf(pid=6218): Launched 23:04:17.064298 run osmo-stp_10.42.42.5(pid=6215): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6215)] 23:04:17.206847 run osmo-stp_10.42.42.5(pid=6215): stdout: | (launched: 2022-12-12_23:04:15.617747) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:04:17.349083 run osmo-stp_10.42.42.5(pid=6215): stderr: | [0;m[38;5;43m20221212230415813 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230415813 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230415813 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230415814 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230415816 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230415816 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230415816 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:04:17.491065 run osmo-stp_10.42.42.5(pid=6215): stdout: | (launched: 2022-12-12_23:04:15.617747) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:04:17.626665 run osmo-stp_10.42.42.5(pid=6215): stderr: | [0;m[38;5;43m20221212230415813 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230415813 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230415813 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230415814 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230415816 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230415816 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230415816 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:04:17.787380 run patchelf(pid=6218): Terminating (SIGINT) 23:04:17.974217 run patchelf(pid=6218): Terminated: ok {rc=0} 23:04:18.109010 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=6215): Process ended prematurely: osmo-stp_10.42.42.5(pid=6215) [trial-2383↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6215)] [trial-2383↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 23:04:18.119303 tst cs_paging_gprs_active.py:38: Test FAILED (9.1 sec) 23:04:18.148074 run osmo-hlr_10.42.42.2(pid=6212): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6212)] 23:04:18.198258 run osmo-hlr_10.42.42.2(pid=6212): stdout: | (launched: 2022-12-12_23:04:14.592372) 23:04:18.249977 run osmo-hlr_10.42.42.2(pid=6212): stderr: | [0;m[1;31m20221212230414793 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212230414793 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212230414793 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212230414793 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212230414793 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212230414793 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212230414807 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212230414815 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212230414815 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212230414815 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:04:18.302246 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6205): Terminating (SIGTERM) 23:04:18.344014 run iperf3-srv_10.42.42.10(pid=6206): Terminating (SIGTERM) 23:04:18.385891 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6207): Terminating (SIGTERM) 23:04:18.427697 run iperf3-srv_10.42.42.10(pid=6208): Terminating (SIGTERM) 23:04:18.469392 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6211): Terminating (SIGTERM) 23:04:18.511421 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6214): Terminating (SIGTERM) 23:04:18.556386 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6217): Terminating (SIGTERM) 23:04:18.599424 --- ParallelTerminationStrategy: PID 6205 died... 23:04:18.620265 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6205): Terminated: ok {rc=0} 23:04:18.668905 --- ParallelTerminationStrategy: PID 6206 died... 23:04:18.688674 run iperf3-srv_10.42.42.10(pid=6206): Terminated {rc=256} 23:04:18.734391 --- ParallelTerminationStrategy: PID 6207 died... 23:04:18.753900 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6207): Terminated: ok {rc=0} 23:04:18.799603 --- ParallelTerminationStrategy: PID 6208 died... 23:04:18.819027 run iperf3-srv_10.42.42.10(pid=6208): Terminated {rc=256} 23:04:18.864752 --- ParallelTerminationStrategy: PID 6211 died... 23:04:18.884309 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6211): Terminated: ok {rc=0} 23:04:18.930548 --- ParallelTerminationStrategy: PID 6214 died... 23:04:18.950023 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6214): Terminated: ok {rc=0} 23:04:18.996293 --- ParallelTerminationStrategy: PID 6217 died... 23:04:19.015785 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6217): Terminated: ok {rc=0} 23:04:19.102456 bus /gobi_0: Setting Powered False 23:04:20.201735 bus /gobi_0: Setting Powered False 23:04:21.317925 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 23:04:22.467905 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:04:22.480240 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:04:22.554678 tst iperf3.py: using LAC 32119 23:04:22.684185 tst iperf3.py: using RAC 244 23:04:22.814480 tst iperf3.py: using CellId 32119 23:04:22.944489 tst iperf3.py: using BVCI 32120 23:04:23.065609 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:04:23.077202 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:04:23.088602 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:04:23.100133 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:04:23.111475 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:04:23.122934 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:04:23.134407 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:04:23.145846 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:04:23.157397 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:04:23.279612 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 23:04:23.502893 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:04:23.833669 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6221): Launched 23:04:24.121899 run iperf3-srv_10.42.42.10(pid=6222): Launched 23:04:24.247162 tst iperf3.py:8: start network... 23:04:24.470015 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:04:24.980550 run create_hlr_db(pid=6223): Launched 23:04:25.114504 bus /gobi_6: Setting Powered False 23:04:26.178783 run create_hlr_db(pid=6223): Terminated: ok {rc=0} 23:04:26.634385 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6225): Launched 23:04:26.962570 run osmo-hlr_10.42.42.2(pid=6226): Launched 23:04:27.088721 run osmo-stp_10.42.42.5: Starting osmo-stp 23:04:27.660302 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6228): Launched 23:04:27.988401 run osmo-stp_10.42.42.5(pid=6229): Launched 23:04:28.114802 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:04:28.682931 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6231): Launched 23:04:28.809896 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:04:29.088650 run patchelf(pid=6232): Launched 23:04:29.271528 run osmo-stp_10.42.42.5(pid=6229): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6229)] 23:04:29.410358 run osmo-stp_10.42.42.5(pid=6229): stdout: | (launched: 2022-12-12_23:04:27.928345) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:04:29.551732 run osmo-stp_10.42.42.5(pid=6229): stderr: | [0;m[38;5;43m20221212230428123 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230428123 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230428123 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230428124 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230428124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230428124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230428124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:04:29.692119 run osmo-stp_10.42.42.5(pid=6229): stdout: | (launched: 2022-12-12_23:04:27.928345) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:04:29.826526 run osmo-stp_10.42.42.5(pid=6229): stderr: | [0;m[38;5;43m20221212230428123 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230428123 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230428123 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230428124 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230428124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230428124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230428124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:04:29.986135 run patchelf(pid=6232): Terminating (SIGINT) 23:04:30.172311 run patchelf(pid=6232): Terminated: ok {rc=0} 23:04:30.306105 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6229): Process ended prematurely: osmo-stp_10.42.42.5(pid=6229) [trial-2383↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6229)] [trial-2383↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8] 23:04:30.316427 tst iperf3.py:8: Test FAILED (7.9 sec) 23:04:30.345174 run osmo-hlr_10.42.42.2(pid=6226): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6226)] 23:04:30.395115 run osmo-hlr_10.42.42.2(pid=6226): stdout: | (launched: 2022-12-12_23:04:26.902366) 23:04:30.446863 run osmo-hlr_10.42.42.2(pid=6226): stderr: | [0;m[1;31m20221212230427101 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212230427101 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212230427101 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212230427101 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212230427101 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212230427101 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212230427116 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212230427124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212230427124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212230427124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:04:30.498955 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6221): Terminating (SIGTERM) 23:04:30.540448 run iperf3-srv_10.42.42.10(pid=6222): Terminating (SIGTERM) 23:04:30.582087 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6225): Terminating (SIGTERM) 23:04:30.623610 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6228): Terminating (SIGTERM) 23:04:30.665293 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6231): Terminating (SIGTERM) 23:04:30.707202 --- ParallelTerminationStrategy: PID 6221 died... 23:04:30.726800 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6221): Terminated: ok {rc=0} 23:04:30.772686 --- ParallelTerminationStrategy: PID 6222 died... 23:04:30.792137 run iperf3-srv_10.42.42.10(pid=6222): Terminated {rc=256} 23:04:30.837922 --- ParallelTerminationStrategy: PID 6225 died... 23:04:30.857957 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6225): Terminated: ok {rc=0} 23:04:30.904633 --- ParallelTerminationStrategy: PID 6228 died... 23:04:30.925275 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6228): Terminated: ok {rc=0} 23:04:30.973663 --- ParallelTerminationStrategy: PID 6231 died... 23:04:30.993936 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6231): Terminated: ok {rc=0} 23:04:31.081499 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 23:04:32.228611 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:04:32.241754 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:04:32.313417 tst iperf3m4.py: using LAC 32120 23:04:32.437650 tst iperf3m4.py: using RAC 245 23:04:32.565197 tst iperf3m4.py: using CellId 32120 23:04:32.687190 tst iperf3m4.py: using BVCI 32121 23:04:32.802387 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:04:32.813798 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:04:32.824735 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:04:32.836725 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:04:32.848637 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:04:32.860550 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:04:32.872591 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:04:32.884484 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:04:32.896566 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:04:33.015175 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:04:33.133856 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:04:33.256022 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:04:33.375506 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 23:04:33.584722 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:04:33.895827 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6233): Launched 23:04:34.167088 run iperf3-srv_10.42.42.10(pid=6234): Launched 23:04:34.283871 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 23:04:34.495515 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:04:34.805972 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6235): Launched 23:04:35.078555 run iperf3-srv_10.42.42.10(pid=6236): Launched 23:04:35.197053 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 23:04:35.404659 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:04:35.716004 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6237): Launched 23:04:35.988748 run iperf3-srv_10.42.42.10(pid=6238): Launched 23:04:36.105103 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 23:04:36.312631 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:04:36.623588 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6239): Launched 23:04:36.892756 run iperf3-srv_10.42.42.10(pid=6240): Launched 23:04:37.009411 tst iperf3m4.py:8: start network... 23:04:37.216736 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:04:37.697375 run create_hlr_db(pid=6241): Launched 23:04:37.816480 bus /gobi_6: Setting Powered False 23:04:38.878099 run create_hlr_db(pid=6241): Terminated: ok {rc=0} 23:04:39.307863 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6243): Launched 23:04:39.620746 run osmo-hlr_10.42.42.2(pid=6244): Launched 23:04:39.739569 run osmo-stp_10.42.42.5: Starting osmo-stp 23:04:40.290062 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6246): Launched 23:04:40.602462 run osmo-stp_10.42.42.5(pid=6247): Launched 23:04:40.721082 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:04:41.254186 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6249): Launched 23:04:41.372383 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:04:41.633851 run patchelf(pid=6250): Launched 23:04:41.806777 run osmo-stp_10.42.42.5(pid=6247): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6247)] 23:04:41.938048 run osmo-stp_10.42.42.5(pid=6247): stdout: | (launched: 2022-12-12_23:04:40.545621) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:04:42.070620 run osmo-stp_10.42.42.5(pid=6247): stderr: | [0;m[38;5;43m20221212230440716 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230440716 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230440716 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230440717 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230440717 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230440717 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230440717 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:04:42.202798 run osmo-stp_10.42.42.5(pid=6247): stdout: | (launched: 2022-12-12_23:04:40.545621) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:04:42.329650 run osmo-stp_10.42.42.5(pid=6247): stderr: | [0;m[38;5;43m20221212230440716 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230440716 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230440716 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230440717 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230440717 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230440717 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230440717 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:04:42.479888 run patchelf(pid=6250): Terminating (SIGINT) 23:04:42.655089 run patchelf(pid=6250): Terminated: ok {rc=0} 23:04:42.781053 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6247): Process ended prematurely: osmo-stp_10.42.42.5(pid=6247) [trial-2383↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6247)] [trial-2383↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8] 23:04:42.790699 tst iperf3m4.py:8: Test FAILED (10.6 sec) 23:04:42.818263 run osmo-hlr_10.42.42.2(pid=6244): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6244)] 23:04:42.866387 run osmo-hlr_10.42.42.2(pid=6244): stdout: | (launched: 2022-12-12_23:04:39.560375) 23:04:42.915812 run osmo-hlr_10.42.42.2(pid=6244): stderr: | [0;m[1;31m20221212230439741 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212230439741 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212230439741 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212230439741 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212230439741 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212230439741 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212230439753 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212230439762 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212230439762 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212230439762 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:04:42.965746 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6233): Terminating (SIGTERM) 23:04:43.005696 run iperf3-srv_10.42.42.10(pid=6234): Terminating (SIGTERM) 23:04:43.045711 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6235): Terminating (SIGTERM) 23:04:43.085542 run iperf3-srv_10.42.42.10(pid=6236): Terminating (SIGTERM) 23:04:43.125226 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6237): Terminating (SIGTERM) 23:04:43.165069 run iperf3-srv_10.42.42.10(pid=6238): Terminating (SIGTERM) 23:04:43.204672 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6239): Terminating (SIGTERM) 23:04:43.244484 run iperf3-srv_10.42.42.10(pid=6240): Terminating (SIGTERM) 23:04:43.284011 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6243): Terminating (SIGTERM) 23:04:43.323845 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6246): Terminating (SIGTERM) 23:04:43.363679 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6249): Terminating (SIGTERM) 23:04:43.403678 --- ParallelTerminationStrategy: PID 6233 died... 23:04:43.422810 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6233): Terminated: ok {rc=0} 23:04:43.467440 --- ParallelTerminationStrategy: PID 6234 died... 23:04:43.485993 run iperf3-srv_10.42.42.10(pid=6234): Terminated {rc=256} 23:04:43.529846 --- ParallelTerminationStrategy: PID 6235 died... 23:04:43.548106 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6235): Terminated: ok {rc=0} 23:04:43.592259 --- ParallelTerminationStrategy: PID 6236 died... 23:04:43.611005 run iperf3-srv_10.42.42.10(pid=6236): Terminated {rc=256} 23:04:43.655223 --- ParallelTerminationStrategy: PID 6237 died... 23:04:43.673875 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6237): Terminated: ok {rc=0} 23:04:43.718063 --- ParallelTerminationStrategy: PID 6238 died... 23:04:43.736670 run iperf3-srv_10.42.42.10(pid=6238): Terminated {rc=256} 23:04:43.781046 --- ParallelTerminationStrategy: PID 6239 died... 23:04:43.799692 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6239): Terminated: ok {rc=0} 23:04:43.843877 --- ParallelTerminationStrategy: PID 6240 died... 23:04:43.862976 run iperf3-srv_10.42.42.10(pid=6240): Terminated {rc=256} 23:04:43.907376 --- ParallelTerminationStrategy: PID 6243 died... 23:04:43.926026 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6243): Terminated: ok {rc=0} 23:04:43.970168 --- ParallelTerminationStrategy: PID 6246 died... 23:04:43.988712 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6246): Terminated: ok {rc=0} 23:04:44.032824 --- ParallelTerminationStrategy: PID 6249 died... 23:04:44.051805 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6249): Terminated: ok {rc=0} 23:04:44.138705 bus /gobi_4: Setting Powered False 23:04:45.239347 bus /gobi_4: Setting Powered False 23:04:46.369451 bus /gobi_1: Setting Powered False 23:04:47.474098 bus /gobi_1: Setting Powered False 23:04:48.590438 bus /gobi_0: Setting Powered False 23:04:49.692585 bus /gobi_0: Setting Powered False 23:04:50.812573 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 23:04:51.916187 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:04:51.928104 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:04:51.994779 tst ping.py: using LAC 32121 23:04:52.123495 tst ping.py: using RAC 246 23:04:52.249836 tst ping.py: using CellId 32121 23:04:52.370626 tst ping.py: using BVCI 32122 23:04:52.490256 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:04:52.502073 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:04:52.513595 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:04:52.525790 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:04:52.537811 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:04:52.549866 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:04:52.563065 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:04:52.574551 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:04:52.691942 tst ping.py:19: start network... 23:04:52.911929 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:04:53.411641 run create_hlr_db(pid=6251): Launched 23:04:53.541825 bus /gobi_6: Setting Powered False 23:04:54.602754 run create_hlr_db(pid=6251): Terminated: ok {rc=0} 23:04:55.053413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6253): Launched 23:04:55.378136 run osmo-hlr_10.42.42.2(pid=6254): Launched 23:04:55.500833 run osmo-stp_10.42.42.5: Starting osmo-stp 23:04:56.063245 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6256): Launched 23:04:56.385919 run osmo-stp_10.42.42.5(pid=6257): Launched 23:04:56.508898 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:04:57.069117 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6259): Launched 23:04:57.193354 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:04:57.466765 run patchelf(pid=6260): Launched 23:04:57.646503 run osmo-stp_10.42.42.5(pid=6257): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6257)] 23:04:57.783976 run osmo-stp_10.42.42.5(pid=6257): stdout: | (launched: 2022-12-12_23:04:56.326699) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:04:57.922574 run osmo-stp_10.42.42.5(pid=6257): stderr: | [0;m[38;5;43m20221212230456517 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230456518 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230456518 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230456518 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230456519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230456519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230456519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:04:58.061550 run osmo-stp_10.42.42.5(pid=6257): stdout: | (launched: 2022-12-12_23:04:56.326699) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:04:58.193698 run osmo-stp_10.42.42.5(pid=6257): stderr: | [0;m[38;5;43m20221212230456517 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230456518 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230456518 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230456518 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230456519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230456519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230456519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:04:58.350419 run patchelf(pid=6260): Terminating (SIGINT) 23:04:58.532556 run patchelf(pid=6260): Terminated: ok {rc=0} 23:04:58.663625 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=6257): Process ended prematurely: osmo-stp_10.42.42.5(pid=6257) [trial-2383↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6257)] [trial-2383↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22] 23:04:58.673113 tst ping.py:22: Test FAILED (6.7 sec) 23:04:58.701359 run osmo-hlr_10.42.42.2(pid=6254): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6254)] 23:04:58.751319 run osmo-hlr_10.42.42.2(pid=6254): stdout: | (launched: 2022-12-12_23:04:55.318884) 23:04:58.803221 run osmo-hlr_10.42.42.2(pid=6254): stderr: | [0;m[1;31m20221212230455516 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212230455516 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212230455516 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212230455516 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212230455516 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212230455516 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212230455529 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212230455537 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212230455537 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212230455537 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:04:58.855472 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6253): Terminating (SIGTERM) 23:04:58.897407 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6256): Terminating (SIGTERM) 23:04:58.939269 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6259): Terminating (SIGTERM) 23:04:58.981503 --- ParallelTerminationStrategy: PID 6253 died... 23:04:59.001918 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6253): Terminated: ok {rc=0} 23:04:59.048533 --- ParallelTerminationStrategy: PID 6256 died... 23:04:59.068217 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6256): Terminated: ok {rc=0} 23:04:59.114491 --- ParallelTerminationStrategy: PID 6259 died... 23:04:59.134020 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6259): Terminated: ok {rc=0} 23:04:59.222313 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 23:05:00.310459 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:05:00.323457 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:05:00.396481 tst ping_idle_ping.py: using LAC 32122 23:05:00.523064 tst ping_idle_ping.py: using RAC 247 23:05:00.650456 tst ping_idle_ping.py: using CellId 32122 23:05:00.777091 tst ping_idle_ping.py: using BVCI 32123 23:05:00.908149 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:05:00.923028 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:05:00.935170 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:05:00.947154 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:05:00.959123 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:05:00.971115 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:05:00.983324 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:05:00.995453 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:05:01.133081 tst ping_idle_ping.py:24: start network... 23:05:01.381201 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:05:01.901671 run create_hlr_db(pid=6264): Launched 23:05:02.063801 bus /gobi_6: Setting Powered False 23:05:03.125371 run create_hlr_db(pid=6264): Terminated: ok {rc=0} 23:05:03.579329 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6266): Launched 23:05:03.903435 run osmo-hlr_10.42.42.2(pid=6267): Launched 23:05:04.026376 run osmo-stp_10.42.42.5: Starting osmo-stp 23:05:04.589398 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6269): Launched 23:05:04.914481 run osmo-stp_10.42.42.5(pid=6270): Launched 23:05:05.038458 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:05:05.599519 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6272): Launched 23:05:05.723186 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:05:05.997423 run patchelf(pid=6273): Launched 23:05:06.180271 run osmo-stp_10.42.42.5(pid=6270): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6270)] 23:05:06.317835 run osmo-stp_10.42.42.5(pid=6270): stdout: | (launched: 2022-12-12_23:05:04.855383) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:05:06.456457 run osmo-stp_10.42.42.5(pid=6270): stderr: | [0;m[38;5;43m20221212230505047 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230505048 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230505048 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230505048 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230505049 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230505049 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230505049 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:05:06.595534 run osmo-stp_10.42.42.5(pid=6270): stdout: | (launched: 2022-12-12_23:05:04.855383) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:05:06.728428 run osmo-stp_10.42.42.5(pid=6270): stderr: | [0;m[38;5;43m20221212230505047 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230505048 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230505048 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230505048 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230505049 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230505049 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230505049 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:05:06.885806 run patchelf(pid=6273): Terminating (SIGINT) 23:05:07.069842 run patchelf(pid=6273): Terminated: ok {rc=0} 23:05:07.201821 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=6270): Process ended prematurely: osmo-stp_10.42.42.5(pid=6270) [trial-2383↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6270)] [trial-2383↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 23:05:07.211388 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 23:05:07.239333 run osmo-hlr_10.42.42.2(pid=6267): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6267)] 23:05:07.289173 run osmo-hlr_10.42.42.2(pid=6267): stdout: | (launched: 2022-12-12_23:05:03.844534) 23:05:07.340408 run osmo-hlr_10.42.42.2(pid=6267): stderr: | [0;m[1;31m20221212230504045 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212230504045 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212230504045 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212230504045 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212230504045 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212230504045 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212230504058 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212230504066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212230504066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212230504066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:05:07.392114 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6266): Terminating (SIGTERM) 23:05:07.433606 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6269): Terminating (SIGTERM) 23:05:07.475292 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6272): Terminating (SIGTERM) 23:05:07.516846 --- ParallelTerminationStrategy: PID 6266 died... 23:05:07.536707 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6266): Terminated: ok {rc=0} 23:05:07.582738 --- ParallelTerminationStrategy: PID 6269 died... 23:05:07.602045 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6269): Terminated: ok {rc=0} 23:05:07.647481 --- ParallelTerminationStrategy: PID 6272 died... 23:05:07.666825 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6272): Terminated: ok {rc=0} 23:05:07.753715 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2383 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 23:05:09.062883 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:05:09.069376 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 23:05:09.099598 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 23:05:09.139379 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 23:05:09.230026 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 23:05:09.260529 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 23:05:09.299969 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 23:05:09.897455 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2383 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 23:05:09.951679 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:05:09.963300 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:05:10.030754 tst cs_paging_gprs_active.py: using LAC 32123 23:05:10.158585 tst cs_paging_gprs_active.py: using RAC 248 23:05:10.286272 tst cs_paging_gprs_active.py: using CellId 32123 23:05:10.414530 tst cs_paging_gprs_active.py: using BVCI 32124 23:05:10.534578 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:05:10.546280 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:05:10.557842 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:05:10.569759 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:05:10.581268 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:05:10.592576 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:05:10.604117 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:05:10.615569 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:05:10.627159 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:05:10.745469 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:05:10.863255 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 23:05:11.072476 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:05:11.383456 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6277): Launched 23:05:11.654837 run iperf3-srv_10.42.42.10(pid=6278): Launched 23:05:11.773684 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 23:05:11.982921 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:05:12.294233 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6279): Launched 23:05:12.566785 run iperf3-srv_10.42.42.10(pid=6280): Launched 23:05:12.683107 tst cs_paging_gprs_active.py:38: start network... 23:05:12.890922 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:05:13.372254 run create_hlr_db(pid=6281): Launched 23:05:13.492883 bus /gobi_6: Setting Powered False 23:05:14.554336 run create_hlr_db(pid=6281): Terminated: ok {rc=0} 23:05:15.004757 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6284): Launched 23:05:15.335617 run osmo-hlr_10.42.42.2(pid=6285): Launched 23:05:15.462056 run osmo-stp_10.42.42.5: Starting osmo-stp 23:05:16.045034 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6287): Launched 23:05:16.385746 run osmo-stp_10.42.42.5(pid=6288): Launched 23:05:16.650313 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:05:17.390471 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6290): Launched 23:05:17.512099 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:05:17.782370 run patchelf(pid=6291): Launched 23:05:17.957819 run osmo-stp_10.42.42.5(pid=6288): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6288)] 23:05:18.089432 run osmo-stp_10.42.42.5(pid=6288): stdout: | (launched: 2022-12-12_23:05:16.323234) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:05:18.222728 run osmo-stp_10.42.42.5(pid=6288): stderr: | [0;m[38;5;43m20221212230516713 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230516714 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230516716 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230516718 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230516720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230516721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230516721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:05:18.356223 run osmo-stp_10.42.42.5(pid=6288): stdout: | (launched: 2022-12-12_23:05:16.323234) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:05:18.484305 run osmo-stp_10.42.42.5(pid=6288): stderr: | [0;m[38;5;43m20221212230516713 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230516714 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230516716 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230516718 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230516720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230516721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230516721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:05:18.635802 run patchelf(pid=6291): Terminating (SIGINT) 23:05:18.811635 run patchelf(pid=6291): Terminated: ok {rc=0} 23:05:18.938466 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=6288): Process ended prematurely: osmo-stp_10.42.42.5(pid=6288) [trial-2383↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6288)] [trial-2383↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 23:05:18.948048 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 23:05:18.976033 run osmo-hlr_10.42.42.2(pid=6285): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6285)] 23:05:19.023933 run osmo-hlr_10.42.42.2(pid=6285): stdout: | (launched: 2022-12-12_23:05:15.275256) 23:05:19.073450 run osmo-hlr_10.42.42.2(pid=6285): stderr: | [0;m[1;31m20221212230515473 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212230515474 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212230515474 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212230515474 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212230515474 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212230515474 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212230515486 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212230515495 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212230515495 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212230515495 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:05:19.123365 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6277): Terminating (SIGTERM) 23:05:19.162903 run iperf3-srv_10.42.42.10(pid=6278): Terminating (SIGTERM) 23:05:19.202559 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6279): Terminating (SIGTERM) 23:05:19.242123 run iperf3-srv_10.42.42.10(pid=6280): Terminating (SIGTERM) 23:05:19.281521 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6284): Terminating (SIGTERM) 23:05:19.321232 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6287): Terminating (SIGTERM) 23:05:19.360796 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6290): Terminating (SIGTERM) 23:05:19.400584 --- ParallelTerminationStrategy: PID 6277 died... 23:05:19.419721 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6277): Terminated: ok {rc=0} 23:05:19.463933 --- ParallelTerminationStrategy: PID 6278 died... 23:05:19.482393 run iperf3-srv_10.42.42.10(pid=6278): Terminated {rc=256} 23:05:19.526228 --- ParallelTerminationStrategy: PID 6279 died... 23:05:19.544637 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6279): Terminated: ok {rc=0} 23:05:19.588525 --- ParallelTerminationStrategy: PID 6280 died... 23:05:19.607033 run iperf3-srv_10.42.42.10(pid=6280): Terminated {rc=256} 23:05:19.650840 --- ParallelTerminationStrategy: PID 6284 died... 23:05:19.669379 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6284): Terminated: ok {rc=0} 23:05:19.713259 --- ParallelTerminationStrategy: PID 6287 died... 23:05:19.731549 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6287): Terminated: ok {rc=0} 23:05:19.775492 --- ParallelTerminationStrategy: PID 6290 died... 23:05:19.794116 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6290): Terminated: ok {rc=0} 23:05:19.881129 bus /gobi_0: Setting Powered False 23:05:20.980776 bus /gobi_0: Setting Powered False 23:05:22.095056 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 23:05:23.243858 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:05:23.256310 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:05:23.325011 tst iperf3.py: using LAC 32124 23:05:23.458522 tst iperf3.py: using RAC 249 23:05:23.580468 tst iperf3.py: using CellId 32124 23:05:23.701664 tst iperf3.py: using BVCI 32125 23:05:23.822637 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:05:23.834628 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:05:23.846352 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:05:23.858011 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:05:23.869655 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:05:23.881359 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:05:23.892859 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:05:23.904294 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:05:23.916090 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:05:24.040505 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 23:05:24.248668 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:05:24.557935 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6292): Launched 23:05:24.826876 run iperf3-srv_10.42.42.10(pid=6293): Launched 23:05:24.943083 tst iperf3.py:8: start network... 23:05:25.150899 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:05:25.631035 run create_hlr_db(pid=6294): Launched 23:05:25.751216 bus /gobi_6: Setting Powered False 23:05:26.812001 run create_hlr_db(pid=6294): Terminated: ok {rc=0} 23:05:27.262433 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6296): Launched 23:05:27.592499 run osmo-hlr_10.42.42.2(pid=6297): Launched 23:05:27.719036 run osmo-stp_10.42.42.5: Starting osmo-stp 23:05:28.295631 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6299): Launched 23:05:28.626644 run osmo-stp_10.42.42.5(pid=6300): Launched 23:05:28.753043 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:05:29.323697 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6302): Launched 23:05:29.449744 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:05:29.728877 run patchelf(pid=6303): Launched 23:05:29.912195 run osmo-stp_10.42.42.5(pid=6300): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6300)] 23:05:30.052425 run osmo-stp_10.42.42.5(pid=6300): stdout: | (launched: 2022-12-12_23:05:28.565853) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:05:30.193137 run osmo-stp_10.42.42.5(pid=6300): stderr: | [0;m[38;5;43m20221212230528759 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230528760 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230528760 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230528760 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230528763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230528763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230528763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:05:30.334213 run osmo-stp_10.42.42.5(pid=6300): stdout: | (launched: 2022-12-12_23:05:28.565853) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:05:30.469812 run osmo-stp_10.42.42.5(pid=6300): stderr: | [0;m[38;5;43m20221212230528759 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230528760 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230528760 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230528760 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230528763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230528763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230528763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:05:30.630228 run patchelf(pid=6303): Terminating (SIGINT) 23:05:30.816227 run patchelf(pid=6303): Terminated: ok {rc=0} 23:05:30.964812 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6300): Process ended prematurely: osmo-stp_10.42.42.5(pid=6300) [trial-2383↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6300)] [trial-2383↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8] 23:05:30.975766 tst iperf3.py:8: Test FAILED (7.8 sec) 23:05:31.006769 run osmo-hlr_10.42.42.2(pid=6297): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6297)] 23:05:31.057432 run osmo-hlr_10.42.42.2(pid=6297): stdout: | (launched: 2022-12-12_23:05:27.532241) 23:05:31.109913 run osmo-hlr_10.42.42.2(pid=6297): stderr: | [0;m[1;31m20221212230527731 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212230527731 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212230527731 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212230527731 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212230527731 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212230527732 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212230527744 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212230527754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212230527754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212230527754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:05:31.163968 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6292): Terminating (SIGTERM) 23:05:31.206486 run iperf3-srv_10.42.42.10(pid=6293): Terminating (SIGTERM) 23:05:31.250650 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6296): Terminating (SIGTERM) 23:05:31.293943 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6299): Terminating (SIGTERM) 23:05:31.339647 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6302): Terminating (SIGTERM) 23:05:31.385468 --- ParallelTerminationStrategy: PID 6292 died... 23:05:31.405590 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6292): Terminated: ok {rc=0} 23:05:31.454685 --- ParallelTerminationStrategy: PID 6293 died... 23:05:31.474268 run iperf3-srv_10.42.42.10(pid=6293): Terminated {rc=256} 23:05:31.521555 --- ParallelTerminationStrategy: PID 6296 died... 23:05:31.541530 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6296): Terminated: ok {rc=0} 23:05:31.590913 --- ParallelTerminationStrategy: PID 6299 died... 23:05:31.610552 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6299): Terminated: ok {rc=0} 23:05:31.658093 --- ParallelTerminationStrategy: PID 6302 died... 23:05:31.678736 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6302): Terminated: ok {rc=0} 23:05:31.774073 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 23:05:32.939229 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:05:32.951599 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:05:33.020606 tst iperf3m4.py: using LAC 32125 23:05:33.151815 tst iperf3m4.py: using RAC 250 23:05:33.275540 tst iperf3m4.py: using CellId 32125 23:05:33.400118 tst iperf3m4.py: using BVCI 32126 23:05:33.513728 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:05:33.524753 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:05:33.535841 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:05:33.547641 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:05:33.559448 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:05:33.571151 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:05:33.583034 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:05:33.594851 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:05:33.606714 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:05:33.726439 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:05:33.850238 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:05:33.970901 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:05:34.090026 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 23:05:34.298442 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:05:34.609564 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6304): Launched 23:05:34.880737 run iperf3-srv_10.42.42.10(pid=6305): Launched 23:05:34.997488 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 23:05:35.205521 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:05:35.516788 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6306): Launched 23:05:35.787000 run iperf3-srv_10.42.42.10(pid=6307): Launched 23:05:35.903674 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 23:05:36.111987 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:05:36.423052 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6308): Launched 23:05:36.693793 run iperf3-srv_10.42.42.10(pid=6309): Launched 23:05:36.810194 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 23:05:37.017995 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:05:37.329336 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6310): Launched 23:05:37.599448 run iperf3-srv_10.42.42.10(pid=6311): Launched 23:05:37.716224 tst iperf3m4.py:8: start network... 23:05:37.925235 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:05:38.406429 run create_hlr_db(pid=6312): Launched 23:05:38.524650 bus /gobi_6: Setting Powered False 23:05:39.586046 run create_hlr_db(pid=6312): Terminated: ok {rc=0} 23:05:40.018412 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6314): Launched 23:05:40.329088 run osmo-hlr_10.42.42.2(pid=6315): Launched 23:05:40.447665 run osmo-stp_10.42.42.5: Starting osmo-stp 23:05:40.999716 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6317): Launched 23:05:41.310730 run osmo-stp_10.42.42.5(pid=6318): Launched 23:05:41.429079 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:05:41.963511 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6320): Launched 23:05:42.082849 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:05:42.346477 run patchelf(pid=6321): Launched 23:05:42.519092 run osmo-stp_10.42.42.5(pid=6318): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6318)] 23:05:42.650463 run osmo-stp_10.42.42.5(pid=6318): stdout: | (launched: 2022-12-12_23:05:41.253235) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:05:42.782829 run osmo-stp_10.42.42.5(pid=6318): stderr: | [0;m[38;5;43m20221212230541427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230541427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230541428 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230541428 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230541428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230541429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230541429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:05:42.915382 run osmo-stp_10.42.42.5(pid=6318): stdout: | (launched: 2022-12-12_23:05:41.253235) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:05:43.042480 run osmo-stp_10.42.42.5(pid=6318): stderr: | [0;m[38;5;43m20221212230541427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230541427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230541428 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230541428 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230541428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230541429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230541429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:05:43.192451 run patchelf(pid=6321): Terminating (SIGINT) 23:05:43.368180 run patchelf(pid=6321): Terminated: ok {rc=0} 23:05:43.494735 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6318): Process ended prematurely: osmo-stp_10.42.42.5(pid=6318) [trial-2383↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6318)] [trial-2383↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8] 23:05:43.504398 tst iperf3m4.py:8: Test FAILED (10.6 sec) 23:05:43.532418 run osmo-hlr_10.42.42.2(pid=6315): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6315)] 23:05:43.580607 run osmo-hlr_10.42.42.2(pid=6315): stdout: | (launched: 2022-12-12_23:05:40.271283) 23:05:43.630267 run osmo-hlr_10.42.42.2(pid=6315): stderr: | [0;m[1;31m20221212230540451 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212230540451 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212230540451 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212230540451 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212230540451 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212230540451 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212230540463 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212230540472 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212230540472 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212230540472 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:05:43.680215 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6304): Terminating (SIGTERM) 23:05:43.720285 run iperf3-srv_10.42.42.10(pid=6305): Terminating (SIGTERM) 23:05:43.760130 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6306): Terminating (SIGTERM) 23:05:43.799890 run iperf3-srv_10.42.42.10(pid=6307): Terminating (SIGTERM) 23:05:43.839501 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6308): Terminating (SIGTERM) 23:05:43.879334 run iperf3-srv_10.42.42.10(pid=6309): Terminating (SIGTERM) 23:05:43.919014 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6310): Terminating (SIGTERM) 23:05:43.958619 run iperf3-srv_10.42.42.10(pid=6311): Terminating (SIGTERM) 23:05:43.998547 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6314): Terminating (SIGTERM) 23:05:44.038393 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6317): Terminating (SIGTERM) 23:05:44.078180 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6320): Terminating (SIGTERM) 23:05:44.118189 --- ParallelTerminationStrategy: PID 6304 died... 23:05:44.137189 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6304): Terminated: ok {rc=0} 23:05:44.181602 --- ParallelTerminationStrategy: PID 6305 died... 23:05:44.199931 run iperf3-srv_10.42.42.10(pid=6305): Terminated {rc=256} 23:05:44.244329 --- ParallelTerminationStrategy: PID 6306 died... 23:05:44.262936 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6306): Terminated: ok {rc=0} 23:05:44.307795 --- ParallelTerminationStrategy: PID 6307 died... 23:05:44.326306 run iperf3-srv_10.42.42.10(pid=6307): Terminated {rc=256} 23:05:44.370212 --- ParallelTerminationStrategy: PID 6308 died... 23:05:44.388600 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6308): Terminated: ok {rc=0} 23:05:44.432697 --- ParallelTerminationStrategy: PID 6309 died... 23:05:44.451245 run iperf3-srv_10.42.42.10(pid=6309): Terminated {rc=256} 23:05:44.495259 --- ParallelTerminationStrategy: PID 6310 died... 23:05:44.513765 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6310): Terminated: ok {rc=0} 23:05:44.557849 --- ParallelTerminationStrategy: PID 6311 died... 23:05:44.576659 run iperf3-srv_10.42.42.10(pid=6311): Terminated {rc=256} 23:05:44.620598 --- ParallelTerminationStrategy: PID 6314 died... 23:05:44.639195 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6314): Terminated: ok {rc=0} 23:05:44.683286 --- ParallelTerminationStrategy: PID 6317 died... 23:05:44.701820 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6317): Terminated: ok {rc=0} 23:05:44.746326 --- ParallelTerminationStrategy: PID 6320 died... 23:05:44.764729 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6320): Terminated: ok {rc=0} 23:05:44.848312 bus /gobi_4: Setting Powered False 23:05:45.947799 bus /gobi_4: Setting Powered False 23:05:47.067666 bus /gobi_1: Setting Powered False 23:05:48.169505 bus /gobi_1: Setting Powered False 23:05:49.285429 bus /gobi_0: Setting Powered False 23:05:50.383867 bus /gobi_0: Setting Powered False 23:05:51.500719 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 23:05:52.602707 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:05:52.615334 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:05:52.684168 tst ping.py: using LAC 32126 23:05:52.811248 tst ping.py: using RAC 251 23:05:52.938837 tst ping.py: using CellId 32126 23:05:53.069915 tst ping.py: using BVCI 32127 23:05:53.188286 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:05:53.200071 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:05:53.211632 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:05:53.223161 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:05:53.234646 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:05:53.246151 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:05:53.257834 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:05:53.269400 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:05:53.385971 tst ping.py:19: start network... 23:05:53.590574 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:05:54.060835 run create_hlr_db(pid=6322): Launched 23:05:54.177225 bus /gobi_6: Setting Powered False 23:05:55.236819 run create_hlr_db(pid=6322): Terminated: ok {rc=0} 23:05:55.679422 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6324): Launched 23:05:56.004095 run osmo-hlr_10.42.42.2(pid=6325): Launched 23:05:56.130028 run osmo-stp_10.42.42.5: Starting osmo-stp 23:05:56.697109 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6327): Launched 23:05:57.020357 run osmo-stp_10.42.42.5(pid=6328): Launched 23:05:57.146354 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:05:57.705068 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6330): Launched 23:05:57.828683 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:05:58.102811 run patchelf(pid=6331): Launched 23:05:58.284776 run osmo-stp_10.42.42.5(pid=6328): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6328)] 23:05:58.422462 run osmo-stp_10.42.42.5(pid=6328): stdout: | (launched: 2022-12-12_23:05:56.961539) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:05:58.561104 run osmo-stp_10.42.42.5(pid=6328): stderr: | [0;m[38;5;43m20221212230557156 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230557156 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230557157 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230557157 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230557158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230557158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230557158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:05:58.699925 run osmo-stp_10.42.42.5(pid=6328): stdout: | (launched: 2022-12-12_23:05:56.961539) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:05:58.832437 run osmo-stp_10.42.42.5(pid=6328): stderr: | [0;m[38;5;43m20221212230557156 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230557156 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230557157 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230557157 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230557158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230557158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230557158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:05:58.989682 run patchelf(pid=6331): Terminating (SIGINT) 23:05:59.173590 run patchelf(pid=6331): Terminated: ok {rc=0} 23:05:59.304885 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=6328): Process ended prematurely: osmo-stp_10.42.42.5(pid=6328) [trial-2383↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6328)] [trial-2383↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22] 23:05:59.314634 tst ping.py:22: Test FAILED (6.7 sec) 23:05:59.342867 run osmo-hlr_10.42.42.2(pid=6325): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6325)] 23:05:59.392784 run osmo-hlr_10.42.42.2(pid=6325): stdout: | (launched: 2022-12-12_23:05:55.944597) 23:05:59.444675 run osmo-hlr_10.42.42.2(pid=6325): stderr: | [0;m[1;31m20221212230556143 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212230556143 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212230556143 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212230556143 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212230556144 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212230556144 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212230556158 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212230556168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212230556168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212230556168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:05:59.496917 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6324): Terminating (SIGTERM) 23:05:59.538760 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6327): Terminating (SIGTERM) 23:05:59.580534 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6330): Terminating (SIGTERM) 23:05:59.622590 --- ParallelTerminationStrategy: PID 6324 died... 23:05:59.642710 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6324): Terminated: ok {rc=0} 23:05:59.689224 --- ParallelTerminationStrategy: PID 6327 died... 23:05:59.708811 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6327): Terminated: ok {rc=0} 23:05:59.754979 --- ParallelTerminationStrategy: PID 6330 died... 23:05:59.774706 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6330): Terminated: ok {rc=0} 23:05:59.862452 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 23:06:00.957561 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:06:00.971131 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:06:01.043764 tst ping_idle_ping.py: using LAC 32127 23:06:01.175698 tst ping_idle_ping.py: using RAC 252 23:06:01.297073 tst ping_idle_ping.py: using CellId 32127 23:06:01.424741 tst ping_idle_ping.py: using BVCI 32128 23:06:01.539780 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:06:01.553189 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:06:01.565664 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:06:01.580344 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:06:01.593638 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:06:01.605798 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:06:01.619039 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:06:01.632374 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:06:01.751932 tst ping_idle_ping.py:24: start network... 23:06:01.965120 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:06:02.449224 run create_hlr_db(pid=6332): Launched 23:06:02.567040 bus /gobi_6: Setting Powered False 23:06:03.627609 run create_hlr_db(pid=6332): Terminated: ok {rc=0} 23:06:04.072652 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6334): Launched 23:06:04.397473 run osmo-hlr_10.42.42.2(pid=6335): Launched 23:06:04.523257 run osmo-stp_10.42.42.5: Starting osmo-stp 23:06:05.083273 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6337): Launched 23:06:05.409263 run osmo-stp_10.42.42.5(pid=6338): Launched 23:06:05.533185 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:06:06.094737 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6340): Launched 23:06:06.220384 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:06:06.495702 run patchelf(pid=6341): Launched 23:06:06.676171 run osmo-stp_10.42.42.5(pid=6338): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6338)] 23:06:06.814000 run osmo-stp_10.42.42.5(pid=6338): stdout: | (launched: 2022-12-12_23:06:05.349513) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:06:06.953278 run osmo-stp_10.42.42.5(pid=6338): stderr: | [0;m[38;5;43m20221212230605542 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230605543 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230605543 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230605543 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230605544 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230605544 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230605544 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:06:07.092630 run osmo-stp_10.42.42.5(pid=6338): stdout: | (launched: 2022-12-12_23:06:05.349513) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:06:07.226084 run osmo-stp_10.42.42.5(pid=6338): stderr: | [0;m[38;5;43m20221212230605542 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230605543 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230605543 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230605543 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230605544 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230605544 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230605544 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:06:07.383908 run patchelf(pid=6341): Terminating (SIGINT) 23:06:07.567589 run patchelf(pid=6341): Terminated: ok {rc=0} 23:06:07.699749 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=6338): Process ended prematurely: osmo-stp_10.42.42.5(pid=6338) [trial-2383↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6338)] [trial-2383↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 23:06:07.709467 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 23:06:07.737648 run osmo-hlr_10.42.42.2(pid=6335): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6335)] 23:06:07.787709 run osmo-hlr_10.42.42.2(pid=6335): stdout: | (launched: 2022-12-12_23:06:04.338279) 23:06:07.839455 run osmo-hlr_10.42.42.2(pid=6335): stderr: | [0;m[1;31m20221212230604539 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212230604539 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212230604539 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212230604539 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212230604539 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212230604539 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212230604559 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212230604569 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212230604570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212230604570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:06:07.891591 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6334): Terminating (SIGTERM) 23:06:07.933751 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6337): Terminating (SIGTERM) 23:06:07.975746 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6340): Terminating (SIGTERM) 23:06:08.017795 --- ParallelTerminationStrategy: PID 6334 died... 23:06:08.038146 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6334): Terminated: ok {rc=0} 23:06:08.084671 --- ParallelTerminationStrategy: PID 6337 died... 23:06:08.104588 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6337): Terminated: ok {rc=0} 23:06:08.150566 --- ParallelTerminationStrategy: PID 6340 died... 23:06:08.170573 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6340): Terminated: ok {rc=0} 23:06:08.258284 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2383 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 23:06:09.565848 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:06:09.573178 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 23:06:09.603221 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 23:06:09.638855 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 23:06:09.693384 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 23:06:09.723240 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 23:06:09.758689 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 23:06:10.320397 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2383 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 23:06:10.326028 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:06:10.338110 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 23:06:10.405720 tst switch_tch_pdch.py: using LAC 32128 23:06:10.528238 tst switch_tch_pdch.py: using RAC 253 23:06:10.649055 tst switch_tch_pdch.py: using CellId 32128 23:06:10.769750 tst switch_tch_pdch.py: using BVCI 32129 23:06:10.882775 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:06:10.894384 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:06:10.906086 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:06:10.917745 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:06:10.929322 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:06:10.940803 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:06:10.952556 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:06:10.964285 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:06:11.080803 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:06:11.199819 tst switch_tch_pdch.py:51: start network... 23:06:11.404043 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:06:11.875524 run create_hlr_db(pid=6345): Launched 23:06:11.990464 bus /gobi_6: Setting Powered False 23:06:13.050963 run create_hlr_db(pid=6345): Terminated: ok {rc=0} 23:06:13.495256 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6347): Launched 23:06:13.818972 run osmo-hlr_10.42.42.2(pid=6348): Launched 23:06:13.941775 run osmo-stp_10.42.42.5: Starting osmo-stp 23:06:14.499424 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6350): Launched 23:06:14.823759 run osmo-stp_10.42.42.5(pid=6351): Launched 23:06:14.946970 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:06:15.507251 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6353): Launched 23:06:15.633026 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:06:15.949737 run patchelf(pid=6354): Launched 23:06:16.141393 run osmo-stp_10.42.42.5(pid=6351): ERR: Terminated: ERROR {rc=1} [trial-2383↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6351)] 23:06:16.282070 run osmo-stp_10.42.42.5(pid=6351): stdout: | (launched: 2022-12-12_23:06:14.764555) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:06:16.422053 run osmo-stp_10.42.42.5(pid=6351): stderr: | [0;m[38;5;43m20221212230614960 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230614960 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230614960 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230614961 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230614961 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230614961 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230614961 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:06:16.560194 run osmo-stp_10.42.42.5(pid=6351): stdout: | (launched: 2022-12-12_23:06:14.764555) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:06:16.690267 run osmo-stp_10.42.42.5(pid=6351): stderr: | [0;m[38;5;43m20221212230614960 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230614960 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230614960 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230614961 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230614961 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230614961 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230614961 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:06:16.845981 run patchelf(pid=6354): Terminating (SIGINT) 23:06:17.060856 run patchelf(pid=6354): Terminated: ok {rc=0} 23:06:17.191115 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=6351): Process ended prematurely: osmo-stp_10.42.42.5(pid=6351) [trial-2383↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6351)] [trial-2383↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 23:06:17.201196 tst switch_tch_pdch.py:54: Test FAILED (6.9 sec) 23:06:17.230158 run osmo-hlr_10.42.42.2(pid=6348): ERR: Terminated: ERROR {rc=237} [trial-2383↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6348)] 23:06:17.278201 run osmo-hlr_10.42.42.2(pid=6348): stdout: | (launched: 2022-12-12_23:06:13.759881) 23:06:17.327973 run osmo-hlr_10.42.42.2(pid=6348): stderr: | [0;m[1;31m20221212230613958 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212230613958 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212230613958 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212230613958 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212230613958 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212230613958 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212230613971 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212230613979 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212230613979 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212230613979 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:06:17.378137 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6347): Terminating (SIGTERM) 23:06:17.417944 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6350): Terminating (SIGTERM) 23:06:17.458007 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6353): Terminating (SIGTERM) 23:06:17.498327 --- ParallelTerminationStrategy: PID 6347 died... 23:06:17.517536 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6347): Terminated: ok {rc=0} 23:06:17.562454 --- ParallelTerminationStrategy: PID 6350 died... 23:06:17.581340 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6350): Terminated: ok {rc=0} 23:06:17.625860 --- ParallelTerminationStrategy: PID 6353 died... 23:06:17.644585 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6353): Terminated: ok {rc=0} 23:06:17.731742 bus /gobi_0: Setting Powered False 23:06:18.831730 bus /gobi_0: Setting Powered False 23:06:19.947097 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2383 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 23:06:21.200853 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:06:21.206661 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 23:06:21.236285 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 23:06:21.270609 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 23:06:21.325575 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 23:06:21.356441 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 23:06:21.391395 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 23:06:21.944905 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2383 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 23:06:21.950169 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:06:21.961442 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 23:06:22.028337 tst switch_tch_pdch.py: using LAC 32129 23:06:22.150377 tst switch_tch_pdch.py: using RAC 254 23:06:22.271724 tst switch_tch_pdch.py: using CellId 32129 23:06:22.394830 tst switch_tch_pdch.py: using BVCI 32130 23:06:22.508153 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:06:22.519289 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:06:22.530465 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:06:22.542352 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:06:22.554044 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:06:22.565900 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:06:22.577926 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:06:22.590167 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 23:06:22.709498 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 23:06:22.827110 tst switch_tch_pdch.py:51: start network... 23:06:23.046770 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:06:23.521019 run create_hlr_db(pid=6358): Launched 23:06:23.652689 bus /gobi_6: Setting Powered False 23:06:24.716862 run create_hlr_db(pid=6358): Terminated: ok {rc=0} 23:06:25.139837 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6360): Launched 23:06:25.464594 run osmo-hlr_10.42.42.2(pid=6361): Launched 23:06:25.588207 run osmo-stp_10.42.42.5: Starting osmo-stp 23:06:26.117153 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6363): Launched 23:06:26.442070 run osmo-stp_10.42.42.5(pid=6364): Launched 23:06:26.567303 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:06:27.098466 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6366): Launched 23:06:27.222269 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:06:27.497175 run patchelf(pid=6367): Launched 23:06:27.677441 run osmo-stp_10.42.42.5(pid=6364): ERR: Terminated: ERROR {rc=1} [trial-2383↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6364)] 23:06:27.815541 run osmo-stp_10.42.42.5(pid=6364): stdout: | (launched: 2022-12-12_23:06:26.382904) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:06:27.954964 run osmo-stp_10.42.42.5(pid=6364): stderr: | [0;m[38;5;43m20221212230626578 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230626578 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230626578 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230626579 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230626579 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230626579 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230626579 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:06:28.094654 run osmo-stp_10.42.42.5(pid=6364): stdout: | (launched: 2022-12-12_23:06:26.382904) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:06:28.227719 run osmo-stp_10.42.42.5(pid=6364): stderr: | [0;m[38;5;43m20221212230626578 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230626578 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230626578 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230626579 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230626579 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230626579 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230626579 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:06:28.385368 run patchelf(pid=6367): Terminating (SIGINT) 23:06:28.569373 run patchelf(pid=6367): Terminated: ok {rc=0} 23:06:28.701270 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=6364): Process ended prematurely: osmo-stp_10.42.42.5(pid=6364) [trial-2383↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6364)] [trial-2383↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 23:06:28.710919 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 23:06:28.739080 run osmo-hlr_10.42.42.2(pid=6361): ERR: Terminated: ERROR {rc=237} [trial-2383↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6361)] 23:06:28.789341 run osmo-hlr_10.42.42.2(pid=6361): stdout: | (launched: 2022-12-12_23:06:25.404721) 23:06:28.841254 run osmo-hlr_10.42.42.2(pid=6361): stderr: | [0;m[1;31m20221212230625605 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212230625605 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212230625605 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212230625605 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212230625606 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212230625606 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212230625618 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212230625626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212230625626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212230625626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:06:28.893970 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6360): Terminating (SIGTERM) 23:06:28.935994 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6363): Terminating (SIGTERM) 23:06:28.977911 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6366): Terminating (SIGTERM) 23:06:29.020344 --- ParallelTerminationStrategy: PID 6360 died... 23:06:29.040406 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6360): Terminated: ok {rc=0} 23:06:29.086698 --- ParallelTerminationStrategy: PID 6363 died... 23:06:29.106605 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6363): Terminated: ok {rc=0} 23:06:29.152796 --- ParallelTerminationStrategy: PID 6366 died... 23:06:29.172236 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6366): Terminated: ok {rc=0} 23:06:29.260284 bus /gobi_0: Setting Powered False 23:06:30.359529 bus /gobi_0: Setting Powered False 23:06:31.476493 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2383 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 nitb_sms:nanobts --------------------------------------------------------------------- 23:06:32.720915 tst nitb_sms:nanobts: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:06:32.724619 tst nitb_sms:nanobts: Verifying 1 x bts (candidates: 11) 23:06:32.748572 tst nitb_sms:nanobts: Verifying 1 x ip_address (candidates: 9) 23:06:32.756454 tst nitb_sms:nanobts: Verifying 2 x modem (candidates: 12) 23:06:32.808086 tst nitb_sms:nanobts: Reserving 1 x bts (candidates: 11) 23:06:32.831596 tst nitb_sms:nanobts: Reserving 1 x ip_address (candidates: 9) 23:06:32.838568 tst nitb_sms:nanobts: Reserving 2 x modem (candidates: 12) 23:06:33.375919 tst nitb_sms:nanobts: RESERVED RESOURCES for nitb_sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 nitb_sms:nanobts mo_mt_sms.py ---------------------------------------------- 23:06:33.380859 tst nitb_sms:nanobts: Using 1 x ip_address (candidates: 1) 23:06:33.392075 tst nitb_sms:nanobts: Using 1 x bts (candidates: 1) 23:06:33.429748 tst mo_mt_sms.py: using LAC 32130 23:06:33.558803 tst mo_mt_sms.py: using RAC 255 23:06:33.678489 tst mo_mt_sms.py: using CellId 32130 23:06:33.797972 tst mo_mt_sms.py: using BVCI 32131 23:06:33.910445 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 23:06:34.030641 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 23:06:34.148073 tst mo_mt_sms.py:9: start nitb and bts... 23:06:34.352938 run osmo-nitb_10.42.42.2: Starting osmo-nitb 23:06:34.974646 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6371): Launched 23:06:35.279218 run osmo-nitb_10.42.42.2(pid=6372): Launched 23:06:35.448482 run osmo-nitb_10.42.42.2(pid=6372): ERR: Terminated: ERROR {rc=2} [trial-2383↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6372)] 23:06:35.585199 run osmo-nitb_10.42.42.2(pid=6372): stdout: | (launched: 2022-12-12_23:06:35.223868) 23:06:35.723518 run osmo-nitb_10.42.42.2(pid=6372): stderr: | (launched: 2022-12-12_23:06:35.268863) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:06:35.862103 run osmo-nitb_10.42.42.2(pid=6372): stdout: | (launched: 2022-12-12_23:06:35.223868) 23:06:35.994627 run osmo-nitb_10.42.42.2(pid=6372): stderr: | (launched: 2022-12-12_23:06:35.268863) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fa469b2b268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=6372): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6372) [trial-2383↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6372)] 23:06:36.393826 tst osmo-nitb_10.42.42.2(pid=6372): stdout: | (launched: 2022-12-12_23:06:35.223868) 23:06:36.517572 tst osmo-nitb_10.42.42.2(pid=6372): stderr: | (launched: 2022-12-12_23:06:35.268863) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:06:36.663202 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=6372): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6372) [trial-2383↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6372)] [trial-2383↪nitb_sms:nanobts↪mo_mt_sms.py:11] 23:06:36.671713 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 23:06:36.678373 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6371): Terminating (SIGTERM) 23:06:36.887727 --- ParallelTerminationStrategy: PID 6371 died... 23:06:36.908228 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6371): Terminated: ok {rc=0} 23:06:36.991925 bus /sierra_3: Setting Powered False 23:06:38.091417 bus /sierra_3: Setting Powered False 23:06:39.208065 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 nitb_sms:nanobts FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 sms:nanobts+band-1900 --------------------------------------------------------------------- 23:06:40.400345 tst sms:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:06:40.406920 tst sms:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 23:06:40.431676 tst sms:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 23:06:40.458743 tst sms:nanobts+band-1900: Verifying 2 x modem (candidates: 12) 23:06:40.511070 tst sms:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 23:06:40.536361 tst sms:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 23:06:40.563889 tst sms:nanobts+band-1900: Reserving 2 x modem (candidates: 12) 23:06:41.112266 tst sms:nanobts+band-1900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 sms:nanobts+band-1900 mo_mt_sms.py ---------------------------------------------- 23:06:41.117530 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 23:06:41.128795 tst sms:nanobts+band-1900: Using 1 x bts (candidates: 1) 23:06:41.170586 tst mo_mt_sms.py: using LAC 32131 23:06:41.297205 tst mo_mt_sms.py: using RAC 1 23:06:41.422272 tst mo_mt_sms.py: using CellId 32131 23:06:41.547450 tst mo_mt_sms.py: using BVCI 32132 23:06:41.665880 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 23:06:41.677186 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 23:06:41.688176 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 23:06:41.699209 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 23:06:41.710335 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 23:06:41.721407 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 23:06:41.839304 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 23:06:41.955876 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:06:42.428806 run create_hlr_db(pid=6376): Launched 23:06:42.546606 bus /sierra_2: Setting Powered False 23:06:43.607644 run create_hlr_db(pid=6376): Terminated: ok {rc=0} 23:06:44.051705 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6378): Launched 23:06:44.377715 run osmo-hlr_10.42.42.2(pid=6379): Launched 23:06:44.503577 run osmo-stp_10.42.42.5: Starting osmo-stp 23:06:45.064320 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6381): Launched 23:06:45.387176 run osmo-stp_10.42.42.5(pid=6382): Launched 23:06:45.512211 run osmo-msc_10.42.42.6: Starting osmo-msc 23:06:46.128709 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6384): Launched 23:06:46.465688 run osmo-msc_10.42.42.6(pid=6385): Launched 23:06:46.871512 run osmo-stp_10.42.42.5(pid=6382): ERR: Terminated: ERROR {rc=1} [trial-2383↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6382)] 23:06:47.058435 run osmo-stp_10.42.42.5(pid=6382): stdout: | (launched: 2022-12-12_23:06:45.328373) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:06:47.273062 run osmo-stp_10.42.42.5(pid=6382): stderr: | [0;m[38;5;43m20221212230645521 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230645521 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230645521 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230645521 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230645524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230645524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230645524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:06:47.402209 run osmo-stp_10.42.42.5(pid=6382): stdout: | (launched: 2022-12-12_23:06:45.328373) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:06:47.523771 run osmo-stp_10.42.42.5(pid=6382): stderr: | [0;m[38;5;43m20221212230645521 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230645521 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230645521 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230645521 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230645524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230645524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230645524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:06:47.668876 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=6382): Process ended prematurely: osmo-stp_10.42.42.5(pid=6382) [trial-2383↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6382)] [trial-2383↪sms:nanobts+band-1900↪mo_mt_sms.py:16] 23:06:47.677381 tst mo_mt_sms.py:16: Test FAILED (6.6 sec) 23:06:47.703615 run osmo-hlr_10.42.42.2(pid=6379): ERR: Terminated: ERROR {rc=237} [trial-2383↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6379)] 23:06:47.751657 run osmo-hlr_10.42.42.2(pid=6379): stdout: | (launched: 2022-12-12_23:06:44.318527) 23:06:47.801044 run osmo-hlr_10.42.42.2(pid=6379): stderr: | [0;m[1;31m20221212230644518 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212230644518 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212230644518 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212230644518 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212230644518 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212230644518 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212230644530 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/sms:nanobts+band-1900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212230644539 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212230644539 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212230644539 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:06:47.870012 run osmo-msc_10.42.42.6(pid=6385): ERR: Terminated: ERROR {rc=2} [trial-2383↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6385)] 23:06:47.917826 run osmo-msc_10.42.42.6(pid=6385): stdout: | (launched: 2022-12-12_23:06:46.398032) 23:06:47.967021 run osmo-msc_10.42.42.6(pid=6385): stderr: | [0;m[38;5;43m20221212230646802 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212230646802 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5d8583ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212230646802 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212230646802 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212230646802 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212230646802 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212230646804 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212230646804 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212230646805 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212230646805 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:06:48.016574 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6378): Terminating (SIGTERM) 23:06:48.056380 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6381): Terminating (SIGTERM) 23:06:48.096158 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6384): Terminating (SIGTERM) 23:06:48.136482 --- ParallelTerminationStrategy: PID 6378 died... 23:06:48.155708 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6378): Terminated: ok {rc=0} 23:06:48.200306 --- ParallelTerminationStrategy: PID 6381 died... 23:06:48.219022 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6381): Terminated: ok {rc=0} 23:06:48.263349 --- ParallelTerminationStrategy: PID 6384 died... 23:06:48.281832 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6384): Terminated: ok {rc=0} 23:06:48.367712 bus /sierra_3: Setting Powered False 23:06:49.466180 bus /sierra_3: Setting Powered False 23:06:50.580779 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 sms:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 nitb_ussd:nanobts+band-1900 --------------------------------------------------------------------- 23:06:51.811688 tst nitb_ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:06:51.818328 tst nitb_ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 23:06:51.842965 tst nitb_ussd:nanobts+band-1900: Verifying 1 x ip_address (candidates: 9) 23:06:51.850023 tst nitb_ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 23:06:51.883620 tst nitb_ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 23:06:51.907115 tst nitb_ussd:nanobts+band-1900: Reserving 1 x ip_address (candidates: 9) 23:06:51.914156 tst nitb_ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 23:06:52.437997 tst nitb_ussd:nanobts+band-1900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2383 nitb_ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 23:06:52.443421 tst nitb_ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 1) 23:06:52.455172 tst nitb_ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 23:06:52.494383 tst assert_extension.py: using LAC 32132 23:06:52.621719 tst assert_extension.py: using RAC 2 23:06:52.746819 tst assert_extension.py: using CellId 32132 23:06:52.872591 tst assert_extension.py: using BVCI 32133 23:06:52.990552 tst nitb_ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 23:06:53.107578 tst assert_extension.py:10: start nitb and bts... 23:06:53.313090 run osmo-nitb_10.42.42.2: Starting osmo-nitb 23:06:53.934545 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6390): Launched 23:06:54.240699 run osmo-nitb_10.42.42.2(pid=6391): Launched 23:06:54.409950 run osmo-nitb_10.42.42.2(pid=6391): ERR: Terminated: ERROR {rc=2} [trial-2383↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6391)] 23:06:54.546316 run osmo-nitb_10.42.42.2(pid=6391): stdout: | (launched: 2022-12-12_23:06:54.185082) 23:06:54.685164 run osmo-nitb_10.42.42.2(pid=6391): stderr: | (launched: 2022-12-12_23:06:54.230385) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:06:54.823288 run osmo-nitb_10.42.42.2(pid=6391): stdout: | (launched: 2022-12-12_23:06:54.185082) 23:06:54.955261 run osmo-nitb_10.42.42.2(pid=6391): stderr: | (launched: 2022-12-12_23:06:54.230385) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fa469b2b268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=6391): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6391) [trial-2383↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6391)] 23:06:55.355946 tst osmo-nitb_10.42.42.2(pid=6391): stdout: | (launched: 2022-12-12_23:06:54.185082) 23:06:55.479519 tst osmo-nitb_10.42.42.2(pid=6391): stderr: | (launched: 2022-12-12_23:06:54.230385) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:06:55.625449 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=6391): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6391) [trial-2383↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6391)] [trial-2383↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12] 23:06:55.634096 tst assert_extension.py:12: Test FAILED (3.2 sec) 23:06:55.640752 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6390): Terminating (SIGTERM) 23:06:55.849883 --- ParallelTerminationStrategy: PID 6390 died... 23:06:55.870867 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6390): Terminated: ok {rc=0} 23:06:55.957650 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 nitb_ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 ussd:nanobts+band-1900 --------------------------------------------------------------------- 23:06:57.122437 tst ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:06:57.127304 tst ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 23:06:57.151399 tst ussd:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 23:06:57.178380 tst ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 23:06:57.213762 tst ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 23:06:57.238701 tst ussd:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 23:06:57.266755 tst ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 23:06:57.794030 tst ussd:nanobts+band-1900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2383 ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 23:06:57.800089 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 23:06:57.811101 tst ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 23:06:57.849597 tst assert_extension.py: using LAC 32133 23:06:57.971579 tst assert_extension.py: using RAC 3 23:06:58.093394 tst assert_extension.py: using CellId 32133 23:06:58.222368 tst assert_extension.py: using BVCI 32134 23:06:58.340711 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 23:06:58.352231 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 23:06:58.363511 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 23:06:58.374674 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 23:06:58.386199 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 23:06:58.397278 tst ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 23:06:58.512725 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:06:58.982394 run create_hlr_db(pid=6396): Launched 23:06:59.100722 bus /sierra_2: Setting Powered False 23:07:00.161623 run create_hlr_db(pid=6396): Terminated: ok {rc=0} 23:07:00.604698 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6398): Launched 23:07:00.949740 run osmo-hlr_10.42.42.2(pid=6399): Launched 23:07:01.159695 run osmo-stp_10.42.42.5: Starting osmo-stp 23:07:01.864399 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6401): Launched 23:07:02.194923 run osmo-stp_10.42.42.5(pid=6402): Launched 23:07:02.372248 run osmo-msc_10.42.42.6: Starting osmo-msc 23:07:02.957727 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6404): Launched 23:07:03.283621 run osmo-msc_10.42.42.6(pid=6405): Launched 23:07:03.463908 run osmo-stp_10.42.42.5(pid=6402): ERR: Terminated: ERROR {rc=1} [trial-2383↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6402)] 23:07:03.600216 run osmo-stp_10.42.42.5(pid=6402): stdout: | (launched: 2022-12-12_23:07:02.128844) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:07:03.737112 run osmo-stp_10.42.42.5(pid=6402): stderr: | [0;m[38;5;43m20221212230702389 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230702389 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230702390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230702390 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230702391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230702391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230702391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:07:03.873242 run osmo-stp_10.42.42.5(pid=6402): stdout: | (launched: 2022-12-12_23:07:02.128844) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:07:04.001632 run osmo-stp_10.42.42.5(pid=6402): stderr: | [0;m[38;5;43m20221212230702389 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230702389 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230702390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230702390 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230702391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230702391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230702391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:07:04.156122 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=6402): Process ended prematurely: osmo-stp_10.42.42.5(pid=6402) [trial-2383↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6402)] [trial-2383↪ussd:nanobts+band-1900↪assert_extension.py:17] 23:07:04.165384 tst assert_extension.py:17: Test FAILED (6.4 sec) 23:07:04.192784 run osmo-hlr_10.42.42.2(pid=6399): ERR: Terminated: ERROR {rc=237} [trial-2383↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6399)] 23:07:04.242702 run osmo-hlr_10.42.42.2(pid=6399): stdout: | (launched: 2022-12-12_23:07:00.874675) 23:07:04.295098 run osmo-hlr_10.42.42.2(pid=6399): stderr: | [0;m[1;31m20221212230701243 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212230701244 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212230701244 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212230701244 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212230701244 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212230701244 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212230701264 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/ussd:nanobts+band-1900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212230701283 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212230701283 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212230701283 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:07:04.367591 run osmo-msc_10.42.42.6(pid=6405): ERR: Terminated: ERROR {rc=2} [trial-2383↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6405)] 23:07:04.417466 run osmo-msc_10.42.42.6(pid=6405): stdout: | (launched: 2022-12-12_23:07:03.224146) 23:07:04.469183 run osmo-msc_10.42.42.6(pid=6405): stderr: | [0;m[38;5;43m20221212230703545 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212230703545 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7f8a842c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212230703545 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212230703545 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212230703546 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212230703546 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212230703547 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212230703548 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212230703548 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212230703548 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:07:04.521437 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6398): Terminating (SIGTERM) 23:07:04.563213 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6401): Terminating (SIGTERM) 23:07:04.605138 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6404): Terminating (SIGTERM) 23:07:04.647221 --- ParallelTerminationStrategy: PID 6398 died... 23:07:04.667339 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6398): Terminated: ok {rc=0} 23:07:04.714030 --- ParallelTerminationStrategy: PID 6401 died... 23:07:04.733860 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6401): Terminated: ok {rc=0} 23:07:04.780039 --- ParallelTerminationStrategy: PID 6404 died... 23:07:04.799755 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6404): Terminated: ok {rc=0} 23:07:04.887141 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 23:07:06.089976 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:07:06.097339 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 23:07:06.122024 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 23:07:06.148861 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 23:07:06.206418 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 23:07:06.230420 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 23:07:06.257367 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 23:07:06.803056 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 23:07:06.854141 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:07:06.865686 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 23:07:06.923445 tst mo_mt_call.py: using LAC 32134 23:07:07.045395 tst mo_mt_call.py: using RAC 4 23:07:07.169275 tst mo_mt_call.py: using CellId 32134 23:07:07.291571 tst mo_mt_call.py: using BVCI 32135 23:07:07.406306 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:07:07.417785 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:07:07.428706 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:07:07.440620 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:07:07.452293 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:07:07.463826 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 23:07:07.584023 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 23:07:07.700607 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:07:08.180619 run create_hlr_db(pid=6410): Launched 23:07:08.298813 bus /sierra_2: Setting Powered False 23:07:09.360418 run create_hlr_db(pid=6410): Terminated: ok {rc=0} 23:07:09.810091 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6412): Launched 23:07:10.142618 run osmo-hlr_10.42.42.2(pid=6413): Launched 23:07:10.268823 run osmo-stp_10.42.42.5: Starting osmo-stp 23:07:10.839968 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6415): Launched 23:07:11.169341 run osmo-stp_10.42.42.5(pid=6416): Launched 23:07:11.296879 run osmo-msc_10.42.42.6: Starting osmo-msc 23:07:11.895876 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6418): Launched 23:07:12.226919 run osmo-msc_10.42.42.6(pid=6419): Launched 23:07:12.411252 run osmo-stp_10.42.42.5(pid=6416): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6416)] 23:07:12.549994 run osmo-stp_10.42.42.5(pid=6416): stdout: | (launched: 2022-12-12_23:07:11.109360) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:07:12.689099 run osmo-stp_10.42.42.5(pid=6416): stderr: | [0;m[38;5;43m20221212230711301 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230711301 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230711302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230711302 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230711303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230711303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230711303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:07:12.828321 run osmo-stp_10.42.42.5(pid=6416): stdout: | (launched: 2022-12-12_23:07:11.109360) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:07:12.959449 run osmo-stp_10.42.42.5(pid=6416): stderr: | [0;m[38;5;43m20221212230711301 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230711301 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230711302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230711302 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230711303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230711303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230711303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:07:13.117005 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6416): Process ended prematurely: osmo-stp_10.42.42.5(pid=6416) [trial-2383↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6416)] [trial-2383↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 23:07:13.126889 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 23:07:13.155241 run osmo-hlr_10.42.42.2(pid=6413): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6413)] 23:07:13.205719 run osmo-hlr_10.42.42.2(pid=6413): stdout: | (launched: 2022-12-12_23:07:10.081804) 23:07:13.257905 run osmo-hlr_10.42.42.2(pid=6413): stderr: | [0;m[1;31m20221212230710281 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212230710281 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212230710281 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212230710281 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212230710281 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212230710281 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212230710294 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212230710303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212230710303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212230710303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:07:13.330676 run osmo-msc_10.42.42.6(pid=6419): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6419)] 23:07:13.380818 run osmo-msc_10.42.42.6(pid=6419): stdout: | (launched: 2022-12-12_23:07:12.166394) 23:07:13.432254 run osmo-msc_10.42.42.6(pid=6419): stderr: | [0;m[38;5;43m20221212230712489 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212230712489 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc0871cec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212230712489 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212230712489 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212230712490 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212230712490 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212230712491 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212230712492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212230712492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212230712492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:07:13.484053 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6412): Terminating (SIGTERM) 23:07:13.525770 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6415): Terminating (SIGTERM) 23:07:13.567788 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6418): Terminating (SIGTERM) 23:07:13.609968 --- ParallelTerminationStrategy: PID 6412 died... 23:07:13.630128 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6412): Terminated: ok {rc=0} 23:07:13.676730 --- ParallelTerminationStrategy: PID 6415 died... 23:07:13.696440 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6415): Terminated: ok {rc=0} 23:07:13.742809 --- ParallelTerminationStrategy: PID 6418 died... 23:07:13.762523 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6418): Terminated: ok {rc=0} 23:07:13.849776 bus /sierra_3: Setting Powered False 23:07:14.948419 bus /sierra_3: Setting Powered False 23:07:16.073968 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2383 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 23:07:17.230375 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:07:17.243381 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 23:07:17.305797 tst mo_mt_call_osmux.py: using LAC 32135 23:07:17.429178 tst mo_mt_call_osmux.py: using RAC 5 23:07:17.552289 tst mo_mt_call_osmux.py: using CellId 32135 23:07:17.676113 tst mo_mt_call_osmux.py: using BVCI 32136 23:07:17.790928 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:07:17.802257 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:07:17.813366 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:07:17.824671 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:07:17.836152 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:07:17.847463 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 23:07:17.967897 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 23:07:18.090703 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:07:18.602875 run create_hlr_db(pid=6421): Launched 23:07:18.736034 bus /sierra_2: Setting Powered False 23:07:19.801619 run create_hlr_db(pid=6421): Terminated: ok {rc=0} 23:07:20.242074 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6423): Launched 23:07:20.551902 run osmo-hlr_10.42.42.2(pid=6424): Launched 23:07:20.670657 run osmo-stp_10.42.42.5: Starting osmo-stp 23:07:21.223365 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6426): Launched 23:07:21.534604 run osmo-stp_10.42.42.5(pid=6427): Launched 23:07:21.655247 run osmo-msc_10.42.42.6: Starting osmo-msc 23:07:22.216788 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6429): Launched 23:07:22.528158 run osmo-msc_10.42.42.6(pid=6430): Launched 23:07:22.703195 run osmo-stp_10.42.42.5(pid=6427): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6427)] 23:07:22.834616 run osmo-stp_10.42.42.5(pid=6427): stdout: | (launched: 2022-12-12_23:07:21.477755) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:07:22.966016 run osmo-stp_10.42.42.5(pid=6427): stderr: | [0;m[38;5;43m20221212230721650 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230721650 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230721650 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230721651 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230721651 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230721651 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230721651 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:07:23.095262 run osmo-stp_10.42.42.5(pid=6427): stdout: | (launched: 2022-12-12_23:07:21.477755) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:07:23.218386 run osmo-stp_10.42.42.5(pid=6427): stderr: | [0;m[38;5;43m20221212230721650 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230721650 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230721650 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230721651 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230721651 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230721651 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230721651 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:07:23.365531 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6427): Process ended prematurely: osmo-stp_10.42.42.5(pid=6427) [trial-2383↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6427)] [trial-2383↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 23:07:23.374443 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 23:07:23.400809 run osmo-hlr_10.42.42.2(pid=6424): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6424)] 23:07:23.448801 run osmo-hlr_10.42.42.2(pid=6424): stdout: | (launched: 2022-12-12_23:07:20.495132) 23:07:23.498039 run osmo-hlr_10.42.42.2(pid=6424): stderr: | [0;m[1;31m20221212230720673 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212230720673 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212230720673 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212230720673 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212230720673 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212230720673 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212230720685 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212230720694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212230720694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212230720694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:07:23.566857 run osmo-msc_10.42.42.6(pid=6430): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6430)] 23:07:23.614359 run osmo-msc_10.42.42.6(pid=6430): stdout: | (launched: 2022-12-12_23:07:22.471057) 23:07:23.663460 run osmo-msc_10.42.42.6(pid=6430): stderr: | [0;m[38;5;43m20221212230722744 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212230722744 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f00cc36fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212230722744 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212230722744 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212230722744 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212230722745 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212230722746 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212230722747 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212230722747 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212230722747 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:07:23.713037 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6423): Terminating (SIGTERM) 23:07:23.752668 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6426): Terminating (SIGTERM) 23:07:23.792386 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6429): Terminating (SIGTERM) 23:07:23.832206 --- ParallelTerminationStrategy: PID 6423 died... 23:07:23.851167 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6423): Terminated: ok {rc=0} 23:07:23.895900 --- ParallelTerminationStrategy: PID 6426 died... 23:07:23.914306 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6426): Terminated: ok {rc=0} 23:07:23.958279 --- ParallelTerminationStrategy: PID 6429 died... 23:07:23.976525 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6429): Terminated: ok {rc=0} 23:07:24.059864 bus /sierra_3: Setting Powered False 23:07:25.157830 bus /sierra_3: Setting Powered False 23:07:26.273436 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 23:07:27.516796 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:07:27.523975 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 23:07:27.548501 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 23:07:27.575384 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 23:07:27.627323 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 23:07:27.651160 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 23:07:27.677598 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 23:07:28.227730 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 23:07:28.277457 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:07:28.288625 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 23:07:28.347380 tst mo_mt_call.py: using LAC 32136 23:07:28.476545 tst mo_mt_call.py: using RAC 6 23:07:28.598295 tst mo_mt_call.py: using CellId 32136 23:07:28.722023 tst mo_mt_call.py: using BVCI 32137 23:07:28.837148 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:07:28.848225 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:07:28.859272 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:07:28.870533 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:07:28.882053 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:07:28.893323 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 23:07:29.014109 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 23:07:29.135409 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:07:29.645303 run create_hlr_db(pid=6436): Launched 23:07:29.778402 bus /sierra_2: Setting Powered False 23:07:30.859992 run create_hlr_db(pid=6436): Terminated: ok {rc=0} 23:07:31.309246 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6438): Launched 23:07:31.637149 run osmo-hlr_10.42.42.2(pid=6439): Launched 23:07:31.888003 run osmo-stp_10.42.42.5: Starting osmo-stp 23:07:32.611544 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6441): Launched 23:07:32.938998 run osmo-stp_10.42.42.5(pid=6442): Launched 23:07:33.065905 run osmo-msc_10.42.42.6: Starting osmo-msc 23:07:33.660718 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6444): Launched 23:07:33.989153 run osmo-msc_10.42.42.6(pid=6445): Launched 23:07:34.174036 run osmo-stp_10.42.42.5(pid=6442): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6442)] 23:07:34.312514 run osmo-stp_10.42.42.5(pid=6442): stdout: | (launched: 2022-12-12_23:07:32.879289) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:07:34.452517 run osmo-stp_10.42.42.5(pid=6442): stderr: | [0;m[38;5;43m20221212230733071 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230733071 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230733072 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230733072 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230733073 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230733073 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230733073 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:07:34.590443 run osmo-stp_10.42.42.5(pid=6442): stdout: | (launched: 2022-12-12_23:07:32.879289) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:07:34.721068 run osmo-stp_10.42.42.5(pid=6442): stderr: | [0;m[38;5;43m20221212230733071 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230733071 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230733072 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230733072 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230733073 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230733073 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230733073 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:07:34.877125 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6442): Process ended prematurely: osmo-stp_10.42.42.5(pid=6442) [trial-2383↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6442)] [trial-2383↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 23:07:34.886727 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 23:07:34.914455 run osmo-hlr_10.42.42.2(pid=6439): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6439)] 23:07:34.964106 run osmo-hlr_10.42.42.2(pid=6439): stdout: | (launched: 2022-12-12_23:07:31.579257) 23:07:35.015706 run osmo-hlr_10.42.42.2(pid=6439): stderr: | [0;m[1;31m20221212230731920 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212230731920 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212230731920 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212230731920 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212230731920 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212230731920 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212230731947 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212230731959 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212230731960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212230731960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:07:35.087882 run osmo-msc_10.42.42.6(pid=6445): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6445)] 23:07:35.137446 run osmo-msc_10.42.42.6(pid=6445): stdout: | (launched: 2022-12-12_23:07:33.928802) 23:07:35.188616 run osmo-msc_10.42.42.6(pid=6445): stderr: | [0;m[38;5;43m20221212230734251 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212230734252 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f706a91bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212230734252 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212230734252 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212230734252 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212230734252 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212230734254 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212230734254 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212230734254 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212230734254 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:07:35.240114 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6438): Terminating (SIGTERM) 23:07:35.281297 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6441): Terminating (SIGTERM) 23:07:35.322675 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6444): Terminating (SIGTERM) 23:07:35.364177 --- ParallelTerminationStrategy: PID 6438 died... 23:07:35.384061 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6438): Terminated: ok {rc=0} 23:07:35.429785 --- ParallelTerminationStrategy: PID 6441 died... 23:07:35.449177 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6441): Terminated: ok {rc=0} 23:07:35.494530 --- ParallelTerminationStrategy: PID 6444 died... 23:07:35.513797 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6444): Terminated: ok {rc=0} 23:07:35.601252 bus /sierra_3: Setting Powered False 23:07:36.699500 bus /sierra_3: Setting Powered False 23:07:37.817306 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2383 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 23:07:38.967690 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:07:38.980224 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 23:07:39.042499 tst mo_mt_call_osmux.py: using LAC 32137 23:07:39.173423 tst mo_mt_call_osmux.py: using RAC 7 23:07:39.297257 tst mo_mt_call_osmux.py: using CellId 32137 23:07:39.419703 tst mo_mt_call_osmux.py: using BVCI 32138 23:07:39.535074 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:07:39.546461 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:07:39.557904 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:07:39.569523 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:07:39.580888 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:07:39.592290 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 23:07:39.709222 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 23:07:39.832756 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:07:40.345397 run create_hlr_db(pid=6447): Launched 23:07:40.480202 bus /sierra_2: Setting Powered False 23:07:41.545824 run create_hlr_db(pid=6447): Terminated: ok {rc=0} 23:07:42.003450 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6449): Launched 23:07:42.331519 run osmo-hlr_10.42.42.2(pid=6450): Launched 23:07:42.457967 run osmo-stp_10.42.42.5: Starting osmo-stp 23:07:43.027460 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6452): Launched 23:07:43.357584 run osmo-stp_10.42.42.5(pid=6453): Launched 23:07:43.484155 run osmo-msc_10.42.42.6: Starting osmo-msc 23:07:44.085842 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6455): Launched 23:07:44.417386 run osmo-msc_10.42.42.6(pid=6456): Launched 23:07:44.601785 run osmo-stp_10.42.42.5(pid=6453): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6453)] 23:07:44.740404 run osmo-stp_10.42.42.5(pid=6453): stdout: | (launched: 2022-12-12_23:07:43.297393) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:07:44.879699 run osmo-stp_10.42.42.5(pid=6453): stderr: | [0;m[38;5;43m20221212230743489 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230743490 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230743490 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230743490 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230743491 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230743491 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230743491 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:07:45.018452 run osmo-stp_10.42.42.5(pid=6453): stdout: | (launched: 2022-12-12_23:07:43.297393) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:07:45.151311 run osmo-stp_10.42.42.5(pid=6453): stderr: | [0;m[38;5;43m20221212230743489 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230743490 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230743490 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230743490 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230743491 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230743491 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230743491 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:07:45.308871 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6453): Process ended prematurely: osmo-stp_10.42.42.5(pid=6453) [trial-2383↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6453)] [trial-2383↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 23:07:45.318696 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 23:07:45.346705 run osmo-hlr_10.42.42.2(pid=6450): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6450)] 23:07:45.397100 run osmo-hlr_10.42.42.2(pid=6450): stdout: | (launched: 2022-12-12_23:07:42.271688) 23:07:45.449076 run osmo-hlr_10.42.42.2(pid=6450): stderr: | [0;m[1;31m20221212230742472 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212230742472 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212230742472 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212230742472 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212230742472 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212230742473 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212230742485 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212230742494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212230742494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212230742494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:07:45.521734 run osmo-msc_10.42.42.6(pid=6456): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6456)] 23:07:45.571564 run osmo-msc_10.42.42.6(pid=6456): stdout: | (launched: 2022-12-12_23:07:44.356391) 23:07:45.623374 run osmo-msc_10.42.42.6(pid=6456): stderr: | [0;m[38;5;43m20221212230744681 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212230744682 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7feb25dd2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212230744682 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212230744682 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212230744682 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212230744682 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212230744684 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212230744684 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212230744684 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212230744684 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:07:45.675586 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6449): Terminating (SIGTERM) 23:07:45.717682 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6452): Terminating (SIGTERM) 23:07:45.759699 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6455): Terminating (SIGTERM) 23:07:45.801907 --- ParallelTerminationStrategy: PID 6449 died... 23:07:45.822008 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6449): Terminated: ok {rc=0} 23:07:45.869192 --- ParallelTerminationStrategy: PID 6452 died... 23:07:45.889517 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6452): Terminated: ok {rc=0} 23:07:45.936834 --- ParallelTerminationStrategy: PID 6455 died... 23:07:45.956856 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6455): Terminated: ok {rc=0} 23:07:46.051689 bus /sierra_3: Setting Powered False 23:07:47.157019 bus /sierra_3: Setting Powered False 23:07:48.288786 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 23:07:49.525066 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:07:49.532424 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 23:07:49.556050 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 23:07:49.582904 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 23:07:49.632576 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 23:07:49.656466 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 23:07:49.683431 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 23:07:50.241939 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 23:07:50.296534 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:07:50.308214 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 23:07:50.368701 tst mo_mt_call.py: using LAC 32138 23:07:50.497176 tst mo_mt_call.py: using RAC 8 23:07:50.625787 tst mo_mt_call.py: using CellId 32138 23:07:50.755103 tst mo_mt_call.py: using BVCI 32139 23:07:50.870657 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:07:50.882091 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:07:50.893423 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:07:50.904887 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:07:50.916443 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:07:50.927890 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 23:07:51.047590 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 23:07:51.166614 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:07:51.647089 run create_hlr_db(pid=6461): Launched 23:07:51.765310 bus /sierra_2: Setting Powered False 23:07:52.826725 run create_hlr_db(pid=6461): Terminated: ok {rc=0} 23:07:53.277042 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6463): Launched 23:07:53.606757 run osmo-hlr_10.42.42.2(pid=6464): Launched 23:07:53.732645 run osmo-stp_10.42.42.5: Starting osmo-stp 23:07:54.304643 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6466): Launched 23:07:54.633064 run osmo-stp_10.42.42.5(pid=6467): Launched 23:07:54.758194 run osmo-msc_10.42.42.6: Starting osmo-msc 23:07:55.355648 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6469): Launched 23:07:55.685181 run osmo-msc_10.42.42.6(pid=6470): Launched 23:07:55.869686 run osmo-stp_10.42.42.5(pid=6467): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6467)] 23:07:56.008370 run osmo-stp_10.42.42.5(pid=6467): stdout: | (launched: 2022-12-12_23:07:54.572769) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:07:56.148531 run osmo-stp_10.42.42.5(pid=6467): stderr: | [0;m[38;5;43m20221212230754769 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230754769 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230754769 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230754770 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230754770 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230754770 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230754770 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:07:56.286726 run osmo-stp_10.42.42.5(pid=6467): stdout: | (launched: 2022-12-12_23:07:54.572769) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:07:56.417500 run osmo-stp_10.42.42.5(pid=6467): stderr: | [0;m[38;5;43m20221212230754769 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230754769 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230754769 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230754770 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230754770 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230754770 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230754770 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:07:56.574360 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6467): Process ended prematurely: osmo-stp_10.42.42.5(pid=6467) [trial-2383↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6467)] [trial-2383↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 23:07:56.584085 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 23:07:56.612130 run osmo-hlr_10.42.42.2(pid=6464): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6464)] 23:07:56.662157 run osmo-hlr_10.42.42.2(pid=6464): stdout: | (launched: 2022-12-12_23:07:53.546590) 23:07:56.713712 run osmo-hlr_10.42.42.2(pid=6464): stderr: | [0;m[1;31m20221212230753745 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212230753745 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212230753745 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212230753745 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212230753746 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212230753746 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212230753759 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212230753767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212230753767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212230753768 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:07:56.785683 run osmo-msc_10.42.42.6(pid=6470): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6470)] 23:07:56.835373 run osmo-msc_10.42.42.6(pid=6470): stdout: | (launched: 2022-12-12_23:07:55.624326) 23:07:56.886874 run osmo-msc_10.42.42.6(pid=6470): stderr: | [0;m[38;5;43m20221212230755948 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212230755948 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1411520c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212230755948 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212230755948 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212230755948 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212230755949 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212230755950 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212230755951 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212230755951 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212230755951 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:07:56.939066 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6463): Terminating (SIGTERM) 23:07:56.980440 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6466): Terminating (SIGTERM) 23:07:57.021894 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6469): Terminating (SIGTERM) 23:07:57.063494 --- ParallelTerminationStrategy: PID 6463 died... 23:07:57.083534 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6463): Terminated: ok {rc=0} 23:07:57.129908 --- ParallelTerminationStrategy: PID 6466 died... 23:07:57.149661 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6466): Terminated: ok {rc=0} 23:07:57.195456 --- ParallelTerminationStrategy: PID 6469 died... 23:07:57.214834 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6469): Terminated: ok {rc=0} 23:07:57.302282 bus /sierra_3: Setting Powered False 23:07:58.401618 bus /sierra_3: Setting Powered False 23:07:59.516813 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2383 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 23:08:00.667629 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:08:00.680243 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 23:08:00.742163 tst mo_mt_call_osmux.py: using LAC 32139 23:08:00.882867 tst mo_mt_call_osmux.py: using RAC 9 23:08:01.018618 tst mo_mt_call_osmux.py: using CellId 32139 23:08:01.153681 tst mo_mt_call_osmux.py: using BVCI 32140 23:08:01.271963 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:08:01.284527 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:08:01.297092 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:08:01.310587 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:08:01.325369 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:08:01.338855 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 23:08:01.460666 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 23:08:01.581123 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:08:02.143249 run create_hlr_db(pid=6472): Launched 23:08:02.310441 bus /sierra_2: Setting Powered False 23:08:03.375690 run create_hlr_db(pid=6472): Terminated: ok {rc=0} 23:08:03.831991 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6474): Launched 23:08:04.160854 run osmo-hlr_10.42.42.2(pid=6475): Launched 23:08:04.286157 run osmo-stp_10.42.42.5: Starting osmo-stp 23:08:04.852242 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6477): Launched 23:08:05.182149 run osmo-stp_10.42.42.5(pid=6478): Launched 23:08:05.308242 run osmo-msc_10.42.42.6: Starting osmo-msc 23:08:05.908547 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6480): Launched 23:08:06.238948 run osmo-msc_10.42.42.6(pid=6481): Launched 23:08:06.423586 run osmo-stp_10.42.42.5(pid=6478): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6478)] 23:08:06.562854 run osmo-stp_10.42.42.5(pid=6478): stdout: | (launched: 2022-12-12_23:08:05.121797) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:08:06.702965 run osmo-stp_10.42.42.5(pid=6478): stderr: | [0;m[38;5;43m20221212230805318 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230805318 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230805318 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230805318 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230805319 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230805319 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230805319 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:08:06.841677 run osmo-stp_10.42.42.5(pid=6478): stdout: | (launched: 2022-12-12_23:08:05.121797) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:08:06.973188 run osmo-stp_10.42.42.5(pid=6478): stderr: | [0;m[38;5;43m20221212230805318 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230805318 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230805318 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230805318 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230805319 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230805319 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230805319 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:08:07.131007 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6478): Process ended prematurely: osmo-stp_10.42.42.5(pid=6478) [trial-2383↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6478)] [trial-2383↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 23:08:07.141054 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 23:08:07.168824 run osmo-hlr_10.42.42.2(pid=6475): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6475)] 23:08:07.219024 run osmo-hlr_10.42.42.2(pid=6475): stdout: | (launched: 2022-12-12_23:08:04.100845) 23:08:07.270952 run osmo-hlr_10.42.42.2(pid=6475): stderr: | [0;m[1;31m20221212230804300 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212230804300 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212230804301 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212230804301 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212230804301 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212230804301 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212230804313 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212230804323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212230804323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212230804323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:08:07.343144 run osmo-msc_10.42.42.6(pid=6481): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6481)] 23:08:07.393361 run osmo-msc_10.42.42.6(pid=6481): stdout: | (launched: 2022-12-12_23:08:06.178841) 23:08:07.445150 run osmo-msc_10.42.42.6(pid=6481): stderr: | [0;m[38;5;43m20221212230806501 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212230806501 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9db5e05c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212230806501 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212230806501 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212230806501 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212230806502 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212230806503 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212230806504 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212230806504 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212230806504 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:08:07.497098 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6474): Terminating (SIGTERM) 23:08:07.538839 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6477): Terminating (SIGTERM) 23:08:07.580426 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6480): Terminating (SIGTERM) 23:08:07.622224 --- ParallelTerminationStrategy: PID 6474 died... 23:08:07.642230 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6474): Terminated: ok {rc=0} 23:08:07.688479 --- ParallelTerminationStrategy: PID 6477 died... 23:08:07.708075 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6477): Terminated: ok {rc=0} 23:08:07.753754 --- ParallelTerminationStrategy: PID 6480 died... 23:08:07.773366 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6480): Terminated: ok {rc=0} 23:08:07.860416 bus /sierra_3: Setting Powered False 23:08:08.960404 bus /sierra_3: Setting Powered False 23:08:10.077831 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 23:08:11.315960 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:08:11.323392 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 23:08:11.347432 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 23:08:11.373970 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 23:08:11.426800 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 23:08:11.450941 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 23:08:11.477971 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 23:08:12.028529 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 23:08:12.079061 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:08:12.090482 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 23:08:12.149888 tst mo_mt_call.py: using LAC 32140 23:08:12.273637 tst mo_mt_call.py: using RAC 10 23:08:12.404532 tst mo_mt_call.py: using CellId 32140 23:08:12.535578 tst mo_mt_call.py: using BVCI 32141 23:08:12.656788 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:08:12.668531 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:08:12.680271 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:08:12.692010 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:08:12.703612 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:08:12.715135 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 23:08:12.836717 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 23:08:12.952568 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:08:13.435365 run create_hlr_db(pid=6486): Launched 23:08:13.556515 bus /sierra_2: Setting Powered False 23:08:14.618212 run create_hlr_db(pid=6486): Terminated: ok {rc=0} 23:08:15.049284 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6488): Launched 23:08:15.359503 run osmo-hlr_10.42.42.2(pid=6489): Launched 23:08:15.478539 run osmo-stp_10.42.42.5: Starting osmo-stp 23:08:16.063647 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6491): Launched 23:08:16.401530 run osmo-stp_10.42.42.5(pid=6492): Launched 23:08:16.674319 run osmo-msc_10.42.42.6: Starting osmo-msc 23:08:17.312609 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6494): Launched 23:08:17.653296 run osmo-msc_10.42.42.6(pid=6495): Launched 23:08:17.837085 run osmo-stp_10.42.42.5(pid=6492): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6492)] 23:08:17.975152 run osmo-stp_10.42.42.5(pid=6492): stdout: | (launched: 2022-12-12_23:08:16.337478) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:08:18.114666 run osmo-stp_10.42.42.5(pid=6492): stderr: | [0;m[38;5;43m20221212230816526 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230816527 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230816527 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230816528 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230816528 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230816528 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230816528 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:08:18.252373 run osmo-stp_10.42.42.5(pid=6492): stdout: | (launched: 2022-12-12_23:08:16.337478) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:08:18.383240 run osmo-stp_10.42.42.5(pid=6492): stderr: | [0;m[38;5;43m20221212230816526 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230816527 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230816527 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230816528 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230816528 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230816528 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230816528 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:08:18.539654 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6492): Process ended prematurely: osmo-stp_10.42.42.5(pid=6492) [trial-2383↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6492)] [trial-2383↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 23:08:18.549142 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 23:08:18.576850 run osmo-hlr_10.42.42.2(pid=6489): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6489)] 23:08:18.626509 run osmo-hlr_10.42.42.2(pid=6489): stdout: | (launched: 2022-12-12_23:08:15.301920) 23:08:18.678162 run osmo-hlr_10.42.42.2(pid=6489): stderr: | [0;m[1;31m20221212230815479 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212230815479 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212230815479 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212230815480 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212230815480 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212230815480 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212230815492 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212230815501 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212230815501 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212230815501 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:08:18.750122 run osmo-msc_10.42.42.6(pid=6495): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6495)] 23:08:18.799734 run osmo-msc_10.42.42.6(pid=6495): stdout: | (launched: 2022-12-12_23:08:17.592782) 23:08:18.851099 run osmo-msc_10.42.42.6(pid=6495): stderr: | [0;m[38;5;43m20221212230817916 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212230817917 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f893ad70c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212230817917 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212230817917 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212230817917 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212230817917 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212230817919 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212230817919 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212230817919 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212230817919 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:08:18.902896 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6488): Terminating (SIGTERM) 23:08:18.944426 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6491): Terminating (SIGTERM) 23:08:18.986484 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6494): Terminating (SIGTERM) 23:08:19.028142 --- ParallelTerminationStrategy: PID 6488 died... 23:08:19.048299 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6488): Terminated: ok {rc=0} 23:08:19.094188 --- ParallelTerminationStrategy: PID 6491 died... 23:08:19.113895 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6491): Terminated: ok {rc=0} 23:08:19.159683 --- ParallelTerminationStrategy: PID 6494 died... 23:08:19.179161 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6494): Terminated: ok {rc=0} 23:08:19.266338 bus /sierra_3: Setting Powered False 23:08:20.365035 bus /sierra_3: Setting Powered False 23:08:21.480344 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2383 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 23:08:22.630664 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:08:22.643335 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 23:08:22.705460 tst mo_mt_call_osmux.py: using LAC 32141 23:08:22.837032 tst mo_mt_call_osmux.py: using RAC 11 23:08:22.967440 tst mo_mt_call_osmux.py: using CellId 32141 23:08:23.099365 tst mo_mt_call_osmux.py: using BVCI 32142 23:08:23.221898 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:08:23.233734 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:08:23.245311 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:08:23.256720 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:08:23.268387 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:08:23.279964 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 23:08:23.397182 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 23:08:23.518733 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:08:24.030595 run create_hlr_db(pid=6497): Launched 23:08:24.166571 bus /sierra_2: Setting Powered False 23:08:25.231420 run create_hlr_db(pid=6497): Terminated: ok {rc=0} 23:08:25.671779 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6499): Launched 23:08:25.983241 run osmo-hlr_10.42.42.2(pid=6500): Launched 23:08:26.103035 run osmo-stp_10.42.42.5: Starting osmo-stp 23:08:26.676051 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6502): Launched 23:08:27.006424 run osmo-stp_10.42.42.5(pid=6503): Launched 23:08:27.134574 run osmo-msc_10.42.42.6: Starting osmo-msc 23:08:27.734131 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6505): Launched 23:08:28.065695 run osmo-msc_10.42.42.6(pid=6506): Launched 23:08:28.253092 run osmo-stp_10.42.42.5(pid=6503): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6503)] 23:08:28.392564 run osmo-stp_10.42.42.5(pid=6503): stdout: | (launched: 2022-12-12_23:08:26.946400) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:08:28.533329 run osmo-stp_10.42.42.5(pid=6503): stderr: | [0;m[38;5;43m20221212230827139 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230827139 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230827139 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230827140 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230827140 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230827140 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230827140 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:08:28.671576 run osmo-stp_10.42.42.5(pid=6503): stdout: | (launched: 2022-12-12_23:08:26.946400) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:08:28.803382 run osmo-stp_10.42.42.5(pid=6503): stderr: | [0;m[38;5;43m20221212230827139 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230827139 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230827139 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230827140 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230827140 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230827140 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230827140 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:08:28.961094 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6503): Process ended prematurely: osmo-stp_10.42.42.5(pid=6503) [trial-2383↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6503)] [trial-2383↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 23:08:28.971033 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 23:08:28.999220 run osmo-hlr_10.42.42.2(pid=6500): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6500)] 23:08:29.050068 run osmo-hlr_10.42.42.2(pid=6500): stdout: | (launched: 2022-12-12_23:08:25.926584) 23:08:29.102581 run osmo-hlr_10.42.42.2(pid=6500): stderr: | [0;m[1;31m20221212230826103 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212230826103 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212230826103 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212230826103 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212230826103 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212230826103 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212230826116 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212230826124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212230826124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212230826124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:08:29.175409 run osmo-msc_10.42.42.6(pid=6506): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6506)] 23:08:29.225561 run osmo-msc_10.42.42.6(pid=6506): stdout: | (launched: 2022-12-12_23:08:28.005088) 23:08:29.277214 run osmo-msc_10.42.42.6(pid=6506): stderr: | [0;m[38;5;43m20221212230828327 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212230828328 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fcaac3dbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212230828328 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212230828328 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212230828328 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212230828328 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212230828330 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212230828330 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212230828330 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212230828331 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:08:29.329372 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6499): Terminating (SIGTERM) 23:08:29.371604 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6502): Terminating (SIGTERM) 23:08:29.414256 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6505): Terminating (SIGTERM) 23:08:29.456677 --- ParallelTerminationStrategy: PID 6499 died... 23:08:29.476907 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6499): Terminated: ok {rc=0} 23:08:29.523741 --- ParallelTerminationStrategy: PID 6502 died... 23:08:29.543567 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6502): Terminated: ok {rc=0} 23:08:29.590358 --- ParallelTerminationStrategy: PID 6505 died... 23:08:29.610248 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6505): Terminated: ok {rc=0} 23:08:29.700831 bus /sierra_3: Setting Powered False 23:08:30.799639 bus /sierra_3: Setting Powered False 23:08:31.959433 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 23:08:33.209366 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:08:33.216684 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 23:08:33.241669 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 23:08:33.269103 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 23:08:33.320683 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 23:08:33.344768 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 23:08:33.372064 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 23:08:33.923805 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 23:08:33.974543 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:08:33.986232 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 23:08:34.046973 tst mo_mt_call.py: using LAC 32142 23:08:34.170866 tst mo_mt_call.py: using RAC 12 23:08:34.293791 tst mo_mt_call.py: using CellId 32142 23:08:34.419267 tst mo_mt_call.py: using BVCI 32143 23:08:34.532678 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:08:34.544115 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:08:34.555241 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:08:34.566877 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:08:34.578531 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:08:34.590809 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:08:34.711436 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:08:34.829544 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:08:35.310933 run create_hlr_db(pid=6512): Launched 23:08:35.430189 bus /sierra_2: Setting Powered False 23:08:36.491820 run create_hlr_db(pid=6512): Terminated: ok {rc=0} 23:08:36.923133 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6514): Launched 23:08:37.233726 run osmo-hlr_10.42.42.2(pid=6515): Launched 23:08:37.352635 run osmo-stp_10.42.42.5: Starting osmo-stp 23:08:37.899917 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6517): Launched 23:08:38.211230 run osmo-stp_10.42.42.5(pid=6518): Launched 23:08:38.332921 run osmo-msc_10.42.42.6: Starting osmo-msc 23:08:38.898770 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6520): Launched 23:08:39.211921 run osmo-msc_10.42.42.6(pid=6521): Launched 23:08:39.388645 run osmo-stp_10.42.42.5(pid=6518): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6518)] 23:08:39.521549 run osmo-stp_10.42.42.5(pid=6518): stdout: | (launched: 2022-12-12_23:08:38.154273) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:08:39.653955 run osmo-stp_10.42.42.5(pid=6518): stderr: | [0;m[38;5;43m20221212230838323 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230838324 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230838324 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230838324 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230838325 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230838325 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230838325 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:08:39.784468 run osmo-stp_10.42.42.5(pid=6518): stdout: | (launched: 2022-12-12_23:08:38.154273) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:08:39.908707 run osmo-stp_10.42.42.5(pid=6518): stderr: | [0;m[38;5;43m20221212230838323 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230838324 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230838324 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230838324 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230838325 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230838325 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230838325 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:08:40.057504 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6518): Process ended prematurely: osmo-stp_10.42.42.5(pid=6518) [trial-2383↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6518)] [trial-2383↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 23:08:40.066716 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 23:08:40.093971 run osmo-hlr_10.42.42.2(pid=6515): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6515)] 23:08:40.142185 run osmo-hlr_10.42.42.2(pid=6515): stdout: | (launched: 2022-12-12_23:08:37.177059) 23:08:40.191780 run osmo-hlr_10.42.42.2(pid=6515): stderr: | [0;m[1;31m20221212230837352 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212230837352 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212230837352 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212230837352 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212230837352 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212230837352 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212230837365 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212230837373 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212230837373 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212230837373 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:08:40.260757 run osmo-msc_10.42.42.6(pid=6521): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6521)] 23:08:40.308271 run osmo-msc_10.42.42.6(pid=6521): stdout: | (launched: 2022-12-12_23:08:39.154694) 23:08:40.357686 run osmo-msc_10.42.42.6(pid=6521): stderr: | [0;m[38;5;43m20221212230839427 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212230839428 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc6e5f5bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212230839428 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212230839428 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212230839428 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212230839428 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212230839430 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212230839430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212230839430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212230839430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:08:40.407578 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6514): Terminating (SIGTERM) 23:08:40.447619 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6517): Terminating (SIGTERM) 23:08:40.487600 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6520): Terminating (SIGTERM) 23:08:40.528056 --- ParallelTerminationStrategy: PID 6514 died... 23:08:40.547262 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6514): Terminated: ok {rc=0} 23:08:40.591792 --- ParallelTerminationStrategy: PID 6517 died... 23:08:40.610406 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6517): Terminated: ok {rc=0} 23:08:40.654499 --- ParallelTerminationStrategy: PID 6520 died... 23:08:40.673143 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6520): Terminated: ok {rc=0} 23:08:40.759524 bus /sierra_3: Setting Powered False 23:08:41.860318 bus /sierra_3: Setting Powered False 23:08:42.978071 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2383 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 23:08:44.125298 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:08:44.137547 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 23:08:44.198620 tst mo_mt_call_osmux.py: using LAC 32143 23:08:44.324218 tst mo_mt_call_osmux.py: using RAC 13 23:08:44.459436 tst mo_mt_call_osmux.py: using CellId 32143 23:08:44.595984 tst mo_mt_call_osmux.py: using BVCI 32144 23:08:44.718152 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:08:44.730204 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:08:44.741840 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:08:44.753598 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:08:44.765376 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:08:44.776941 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:08:44.897233 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:08:45.016416 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:08:45.499243 run create_hlr_db(pid=6523): Launched 23:08:45.621341 bus /sierra_2: Setting Powered False 23:08:46.721819 run create_hlr_db(pid=6523): Terminated: ok {rc=0} 23:08:47.231632 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6574): Launched 23:08:47.625117 run osmo-hlr_10.42.42.2(pid=6586): Launched 23:08:47.902038 run osmo-stp_10.42.42.5: Starting osmo-stp 23:08:48.710373 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6687): Launched 23:08:49.149128 run osmo-stp_10.42.42.5(pid=6742): Launched 23:08:49.429598 run osmo-msc_10.42.42.6: Starting osmo-msc 23:08:50.156233 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6800): Launched 23:08:50.509161 run osmo-msc_10.42.42.6(pid=6801): Launched 23:08:50.938799 run osmo-stp_10.42.42.5(pid=6742): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6742)] 23:08:51.222840 run osmo-stp_10.42.42.5(pid=6742): stdout: | (launched: 2022-12-12_23:08:49.074004) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:08:51.365708 run osmo-stp_10.42.42.5(pid=6742): stderr: | [0;m[38;5;43m20221212230849417 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230849418 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230849418 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230849418 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230849419 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230849419 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230849419 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:08:51.507647 run osmo-stp_10.42.42.5(pid=6742): stdout: | (launched: 2022-12-12_23:08:49.074004) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:08:51.643851 run osmo-stp_10.42.42.5(pid=6742): stderr: | [0;m[38;5;43m20221212230849417 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230849418 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230849418 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230849418 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230849419 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230849419 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230849419 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:08:51.805598 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6742): Process ended prematurely: osmo-stp_10.42.42.5(pid=6742) [trial-2383↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6742)] [trial-2383↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 23:08:51.816320 tst mo_mt_call_osmux.py:8: Test FAILED (7.7 sec) 23:08:51.845849 run osmo-hlr_10.42.42.2(pid=6586): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6586)] 23:08:51.897947 run osmo-hlr_10.42.42.2(pid=6586): stdout: | (launched: 2022-12-12_23:08:47.554479) 23:08:51.951417 run osmo-hlr_10.42.42.2(pid=6586): stderr: | [0;m[1;31m20221212230847895 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212230847895 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212230847895 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212230847895 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212230847895 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212230847895 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212230847917 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212230847932 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212230847932 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212230847932 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:08:52.027056 run osmo-msc_10.42.42.6(pid=6801): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6801)] 23:08:52.078479 run osmo-msc_10.42.42.6(pid=6801): stdout: | (launched: 2022-12-12_23:08:50.446178) 23:08:52.132342 run osmo-msc_10.42.42.6(pid=6801): stderr: | [0;m[38;5;43m20221212230850945 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212230850945 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6ac7955c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212230850945 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212230850945 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212230850946 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212230850946 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212230850947 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212230850948 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212230850948 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212230850948 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:08:52.187168 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6574): Terminating (SIGTERM) 23:08:52.231494 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6687): Terminating (SIGTERM) 23:08:52.277862 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6800): Terminating (SIGTERM) 23:08:52.323822 --- ParallelTerminationStrategy: PID 6574 died... 23:08:52.345440 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6574): Terminated: ok {rc=0} 23:08:52.395820 --- ParallelTerminationStrategy: PID 6687 died... 23:08:52.416919 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6687): Terminated: ok {rc=0} 23:08:52.464473 --- ParallelTerminationStrategy: PID 6800 died... 23:08:52.485261 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6800): Terminated: ok {rc=0} 23:08:52.576842 bus /sierra_3: Setting Powered False 23:08:53.678613 bus /sierra_3: Setting Powered False 23:08:54.797763 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 emergency:nanobts+band-1900 --------------------------------------------------------------------- 23:08:56.044388 tst emergency:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:08:56.050504 tst emergency:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 23:08:56.078225 tst emergency:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 23:08:56.108381 tst emergency:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 23:08:56.195621 tst emergency:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 23:08:56.222058 tst emergency:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 23:08:56.250051 tst emergency:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 23:08:56.832689 tst emergency:nanobts+band-1900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2383 emergency:nanobts+band-1900 emergency_mo_mt_call.py ---------------------------------------------- 23:08:56.839749 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 23:08:56.851755 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 23:08:56.896017 tst emergency_mo_mt_call.py: using LAC 32144 23:08:57.020256 tst emergency_mo_mt_call.py: using RAC 14 23:08:57.144808 tst emergency_mo_mt_call.py: using CellId 32144 23:08:57.268863 tst emergency_mo_mt_call.py: using BVCI 32145 23:08:57.385271 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 23:08:57.397174 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 23:08:57.408852 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 23:08:57.421637 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 23:08:57.434279 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 23:08:57.446798 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 23:08:57.573111 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 23:08:57.696886 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:08:58.209411 run create_hlr_db(pid=6808): Launched 23:08:58.375843 bus /sierra_2: Setting Powered False 23:08:59.440758 run create_hlr_db(pid=6808): Terminated: ok {rc=0} 23:08:59.907680 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6810): Launched 23:09:00.252158 run osmo-hlr_10.42.42.2(pid=6811): Launched 23:09:00.505587 run osmo-stp_10.42.42.5: Starting osmo-stp 23:09:01.223479 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6813): Launched 23:09:01.684361 run osmo-stp_10.42.42.5(pid=6814): Launched 23:09:02.016055 tst emergency_mo_mt_call.py: using MSISDN 8014 23:09:02.188759 run osmo-msc_10.42.42.6: Starting osmo-msc 23:09:02.752998 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6816): Launched 23:09:03.086471 run osmo-msc_10.42.42.6(pid=6817): Launched 23:09:03.441545 run osmo-stp_10.42.42.5(pid=6814): ERR: Terminated: ERROR {rc=1} [trial-2383↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6814)] 23:09:03.715989 run osmo-stp_10.42.42.5(pid=6814): stdout: | (launched: 2022-12-12_23:09:01.607291) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:09:03.991557 run osmo-stp_10.42.42.5(pid=6814): stderr: | [0;m[38;5;43m20221212230901942 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230901942 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230901942 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230901943 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230901943 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230901943 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230901943 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:09:04.171464 run osmo-stp_10.42.42.5(pid=6814): stdout: | (launched: 2022-12-12_23:09:01.607291) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:09:04.297321 run osmo-stp_10.42.42.5(pid=6814): stderr: | [0;m[38;5;43m20221212230901942 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230901942 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230901942 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230901943 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230901943 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230901943 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230901943 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:09:04.447973 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=6814): Process ended prematurely: osmo-stp_10.42.42.5(pid=6814) [trial-2383↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6814)] [trial-2383↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19] 23:09:04.457707 tst emergency_mo_mt_call.py:19: Test FAILED (7.6 sec) 23:09:04.487790 run osmo-hlr_10.42.42.2(pid=6811): ERR: Terminated: ERROR {rc=237} [trial-2383↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6811)] 23:09:04.539456 run osmo-hlr_10.42.42.2(pid=6811): stdout: | (launched: 2022-12-12_23:09:00.192131) 23:09:04.593242 run osmo-hlr_10.42.42.2(pid=6811): stderr: | [0;m[1;31m20221212230900499 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212230900499 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212230900499 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212230900500 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212230900500 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212230900500 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212230900519 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/emergency:nanobts+band-1900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212230900537 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212230900537 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212230900537 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:09:04.667031 run osmo-msc_10.42.42.6(pid=6817): ERR: Terminated: ERROR {rc=2} [trial-2383↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6817)] 23:09:04.718990 run osmo-msc_10.42.42.6(pid=6817): stdout: | (launched: 2022-12-12_23:09:03.029168) 23:09:04.771595 run osmo-msc_10.42.42.6(pid=6817): stderr: | [0;m[38;5;43m20221212230903622 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212230903622 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb067689c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212230903622 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212230903622 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212230903623 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212230903623 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212230903633 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212230903633 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212230903633 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212230903633 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:09:04.825308 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6810): Terminating (SIGTERM) 23:09:04.868710 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6813): Terminating (SIGTERM) 23:09:04.914091 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6816): Terminating (SIGTERM) 23:09:04.959464 --- ParallelTerminationStrategy: PID 6810 died... 23:09:04.979936 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6810): Terminated: ok {rc=0} 23:09:05.029915 --- ParallelTerminationStrategy: PID 6813 died... 23:09:05.050279 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6813): Terminated: ok {rc=0} 23:09:05.098594 --- ParallelTerminationStrategy: PID 6816 died... 23:09:05.118551 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6816): Terminated: ok {rc=0} 23:09:05.208669 bus /sierra_3: Setting Powered False 23:09:06.309577 bus /sierra_3: Setting Powered False 23:09:07.427396 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2383 emergency:nanobts+band-1900 emergency_preemptive_call.py ---------------------------------------------- 23:09:08.517378 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 23:09:08.530448 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 23:09:08.576435 tst emergency_preemptive_call.py: using LAC 32145 23:09:08.699777 tst emergency_preemptive_call.py: using RAC 15 23:09:08.822621 tst emergency_preemptive_call.py: using CellId 32145 23:09:08.945438 tst emergency_preemptive_call.py: using BVCI 32146 23:09:09.060418 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 23:09:09.072642 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 23:09:09.085024 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 23:09:09.098492 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 23:09:09.111432 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 23:09:09.123226 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 23:09:09.248035 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 23:09:09.372141 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 23:09:09.492550 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 23:09:09.614165 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:09:10.109435 run create_hlr_db(pid=6820): Launched 23:09:10.270343 bus /sierra_2: Setting Powered False 23:09:11.330303 run create_hlr_db(pid=6820): Terminated: ok {rc=0} 23:09:11.775352 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6823): Launched 23:09:12.081193 run osmo-hlr_10.42.42.2(pid=6824): Launched 23:09:12.195899 run osmo-stp_10.42.42.5: Starting osmo-stp 23:09:12.726099 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6826): Launched 23:09:13.026247 run osmo-stp_10.42.42.5(pid=6827): Launched 23:09:13.150645 tst emergency_preemptive_call.py: using MSISDN 8015 23:09:13.305663 run osmo-msc_10.42.42.6: Starting osmo-msc 23:09:13.844835 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6829): Launched 23:09:14.144913 run osmo-msc_10.42.42.6(pid=6830): Launched 23:09:14.313612 run osmo-stp_10.42.42.5(pid=6827): ERR: Terminated: ERROR {rc=1} [trial-2383↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6827)] 23:09:14.441569 run osmo-stp_10.42.42.5(pid=6827): stdout: | (launched: 2022-12-12_23:09:12.971284) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:09:14.569753 run osmo-stp_10.42.42.5(pid=6827): stderr: | [0;m[38;5;43m20221212230913142 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230913142 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230913142 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230913143 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230913144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230913144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230913144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:09:14.694908 run osmo-stp_10.42.42.5(pid=6827): stdout: | (launched: 2022-12-12_23:09:12.971284) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:09:14.814420 run osmo-stp_10.42.42.5(pid=6827): stderr: | [0;m[38;5;43m20221212230913142 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230913142 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230913142 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230913143 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230913144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230913144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230913144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:09:14.957646 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=6827): Process ended prematurely: osmo-stp_10.42.42.5(pid=6827) [trial-2383↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6827)] [trial-2383↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32] 23:09:14.965926 tst emergency_preemptive_call.py:32: Test FAILED (6.4 sec) 23:09:14.992832 run osmo-hlr_10.42.42.2(pid=6824): ERR: Terminated: ERROR {rc=237} [trial-2383↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6824)] 23:09:15.040348 run osmo-hlr_10.42.42.2(pid=6824): stdout: | (launched: 2022-12-12_23:09:12.026092) 23:09:15.089957 run osmo-hlr_10.42.42.2(pid=6824): stderr: | [0;m[1;31m20221212230912201 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212230912201 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212230912201 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212230912201 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212230912201 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212230912201 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212230912213 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/emergency:nanobts+band-1900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212230912222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212230912222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212230912222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:09:15.159157 run osmo-msc_10.42.42.6(pid=6830): ERR: Terminated: ERROR {rc=2} [trial-2383↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6830)] 23:09:15.206686 run osmo-msc_10.42.42.6(pid=6830): stdout: | (launched: 2022-12-12_23:09:14.089809) 23:09:15.255907 run osmo-msc_10.42.42.6(pid=6830): stderr: | [0;m[38;5;43m20221212230914361 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212230914361 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff612260c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212230914361 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212230914361 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212230914361 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212230914362 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212230914363 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212230914364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212230914364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212230914364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:09:15.305639 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6823): Terminating (SIGTERM) 23:09:15.345289 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6826): Terminating (SIGTERM) 23:09:15.385091 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6829): Terminating (SIGTERM) 23:09:15.425146 --- ParallelTerminationStrategy: PID 6823 died... 23:09:15.444139 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6823): Terminated: ok {rc=0} 23:09:15.488465 --- ParallelTerminationStrategy: PID 6826 died... 23:09:15.507123 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6826): Terminated: ok {rc=0} 23:09:15.551156 --- ParallelTerminationStrategy: PID 6829 died... 23:09:15.569821 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6829): Terminated: ok {rc=0} 23:09:15.652628 bus /sierra_9: Setting Powered False 23:09:16.755380 bus /sierra_9: Setting Powered False 23:09:17.889726 bus /sierra_8: Setting Powered False 23:09:18.991580 bus /sierra_8: Setting Powered False 23:09:20.106629 bus /sierra_3: Setting Powered False 23:09:21.204423 bus /sierra_3: Setting Powered False 23:09:22.320986 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 emergency:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 gprs:nanobts+band-1900 --------------------------------------------------------------------- 23:09:23.598774 tst gprs:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:09:23.604369 tst gprs:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 23:09:23.628702 tst gprs:nanobts+band-1900: Verifying 9 x ip_address (candidates: 9) 23:09:23.668576 tst gprs:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 23:09:23.758175 tst gprs:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 23:09:23.782930 tst gprs:nanobts+band-1900: Reserving 9 x ip_address (candidates: 9) 23:09:23.822032 tst gprs:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 23:09:24.413446 tst gprs:nanobts+band-1900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2383 gprs:nanobts+band-1900 cs_paging_gprs_active.py ---------------------------------------------- 23:09:24.466147 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 23:09:24.477330 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 23:09:24.517186 tst cs_paging_gprs_active.py: using LAC 32146 23:09:24.644921 tst cs_paging_gprs_active.py: using RAC 16 23:09:24.772877 tst cs_paging_gprs_active.py: using CellId 32146 23:09:24.901250 tst cs_paging_gprs_active.py: using BVCI 32147 23:09:25.019520 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 23:09:25.030774 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 23:09:25.041781 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 23:09:25.052702 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 23:09:25.063725 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 23:09:25.074658 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 23:09:25.085808 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 23:09:25.096630 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 23:09:25.107796 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 23:09:25.225456 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 23:09:25.347392 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 23:09:25.568905 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:09:25.896575 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6837): Launched 23:09:26.180656 run iperf3-srv_10.42.42.10(pid=6838): Launched 23:09:26.303346 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 23:09:26.523088 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:09:26.849672 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6839): Launched 23:09:27.134579 run iperf3-srv_10.42.42.10(pid=6840): Launched 23:09:27.257090 tst cs_paging_gprs_active.py:38: start network... 23:09:27.476525 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:09:27.981316 run create_hlr_db(pid=6841): Launched 23:09:28.113070 bus /sierra_2: Setting Powered False 23:09:29.178466 run create_hlr_db(pid=6841): Terminated: ok {rc=0} 23:09:29.613526 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6843): Launched 23:09:29.922382 run osmo-hlr_10.42.42.2(pid=6844): Launched 23:09:30.039422 run osmo-stp_10.42.42.5: Starting osmo-stp 23:09:30.572517 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6846): Launched 23:09:30.914618 run osmo-stp_10.42.42.5(pid=6847): Launched 23:09:31.216035 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:09:31.814977 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6849): Launched 23:09:31.950302 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:09:32.234971 run patchelf(pid=6850): Launched 23:09:32.428164 run osmo-stp_10.42.42.5(pid=6847): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6847)] 23:09:32.566390 run osmo-stp_10.42.42.5(pid=6847): stdout: | (launched: 2022-12-12_23:09:30.824126) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:09:32.706112 run osmo-stp_10.42.42.5(pid=6847): stderr: | [0;m[38;5;43m20221212230931106 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230931106 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230931107 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230931107 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230931109 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230931110 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230931110 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:09:32.845888 run osmo-stp_10.42.42.5(pid=6847): stdout: | (launched: 2022-12-12_23:09:30.824126) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:09:32.979776 run osmo-stp_10.42.42.5(pid=6847): stderr: | [0;m[38;5;43m20221212230931106 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230931106 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230931107 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230931107 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230931109 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230931110 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230931110 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:09:33.138898 run patchelf(pid=6850): Terminating (SIGINT) 23:09:33.322906 run patchelf(pid=6850): Terminated: ok {rc=0} 23:09:33.455419 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=6847): Process ended prematurely: osmo-stp_10.42.42.5(pid=6847) [trial-2383↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6847)] [trial-2383↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38] 23:09:33.465461 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 23:09:33.493770 run osmo-hlr_10.42.42.2(pid=6844): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6844)] 23:09:33.543536 run osmo-hlr_10.42.42.2(pid=6844): stdout: | (launched: 2022-12-12_23:09:29.865712) 23:09:33.595333 run osmo-hlr_10.42.42.2(pid=6844): stderr: | [0;m[1;31m20221212230930044 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212230930044 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212230930044 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212230930044 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212230930044 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212230930044 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212230930056 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:nanobts+band-1900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212230930065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212230930065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212230930065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:09:33.647188 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6837): Terminating (SIGTERM) 23:09:33.688757 run iperf3-srv_10.42.42.10(pid=6838): Terminating (SIGTERM) 23:09:33.730320 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6839): Terminating (SIGTERM) 23:09:33.771843 run iperf3-srv_10.42.42.10(pid=6840): Terminating (SIGTERM) 23:09:33.813382 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6843): Terminating (SIGTERM) 23:09:33.855095 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6846): Terminating (SIGTERM) 23:09:33.896555 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6849): Terminating (SIGTERM) 23:09:33.939414 --- ParallelTerminationStrategy: PID 6837 died... 23:09:33.959256 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6837): Terminated: ok {rc=0} 23:09:34.005843 --- ParallelTerminationStrategy: PID 6838 died... 23:09:34.025294 run iperf3-srv_10.42.42.10(pid=6838): Terminated {rc=256} 23:09:34.071526 --- ParallelTerminationStrategy: PID 6839 died... 23:09:34.091011 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6839): Terminated: ok {rc=0} 23:09:34.137330 --- ParallelTerminationStrategy: PID 6840 died... 23:09:34.156750 run iperf3-srv_10.42.42.10(pid=6840): Terminated {rc=256} 23:09:34.203096 --- ParallelTerminationStrategy: PID 6843 died... 23:09:34.222505 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6843): Terminated: ok {rc=0} 23:09:34.267985 --- ParallelTerminationStrategy: PID 6846 died... 23:09:34.287396 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6846): Terminated: ok {rc=0} 23:09:34.333287 --- ParallelTerminationStrategy: PID 6849 died... 23:09:34.352816 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6849): Terminated: ok {rc=0} 23:09:34.443524 bus /gobi_0: Setting Powered False 23:09:35.542093 bus /gobi_0: Setting Powered False 23:09:36.656409 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:nanobts+band-1900 iperf3.py ---------------------------------------------- 23:09:37.804282 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 23:09:37.816183 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 23:09:37.857054 tst iperf3.py: using LAC 32147 23:09:37.980278 tst iperf3.py: using RAC 17 23:09:38.102520 tst iperf3.py: using CellId 32147 23:09:38.224593 tst iperf3.py: using BVCI 32148 23:09:38.336734 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 23:09:38.347532 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 23:09:38.358058 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 23:09:38.368707 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 23:09:38.379489 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 23:09:38.390212 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 23:09:38.401054 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 23:09:38.411619 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 23:09:38.422489 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 23:09:38.543753 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 23:09:38.764506 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:09:39.090105 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6854): Launched 23:09:39.375203 run iperf3-srv_10.42.42.10(pid=6855): Launched 23:09:39.497334 tst iperf3.py:8: start network... 23:09:39.716522 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:09:40.220877 run create_hlr_db(pid=6856): Launched 23:09:40.353505 bus /gobi_6: Setting Powered False 23:09:41.417857 run create_hlr_db(pid=6856): Terminated: ok {rc=0} 23:09:41.869405 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6858): Launched 23:09:42.197961 run osmo-hlr_10.42.42.2(pid=6859): Launched 23:09:42.321783 run osmo-stp_10.42.42.5: Starting osmo-stp 23:09:42.878846 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6861): Launched 23:09:43.203063 run osmo-stp_10.42.42.5(pid=6862): Launched 23:09:43.327247 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:09:43.890126 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6864): Launched 23:09:44.014645 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:09:44.290559 run patchelf(pid=6865): Launched 23:09:44.471922 run osmo-stp_10.42.42.5(pid=6862): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6862)] 23:09:44.609511 run osmo-stp_10.42.42.5(pid=6862): stdout: | (launched: 2022-12-12_23:09:43.143842) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:09:44.748119 run osmo-stp_10.42.42.5(pid=6862): stderr: | [0;m[38;5;43m20221212230943337 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230943337 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230943337 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230943338 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230943338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230943338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230943338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:09:44.887072 run osmo-stp_10.42.42.5(pid=6862): stdout: | (launched: 2022-12-12_23:09:43.143842) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:09:45.020320 run osmo-stp_10.42.42.5(pid=6862): stderr: | [0;m[38;5;43m20221212230943337 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230943337 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230943337 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230943338 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230943338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230943338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230943338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:09:45.179029 run patchelf(pid=6865): Terminating (SIGINT) 23:09:45.362883 run patchelf(pid=6865): Terminated: ok {rc=0} 23:09:45.494711 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6862): Process ended prematurely: osmo-stp_10.42.42.5(pid=6862) [trial-2383↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6862)] [trial-2383↪gprs:nanobts+band-1900↪iperf3.py:8] 23:09:45.504638 tst iperf3.py:8: Test FAILED (7.7 sec) 23:09:45.533002 run osmo-hlr_10.42.42.2(pid=6859): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:nanobts+band-1900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6859)] 23:09:45.582494 run osmo-hlr_10.42.42.2(pid=6859): stdout: | (launched: 2022-12-12_23:09:42.138205) 23:09:45.633600 run osmo-hlr_10.42.42.2(pid=6859): stderr: | [0;m[1;31m20221212230942337 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212230942337 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212230942337 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212230942337 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212230942337 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212230942337 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212230942348 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:nanobts+band-1900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212230942357 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212230942357 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212230942357 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:09:45.685295 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6854): Terminating (SIGTERM) 23:09:45.726705 run iperf3-srv_10.42.42.10(pid=6855): Terminating (SIGTERM) 23:09:45.768142 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6858): Terminating (SIGTERM) 23:09:45.809578 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6861): Terminating (SIGTERM) 23:09:45.851129 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6864): Terminating (SIGTERM) 23:09:45.896127 --- ParallelTerminationStrategy: PID 6854 died... 23:09:45.928049 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6854): Terminated: ok {rc=0} 23:09:45.978186 --- ParallelTerminationStrategy: PID 6855 died... 23:09:45.998152 run iperf3-srv_10.42.42.10(pid=6855): Terminated {rc=256} 23:09:46.046321 --- ParallelTerminationStrategy: PID 6858 died... 23:09:46.065912 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6858): Terminated: ok {rc=0} 23:09:46.113327 --- ParallelTerminationStrategy: PID 6861 died... 23:09:46.132924 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6861): Terminated: ok {rc=0} 23:09:46.181364 --- ParallelTerminationStrategy: PID 6864 died... 23:09:46.201142 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6864): Terminated: ok {rc=0} 23:09:46.293168 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:nanobts+band-1900 iperf3m4.py ---------------------------------------------- 23:09:47.450437 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 23:09:47.461615 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 23:09:47.498396 tst iperf3m4.py: using LAC 32148 23:09:47.618283 tst iperf3m4.py: using RAC 18 23:09:47.736770 tst iperf3m4.py: using CellId 32148 23:09:47.855421 tst iperf3m4.py: using BVCI 32149 23:09:47.967375 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 23:09:47.978045 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 23:09:47.988525 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 23:09:47.999219 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 23:09:48.010205 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 23:09:48.020906 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 23:09:48.031811 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 23:09:48.042508 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 23:09:48.053552 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 23:09:48.176147 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 23:09:48.294967 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 23:09:48.413058 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 23:09:48.530588 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 23:09:48.736902 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:09:49.044765 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6866): Launched 23:09:49.311382 run iperf3-srv_10.42.42.10(pid=6867): Launched 23:09:49.426338 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 23:09:49.630548 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:09:49.937554 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6868): Launched 23:09:50.226188 run iperf3-srv_10.42.42.10(pid=6869): Launched 23:09:50.348784 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 23:09:50.568586 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:09:50.896130 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6870): Launched 23:09:51.180370 run iperf3-srv_10.42.42.10(pid=6871): Launched 23:09:51.302581 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 23:09:51.522514 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:09:51.850336 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6872): Launched 23:09:52.134267 run iperf3-srv_10.42.42.10(pid=6873): Launched 23:09:52.256520 tst iperf3m4.py:8: start network... 23:09:52.476474 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:09:52.983071 run create_hlr_db(pid=6874): Launched 23:09:53.114871 bus /gobi_6: Setting Powered False 23:09:54.179176 run create_hlr_db(pid=6874): Terminated: ok {rc=0} 23:09:54.630235 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6876): Launched 23:09:54.955701 run osmo-hlr_10.42.42.2(pid=6877): Launched 23:09:55.080422 run osmo-stp_10.42.42.5: Starting osmo-stp 23:09:55.648462 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6879): Launched 23:09:55.975262 run osmo-stp_10.42.42.5(pid=6880): Launched 23:09:56.100159 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:09:56.664107 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6882): Launched 23:09:56.788169 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:09:57.063643 run patchelf(pid=6883): Launched 23:09:57.247679 run osmo-stp_10.42.42.5(pid=6880): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6880)] 23:09:57.386089 run osmo-stp_10.42.42.5(pid=6880): stdout: | (launched: 2022-12-12_23:09:55.914883) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:09:57.525488 run osmo-stp_10.42.42.5(pid=6880): stderr: | [0;m[38;5;43m20221212230956110 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230956110 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230956110 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230956110 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230956111 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230956111 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230956111 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:09:57.664630 run osmo-stp_10.42.42.5(pid=6880): stdout: | (launched: 2022-12-12_23:09:55.914883) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:09:57.798252 run osmo-stp_10.42.42.5(pid=6880): stderr: | [0;m[38;5;43m20221212230956110 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212230956110 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212230956110 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212230956110 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212230956111 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212230956111 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212230956111 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:09:57.956490 run patchelf(pid=6883): Terminating (SIGINT) 23:09:58.142183 run patchelf(pid=6883): Terminated: ok {rc=0} 23:09:58.274929 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6880): Process ended prematurely: osmo-stp_10.42.42.5(pid=6880) [trial-2383↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6880)] [trial-2383↪gprs:nanobts+band-1900↪iperf3m4.py:8] 23:09:58.285066 tst iperf3m4.py:8: Test FAILED (10.9 sec) 23:09:58.313715 run osmo-hlr_10.42.42.2(pid=6877): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:nanobts+band-1900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6877)] 23:09:58.363013 run osmo-hlr_10.42.42.2(pid=6877): stdout: | (launched: 2022-12-12_23:09:54.896083) 23:09:58.414225 run osmo-hlr_10.42.42.2(pid=6877): stderr: | [0;m[1;31m20221212230955098 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212230955098 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212230955098 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212230955098 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212230955099 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212230955099 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212230955111 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:nanobts+band-1900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212230955120 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212230955120 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212230955120 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:09:58.465691 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6866): Terminating (SIGTERM) 23:09:58.507303 run iperf3-srv_10.42.42.10(pid=6867): Terminating (SIGTERM) 23:09:58.548841 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6868): Terminating (SIGTERM) 23:09:58.590483 run iperf3-srv_10.42.42.10(pid=6869): Terminating (SIGTERM) 23:09:58.631863 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6870): Terminating (SIGTERM) 23:09:58.673550 run iperf3-srv_10.42.42.10(pid=6871): Terminating (SIGTERM) 23:09:58.714848 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6872): Terminating (SIGTERM) 23:09:58.756383 run iperf3-srv_10.42.42.10(pid=6873): Terminating (SIGTERM) 23:09:58.797993 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6876): Terminating (SIGTERM) 23:09:58.839447 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6879): Terminating (SIGTERM) 23:09:58.880883 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6882): Terminating (SIGTERM) 23:09:58.922642 --- ParallelTerminationStrategy: PID 6866 died... 23:09:58.942618 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6866): Terminated: ok {rc=0} 23:09:58.988537 --- ParallelTerminationStrategy: PID 6867 died... 23:09:59.007946 run iperf3-srv_10.42.42.10(pid=6867): Terminated {rc=256} 23:09:59.054177 --- ParallelTerminationStrategy: PID 6868 died... 23:09:59.073618 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6868): Terminated: ok {rc=0} 23:09:59.119286 --- ParallelTerminationStrategy: PID 6869 died... 23:09:59.138942 run iperf3-srv_10.42.42.10(pid=6869): Terminated {rc=256} 23:09:59.184419 --- ParallelTerminationStrategy: PID 6870 died... 23:09:59.203964 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6870): Terminated: ok {rc=0} 23:09:59.249503 --- ParallelTerminationStrategy: PID 6871 died... 23:09:59.268747 run iperf3-srv_10.42.42.10(pid=6871): Terminated {rc=256} 23:09:59.314029 --- ParallelTerminationStrategy: PID 6872 died... 23:09:59.333522 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6872): Terminated: ok {rc=0} 23:09:59.379035 --- ParallelTerminationStrategy: PID 6873 died... 23:09:59.398443 run iperf3-srv_10.42.42.10(pid=6873): Terminated {rc=256} 23:09:59.443823 --- ParallelTerminationStrategy: PID 6876 died... 23:09:59.463146 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6876): Terminated: ok {rc=0} 23:09:59.508347 --- ParallelTerminationStrategy: PID 6879 died... 23:09:59.527768 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6879): Terminated: ok {rc=0} 23:09:59.573174 --- ParallelTerminationStrategy: PID 6882 died... 23:09:59.592441 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6882): Terminated: ok {rc=0} 23:09:59.678338 bus /gobi_4: Setting Powered False 23:10:00.777997 bus /gobi_4: Setting Powered False 23:10:01.899645 bus /gobi_1: Setting Powered False 23:10:02.999325 bus /gobi_1: Setting Powered False 23:10:04.111942 bus /gobi_0: Setting Powered False 23:10:05.209762 bus /gobi_0: Setting Powered False 23:10:06.327834 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:nanobts+band-1900 ping.py ---------------------------------------------- 23:10:07.430564 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 23:10:07.441889 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 23:10:07.484782 tst ping.py: using LAC 32149 23:10:07.603591 tst ping.py: using RAC 19 23:10:07.731722 tst ping.py: using CellId 32149 23:10:07.856680 tst ping.py: using BVCI 32150 23:10:07.972746 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 23:10:07.983922 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 23:10:07.995024 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 23:10:08.006076 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 23:10:08.016929 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 23:10:08.027974 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 23:10:08.039050 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 23:10:08.050150 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 23:10:08.165311 tst ping.py:19: start network... 23:10:08.367960 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:10:08.832785 run create_hlr_db(pid=6887): Launched 23:10:08.948354 bus /gobi_6: Setting Powered False 23:10:10.008827 run create_hlr_db(pid=6887): Terminated: ok {rc=0} 23:10:10.427768 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6889): Launched 23:10:10.728236 run osmo-hlr_10.42.42.2(pid=6890): Launched 23:10:10.843257 run osmo-stp_10.42.42.5: Starting osmo-stp 23:10:11.381354 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6892): Launched 23:10:11.683699 run osmo-stp_10.42.42.5(pid=6893): Launched 23:10:11.799446 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:10:12.321064 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6895): Launched 23:10:12.436458 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:10:12.691131 run patchelf(pid=6896): Launched 23:10:12.858944 run osmo-stp_10.42.42.5(pid=6893): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6893)] 23:10:12.986835 run osmo-stp_10.42.42.5(pid=6893): stdout: | (launched: 2022-12-12_23:10:11.627902) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:10:13.115634 run osmo-stp_10.42.42.5(pid=6893): stderr: | [0;m[38;5;43m20221212231011798 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231011799 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231011799 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231011799 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231011800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231011800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231011800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:10:13.244392 run osmo-stp_10.42.42.5(pid=6893): stdout: | (launched: 2022-12-12_23:10:11.627902) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:10:13.367752 run osmo-stp_10.42.42.5(pid=6893): stderr: | [0;m[38;5;43m20221212231011798 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231011799 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231011799 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231011799 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231011800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231011800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231011800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:10:13.513771 run patchelf(pid=6896): Terminating (SIGINT) 23:10:13.685339 run patchelf(pid=6896): Terminated: ok {rc=0} 23:10:13.808216 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=6893): Process ended prematurely: osmo-stp_10.42.42.5(pid=6893) [trial-2383↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6893)] [trial-2383↪gprs:nanobts+band-1900↪ping.py:22] 23:10:13.817029 tst ping.py:22: Test FAILED (6.4 sec) 23:10:13.844097 run osmo-hlr_10.42.42.2(pid=6890): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:nanobts+band-1900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6890)] 23:10:13.891785 run osmo-hlr_10.42.42.2(pid=6890): stdout: | (launched: 2022-12-12_23:10:10.673564) 23:10:13.940919 run osmo-hlr_10.42.42.2(pid=6890): stderr: | [0;m[1;31m20221212231010849 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212231010849 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212231010850 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212231010850 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212231010850 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212231010850 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212231010861 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:nanobts+band-1900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212231010870 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212231010870 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212231010870 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:10:13.990483 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6889): Terminating (SIGTERM) 23:10:14.029699 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6892): Terminating (SIGTERM) 23:10:14.069188 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6895): Terminating (SIGTERM) 23:10:14.108737 --- ParallelTerminationStrategy: PID 6889 died... 23:10:14.127655 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6889): Terminated: ok {rc=0} 23:10:14.171482 --- ParallelTerminationStrategy: PID 6892 died... 23:10:14.189899 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6892): Terminated: ok {rc=0} 23:10:14.233819 --- ParallelTerminationStrategy: PID 6895 died... 23:10:14.252186 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6895): Terminated: ok {rc=0} 23:10:14.337756 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:nanobts+band-1900 ping_idle_ping.py ---------------------------------------------- 23:10:15.424770 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 23:10:15.436773 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 23:10:15.491267 tst ping_idle_ping.py: using LAC 32150 23:10:15.621844 tst ping_idle_ping.py: using RAC 20 23:10:15.747931 tst ping_idle_ping.py: using CellId 32150 23:10:15.899585 tst ping_idle_ping.py: using BVCI 32151 23:10:16.030460 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 23:10:16.045612 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 23:10:16.061510 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 23:10:16.077237 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 23:10:16.092388 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 23:10:16.106507 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 23:10:16.122257 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 23:10:16.137935 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 23:10:16.286825 tst ping_idle_ping.py:24: start network... 23:10:16.527082 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:10:17.039804 run create_hlr_db(pid=6897): Launched 23:10:17.202118 bus /gobi_6: Setting Powered False 23:10:18.265747 run create_hlr_db(pid=6897): Terminated: ok {rc=0} 23:10:18.697489 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6899): Launched 23:10:19.002908 run osmo-hlr_10.42.42.2(pid=6900): Launched 23:10:19.118808 run osmo-stp_10.42.42.5: Starting osmo-stp 23:10:19.638040 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6902): Launched 23:10:19.940204 run osmo-stp_10.42.42.5(pid=6903): Launched 23:10:20.056687 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:10:20.579910 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6905): Launched 23:10:20.696508 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:10:20.952444 run patchelf(pid=6906): Launched 23:10:21.121178 run osmo-stp_10.42.42.5(pid=6903): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6903)] 23:10:21.249215 run osmo-stp_10.42.42.5(pid=6903): stdout: | (launched: 2022-12-12_23:10:19.884599) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:10:21.378593 run osmo-stp_10.42.42.5(pid=6903): stderr: | [0;m[38;5;43m20221212231020057 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231020057 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231020057 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231020058 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231020059 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231020059 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231020059 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:10:21.507924 run osmo-stp_10.42.42.5(pid=6903): stdout: | (launched: 2022-12-12_23:10:19.884599) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:10:21.632035 run osmo-stp_10.42.42.5(pid=6903): stderr: | [0;m[38;5;43m20221212231020057 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231020057 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231020057 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231020058 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231020059 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231020059 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231020059 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:10:21.778722 run patchelf(pid=6906): Terminating (SIGINT) 23:10:21.949896 run patchelf(pid=6906): Terminated: ok {rc=0} 23:10:22.073211 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=6903): Process ended prematurely: osmo-stp_10.42.42.5(pid=6903) [trial-2383↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6903)] [trial-2383↪gprs:nanobts+band-1900↪ping_idle_ping.py:27] 23:10:22.081972 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 23:10:22.108871 run osmo-hlr_10.42.42.2(pid=6900): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:nanobts+band-1900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6900)] 23:10:22.156065 run osmo-hlr_10.42.42.2(pid=6900): stdout: | (launched: 2022-12-12_23:10:18.946927) 23:10:22.205104 run osmo-hlr_10.42.42.2(pid=6900): stderr: | [0;m[1;31m20221212231019124 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212231019124 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212231019125 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212231019125 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212231019125 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212231019125 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212231019137 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:nanobts+band-1900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212231019146 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212231019146 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212231019146 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:10:22.254374 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6899): Terminating (SIGTERM) 23:10:22.294125 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6902): Terminating (SIGTERM) 23:10:22.333698 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6905): Terminating (SIGTERM) 23:10:22.373525 --- ParallelTerminationStrategy: PID 6899 died... 23:10:22.392149 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6899): Terminated: ok {rc=0} 23:10:22.435958 --- ParallelTerminationStrategy: PID 6902 died... 23:10:22.454401 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6902): Terminated: ok {rc=0} 23:10:22.498170 --- ParallelTerminationStrategy: PID 6905 died... 23:10:22.516896 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6905): Terminated: ok {rc=0} 23:10:22.599769 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2383 gprs:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 gprs:nanobts+band-1900+mod-bts0-egprs --------------------------------------------------------------------- 23:10:23.897543 tst gprs:nanobts+band-1900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:10:23.904265 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 23:10:23.928491 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 23:10:23.968201 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 23:10:24.058290 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 23:10:24.082922 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 23:10:24.121806 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 23:10:24.716283 tst gprs:nanobts+band-1900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2383 gprs:nanobts+band-1900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 23:10:24.768100 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:10:24.779377 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:10:24.820059 tst cs_paging_gprs_active.py: using LAC 32151 23:10:24.949686 tst cs_paging_gprs_active.py: using RAC 21 23:10:25.077883 tst cs_paging_gprs_active.py: using CellId 32151 23:10:25.207516 tst cs_paging_gprs_active.py: using BVCI 32152 23:10:25.325833 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:10:25.337392 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:10:25.348576 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:10:25.359825 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:10:25.370980 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:10:25.382124 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:10:25.393502 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:10:25.404597 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:10:25.415929 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:10:25.535995 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:10:25.657188 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 23:10:25.876194 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:10:26.202330 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6910): Launched 23:10:26.484613 run iperf3-srv_10.42.42.10(pid=6911): Launched 23:10:26.606623 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 23:10:26.825070 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:10:27.150421 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6912): Launched 23:10:27.433676 run iperf3-srv_10.42.42.10(pid=6913): Launched 23:10:27.555046 tst cs_paging_gprs_active.py:38: start network... 23:10:27.774720 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:10:28.278565 run create_hlr_db(pid=6914): Launched 23:10:28.411526 bus /gobi_6: Setting Powered False 23:10:29.475170 run create_hlr_db(pid=6914): Terminated: ok {rc=0} 23:10:29.926473 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6916): Launched 23:10:30.252913 run osmo-hlr_10.42.42.2(pid=6917): Launched 23:10:30.378315 run osmo-stp_10.42.42.5: Starting osmo-stp 23:10:30.948936 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6919): Launched 23:10:31.296035 run osmo-stp_10.42.42.5(pid=6920): Launched 23:10:31.576342 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:10:32.185185 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6922): Launched 23:10:32.313287 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:10:32.589077 run patchelf(pid=6923): Launched 23:10:32.769469 run osmo-stp_10.42.42.5(pid=6920): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6920)] 23:10:32.906929 run osmo-stp_10.42.42.5(pid=6920): stdout: | (launched: 2022-12-12_23:10:31.230889) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:10:33.045945 run osmo-stp_10.42.42.5(pid=6920): stderr: | [0;m[38;5;43m20221212231031479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231031479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231031479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231031479 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231031485 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231031485 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231031485 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:10:33.185600 run osmo-stp_10.42.42.5(pid=6920): stdout: | (launched: 2022-12-12_23:10:31.230889) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:10:33.319308 run osmo-stp_10.42.42.5(pid=6920): stderr: | [0;m[38;5;43m20221212231031479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231031479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231031479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231031479 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231031485 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231031485 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231031485 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:10:33.477636 run patchelf(pid=6923): Terminating (SIGINT) 23:10:33.660873 run patchelf(pid=6923): Terminated: ok {rc=0} 23:10:33.792892 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=6920): Process ended prematurely: osmo-stp_10.42.42.5(pid=6920) [trial-2383↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6920)] [trial-2383↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 23:10:33.802987 tst cs_paging_gprs_active.py:38: Test FAILED (9.1 sec) 23:10:33.831327 run osmo-hlr_10.42.42.2(pid=6917): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6917)] 23:10:33.880853 run osmo-hlr_10.42.42.2(pid=6917): stdout: | (launched: 2022-12-12_23:10:30.193508) 23:10:33.932356 run osmo-hlr_10.42.42.2(pid=6917): stderr: | [0;m[1;31m20221212231030394 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212231030394 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212231030394 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212231030394 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212231030394 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212231030394 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212231030406 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:nanobts+band-1900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212231030415 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212231030415 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212231030415 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:10:33.984033 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6910): Terminating (SIGTERM) 23:10:34.025805 run iperf3-srv_10.42.42.10(pid=6911): Terminating (SIGTERM) 23:10:34.067316 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6912): Terminating (SIGTERM) 23:10:34.108929 run iperf3-srv_10.42.42.10(pid=6913): Terminating (SIGTERM) 23:10:34.150331 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6916): Terminating (SIGTERM) 23:10:34.192378 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6919): Terminating (SIGTERM) 23:10:34.234049 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6922): Terminating (SIGTERM) 23:10:34.275822 --- ParallelTerminationStrategy: PID 6910 died... 23:10:34.295812 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6910): Terminated: ok {rc=0} 23:10:34.341587 --- ParallelTerminationStrategy: PID 6911 died... 23:10:34.360577 run iperf3-srv_10.42.42.10(pid=6911): Terminated {rc=256} 23:10:34.406741 --- ParallelTerminationStrategy: PID 6912 died... 23:10:34.426220 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6912): Terminated: ok {rc=0} 23:10:34.471915 --- ParallelTerminationStrategy: PID 6913 died... 23:10:34.491235 run iperf3-srv_10.42.42.10(pid=6913): Terminated {rc=256} 23:10:34.537273 --- ParallelTerminationStrategy: PID 6916 died... 23:10:34.556514 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6916): Terminated: ok {rc=0} 23:10:34.602123 --- ParallelTerminationStrategy: PID 6919 died... 23:10:34.621499 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6919): Terminated: ok {rc=0} 23:10:34.666662 --- ParallelTerminationStrategy: PID 6922 died... 23:10:34.686040 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6922): Terminated: ok {rc=0} 23:10:34.772557 bus /gobi_0: Setting Powered False 23:10:35.871495 bus /gobi_0: Setting Powered False 23:10:36.987668 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:nanobts+band-1900+mod-bts0-egprs iperf3.py ---------------------------------------------- 23:10:38.132820 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:10:38.144216 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:10:38.190549 tst iperf3.py: using LAC 32152 23:10:38.311068 tst iperf3.py: using RAC 22 23:10:38.432215 tst iperf3.py: using CellId 32152 23:10:38.552191 tst iperf3.py: using BVCI 32153 23:10:38.664612 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:10:38.675580 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:10:38.686293 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:10:38.697538 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:10:38.708272 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:10:38.719160 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:10:38.730261 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:10:38.741265 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:10:38.752272 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:10:38.872536 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 23:10:39.095031 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:10:39.424147 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6924): Launched 23:10:39.709624 run iperf3-srv_10.42.42.10(pid=6925): Launched 23:10:39.832745 tst iperf3.py:8: start network... 23:10:40.054895 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:10:40.564511 run create_hlr_db(pid=6926): Launched 23:10:40.697446 bus /gobi_6: Setting Powered False 23:10:41.761560 run create_hlr_db(pid=6926): Terminated: ok {rc=0} 23:10:42.220022 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6928): Launched 23:10:42.528573 run osmo-hlr_10.42.42.2(pid=6929): Launched 23:10:42.648386 run osmo-stp_10.42.42.5: Starting osmo-stp 23:10:43.194616 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6931): Launched 23:10:43.501184 run osmo-stp_10.42.42.5(pid=6932): Launched 23:10:43.619669 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:10:44.147423 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6934): Launched 23:10:44.265252 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:10:44.524540 run patchelf(pid=6935): Launched 23:10:44.696030 run osmo-stp_10.42.42.5(pid=6932): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6932)] 23:10:44.826008 run osmo-stp_10.42.42.5(pid=6932): stdout: | (launched: 2022-12-12_23:10:43.445362) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:10:44.957411 run osmo-stp_10.42.42.5(pid=6932): stderr: | [0;m[38;5;43m20221212231043618 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231043618 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231043619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231043619 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231043619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231043619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231043620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:10:45.088842 run osmo-stp_10.42.42.5(pid=6932): stdout: | (launched: 2022-12-12_23:10:43.445362) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:10:45.215057 run osmo-stp_10.42.42.5(pid=6932): stderr: | [0;m[38;5;43m20221212231043618 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231043618 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231043619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231043619 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231043619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231043619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231043620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:10:45.364172 run patchelf(pid=6935): Terminating (SIGINT) 23:10:45.538393 run patchelf(pid=6935): Terminated: ok {rc=0} 23:10:45.663691 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6932): Process ended prematurely: osmo-stp_10.42.42.5(pid=6932) [trial-2383↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6932)] [trial-2383↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8] 23:10:45.673117 tst iperf3.py:8: Test FAILED (7.6 sec) 23:10:45.700431 run osmo-hlr_10.42.42.2(pid=6929): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6929)] 23:10:45.748178 run osmo-hlr_10.42.42.2(pid=6929): stdout: | (launched: 2022-12-12_23:10:42.472051) 23:10:45.797147 run osmo-hlr_10.42.42.2(pid=6929): stderr: | [0;m[1;31m20221212231042651 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212231042651 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212231042651 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212231042651 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212231042651 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212231042651 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212231042663 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212231042671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212231042672 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212231042672 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:10:45.862140 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6924): Terminating (SIGTERM) 23:10:45.917355 run iperf3-srv_10.42.42.10(pid=6925): Terminating (SIGTERM) 23:10:45.974803 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6928): Terminating (SIGTERM) 23:10:46.018805 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6931): Terminating (SIGTERM) 23:10:46.064029 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6934): Terminating (SIGTERM) 23:10:46.110297 --- ParallelTerminationStrategy: PID 6924 died... 23:10:46.130826 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6924): Terminated: ok {rc=0} 23:10:46.180723 --- ParallelTerminationStrategy: PID 6925 died... 23:10:46.201213 run iperf3-srv_10.42.42.10(pid=6925): Terminated {rc=256} 23:10:46.248599 --- ParallelTerminationStrategy: PID 6928 died... 23:10:46.269258 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6928): Terminated: ok {rc=0} 23:10:46.316791 --- ParallelTerminationStrategy: PID 6931 died... 23:10:46.337240 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6931): Terminated: ok {rc=0} 23:10:46.386131 --- ParallelTerminationStrategy: PID 6934 died... 23:10:46.406669 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6934): Terminated: ok {rc=0} 23:10:46.495725 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:nanobts+band-1900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 23:10:47.646967 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:10:47.662534 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:10:47.702811 tst iperf3m4.py: using LAC 32153 23:10:47.831024 tst iperf3m4.py: using RAC 23 23:10:47.962043 tst iperf3m4.py: using CellId 32153 23:10:48.084856 tst iperf3m4.py: using BVCI 32154 23:10:48.198751 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:10:48.209913 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:10:48.220641 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:10:48.231838 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:10:48.242865 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:10:48.253884 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:10:48.264937 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:10:48.275882 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:10:48.286960 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:10:48.406351 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:10:48.526255 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:10:48.647405 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:10:48.768686 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 23:10:48.975578 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:10:49.283229 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6936): Launched 23:10:49.550941 run iperf3-srv_10.42.42.10(pid=6937): Launched 23:10:49.666705 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 23:10:49.872887 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:10:50.180933 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6938): Launched 23:10:50.448497 run iperf3-srv_10.42.42.10(pid=6939): Launched 23:10:50.565668 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 23:10:50.773212 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:10:51.083002 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6940): Launched 23:10:51.351168 run iperf3-srv_10.42.42.10(pid=6941): Launched 23:10:51.466722 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 23:10:51.672778 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:10:51.981188 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6942): Launched 23:10:52.248626 run iperf3-srv_10.42.42.10(pid=6943): Launched 23:10:52.364250 tst iperf3m4.py:8: start network... 23:10:52.570846 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:10:53.047266 run create_hlr_db(pid=6944): Launched 23:10:53.164776 bus /gobi_6: Setting Powered False 23:10:54.225996 run create_hlr_db(pid=6944): Terminated: ok {rc=0} 23:10:54.653483 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6946): Launched 23:10:54.961559 run osmo-hlr_10.42.42.2(pid=6947): Launched 23:10:55.080414 run osmo-stp_10.42.42.5: Starting osmo-stp 23:10:55.627304 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6949): Launched 23:10:55.933778 run osmo-stp_10.42.42.5(pid=6950): Launched 23:10:56.052174 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:10:56.581968 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6952): Launched 23:10:56.699489 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:10:56.958441 run patchelf(pid=6953): Launched 23:10:57.129972 run osmo-stp_10.42.42.5(pid=6950): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6950)] 23:10:57.259513 run osmo-stp_10.42.42.5(pid=6950): stdout: | (launched: 2022-12-12_23:10:55.877602) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:10:57.390367 run osmo-stp_10.42.42.5(pid=6950): stderr: | [0;m[38;5;43m20221212231056050 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231056050 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231056051 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231056051 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231056051 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231056052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231056052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:10:57.521387 run osmo-stp_10.42.42.5(pid=6950): stdout: | (launched: 2022-12-12_23:10:55.877602) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:10:57.646774 run osmo-stp_10.42.42.5(pid=6950): stderr: | [0;m[38;5;43m20221212231056050 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231056050 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231056051 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231056051 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231056051 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231056052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231056052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:10:57.795113 run patchelf(pid=6953): Terminating (SIGINT) 23:10:57.969083 run patchelf(pid=6953): Terminated: ok {rc=0} 23:10:58.094356 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6950): Process ended prematurely: osmo-stp_10.42.42.5(pid=6950) [trial-2383↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6950)] [trial-2383↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8] 23:10:58.103756 tst iperf3m4.py:8: Test FAILED (10.5 sec) 23:10:58.131155 run osmo-hlr_10.42.42.2(pid=6947): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6947)] 23:10:58.178408 run osmo-hlr_10.42.42.2(pid=6947): stdout: | (launched: 2022-12-12_23:10:54.905281) 23:10:58.227276 run osmo-hlr_10.42.42.2(pid=6947): stderr: | [0;m[1;31m20221212231055081 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212231055081 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212231055081 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212231055081 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212231055081 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212231055082 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212231055094 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212231055102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212231055102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212231055102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:10:58.276791 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6936): Terminating (SIGTERM) 23:10:58.316377 run iperf3-srv_10.42.42.10(pid=6937): Terminating (SIGTERM) 23:10:58.355794 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6938): Terminating (SIGTERM) 23:10:58.395304 run iperf3-srv_10.42.42.10(pid=6939): Terminating (SIGTERM) 23:10:58.434512 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6940): Terminating (SIGTERM) 23:10:58.473872 run iperf3-srv_10.42.42.10(pid=6941): Terminating (SIGTERM) 23:10:58.513106 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6942): Terminating (SIGTERM) 23:10:58.552103 run iperf3-srv_10.42.42.10(pid=6943): Terminating (SIGTERM) 23:10:58.591823 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6946): Terminating (SIGTERM) 23:10:58.630809 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6949): Terminating (SIGTERM) 23:10:58.669939 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6952): Terminating (SIGTERM) 23:10:58.709764 --- ParallelTerminationStrategy: PID 6936 died... 23:10:58.728584 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6936): Terminated: ok {rc=0} 23:10:58.772866 --- ParallelTerminationStrategy: PID 6937 died... 23:10:58.791892 run iperf3-srv_10.42.42.10(pid=6937): Terminated {rc=256} 23:10:58.835648 --- ParallelTerminationStrategy: PID 6938 died... 23:10:58.854046 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6938): Terminated: ok {rc=0} 23:10:58.898245 --- ParallelTerminationStrategy: PID 6939 died... 23:10:58.916542 run iperf3-srv_10.42.42.10(pid=6939): Terminated {rc=256} 23:10:58.960620 --- ParallelTerminationStrategy: PID 6940 died... 23:10:58.979100 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6940): Terminated: ok {rc=0} 23:10:59.022621 --- ParallelTerminationStrategy: PID 6941 died... 23:10:59.040883 run iperf3-srv_10.42.42.10(pid=6941): Terminated {rc=256} 23:10:59.084196 --- ParallelTerminationStrategy: PID 6942 died... 23:10:59.102598 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6942): Terminated: ok {rc=0} 23:10:59.146434 --- ParallelTerminationStrategy: PID 6943 died... 23:10:59.164821 run iperf3-srv_10.42.42.10(pid=6943): Terminated {rc=256} 23:10:59.208433 --- ParallelTerminationStrategy: PID 6946 died... 23:10:59.226753 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6946): Terminated: ok {rc=0} 23:10:59.270330 --- ParallelTerminationStrategy: PID 6949 died... 23:10:59.288684 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6949): Terminated: ok {rc=0} 23:10:59.332290 --- ParallelTerminationStrategy: PID 6952 died... 23:10:59.350804 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6952): Terminated: ok {rc=0} 23:10:59.436128 bus /gobi_4: Setting Powered False 23:11:00.535154 bus /gobi_4: Setting Powered False 23:11:01.649377 bus /gobi_1: Setting Powered False 23:11:02.751081 bus /gobi_1: Setting Powered False 23:11:03.865986 bus /gobi_0: Setting Powered False 23:11:04.962390 bus /gobi_0: Setting Powered False 23:11:06.077904 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:nanobts+band-1900+mod-bts0-egprs ping.py ---------------------------------------------- 23:11:07.180656 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:11:07.192710 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:11:07.234487 tst ping.py: using LAC 32154 23:11:07.361085 tst ping.py: using RAC 24 23:11:07.486440 tst ping.py: using CellId 32154 23:11:07.606352 tst ping.py: using BVCI 32155 23:11:07.718079 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:11:07.729127 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:11:07.739998 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:11:07.751186 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:11:07.762282 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:11:07.772847 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:11:07.784074 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:11:07.795084 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:11:07.914619 tst ping.py:19: start network... 23:11:08.130697 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:11:08.624694 run create_hlr_db(pid=6954): Launched 23:11:08.754827 bus /gobi_6: Setting Powered False 23:11:09.817891 run create_hlr_db(pid=6954): Terminated: ok {rc=0} 23:11:10.245930 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6956): Launched 23:11:10.545645 run osmo-hlr_10.42.42.2(pid=6957): Launched 23:11:10.662121 run osmo-stp_10.42.42.5: Starting osmo-stp 23:11:11.190160 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6959): Launched 23:11:11.490099 run osmo-stp_10.42.42.5(pid=6960): Launched 23:11:11.604732 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:11:12.122843 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6962): Launched 23:11:12.238534 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:11:12.492726 run patchelf(pid=6963): Launched 23:11:12.660805 run osmo-stp_10.42.42.5(pid=6960): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6960)] 23:11:12.789102 run osmo-stp_10.42.42.5(pid=6960): stdout: | (launched: 2022-12-12_23:11:11.434995) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:11:12.918089 run osmo-stp_10.42.42.5(pid=6960): stderr: | [0;m[38;5;43m20221212231111604 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231111605 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231111605 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231111605 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231111607 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231111608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231111608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:11:13.047447 run osmo-stp_10.42.42.5(pid=6960): stdout: | (launched: 2022-12-12_23:11:11.434995) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:11:13.170875 run osmo-stp_10.42.42.5(pid=6960): stderr: | [0;m[38;5;43m20221212231111604 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231111605 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231111605 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231111605 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231111607 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231111608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231111608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:11:13.317222 run patchelf(pid=6963): Terminating (SIGINT) 23:11:13.488277 run patchelf(pid=6963): Terminated: ok {rc=0} 23:11:13.611196 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=6960): Process ended prematurely: osmo-stp_10.42.42.5(pid=6960) [trial-2383↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6960)] [trial-2383↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22] 23:11:13.619897 tst ping.py:22: Test FAILED (6.4 sec) 23:11:13.646845 run osmo-hlr_10.42.42.2(pid=6957): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6957)] 23:11:13.694711 run osmo-hlr_10.42.42.2(pid=6957): stdout: | (launched: 2022-12-12_23:11:10.490880) 23:11:13.744593 run osmo-hlr_10.42.42.2(pid=6957): stderr: | [0;m[1;31m20221212231110668 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212231110668 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212231110668 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212231110668 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212231110668 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212231110668 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212231110680 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:nanobts+band-1900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212231110689 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212231110690 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212231110690 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:11:13.794409 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6956): Terminating (SIGTERM) 23:11:13.834319 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6959): Terminating (SIGTERM) 23:11:13.873894 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6962): Terminating (SIGTERM) 23:11:13.914456 --- ParallelTerminationStrategy: PID 6956 died... 23:11:13.933485 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6956): Terminated: ok {rc=0} 23:11:13.978080 --- ParallelTerminationStrategy: PID 6959 died... 23:11:13.996607 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6959): Terminated: ok {rc=0} 23:11:14.041324 --- ParallelTerminationStrategy: PID 6962 died... 23:11:14.059846 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6962): Terminated: ok {rc=0} 23:11:14.143527 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:nanobts+band-1900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 23:11:15.230181 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:11:15.242352 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:11:15.285157 tst ping_idle_ping.py: using LAC 32155 23:11:15.412144 tst ping_idle_ping.py: using RAC 25 23:11:15.537535 tst ping_idle_ping.py: using CellId 32155 23:11:15.657104 tst ping_idle_ping.py: using BVCI 32156 23:11:15.769275 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:11:15.780152 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:11:15.790977 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:11:15.802059 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:11:15.812608 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:11:15.824453 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:11:15.843611 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:11:15.856521 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:11:16.013409 tst ping_idle_ping.py:24: start network... 23:11:16.237812 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:11:16.766509 run create_hlr_db(pid=6964): Launched 23:11:16.931857 bus /gobi_6: Setting Powered False 23:11:17.994729 run create_hlr_db(pid=6964): Terminated: ok {rc=0} 23:11:18.428094 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6966): Launched 23:11:18.730001 run osmo-hlr_10.42.42.2(pid=6967): Launched 23:11:18.846497 run osmo-stp_10.42.42.5: Starting osmo-stp 23:11:19.381444 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6969): Launched 23:11:19.684479 run osmo-stp_10.42.42.5(pid=6970): Launched 23:11:19.800107 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:11:20.320725 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6972): Launched 23:11:20.436587 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:11:20.691717 run patchelf(pid=6973): Launched 23:11:20.861111 run osmo-stp_10.42.42.5(pid=6970): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6970)] 23:11:20.989529 run osmo-stp_10.42.42.5(pid=6970): stdout: | (launched: 2022-12-12_23:11:19.628816) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:11:21.119275 run osmo-stp_10.42.42.5(pid=6970): stderr: | [0;m[38;5;43m20221212231119799 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231119799 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231119800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231119800 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231119801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231119801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231119801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:11:21.248901 run osmo-stp_10.42.42.5(pid=6970): stdout: | (launched: 2022-12-12_23:11:19.628816) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:11:21.372642 run osmo-stp_10.42.42.5(pid=6970): stderr: | [0;m[38;5;43m20221212231119799 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231119799 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231119800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231119800 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231119801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231119801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231119801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:11:21.519262 run patchelf(pid=6973): Terminating (SIGINT) 23:11:21.691083 run patchelf(pid=6973): Terminated: ok {rc=0} 23:11:21.814467 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=6970): Process ended prematurely: osmo-stp_10.42.42.5(pid=6970) [trial-2383↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6970)] [trial-2383↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27] 23:11:21.823184 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 23:11:21.849817 run osmo-hlr_10.42.42.2(pid=6967): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6967)] 23:11:21.897298 run osmo-hlr_10.42.42.2(pid=6967): stdout: | (launched: 2022-12-12_23:11:18.675221) 23:11:21.947060 run osmo-hlr_10.42.42.2(pid=6967): stderr: | [0;m[1;31m20221212231118853 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212231118853 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212231118853 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212231118853 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212231118853 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212231118853 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212231118866 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:nanobts+band-1900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212231118874 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212231118875 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212231118875 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:11:21.996490 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6966): Terminating (SIGTERM) 23:11:22.036006 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6969): Terminating (SIGTERM) 23:11:22.075535 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6972): Terminating (SIGTERM) 23:11:22.115402 --- ParallelTerminationStrategy: PID 6966 died... 23:11:22.134377 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6966): Terminated: ok {rc=0} 23:11:22.178855 --- ParallelTerminationStrategy: PID 6969 died... 23:11:22.197402 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6969): Terminated: ok {rc=0} 23:11:22.241293 --- ParallelTerminationStrategy: PID 6972 died... 23:11:22.259672 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6972): Terminated: ok {rc=0} 23:11:22.343186 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2383 gprs:nanobts+band-1900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 gprs:nanobts+band-1900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 23:11:23.630424 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:11:23.637534 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 23:11:23.661439 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 23:11:23.699793 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 23:11:23.788085 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 23:11:23.812515 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 23:11:23.852031 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 23:11:24.441676 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2383 gprs:nanobts+band-1900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 23:11:24.495508 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:11:24.507127 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:11:24.568501 tst cs_paging_gprs_active.py: using LAC 32156 23:11:24.698922 tst cs_paging_gprs_active.py: using RAC 26 23:11:24.831584 tst cs_paging_gprs_active.py: using CellId 32156 23:11:24.957744 tst cs_paging_gprs_active.py: using BVCI 32157 23:11:25.070188 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:11:25.081152 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:11:25.091799 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:11:25.102979 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:11:25.114389 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:11:25.125525 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:11:25.136449 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:11:25.147462 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:11:25.158877 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:11:25.280386 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:11:25.404296 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 23:11:25.624463 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:11:25.950597 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6977): Launched 23:11:26.234734 run iperf3-srv_10.42.42.10(pid=6978): Launched 23:11:26.357392 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 23:11:26.576934 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:11:26.904399 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6979): Launched 23:11:27.189278 run iperf3-srv_10.42.42.10(pid=6980): Launched 23:11:27.311531 tst cs_paging_gprs_active.py:38: start network... 23:11:27.531280 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:11:28.036363 run create_hlr_db(pid=6981): Launched 23:11:28.169367 bus /gobi_6: Setting Powered False 23:11:29.234112 run create_hlr_db(pid=6981): Terminated: ok {rc=0} 23:11:29.671035 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6983): Launched 23:11:29.978776 run osmo-hlr_10.42.42.2(pid=6984): Launched 23:11:30.096224 run osmo-stp_10.42.42.5: Starting osmo-stp 23:11:30.635296 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6986): Launched 23:11:30.969638 run osmo-stp_10.42.42.5(pid=6987): Launched 23:11:31.250095 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:11:31.830626 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6989): Launched 23:11:31.969918 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:11:32.262064 run patchelf(pid=6990): Launched 23:11:32.460481 run osmo-stp_10.42.42.5(pid=6987): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6987)] 23:11:32.599725 run osmo-stp_10.42.42.5(pid=6987): stdout: | (launched: 2022-12-12_23:11:30.897874) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:11:32.739821 run osmo-stp_10.42.42.5(pid=6987): stderr: | [0;m[38;5;43m20221212231131094 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231131094 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231131095 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231131095 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231131096 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231131096 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231131096 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:11:32.880644 run osmo-stp_10.42.42.5(pid=6987): stdout: | (launched: 2022-12-12_23:11:30.897874) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:11:33.014844 run osmo-stp_10.42.42.5(pid=6987): stderr: | [0;m[38;5;43m20221212231131094 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231131094 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231131095 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231131095 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231131096 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231131096 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231131096 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:11:33.173974 run patchelf(pid=6990): Terminating (SIGINT) 23:11:33.359268 run patchelf(pid=6990): Terminated: ok {rc=0} 23:11:33.492010 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=6987): Process ended prematurely: osmo-stp_10.42.42.5(pid=6987) [trial-2383↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6987)] [trial-2383↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 23:11:33.502342 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 23:11:33.531058 run osmo-hlr_10.42.42.2(pid=6984): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6984)] 23:11:33.581176 run osmo-hlr_10.42.42.2(pid=6984): stdout: | (launched: 2022-12-12_23:11:29.922144) 23:11:33.633313 run osmo-hlr_10.42.42.2(pid=6984): stderr: | [0;m[1;31m20221212231130098 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212231130098 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212231130098 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212231130098 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212231130098 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212231130098 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212231130110 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212231130119 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212231130120 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212231130120 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:11:33.685855 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6977): Terminating (SIGTERM) 23:11:33.727945 run iperf3-srv_10.42.42.10(pid=6978): Terminating (SIGTERM) 23:11:33.769911 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6979): Terminating (SIGTERM) 23:11:33.811978 run iperf3-srv_10.42.42.10(pid=6980): Terminating (SIGTERM) 23:11:33.854366 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6983): Terminating (SIGTERM) 23:11:33.896294 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6986): Terminating (SIGTERM) 23:11:33.938851 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6989): Terminating (SIGTERM) 23:11:33.981160 --- ParallelTerminationStrategy: PID 6977 died... 23:11:34.001442 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6977): Terminated: ok {rc=0} 23:11:34.048096 --- ParallelTerminationStrategy: PID 6978 died... 23:11:34.067896 run iperf3-srv_10.42.42.10(pid=6978): Terminated {rc=256} 23:11:34.114381 --- ParallelTerminationStrategy: PID 6979 died... 23:11:34.134077 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6979): Terminated: ok {rc=0} 23:11:34.180206 --- ParallelTerminationStrategy: PID 6980 died... 23:11:34.200222 run iperf3-srv_10.42.42.10(pid=6980): Terminated {rc=256} 23:11:34.246483 --- ParallelTerminationStrategy: PID 6983 died... 23:11:34.266088 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6983): Terminated: ok {rc=0} 23:11:34.312511 --- ParallelTerminationStrategy: PID 6986 died... 23:11:34.332439 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6986): Terminated: ok {rc=0} 23:11:34.379120 --- ParallelTerminationStrategy: PID 6989 died... 23:11:34.398902 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6989): Terminated: ok {rc=0} 23:11:34.486671 bus /gobi_0: Setting Powered False 23:11:35.586518 bus /gobi_0: Setting Powered False 23:11:36.700841 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 23:11:37.848534 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:11:37.860741 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:11:37.929323 tst iperf3.py: using LAC 32157 23:11:38.055777 tst iperf3.py: using RAC 27 23:11:38.175631 tst iperf3.py: using CellId 32157 23:11:38.294693 tst iperf3.py: using BVCI 32158 23:11:38.408307 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:11:38.419557 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:11:38.430526 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:11:38.442001 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:11:38.453061 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:11:38.464285 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:11:38.475536 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:11:38.486526 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:11:38.497920 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:11:38.612353 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 23:11:38.818795 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:11:39.127574 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6991): Launched 23:11:39.395619 run iperf3-srv_10.42.42.10(pid=6992): Launched 23:11:39.511631 tst iperf3.py:8: start network... 23:11:39.717372 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:11:40.191937 run create_hlr_db(pid=6993): Launched 23:11:40.309131 bus /gobi_6: Setting Powered False 23:11:41.369780 run create_hlr_db(pid=6993): Terminated: ok {rc=0} 23:11:41.794780 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6995): Launched 23:11:42.100809 run osmo-hlr_10.42.42.2(pid=6996): Launched 23:11:42.218488 run osmo-stp_10.42.42.5: Starting osmo-stp 23:11:42.758220 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6998): Launched 23:11:43.065392 run osmo-stp_10.42.42.5(pid=6999): Launched 23:11:43.183464 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:11:43.718227 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7001): Launched 23:11:43.835256 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:11:44.094060 run patchelf(pid=7002): Launched 23:11:44.264681 run osmo-stp_10.42.42.5(pid=6999): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6999)] 23:11:44.394461 run osmo-stp_10.42.42.5(pid=6999): stdout: | (launched: 2022-12-12_23:11:43.009492) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:11:44.525231 run osmo-stp_10.42.42.5(pid=6999): stderr: | [0;m[38;5;43m20221212231143182 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231143182 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231143182 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231143183 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231143183 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231143183 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231143183 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:11:44.656388 run osmo-stp_10.42.42.5(pid=6999): stdout: | (launched: 2022-12-12_23:11:43.009492) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:11:44.782253 run osmo-stp_10.42.42.5(pid=6999): stderr: | [0;m[38;5;43m20221212231143182 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231143182 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231143182 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231143183 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231143183 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231143183 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231143183 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:11:44.931108 run patchelf(pid=7002): Terminating (SIGINT) 23:11:45.105431 run patchelf(pid=7002): Terminated: ok {rc=0} 23:11:45.230427 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6999): Process ended prematurely: osmo-stp_10.42.42.5(pid=6999) [trial-2383↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6999)] [trial-2383↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8] 23:11:45.239779 tst iperf3.py:8: Test FAILED (7.4 sec) 23:11:45.267100 run osmo-hlr_10.42.42.2(pid=6996): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6996)] 23:11:45.315111 run osmo-hlr_10.42.42.2(pid=6996): stdout: | (launched: 2022-12-12_23:11:42.044480) 23:11:45.364488 run osmo-hlr_10.42.42.2(pid=6996): stderr: | [0;m[1;31m20221212231142220 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212231142221 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212231142221 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212231142221 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212231142221 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212231142221 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212231142232 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212231142241 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212231142241 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212231142241 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:11:45.414627 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6991): Terminating (SIGTERM) 23:11:45.454599 run iperf3-srv_10.42.42.10(pid=6992): Terminating (SIGTERM) 23:11:45.494356 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6995): Terminating (SIGTERM) 23:11:45.534344 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6998): Terminating (SIGTERM) 23:11:45.574114 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7001): Terminating (SIGTERM) 23:11:45.614096 --- ParallelTerminationStrategy: PID 6991 died... 23:11:45.633118 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6991): Terminated: ok {rc=0} 23:11:45.677737 --- ParallelTerminationStrategy: PID 6992 died... 23:11:45.696157 run iperf3-srv_10.42.42.10(pid=6992): Terminated {rc=256} 23:11:45.740599 --- ParallelTerminationStrategy: PID 6995 died... 23:11:45.759216 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6995): Terminated: ok {rc=0} 23:11:45.803479 --- ParallelTerminationStrategy: PID 6998 died... 23:11:45.822053 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6998): Terminated: ok {rc=0} 23:11:45.886175 --- ParallelTerminationStrategy: PID 7001 died... 23:11:45.908581 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7001): Terminated: ok {rc=0} 23:11:45.993981 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 23:11:47.136910 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:11:47.149249 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:11:47.210983 tst iperf3m4.py: using LAC 32158 23:11:47.350288 tst iperf3m4.py: using RAC 28 23:11:47.477505 tst iperf3m4.py: using CellId 32158 23:11:47.603677 tst iperf3m4.py: using BVCI 32159 23:11:47.723813 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:11:47.735321 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:11:47.746613 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:11:47.758335 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:11:47.769795 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:11:47.781074 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:11:47.792373 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:11:47.803775 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:11:47.815163 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:11:47.935698 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:11:48.057232 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:11:48.175792 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:11:48.296802 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 23:11:48.518043 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:11:48.845218 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7003): Launched 23:11:49.130506 run iperf3-srv_10.42.42.10(pid=7004): Launched 23:11:49.254097 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 23:11:49.474866 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:11:49.802184 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7005): Launched 23:11:50.086001 run iperf3-srv_10.42.42.10(pid=7006): Launched 23:11:50.209299 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 23:11:50.428882 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:11:50.756876 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7007): Launched 23:11:51.040362 run iperf3-srv_10.42.42.10(pid=7008): Launched 23:11:51.162834 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 23:11:51.383283 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:11:51.710674 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7009): Launched 23:11:51.994451 run iperf3-srv_10.42.42.10(pid=7010): Launched 23:11:52.117012 tst iperf3m4.py:8: start network... 23:11:52.337153 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:11:52.842901 run create_hlr_db(pid=7011): Launched 23:11:52.975084 bus /gobi_6: Setting Powered False 23:11:54.038808 run create_hlr_db(pid=7011): Terminated: ok {rc=0} 23:11:54.473603 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7013): Launched 23:11:54.782249 run osmo-hlr_10.42.42.2(pid=7014): Launched 23:11:54.899675 run osmo-stp_10.42.42.5: Starting osmo-stp 23:11:55.432790 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7016): Launched 23:11:55.738679 run osmo-stp_10.42.42.5(pid=7017): Launched 23:11:55.855382 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:11:56.383497 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7019): Launched 23:11:56.500768 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:11:56.760242 run patchelf(pid=7020): Launched 23:11:56.931114 run osmo-stp_10.42.42.5(pid=7017): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7017)] 23:11:57.060814 run osmo-stp_10.42.42.5(pid=7017): stdout: | (launched: 2022-12-12_23:11:55.682515) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:11:57.191844 run osmo-stp_10.42.42.5(pid=7017): stderr: | [0;m[38;5;43m20221212231155855 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231155855 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231155855 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231155856 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231155856 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231155856 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231155856 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:11:57.323055 run osmo-stp_10.42.42.5(pid=7017): stdout: | (launched: 2022-12-12_23:11:55.682515) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:11:57.448763 run osmo-stp_10.42.42.5(pid=7017): stderr: | [0;m[38;5;43m20221212231155855 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231155855 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231155855 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231155856 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231155856 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231155856 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231155856 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:11:57.598070 run patchelf(pid=7020): Terminating (SIGINT) 23:11:57.771761 run patchelf(pid=7020): Terminated: ok {rc=0} 23:11:57.896311 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7017): Process ended prematurely: osmo-stp_10.42.42.5(pid=7017) [trial-2383↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7017)] [trial-2383↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 23:11:57.905916 tst iperf3m4.py:8: Test FAILED (10.8 sec) 23:11:57.933452 run osmo-hlr_10.42.42.2(pid=7014): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7014)] 23:11:57.981386 run osmo-hlr_10.42.42.2(pid=7014): stdout: | (launched: 2022-12-12_23:11:54.725980) 23:11:58.030686 run osmo-hlr_10.42.42.2(pid=7014): stderr: | [0;m[1;31m20221212231154903 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212231154903 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212231154903 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212231154903 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212231154903 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212231154903 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212231154920 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212231154930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212231154930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212231154930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:11:58.080228 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7003): Terminating (SIGTERM) 23:11:58.119771 run iperf3-srv_10.42.42.10(pid=7004): Terminating (SIGTERM) 23:11:58.159384 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7005): Terminating (SIGTERM) 23:11:58.199569 run iperf3-srv_10.42.42.10(pid=7006): Terminating (SIGTERM) 23:11:58.239396 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7007): Terminating (SIGTERM) 23:11:58.278689 run iperf3-srv_10.42.42.10(pid=7008): Terminating (SIGTERM) 23:11:58.318552 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7009): Terminating (SIGTERM) 23:11:58.358386 run iperf3-srv_10.42.42.10(pid=7010): Terminating (SIGTERM) 23:11:58.398138 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7013): Terminating (SIGTERM) 23:11:58.437377 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7016): Terminating (SIGTERM) 23:11:58.477392 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7019): Terminating (SIGTERM) 23:11:58.517874 --- ParallelTerminationStrategy: PID 7003 died... 23:11:58.536901 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7003): Terminated: ok {rc=0} 23:11:58.581416 --- ParallelTerminationStrategy: PID 7004 died... 23:11:58.599857 run iperf3-srv_10.42.42.10(pid=7004): Terminated {rc=256} 23:11:58.643321 --- ParallelTerminationStrategy: PID 7005 died... 23:11:58.661881 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7005): Terminated: ok {rc=0} 23:11:58.705792 --- ParallelTerminationStrategy: PID 7006 died... 23:11:58.724269 run iperf3-srv_10.42.42.10(pid=7006): Terminated {rc=256} 23:11:58.768075 --- ParallelTerminationStrategy: PID 7007 died... 23:11:58.786586 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7007): Terminated: ok {rc=0} 23:11:58.830839 --- ParallelTerminationStrategy: PID 7008 died... 23:11:58.849273 run iperf3-srv_10.42.42.10(pid=7008): Terminated {rc=256} 23:11:58.893330 --- ParallelTerminationStrategy: PID 7009 died... 23:11:58.911942 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7009): Terminated: ok {rc=0} 23:11:58.955720 --- ParallelTerminationStrategy: PID 7010 died... 23:11:58.974170 run iperf3-srv_10.42.42.10(pid=7010): Terminated {rc=256} 23:11:59.018394 --- ParallelTerminationStrategy: PID 7013 died... 23:11:59.036865 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7013): Terminated: ok {rc=0} 23:11:59.080848 --- ParallelTerminationStrategy: PID 7016 died... 23:11:59.099735 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7016): Terminated: ok {rc=0} 23:11:59.143425 --- ParallelTerminationStrategy: PID 7019 died... 23:11:59.162392 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7019): Terminated: ok {rc=0} 23:11:59.247527 bus /gobi_4: Setting Powered False 23:12:00.347715 bus /gobi_4: Setting Powered False 23:12:01.474287 bus /gobi_1: Setting Powered False 23:12:02.572580 bus /gobi_1: Setting Powered False 23:12:03.687878 bus /gobi_0: Setting Powered False 23:12:04.785524 bus /gobi_0: Setting Powered False 23:12:05.903097 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 23:12:07.004806 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:12:07.016418 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:12:07.077179 tst ping.py: using LAC 32159 23:12:07.197262 tst ping.py: using RAC 29 23:12:07.315046 tst ping.py: using CellId 32159 23:12:07.438715 tst ping.py: using BVCI 32160 23:12:07.549398 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:12:07.560394 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:12:07.571207 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:12:07.582375 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:12:07.593344 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:12:07.604455 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:12:07.615652 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:12:07.626696 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:12:07.741732 tst ping.py:19: start network... 23:12:07.943650 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:12:08.408486 run create_hlr_db(pid=7021): Launched 23:12:08.523214 bus /gobi_6: Setting Powered False 23:12:09.583353 run create_hlr_db(pid=7021): Terminated: ok {rc=0} 23:12:10.021966 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7023): Launched 23:12:10.342969 run osmo-hlr_10.42.42.2(pid=7024): Launched 23:12:10.465986 run osmo-stp_10.42.42.5: Starting osmo-stp 23:12:11.025610 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7026): Launched 23:12:11.346523 run osmo-stp_10.42.42.5(pid=7027): Launched 23:12:11.468002 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:12:12.020235 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7029): Launched 23:12:12.142808 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:12:12.413553 run patchelf(pid=7030): Launched 23:12:12.592311 run osmo-stp_10.42.42.5(pid=7027): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7027)] 23:12:12.728455 run osmo-stp_10.42.42.5(pid=7027): stdout: | (launched: 2022-12-12_23:12:11.288242) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:12:12.865952 run osmo-stp_10.42.42.5(pid=7027): stderr: | [0;m[38;5;43m20221212231211479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231211479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231211479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231211480 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231211480 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231211480 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231211480 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:12:13.003326 run osmo-stp_10.42.42.5(pid=7027): stdout: | (launched: 2022-12-12_23:12:11.288242) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:12:13.134951 run osmo-stp_10.42.42.5(pid=7027): stderr: | [0;m[38;5;43m20221212231211479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231211479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231211479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231211480 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231211480 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231211480 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231211480 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:12:13.291915 run patchelf(pid=7030): Terminating (SIGINT) 23:12:13.474056 run patchelf(pid=7030): Terminated: ok {rc=0} 23:12:13.605006 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=7027): Process ended prematurely: osmo-stp_10.42.42.5(pid=7027) [trial-2383↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7027)] [trial-2383↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22] 23:12:13.614683 tst ping.py:22: Test FAILED (6.6 sec) 23:12:13.642640 run osmo-hlr_10.42.42.2(pid=7024): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7024)] 23:12:13.692082 run osmo-hlr_10.42.42.2(pid=7024): stdout: | (launched: 2022-12-12_23:12:10.284656) 23:12:13.743362 run osmo-hlr_10.42.42.2(pid=7024): stderr: | [0;m[1;31m20221212231210483 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212231210483 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212231210483 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212231210483 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212231210483 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212231210483 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212231210495 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212231210503 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212231210504 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212231210504 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:12:13.794968 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7023): Terminating (SIGTERM) 23:12:13.836293 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7026): Terminating (SIGTERM) 23:12:13.877838 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7029): Terminating (SIGTERM) 23:12:13.919468 --- ParallelTerminationStrategy: PID 7023 died... 23:12:13.939449 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7023): Terminated: ok {rc=0} 23:12:13.985067 --- ParallelTerminationStrategy: PID 7026 died... 23:12:14.004534 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7026): Terminated: ok {rc=0} 23:12:14.050361 --- ParallelTerminationStrategy: PID 7029 died... 23:12:14.069809 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7029): Terminated: ok {rc=0} 23:12:14.155492 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 23:12:15.242417 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:12:15.254604 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:12:15.315452 tst ping_idle_ping.py: using LAC 32160 23:12:15.437555 tst ping_idle_ping.py: using RAC 30 23:12:15.556772 tst ping_idle_ping.py: using CellId 32160 23:12:15.674295 tst ping_idle_ping.py: using BVCI 32161 23:12:15.785990 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:12:15.797170 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:12:15.808008 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:12:15.819608 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:12:15.831216 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:12:15.850643 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:12:15.863393 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:12:15.875925 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:12:16.003598 tst ping_idle_ping.py:24: start network... 23:12:16.212375 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:12:16.701059 run create_hlr_db(pid=7031): Launched 23:12:16.870336 bus /gobi_6: Setting Powered False 23:12:17.930408 run create_hlr_db(pid=7031): Terminated: ok {rc=0} 23:12:18.422664 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7033): Launched 23:12:18.742431 run osmo-hlr_10.42.42.2(pid=7034): Launched 23:12:18.864098 run osmo-stp_10.42.42.5: Starting osmo-stp 23:12:19.421524 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7036): Launched 23:12:19.741138 run osmo-stp_10.42.42.5(pid=7037): Launched 23:12:19.862712 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:12:20.415182 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7039): Launched 23:12:20.537429 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:12:20.807262 run patchelf(pid=7040): Launched 23:12:20.984822 run osmo-stp_10.42.42.5(pid=7037): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7037)] 23:12:21.120381 run osmo-stp_10.42.42.5(pid=7037): stdout: | (launched: 2022-12-12_23:12:19.682917) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:12:21.258377 run osmo-stp_10.42.42.5(pid=7037): stderr: | [0;m[38;5;43m20221212231219876 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231219877 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231219877 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231219877 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231219878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231219878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231219878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:12:21.395518 run osmo-stp_10.42.42.5(pid=7037): stdout: | (launched: 2022-12-12_23:12:19.682917) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:12:21.526643 run osmo-stp_10.42.42.5(pid=7037): stderr: | [0;m[38;5;43m20221212231219876 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231219877 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231219877 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231219877 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231219878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231219878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231219878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:12:21.681541 run patchelf(pid=7040): Terminating (SIGINT) 23:12:21.862420 run patchelf(pid=7040): Terminated: ok {rc=0} 23:12:21.992444 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=7037): Process ended prematurely: osmo-stp_10.42.42.5(pid=7037) [trial-2383↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7037)] [trial-2383↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 23:12:22.002009 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 23:12:22.029769 run osmo-hlr_10.42.42.2(pid=7034): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7034)] 23:12:22.079433 run osmo-hlr_10.42.42.2(pid=7034): stdout: | (launched: 2022-12-12_23:12:18.684375) 23:12:22.130825 run osmo-hlr_10.42.42.2(pid=7034): stderr: | [0;m[1;31m20221212231218883 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212231218883 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212231218883 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212231218883 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212231218883 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212231218883 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212231218895 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212231218903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212231218903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212231218904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:12:22.182499 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7033): Terminating (SIGTERM) 23:12:22.224104 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7036): Terminating (SIGTERM) 23:12:22.265546 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7039): Terminating (SIGTERM) 23:12:22.307061 --- ParallelTerminationStrategy: PID 7033 died... 23:12:22.326946 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7033): Terminated: ok {rc=0} 23:12:22.372543 --- ParallelTerminationStrategy: PID 7036 died... 23:12:22.391953 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7036): Terminated: ok {rc=0} 23:12:22.437464 --- ParallelTerminationStrategy: PID 7039 died... 23:12:22.456862 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7039): Terminated: ok {rc=0} 23:12:22.545037 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2383 gprs:nanobts+band-1900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 23:12:23.844019 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:12:23.852102 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 23:12:23.877693 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 23:12:23.913343 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 23:12:23.976067 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 23:12:24.000856 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 23:12:24.036102 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 23:12:24.595695 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2383 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 23:12:24.603094 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:12:24.615896 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 23:12:24.681993 tst switch_tch_pdch.py: using LAC 32161 23:12:24.807549 tst switch_tch_pdch.py: using RAC 31 23:12:24.932840 tst switch_tch_pdch.py: using CellId 32161 23:12:25.058458 tst switch_tch_pdch.py: using BVCI 32162 23:12:25.177333 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:12:25.189408 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:12:25.201216 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:12:25.213530 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:12:25.225592 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:12:25.237431 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:12:25.249422 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:12:25.261682 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:12:25.378486 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:12:25.496249 tst switch_tch_pdch.py:51: start network... 23:12:25.698800 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:12:26.163182 run create_hlr_db(pid=7045): Launched 23:12:26.278585 bus /gobi_6: Setting Powered False 23:12:27.339576 run create_hlr_db(pid=7045): Terminated: ok {rc=0} 23:12:27.775260 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7047): Launched 23:12:28.075467 run osmo-hlr_10.42.42.2(pid=7048): Launched 23:12:28.190008 run osmo-stp_10.42.42.5: Starting osmo-stp 23:12:28.706140 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7050): Launched 23:12:29.005531 run osmo-stp_10.42.42.5(pid=7051): Launched 23:12:29.121459 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:12:29.643210 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7053): Launched 23:12:29.758444 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:12:30.012518 run patchelf(pid=7054): Launched 23:12:30.180260 run osmo-stp_10.42.42.5(pid=7051): ERR: Terminated: ERROR {rc=1} [trial-2383↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7051)] 23:12:30.308130 run osmo-stp_10.42.42.5(pid=7051): stdout: | (launched: 2022-12-12_23:12:28.950564) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:12:30.437527 run osmo-stp_10.42.42.5(pid=7051): stderr: | [0;m[38;5;43m20221212231229121 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231229121 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231229121 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231229122 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231229122 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231229122 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231229122 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:12:30.566691 run osmo-stp_10.42.42.5(pid=7051): stdout: | (launched: 2022-12-12_23:12:28.950564) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:12:30.690329 run osmo-stp_10.42.42.5(pid=7051): stderr: | [0;m[38;5;43m20221212231229121 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231229121 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231229121 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231229122 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231229122 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231229122 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231229122 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:12:30.842516 run patchelf(pid=7054): Terminating (SIGINT) 23:12:31.034066 run patchelf(pid=7054): Terminated: ok {rc=0} 23:12:31.200282 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=7051): Process ended prematurely: osmo-stp_10.42.42.5(pid=7051) [trial-2383↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7051)] [trial-2383↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 23:12:31.213856 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 23:12:31.251697 run osmo-hlr_10.42.42.2(pid=7048): ERR: Terminated: ERROR {rc=237} [trial-2383↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7048)] 23:12:31.312281 run osmo-hlr_10.42.42.2(pid=7048): stdout: | (launched: 2022-12-12_23:12:28.020784) 23:12:31.368093 run osmo-hlr_10.42.42.2(pid=7048): stderr: | [0;m[1;31m20221212231228199 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212231228199 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212231228199 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212231228199 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212231228199 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212231228199 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212231228211 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212231228221 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212231228221 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212231228221 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:12:31.421814 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7047): Terminating (SIGTERM) 23:12:31.464713 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7050): Terminating (SIGTERM) 23:12:31.508666 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7053): Terminating (SIGTERM) 23:12:31.553913 --- ParallelTerminationStrategy: PID 7047 died... 23:12:31.573950 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7047): Terminated: ok {rc=0} 23:12:31.623339 --- ParallelTerminationStrategy: PID 7050 died... 23:12:31.643618 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7050): Terminated: ok {rc=0} 23:12:31.690592 --- ParallelTerminationStrategy: PID 7053 died... 23:12:31.710503 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7053): Terminated: ok {rc=0} 23:12:31.799221 bus /gobi_0: Setting Powered False 23:12:32.896663 bus /gobi_0: Setting Powered False 23:12:34.011270 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2383 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 sms:nanobts+band-900 --------------------------------------------------------------------- 23:12:35.260475 tst sms:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:12:35.266589 tst sms:nanobts+band-900: Verifying 1 x bts (candidates: 11) 23:12:35.300096 tst sms:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 23:12:35.326480 tst sms:nanobts+band-900: Verifying 2 x modem (candidates: 12) 23:12:35.379711 tst sms:nanobts+band-900: Reserving 1 x bts (candidates: 11) 23:12:35.412882 tst sms:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 23:12:35.439417 tst sms:nanobts+band-900: Reserving 2 x modem (candidates: 12) 23:12:35.982907 tst sms:nanobts+band-900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 sms:nanobts+band-900 mo_mt_sms.py ---------------------------------------------- 23:12:35.988058 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 23:12:35.998766 tst sms:nanobts+band-900: Using 1 x bts (candidates: 1) 23:12:36.044638 tst mo_mt_sms.py: using LAC 32162 23:12:36.162801 tst mo_mt_sms.py: using RAC 32 23:12:36.282574 tst mo_mt_sms.py: using CellId 32162 23:12:36.400202 tst mo_mt_sms.py: using BVCI 32163 23:12:36.509050 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 23:12:36.519570 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 23:12:36.530161 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 23:12:36.540708 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 23:12:36.551140 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 23:12:36.562644 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 23:12:36.681497 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 23:12:36.801611 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:12:37.298130 run create_hlr_db(pid=7058): Launched 23:12:37.428883 bus /gobi_6: Setting Powered False 23:12:38.488568 run create_hlr_db(pid=7058): Terminated: ok {rc=0} 23:12:38.936157 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7060): Launched 23:12:39.254748 run osmo-hlr_10.42.42.2(pid=7061): Launched 23:12:39.376572 run osmo-stp_10.42.42.5: Starting osmo-stp 23:12:39.930625 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7063): Launched 23:12:40.250368 run osmo-stp_10.42.42.5(pid=7064): Launched 23:12:40.372932 run osmo-msc_10.42.42.6: Starting osmo-msc 23:12:40.951086 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7066): Launched 23:12:41.271680 run osmo-msc_10.42.42.6(pid=7067): Launched 23:12:41.452217 run osmo-stp_10.42.42.5(pid=7064): ERR: Terminated: ERROR {rc=1} [trial-2383↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7064)] 23:12:41.587671 run osmo-stp_10.42.42.5(pid=7064): stdout: | (launched: 2022-12-12_23:12:40.191957) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:12:41.723590 run osmo-stp_10.42.42.5(pid=7064): stderr: | [0;m[38;5;43m20221212231240386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231240387 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231240387 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231240387 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231240388 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231240388 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231240388 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:12:41.858648 run osmo-stp_10.42.42.5(pid=7064): stdout: | (launched: 2022-12-12_23:12:40.191957) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:12:41.986099 run osmo-stp_10.42.42.5(pid=7064): stderr: | [0;m[38;5;43m20221212231240386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231240387 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231240387 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231240387 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231240388 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231240388 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231240388 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:12:42.138443 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=7064): Process ended prematurely: osmo-stp_10.42.42.5(pid=7064) [trial-2383↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7064)] [trial-2383↪sms:nanobts+band-900↪mo_mt_sms.py:16] 23:12:42.147287 tst mo_mt_sms.py:16: Test FAILED (6.2 sec) 23:12:42.174422 run osmo-hlr_10.42.42.2(pid=7061): ERR: Terminated: ERROR {rc=237} [trial-2383↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7061)] 23:12:42.224184 run osmo-hlr_10.42.42.2(pid=7061): stdout: | (launched: 2022-12-12_23:12:39.196511) 23:12:42.275508 run osmo-hlr_10.42.42.2(pid=7061): stderr: | [0;m[1;31m20221212231239396 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212231239396 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212231239396 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212231239396 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212231239396 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212231239396 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212231239409 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/sms:nanobts+band-900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212231239418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212231239418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212231239418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:12:42.346845 run osmo-msc_10.42.42.6(pid=7067): ERR: Terminated: ERROR {rc=2} [trial-2383↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7067)] 23:12:42.396022 run osmo-msc_10.42.42.6(pid=7067): stdout: | (launched: 2022-12-12_23:12:41.212751) 23:12:42.446762 run osmo-msc_10.42.42.6(pid=7067): stderr: | [0;m[38;5;43m20221212231241534 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212231241534 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa78f42cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212231241534 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212231241534 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212231241534 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212231241535 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212231241536 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212231241537 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212231241537 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212231241537 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:12:42.498088 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7060): Terminating (SIGTERM) 23:12:42.539236 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7063): Terminating (SIGTERM) 23:12:42.580663 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7066): Terminating (SIGTERM) 23:12:42.622395 --- ParallelTerminationStrategy: PID 7060 died... 23:12:42.642256 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7060): Terminated: ok {rc=0} 23:12:42.687986 --- ParallelTerminationStrategy: PID 7063 died... 23:12:42.707397 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7063): Terminated: ok {rc=0} 23:12:42.753622 --- ParallelTerminationStrategy: PID 7066 died... 23:12:42.773108 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7066): Terminated: ok {rc=0} 23:12:42.859708 bus /sierra_3: Setting Powered False 23:12:43.957817 bus /sierra_3: Setting Powered False 23:12:45.074682 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 sms:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 nitb_ussd:nanobts+band-900 --------------------------------------------------------------------- 23:12:46.313179 tst nitb_ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:12:46.318730 tst nitb_ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 23:12:46.352712 tst nitb_ussd:nanobts+band-900: Verifying 1 x ip_address (candidates: 9) 23:12:46.360245 tst nitb_ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 23:12:46.399737 tst nitb_ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 23:12:46.433849 tst nitb_ussd:nanobts+band-900: Reserving 1 x ip_address (candidates: 9) 23:12:46.442291 tst nitb_ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 23:12:46.964333 tst nitb_ussd:nanobts+band-900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2383 nitb_ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 23:12:46.971639 tst nitb_ussd:nanobts+band-900: Using 1 x ip_address (candidates: 1) 23:12:46.985661 tst nitb_ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 23:12:47.043670 tst assert_extension.py: using LAC 32163 23:12:47.170209 tst assert_extension.py: using RAC 33 23:12:47.301503 tst assert_extension.py: using CellId 32163 23:12:47.428673 tst assert_extension.py: using BVCI 32164 23:12:47.546852 tst nitb_ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 23:12:47.666428 tst assert_extension.py:10: start nitb and bts... 23:12:47.881955 run osmo-nitb_10.42.42.2: Starting osmo-nitb 23:12:48.532509 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7072): Launched 23:12:48.852560 run osmo-nitb_10.42.42.2(pid=7073): Launched 23:12:49.028865 run osmo-nitb_10.42.42.2(pid=7073): ERR: Terminated: ERROR {rc=2} [trial-2383↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7073)] 23:12:49.172043 run osmo-nitb_10.42.42.2(pid=7073): stdout: | (launched: 2022-12-12_23:12:48.793653) 23:12:49.317040 run osmo-nitb_10.42.42.2(pid=7073): stderr: | (launched: 2022-12-12_23:12:48.841366) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:12:49.461866 run osmo-nitb_10.42.42.2(pid=7073): stdout: | (launched: 2022-12-12_23:12:48.793653) 23:12:49.600621 run osmo-nitb_10.42.42.2(pid=7073): stderr: | (launched: 2022-12-12_23:12:48.841366) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fa469b2b268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=7073): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7073) [trial-2383↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7073)] 23:12:49.972502 tst osmo-nitb_10.42.42.2(pid=7073): stdout: | (launched: 2022-12-12_23:12:48.793653) 23:12:50.101494 tst osmo-nitb_10.42.42.2(pid=7073): stderr: | (launched: 2022-12-12_23:12:48.841366) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:12:50.254353 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=7073): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7073) [trial-2383↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7073)] [trial-2383↪nitb_ussd:nanobts+band-900↪assert_extension.py:12] 23:12:50.263309 tst assert_extension.py:12: Test FAILED (3.3 sec) 23:12:50.270420 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7072): Terminating (SIGTERM) 23:12:50.480801 --- ParallelTerminationStrategy: PID 7072 died... 23:12:50.502938 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7072): Terminated: ok {rc=0} 23:12:50.589971 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 nitb_ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 ussd:nanobts+band-900 --------------------------------------------------------------------- 23:12:51.768850 tst ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:12:51.774701 tst ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 23:12:51.808113 tst ussd:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 23:12:51.835877 tst ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 23:12:51.871068 tst ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 23:12:51.904475 tst ussd:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 23:12:51.932327 tst ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 23:12:52.461913 tst ussd:nanobts+band-900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2383 ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 23:12:52.467327 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 23:12:52.478741 tst ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 23:12:52.525540 tst assert_extension.py: using LAC 32164 23:12:52.653962 tst assert_extension.py: using RAC 34 23:12:52.781151 tst assert_extension.py: using CellId 32164 23:12:52.906599 tst assert_extension.py: using BVCI 32165 23:12:53.023932 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 23:12:53.035216 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 23:12:53.046252 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 23:12:53.057214 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 23:12:53.068190 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 23:12:53.079255 tst ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 23:12:53.193398 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:12:53.660714 run create_hlr_db(pid=7077): Launched 23:12:53.776762 bus /sierra_2: Setting Powered False 23:12:54.837137 run create_hlr_db(pid=7077): Terminated: ok {rc=0} 23:12:55.276295 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7079): Launched 23:12:55.601841 run osmo-hlr_10.42.42.2(pid=7080): Launched 23:12:55.724638 run osmo-stp_10.42.42.5: Starting osmo-stp 23:12:56.282631 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7082): Launched 23:12:56.602729 run osmo-stp_10.42.42.5(pid=7083): Launched 23:12:56.725861 run osmo-msc_10.42.42.6: Starting osmo-msc 23:12:57.305875 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7085): Launched 23:12:57.626468 run osmo-msc_10.42.42.6(pid=7086): Launched 23:12:57.804554 run osmo-stp_10.42.42.5(pid=7083): ERR: Terminated: ERROR {rc=1} [trial-2383↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7083)] 23:12:57.939039 run osmo-stp_10.42.42.5(pid=7083): stdout: | (launched: 2022-12-12_23:12:56.544198) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:12:58.073731 run osmo-stp_10.42.42.5(pid=7083): stderr: | [0;m[38;5;43m20221212231256735 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231256735 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231256735 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231256735 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231256736 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231256736 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231256736 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:12:58.207771 run osmo-stp_10.42.42.5(pid=7083): stdout: | (launched: 2022-12-12_23:12:56.544198) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:12:58.335241 run osmo-stp_10.42.42.5(pid=7083): stderr: | [0;m[38;5;43m20221212231256735 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231256735 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231256735 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231256735 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231256736 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231256736 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231256736 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:12:58.487076 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=7083): Process ended prematurely: osmo-stp_10.42.42.5(pid=7083) [trial-2383↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7083)] [trial-2383↪ussd:nanobts+band-900↪assert_extension.py:17] 23:12:58.495661 tst assert_extension.py:17: Test FAILED (6.0 sec) 23:12:58.522900 run osmo-hlr_10.42.42.2(pid=7080): ERR: Terminated: ERROR {rc=237} [trial-2383↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7080)] 23:12:58.572380 run osmo-hlr_10.42.42.2(pid=7080): stdout: | (launched: 2022-12-12_23:12:55.539190) 23:12:58.623734 run osmo-hlr_10.42.42.2(pid=7080): stderr: | [0;m[1;31m20221212231255737 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212231255737 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212231255737 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212231255737 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212231255737 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212231255737 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212231255750 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/ussd:nanobts+band-900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212231255760 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212231255760 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212231255760 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:12:58.695104 run osmo-msc_10.42.42.6(pid=7086): ERR: Terminated: ERROR {rc=2} [trial-2383↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7086)] 23:12:58.744444 run osmo-msc_10.42.42.6(pid=7086): stdout: | (launched: 2022-12-12_23:12:57.568055) 23:12:58.795591 run osmo-msc_10.42.42.6(pid=7086): stderr: | [0;m[38;5;43m20221212231257893 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212231257893 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff750574c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212231257893 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212231257893 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212231257893 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212231257893 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212231257895 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212231257895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212231257896 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212231257896 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:12:58.847096 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7079): Terminating (SIGTERM) 23:12:58.888193 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7082): Terminating (SIGTERM) 23:12:58.929453 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7085): Terminating (SIGTERM) 23:12:58.970994 --- ParallelTerminationStrategy: PID 7079 died... 23:12:58.990840 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7079): Terminated: ok {rc=0} 23:12:59.036389 --- ParallelTerminationStrategy: PID 7082 died... 23:12:59.055861 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7082): Terminated: ok {rc=0} 23:12:59.101351 --- ParallelTerminationStrategy: PID 7085 died... 23:12:59.120491 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7085): Terminated: ok {rc=0} 23:12:59.206429 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 23:13:00.423419 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:13:00.431422 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 23:13:00.464680 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 23:13:00.492507 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 23:13:00.543985 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 23:13:00.576882 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 23:13:00.604025 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 23:13:01.177428 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 23:13:01.233383 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:13:01.246053 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 23:13:01.314179 tst mo_mt_call.py: using LAC 32165 23:13:01.440664 tst mo_mt_call.py: using RAC 35 23:13:01.564556 tst mo_mt_call.py: using CellId 32165 23:13:01.689175 tst mo_mt_call.py: using BVCI 32166 23:13:01.843563 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:13:01.859507 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:13:01.875228 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:13:01.890444 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:13:01.904842 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:13:01.918636 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 23:13:02.041204 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 23:13:02.162519 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:13:02.671317 run create_hlr_db(pid=7091): Launched 23:13:02.804273 bus /sierra_2: Setting Powered False 23:13:03.869201 run create_hlr_db(pid=7091): Terminated: ok {rc=0} 23:13:04.321447 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7093): Launched 23:13:04.648355 run osmo-hlr_10.42.42.2(pid=7094): Launched 23:13:04.772376 run osmo-stp_10.42.42.5: Starting osmo-stp 23:13:05.333220 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7096): Launched 23:13:05.659225 run osmo-stp_10.42.42.5(pid=7097): Launched 23:13:05.783630 run osmo-msc_10.42.42.6: Starting osmo-msc 23:13:06.373371 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7099): Launched 23:13:06.700289 run osmo-msc_10.42.42.6(pid=7100): Launched 23:13:06.882152 run osmo-stp_10.42.42.5(pid=7097): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7097)] 23:13:07.018662 run osmo-stp_10.42.42.5(pid=7097): stdout: | (launched: 2022-12-12_23:13:05.599666) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:13:07.156186 run osmo-stp_10.42.42.5(pid=7097): stderr: | [0;m[38;5;43m20221212231305795 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231305795 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231305795 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231305796 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231305796 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231305796 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231305796 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:13:07.293300 run osmo-stp_10.42.42.5(pid=7097): stdout: | (launched: 2022-12-12_23:13:05.599666) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:13:07.422477 run osmo-stp_10.42.42.5(pid=7097): stderr: | [0;m[38;5;43m20221212231305795 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231305795 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231305795 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231305796 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231305796 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231305796 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231305796 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:13:07.577209 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7097): Process ended prematurely: osmo-stp_10.42.42.5(pid=7097) [trial-2383↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7097)] [trial-2383↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 23:13:07.586460 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 23:13:07.614572 run osmo-hlr_10.42.42.2(pid=7094): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7094)] 23:13:07.664192 run osmo-hlr_10.42.42.2(pid=7094): stdout: | (launched: 2022-12-12_23:13:04.588857) 23:13:07.715266 run osmo-hlr_10.42.42.2(pid=7094): stderr: | [0;m[1;31m20221212231304790 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212231304790 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212231304790 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212231304790 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212231304790 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212231304790 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212231304803 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212231304811 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212231304812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212231304812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:13:07.786769 run osmo-msc_10.42.42.6(pid=7100): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7100)] 23:13:07.836138 run osmo-msc_10.42.42.6(pid=7100): stdout: | (launched: 2022-12-12_23:13:06.640497) 23:13:07.887128 run osmo-msc_10.42.42.6(pid=7100): stderr: | [0;m[38;5;43m20221212231306966 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212231306966 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fcb0aad3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212231306966 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212231306967 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212231306967 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212231306967 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212231306969 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212231306969 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212231306969 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212231306969 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:13:07.938593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7093): Terminating (SIGTERM) 23:13:07.979665 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7096): Terminating (SIGTERM) 23:13:08.020753 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7099): Terminating (SIGTERM) 23:13:08.062348 --- ParallelTerminationStrategy: PID 7093 died... 23:13:08.082327 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7093): Terminated: ok {rc=0} 23:13:08.127835 --- ParallelTerminationStrategy: PID 7096 died... 23:13:08.147198 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7096): Terminated: ok {rc=0} 23:13:08.192535 --- ParallelTerminationStrategy: PID 7099 died... 23:13:08.212045 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7099): Terminated: ok {rc=0} 23:13:08.299768 bus /sierra_3: Setting Powered False 23:13:09.396910 bus /sierra_3: Setting Powered False 23:13:10.512730 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2383 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 23:13:11.661527 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:13:11.673774 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 23:13:11.741847 tst mo_mt_call_osmux.py: using LAC 32166 23:13:11.869707 tst mo_mt_call_osmux.py: using RAC 36 23:13:11.999636 tst mo_mt_call_osmux.py: using CellId 32166 23:13:12.127536 tst mo_mt_call_osmux.py: using BVCI 32167 23:13:12.246557 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:13:12.258371 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:13:12.269886 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:13:12.281423 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:13:12.293114 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:13:12.304550 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 23:13:12.423552 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 23:13:12.544670 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:13:13.052216 run create_hlr_db(pid=7102): Launched 23:13:13.184316 bus /sierra_2: Setting Powered False 23:13:14.249281 run create_hlr_db(pid=7102): Terminated: ok {rc=0} 23:13:14.686184 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7104): Launched 23:13:14.992615 run osmo-hlr_10.42.42.2(pid=7105): Launched 23:13:15.110242 run osmo-stp_10.42.42.5: Starting osmo-stp 23:13:15.653493 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7107): Launched 23:13:15.982696 run osmo-stp_10.42.42.5(pid=7108): Launched 23:13:16.250904 run osmo-msc_10.42.42.6: Starting osmo-msc 23:13:16.941515 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7110): Launched 23:13:17.294865 run osmo-msc_10.42.42.6(pid=7111): Launched 23:13:17.495123 run osmo-stp_10.42.42.5(pid=7108): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7108)] 23:13:17.625872 run osmo-stp_10.42.42.5(pid=7108): stdout: | (launched: 2022-12-12_23:13:15.914983) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:13:17.756026 run osmo-stp_10.42.42.5(pid=7108): stderr: | [0;m[38;5;43m20221212231316105 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231316105 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231316105 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231316106 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231316106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231316106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231316106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:13:17.884213 run osmo-stp_10.42.42.5(pid=7108): stdout: | (launched: 2022-12-12_23:13:15.914983) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:13:18.006589 run osmo-stp_10.42.42.5(pid=7108): stderr: | [0;m[38;5;43m20221212231316105 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231316105 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231316105 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231316106 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231316106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231316106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231316106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:13:18.152624 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7108): Process ended prematurely: osmo-stp_10.42.42.5(pid=7108) [trial-2383↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7108)] [trial-2383↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 23:13:18.161759 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 23:13:18.188363 run osmo-hlr_10.42.42.2(pid=7105): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7105)] 23:13:18.236476 run osmo-hlr_10.42.42.2(pid=7105): stdout: | (launched: 2022-12-12_23:13:14.936658) 23:13:18.286253 run osmo-hlr_10.42.42.2(pid=7105): stderr: | [0;m[1;31m20221212231315111 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212231315111 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212231315111 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212231315111 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212231315111 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212231315111 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212231315125 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212231315135 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212231315135 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212231315135 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:13:18.354897 run osmo-msc_10.42.42.6(pid=7111): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7111)] 23:13:18.402014 run osmo-msc_10.42.42.6(pid=7111): stdout: | (launched: 2022-12-12_23:13:17.229407) 23:13:18.451063 run osmo-msc_10.42.42.6(pid=7111): stderr: | [0;m[38;5;43m20221212231317536 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212231317536 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb7ab70bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212231317537 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212231317537 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212231317537 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212231317537 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212231317539 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212231317539 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212231317539 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212231317539 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:13:18.500481 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7104): Terminating (SIGTERM) 23:13:18.540283 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7107): Terminating (SIGTERM) 23:13:18.580066 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7110): Terminating (SIGTERM) 23:13:18.620291 --- ParallelTerminationStrategy: PID 7104 died... 23:13:18.639391 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7104): Terminated: ok {rc=0} 23:13:18.683774 --- ParallelTerminationStrategy: PID 7107 died... 23:13:18.702493 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7107): Terminated: ok {rc=0} 23:13:18.746539 --- ParallelTerminationStrategy: PID 7110 died... 23:13:18.765125 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7110): Terminated: ok {rc=0} 23:13:18.850430 bus /sierra_3: Setting Powered False 23:13:19.949031 bus /sierra_3: Setting Powered False 23:13:21.064545 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 23:13:22.326347 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:13:22.334406 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 23:13:22.367723 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 23:13:22.394988 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 23:13:22.446955 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 23:13:22.480025 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 23:13:22.507087 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 23:13:23.060251 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 23:13:23.112416 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:13:23.124192 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 23:13:23.191111 tst mo_mt_call.py: using LAC 32167 23:13:23.325640 tst mo_mt_call.py: using RAC 37 23:13:23.452723 tst mo_mt_call.py: using CellId 32167 23:13:23.578823 tst mo_mt_call.py: using BVCI 32168 23:13:23.697627 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:13:23.709280 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:13:23.720520 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:13:23.732174 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:13:23.743888 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:13:23.755466 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 23:13:23.875833 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 23:13:23.992457 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:13:24.497525 run create_hlr_db(pid=7116): Launched 23:13:24.629824 bus /sierra_2: Setting Powered False 23:13:25.694452 run create_hlr_db(pid=7116): Terminated: ok {rc=0} 23:13:26.130852 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7118): Launched 23:13:26.437475 run osmo-hlr_10.42.42.2(pid=7119): Launched 23:13:26.555552 run osmo-stp_10.42.42.5: Starting osmo-stp 23:13:27.101600 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7121): Launched 23:13:27.410670 run osmo-stp_10.42.42.5(pid=7122): Launched 23:13:27.529461 run osmo-msc_10.42.42.6: Starting osmo-msc 23:13:28.084023 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7124): Launched 23:13:28.389928 run osmo-msc_10.42.42.6(pid=7125): Launched 23:13:28.563068 run osmo-stp_10.42.42.5(pid=7122): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7122)] 23:13:28.693542 run osmo-stp_10.42.42.5(pid=7122): stdout: | (launched: 2022-12-12_23:13:27.354116) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:13:28.823304 run osmo-stp_10.42.42.5(pid=7122): stderr: | [0;m[38;5;43m20221212231327526 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231327526 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231327526 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231327526 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231327527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231327527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231327527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:13:28.950756 run osmo-stp_10.42.42.5(pid=7122): stdout: | (launched: 2022-12-12_23:13:27.354116) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:13:29.072258 run osmo-stp_10.42.42.5(pid=7122): stderr: | [0;m[38;5;43m20221212231327526 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231327526 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231327526 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231327526 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231327527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231327527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231327527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:13:29.217816 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7122): Process ended prematurely: osmo-stp_10.42.42.5(pid=7122) [trial-2383↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7122)] [trial-2383↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 23:13:29.226614 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 23:13:29.253053 run osmo-hlr_10.42.42.2(pid=7119): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7119)] 23:13:29.300539 run osmo-hlr_10.42.42.2(pid=7119): stdout: | (launched: 2022-12-12_23:13:26.381320) 23:13:29.349507 run osmo-hlr_10.42.42.2(pid=7119): stderr: | [0;m[1;31m20221212231326556 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212231326556 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212231326557 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212231326557 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212231326557 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212231326557 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212231326568 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212231326579 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212231326580 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212231326580 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:13:29.417858 run osmo-msc_10.42.42.6(pid=7125): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7125)] 23:13:29.465167 run osmo-msc_10.42.42.6(pid=7125): stdout: | (launched: 2022-12-12_23:13:28.334026) 23:13:29.513996 run osmo-msc_10.42.42.6(pid=7125): stderr: | [0;m[38;5;43m20221212231328604 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212231328604 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f567f3e7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212231328604 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212231328604 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212231328604 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212231328605 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212231328606 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212231328607 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212231328607 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212231328607 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:13:29.563248 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7118): Terminating (SIGTERM) 23:13:29.602656 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7121): Terminating (SIGTERM) 23:13:29.642140 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7124): Terminating (SIGTERM) 23:13:29.681891 --- ParallelTerminationStrategy: PID 7118 died... 23:13:29.700692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7118): Terminated: ok {rc=0} 23:13:29.744879 --- ParallelTerminationStrategy: PID 7121 died... 23:13:29.763567 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7121): Terminated: ok {rc=0} 23:13:29.807974 --- ParallelTerminationStrategy: PID 7124 died... 23:13:29.826548 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7124): Terminated: ok {rc=0} 23:13:29.910068 bus /sierra_3: Setting Powered False 23:13:31.004880 bus /sierra_3: Setting Powered False 23:13:32.122124 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2383 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 23:13:33.268794 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:13:33.280507 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 23:13:33.347227 tst mo_mt_call_osmux.py: using LAC 32168 23:13:33.469713 tst mo_mt_call_osmux.py: using RAC 38 23:13:33.601623 tst mo_mt_call_osmux.py: using CellId 32168 23:13:33.722838 tst mo_mt_call_osmux.py: using BVCI 32169 23:13:33.835431 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:13:33.846691 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:13:33.857646 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:13:33.868787 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:13:33.880081 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:13:33.891256 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 23:13:34.011441 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 23:13:34.130836 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:13:34.636831 run create_hlr_db(pid=7127): Launched 23:13:34.769086 bus /sierra_2: Setting Powered False 23:13:35.834356 run create_hlr_db(pid=7127): Terminated: ok {rc=0} 23:13:36.287489 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7129): Launched 23:13:36.613380 run osmo-hlr_10.42.42.2(pid=7130): Launched 23:13:36.738390 run osmo-stp_10.42.42.5: Starting osmo-stp 23:13:37.308121 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7132): Launched 23:13:37.635833 run osmo-stp_10.42.42.5(pid=7133): Launched 23:13:37.761242 run osmo-msc_10.42.42.6: Starting osmo-msc 23:13:38.353567 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7135): Launched 23:13:38.680059 run osmo-msc_10.42.42.6(pid=7136): Launched 23:13:38.862473 run osmo-stp_10.42.42.5(pid=7133): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7133)] 23:13:38.999645 run osmo-stp_10.42.42.5(pid=7133): stdout: | (launched: 2022-12-12_23:13:37.576085) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:13:39.137832 run osmo-stp_10.42.42.5(pid=7133): stderr: | [0;m[38;5;43m20221212231337771 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231337771 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231337771 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231337771 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231337772 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231337772 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231337772 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:13:39.275575 run osmo-stp_10.42.42.5(pid=7133): stdout: | (launched: 2022-12-12_23:13:37.576085) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:13:39.406000 run osmo-stp_10.42.42.5(pid=7133): stderr: | [0;m[38;5;43m20221212231337771 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231337771 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231337771 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231337771 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231337772 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231337772 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231337772 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:13:39.561821 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7133): Process ended prematurely: osmo-stp_10.42.42.5(pid=7133) [trial-2383↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7133)] [trial-2383↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 23:13:39.571534 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 23:13:39.599639 run osmo-hlr_10.42.42.2(pid=7130): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7130)] 23:13:39.649591 run osmo-hlr_10.42.42.2(pid=7130): stdout: | (launched: 2022-12-12_23:13:36.553989) 23:13:39.701120 run osmo-hlr_10.42.42.2(pid=7130): stderr: | [0;m[1;31m20221212231336751 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212231336751 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212231336751 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212231336751 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212231336751 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212231336752 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212231336764 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212231336773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212231336774 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212231336774 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:13:39.773324 run osmo-msc_10.42.42.6(pid=7136): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7136)] 23:13:39.822851 run osmo-msc_10.42.42.6(pid=7136): stdout: | (launched: 2022-12-12_23:13:38.620205) 23:13:39.874277 run osmo-msc_10.42.42.6(pid=7136): stderr: | [0;m[38;5;43m20221212231338943 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212231338944 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7efddadddc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212231338944 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212231338944 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212231338944 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212231338944 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212231338946 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212231338946 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212231338946 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212231338946 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:13:39.925703 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7129): Terminating (SIGTERM) 23:13:39.967279 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7132): Terminating (SIGTERM) 23:13:40.008777 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7135): Terminating (SIGTERM) 23:13:40.050548 --- ParallelTerminationStrategy: PID 7129 died... 23:13:40.070180 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7129): Terminated: ok {rc=0} 23:13:40.116285 --- ParallelTerminationStrategy: PID 7132 died... 23:13:40.135891 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7132): Terminated: ok {rc=0} 23:13:40.181746 --- ParallelTerminationStrategy: PID 7135 died... 23:13:40.201283 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7135): Terminated: ok {rc=0} 23:13:40.289198 bus /sierra_3: Setting Powered False 23:13:41.387247 bus /sierra_3: Setting Powered False 23:13:42.501810 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 23:13:43.753694 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:13:43.761806 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 23:13:43.795285 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 23:13:43.823272 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 23:13:43.882512 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 23:13:43.916462 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 23:13:43.943781 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 23:13:44.489420 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 23:13:44.542289 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:13:44.554183 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 23:13:44.624666 tst mo_mt_call.py: using LAC 32169 23:13:44.752178 tst mo_mt_call.py: using RAC 39 23:13:44.882457 tst mo_mt_call.py: using CellId 32169 23:13:45.010567 tst mo_mt_call.py: using BVCI 32170 23:13:45.130171 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:13:45.141796 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:13:45.153207 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:13:45.164800 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:13:45.176498 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:13:45.188686 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 23:13:45.304724 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 23:13:45.420399 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:13:45.929904 run create_hlr_db(pid=7141): Launched 23:13:46.103621 bus /sierra_2: Setting Powered False 23:13:47.166813 run create_hlr_db(pid=7141): Terminated: ok {rc=0} 23:13:47.623862 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7143): Launched 23:13:47.951217 run osmo-hlr_10.42.42.2(pid=7144): Launched 23:13:48.076122 run osmo-stp_10.42.42.5: Starting osmo-stp 23:13:48.642622 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7146): Launched 23:13:48.969273 run osmo-stp_10.42.42.5(pid=7147): Launched 23:13:49.094527 run osmo-msc_10.42.42.6: Starting osmo-msc 23:13:49.688810 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7149): Launched 23:13:50.016286 run osmo-msc_10.42.42.6(pid=7150): Launched 23:13:50.199061 run osmo-stp_10.42.42.5(pid=7147): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7147)] 23:13:50.336601 run osmo-stp_10.42.42.5(pid=7147): stdout: | (launched: 2022-12-12_23:13:48.909760) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:13:50.474558 run osmo-stp_10.42.42.5(pid=7147): stderr: | [0;m[38;5;43m20221212231349102 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231349102 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231349103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231349103 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231349105 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231349106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231349106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:13:50.611534 run osmo-stp_10.42.42.5(pid=7147): stdout: | (launched: 2022-12-12_23:13:48.909760) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:13:50.741306 run osmo-stp_10.42.42.5(pid=7147): stderr: | [0;m[38;5;43m20221212231349102 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231349102 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231349103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231349103 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231349105 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231349106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231349106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:13:50.896238 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7147): Process ended prematurely: osmo-stp_10.42.42.5(pid=7147) [trial-2383↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7147)] [trial-2383↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 23:13:50.906006 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 23:13:50.934106 run osmo-hlr_10.42.42.2(pid=7144): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7144)] 23:13:50.984057 run osmo-hlr_10.42.42.2(pid=7144): stdout: | (launched: 2022-12-12_23:13:47.891431) 23:13:51.035528 run osmo-hlr_10.42.42.2(pid=7144): stderr: | [0;m[1;31m20221212231348092 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212231348092 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212231348092 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212231348092 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212231348092 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212231348093 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212231348103 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212231348112 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212231348112 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212231348112 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:13:51.107543 run osmo-msc_10.42.42.6(pid=7150): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7150)] 23:13:51.156901 run osmo-msc_10.42.42.6(pid=7150): stdout: | (launched: 2022-12-12_23:13:49.956303) 23:13:51.207704 run osmo-msc_10.42.42.6(pid=7150): stderr: | [0;m[38;5;43m20221212231350282 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212231350282 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0aa60bcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212231350282 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212231350282 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212231350282 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212231350282 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212231350284 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212231350284 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212231350285 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212231350285 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:13:51.259128 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7143): Terminating (SIGTERM) 23:13:51.300576 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7146): Terminating (SIGTERM) 23:13:51.342309 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7149): Terminating (SIGTERM) 23:13:51.384263 --- ParallelTerminationStrategy: PID 7143 died... 23:13:51.404415 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7143): Terminated: ok {rc=0} 23:13:51.450962 --- ParallelTerminationStrategy: PID 7146 died... 23:13:51.470672 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7146): Terminated: ok {rc=0} 23:13:51.516897 --- ParallelTerminationStrategy: PID 7149 died... 23:13:51.536623 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7149): Terminated: ok {rc=0} 23:13:51.623070 bus /sierra_3: Setting Powered False 23:13:52.720498 bus /sierra_3: Setting Powered False 23:13:53.836864 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2383 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 23:13:54.986111 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:13:54.998490 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 23:13:55.070346 tst mo_mt_call_osmux.py: using LAC 32170 23:13:55.197367 tst mo_mt_call_osmux.py: using RAC 40 23:13:55.325585 tst mo_mt_call_osmux.py: using CellId 32170 23:13:55.450812 tst mo_mt_call_osmux.py: using BVCI 32171 23:13:55.563563 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:13:55.574775 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:13:55.585884 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:13:55.597204 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:13:55.608600 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:13:55.619932 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 23:13:55.740415 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 23:13:55.864541 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:13:56.372662 run create_hlr_db(pid=7152): Launched 23:13:56.506101 bus /sierra_2: Setting Powered False 23:13:57.570742 run create_hlr_db(pid=7152): Terminated: ok {rc=0} 23:13:58.008493 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7154): Launched 23:13:58.316898 run osmo-hlr_10.42.42.2(pid=7155): Launched 23:13:58.435334 run osmo-stp_10.42.42.5: Starting osmo-stp 23:13:58.965732 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7157): Launched 23:13:59.272211 run osmo-stp_10.42.42.5(pid=7158): Launched 23:13:59.390140 run osmo-msc_10.42.42.6: Starting osmo-msc 23:13:59.945608 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7160): Launched 23:14:00.254886 run osmo-msc_10.42.42.6(pid=7161): Launched 23:14:00.429375 run osmo-stp_10.42.42.5(pid=7158): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7158)] 23:14:00.560100 run osmo-stp_10.42.42.5(pid=7158): stdout: | (launched: 2022-12-12_23:13:59.216238) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:14:00.690073 run osmo-stp_10.42.42.5(pid=7158): stderr: | [0;m[38;5;43m20221212231359390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231359390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231359390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231359391 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231359391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231359391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231359391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:14:00.818131 run osmo-stp_10.42.42.5(pid=7158): stdout: | (launched: 2022-12-12_23:13:59.216238) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:14:00.976008 run osmo-stp_10.42.42.5(pid=7158): stderr: | [0;m[38;5;43m20221212231359390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231359390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231359390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231359391 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231359391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231359391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231359391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:14:01.139877 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7158): Process ended prematurely: osmo-stp_10.42.42.5(pid=7158) [trial-2383↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7158)] [trial-2383↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 23:14:01.150075 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 23:14:01.180196 run osmo-hlr_10.42.42.2(pid=7155): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7155)] 23:14:01.231947 run osmo-hlr_10.42.42.2(pid=7155): stdout: | (launched: 2022-12-12_23:13:58.260285) 23:14:01.285546 run osmo-hlr_10.42.42.2(pid=7155): stderr: | [0;m[1;31m20221212231358437 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212231358437 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212231358437 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212231358437 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212231358437 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212231358437 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212231358449 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212231358457 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212231358458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212231358458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:14:01.358892 run osmo-msc_10.42.42.6(pid=7161): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7161)] 23:14:01.411209 run osmo-msc_10.42.42.6(pid=7161): stdout: | (launched: 2022-12-12_23:14:00.197995) 23:14:01.463612 run osmo-msc_10.42.42.6(pid=7161): stderr: | [0;m[38;5;43m20221212231400472 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212231400472 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa71a366c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212231400473 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212231400473 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212231400473 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212231400473 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212231400475 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212231400475 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212231400475 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212231400475 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:14:01.516805 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7154): Terminating (SIGTERM) 23:14:01.560452 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7157): Terminating (SIGTERM) 23:14:01.606185 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7160): Terminating (SIGTERM) 23:14:01.651611 --- ParallelTerminationStrategy: PID 7154 died... 23:14:01.672639 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7154): Terminated: ok {rc=0} 23:14:01.721467 --- ParallelTerminationStrategy: PID 7157 died... 23:14:01.741596 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7157): Terminated: ok {rc=0} 23:14:01.790552 --- ParallelTerminationStrategy: PID 7160 died... 23:14:01.811176 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7160): Terminated: ok {rc=0} 23:14:01.900143 bus /sierra_3: Setting Powered False 23:14:02.999345 bus /sierra_3: Setting Powered False 23:14:04.113923 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 23:14:05.362124 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:14:05.369337 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 23:14:05.401446 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 23:14:05.427791 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 23:14:05.479454 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 23:14:05.511238 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 23:14:05.537292 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 23:14:06.089779 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 23:14:06.143174 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:14:06.155029 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 23:14:06.223003 tst mo_mt_call.py: using LAC 32171 23:14:06.351797 tst mo_mt_call.py: using RAC 41 23:14:06.481680 tst mo_mt_call.py: using CellId 32171 23:14:06.611667 tst mo_mt_call.py: using BVCI 32172 23:14:06.730795 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:14:06.742638 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:14:06.754202 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:14:06.766118 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:14:06.777915 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:14:06.789547 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 23:14:06.909425 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 23:14:07.029365 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:14:07.534753 run create_hlr_db(pid=7168): Launched 23:14:07.667185 bus /sierra_2: Setting Powered False 23:14:08.731279 run create_hlr_db(pid=7168): Terminated: ok {rc=0} 23:14:09.167725 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7170): Launched 23:14:09.473423 run osmo-hlr_10.42.42.2(pid=7171): Launched 23:14:09.591945 run osmo-stp_10.42.42.5: Starting osmo-stp 23:14:10.120704 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7173): Launched 23:14:10.427702 run osmo-stp_10.42.42.5(pid=7174): Launched 23:14:10.546302 run osmo-msc_10.42.42.6: Starting osmo-msc 23:14:11.099697 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7176): Launched 23:14:11.405301 run osmo-msc_10.42.42.6(pid=7177): Launched 23:14:11.578026 run osmo-stp_10.42.42.5(pid=7174): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7174)] 23:14:11.707783 run osmo-stp_10.42.42.5(pid=7174): stdout: | (launched: 2022-12-12_23:14:10.371536) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:14:11.837310 run osmo-stp_10.42.42.5(pid=7174): stderr: | [0;m[38;5;43m20221212231410541 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231410541 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231410542 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231410542 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231410544 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231410544 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231410544 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:14:11.964429 run osmo-stp_10.42.42.5(pid=7174): stdout: | (launched: 2022-12-12_23:14:10.371536) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:14:12.085728 run osmo-stp_10.42.42.5(pid=7174): stderr: | [0;m[38;5;43m20221212231410541 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231410541 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231410542 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231410542 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231410544 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231410544 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231410544 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:14:12.231356 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7174): Process ended prematurely: osmo-stp_10.42.42.5(pid=7174) [trial-2383↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7174)] [trial-2383↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 23:14:12.240128 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 23:14:12.266728 run osmo-hlr_10.42.42.2(pid=7171): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7171)] 23:14:12.314437 run osmo-hlr_10.42.42.2(pid=7171): stdout: | (launched: 2022-12-12_23:14:09.417607) 23:14:12.363448 run osmo-hlr_10.42.42.2(pid=7171): stderr: | [0;m[1;31m20221212231409593 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212231409593 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212231409593 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212231409593 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212231409593 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212231409594 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212231409610 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212231409621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212231409621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212231409621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:14:12.432350 run osmo-msc_10.42.42.6(pid=7177): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7177)] 23:14:12.479602 run osmo-msc_10.42.42.6(pid=7177): stdout: | (launched: 2022-12-12_23:14:11.349231) 23:14:12.528606 run osmo-msc_10.42.42.6(pid=7177): stderr: | [0;m[38;5;43m20221212231411620 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212231411620 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb140197c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212231411620 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212231411620 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212231411620 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212231411621 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212231411622 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212231411623 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212231411623 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212231411623 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:14:12.578121 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7170): Terminating (SIGTERM) 23:14:12.617439 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7173): Terminating (SIGTERM) 23:14:12.656599 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7176): Terminating (SIGTERM) 23:14:12.697279 --- ParallelTerminationStrategy: PID 7170 died... 23:14:12.716129 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7170): Terminated: ok {rc=0} 23:14:12.760291 --- ParallelTerminationStrategy: PID 7173 died... 23:14:12.778727 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7173): Terminated: ok {rc=0} 23:14:12.822670 --- ParallelTerminationStrategy: PID 7176 died... 23:14:12.841142 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7176): Terminated: ok {rc=0} 23:14:12.923754 bus /sierra_3: Setting Powered False 23:14:14.017950 bus /sierra_3: Setting Powered False 23:14:15.130442 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2383 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 23:14:16.274860 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:14:16.287664 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 23:14:16.356847 tst mo_mt_call_osmux.py: using LAC 32172 23:14:16.493302 tst mo_mt_call_osmux.py: using RAC 42 23:14:16.664769 tst mo_mt_call_osmux.py: using CellId 32172 23:14:16.789963 tst mo_mt_call_osmux.py: using BVCI 32173 23:14:16.913122 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:14:16.925351 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:14:16.937343 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:14:16.949628 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:14:16.961817 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:14:16.974534 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 23:14:17.095997 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 23:14:17.222209 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:14:17.730735 run create_hlr_db(pid=7179): Launched 23:14:17.860128 bus /sierra_2: Setting Powered False 23:14:18.921343 run create_hlr_db(pid=7179): Terminated: ok {rc=0} 23:14:19.347837 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7181): Launched 23:14:19.653832 run osmo-hlr_10.42.42.2(pid=7182): Launched 23:14:19.770300 run osmo-stp_10.42.42.5: Starting osmo-stp 23:14:20.310646 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7184): Launched 23:14:20.617069 run osmo-stp_10.42.42.5(pid=7185): Launched 23:14:20.734957 run osmo-msc_10.42.42.6: Starting osmo-msc 23:14:21.288602 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7187): Launched 23:14:21.595498 run osmo-msc_10.42.42.6(pid=7188): Launched 23:14:21.767185 run osmo-stp_10.42.42.5(pid=7185): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7185)] 23:14:21.896104 run osmo-stp_10.42.42.5(pid=7185): stdout: | (launched: 2022-12-12_23:14:20.560531) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:14:22.025323 run osmo-stp_10.42.42.5(pid=7185): stderr: | [0;m[38;5;43m20221212231420733 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231420734 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231420734 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231420734 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231420735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231420735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231420735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:14:22.152878 run osmo-stp_10.42.42.5(pid=7185): stdout: | (launched: 2022-12-12_23:14:20.560531) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:14:22.275966 run osmo-stp_10.42.42.5(pid=7185): stderr: | [0;m[38;5;43m20221212231420733 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231420734 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231420734 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231420734 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231420735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231420735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231420735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:14:22.421678 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7185): Process ended prematurely: osmo-stp_10.42.42.5(pid=7185) [trial-2383↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7185)] [trial-2383↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 23:14:22.430381 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 23:14:22.456727 run osmo-hlr_10.42.42.2(pid=7182): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7182)] 23:14:22.504445 run osmo-hlr_10.42.42.2(pid=7182): stdout: | (launched: 2022-12-12_23:14:19.597826) 23:14:22.553373 run osmo-hlr_10.42.42.2(pid=7182): stderr: | [0;m[1;31m20221212231419774 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212231419774 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212231419775 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212231419775 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212231419775 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212231419775 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212231419788 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212231419797 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212231419797 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212231419797 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:14:22.621518 run osmo-msc_10.42.42.6(pid=7188): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7188)] 23:14:22.668269 run osmo-msc_10.42.42.6(pid=7188): stdout: | (launched: 2022-12-12_23:14:21.539163) 23:14:22.716734 run osmo-msc_10.42.42.6(pid=7188): stderr: | [0;m[38;5;43m20221212231421814 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212231421814 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb83f4dcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212231421814 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212231421814 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212231421814 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212231421814 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212231421816 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212231421816 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212231421817 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212231421817 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:14:22.765634 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7181): Terminating (SIGTERM) 23:14:22.804737 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7184): Terminating (SIGTERM) 23:14:22.843918 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7187): Terminating (SIGTERM) 23:14:22.883853 --- ParallelTerminationStrategy: PID 7181 died... 23:14:22.903138 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7181): Terminated: ok {rc=0} 23:14:22.947004 --- ParallelTerminationStrategy: PID 7184 died... 23:14:22.965391 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7184): Terminated: ok {rc=0} 23:14:23.009562 --- ParallelTerminationStrategy: PID 7187 died... 23:14:23.027804 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7187): Terminated: ok {rc=0} 23:14:23.110909 bus /sierra_3: Setting Powered False 23:14:24.207860 bus /sierra_3: Setting Powered False 23:14:25.325749 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 23:14:26.570141 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:14:26.577723 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 23:14:26.611862 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 23:14:26.638085 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 23:14:26.691741 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 23:14:26.725250 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 23:14:26.751450 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 23:14:27.300045 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 23:14:27.350558 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:14:27.361811 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 23:14:27.429161 tst mo_mt_call.py: using LAC 32173 23:14:27.560535 tst mo_mt_call.py: using RAC 43 23:14:27.690729 tst mo_mt_call.py: using CellId 32173 23:14:27.821645 tst mo_mt_call.py: using BVCI 32174 23:14:27.942140 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:14:27.954247 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:14:27.966085 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:14:27.978020 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:14:27.989746 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:14:28.001266 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:14:28.118602 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:14:28.238337 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:14:28.711580 run create_hlr_db(pid=7195): Launched 23:14:28.830597 bus /sierra_2: Setting Powered False 23:14:29.891194 run create_hlr_db(pid=7195): Terminated: ok {rc=0} 23:14:30.317227 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7197): Launched 23:14:30.623290 run osmo-hlr_10.42.42.2(pid=7198): Launched 23:14:30.741176 run osmo-stp_10.42.42.5: Starting osmo-stp 23:14:31.386202 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7200): Launched 23:14:31.722511 run osmo-stp_10.42.42.5(pid=7201): Launched 23:14:31.858901 run osmo-msc_10.42.42.6: Starting osmo-msc 23:14:32.609635 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7203): Launched 23:14:32.916898 run osmo-msc_10.42.42.6(pid=7204): Launched 23:14:33.089737 run osmo-stp_10.42.42.5(pid=7201): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7201)] 23:14:33.222350 run osmo-stp_10.42.42.5(pid=7201): stdout: | (launched: 2022-12-12_23:14:31.651637) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:14:33.351808 run osmo-stp_10.42.42.5(pid=7201): stderr: | [0;m[38;5;43m20221212231432001 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231432002 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231432002 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231432002 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231432003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231432003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231432003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:14:33.478583 run osmo-stp_10.42.42.5(pid=7201): stdout: | (launched: 2022-12-12_23:14:31.651637) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:14:33.599844 run osmo-stp_10.42.42.5(pid=7201): stderr: | [0;m[38;5;43m20221212231432001 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231432002 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231432002 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231432002 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231432003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231432003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231432003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:14:33.744468 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7201): Process ended prematurely: osmo-stp_10.42.42.5(pid=7201) [trial-2383↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7201)] [trial-2383↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 23:14:33.753266 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 23:14:33.780022 run osmo-hlr_10.42.42.2(pid=7198): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7198)] 23:14:33.827219 run osmo-hlr_10.42.42.2(pid=7198): stdout: | (launched: 2022-12-12_23:14:30.567016) 23:14:33.876732 run osmo-hlr_10.42.42.2(pid=7198): stderr: | [0;m[1;31m20221212231430744 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212231430744 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212231430744 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212231430744 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212231430744 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212231430744 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212231430756 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212231430765 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212231430765 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212231430765 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:14:33.945443 run osmo-msc_10.42.42.6(pid=7204): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7204)] 23:14:33.992593 run osmo-msc_10.42.42.6(pid=7204): stdout: | (launched: 2022-12-12_23:14:32.860654) 23:14:34.041626 run osmo-msc_10.42.42.6(pid=7204): stderr: | [0;m[38;5;43m20221212231433132 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212231433132 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f40f0a32c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212231433132 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212231433133 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212231433133 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212231433133 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212231433135 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212231433135 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212231433135 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212231433135 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:14:34.091293 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7197): Terminating (SIGTERM) 23:14:34.130610 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7200): Terminating (SIGTERM) 23:14:34.170014 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7203): Terminating (SIGTERM) 23:14:34.209572 --- ParallelTerminationStrategy: PID 7197 died... 23:14:34.228195 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7197): Terminated: ok {rc=0} 23:14:34.272020 --- ParallelTerminationStrategy: PID 7200 died... 23:14:34.290671 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7200): Terminated: ok {rc=0} 23:14:34.334387 --- ParallelTerminationStrategy: PID 7203 died... 23:14:34.352828 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7203): Terminated: ok {rc=0} 23:14:34.438978 bus /sierra_3: Setting Powered False 23:14:35.539063 bus /sierra_3: Setting Powered False 23:14:36.654529 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2383 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 23:14:37.800355 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:14:37.812359 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 23:14:37.880036 tst mo_mt_call_osmux.py: using LAC 32174 23:14:38.002576 tst mo_mt_call_osmux.py: using RAC 44 23:14:38.124773 tst mo_mt_call_osmux.py: using CellId 32174 23:14:38.247249 tst mo_mt_call_osmux.py: using BVCI 32175 23:14:38.359803 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:14:38.371063 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:14:38.382168 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:14:38.393455 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:14:38.404778 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:14:38.416349 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:14:38.532265 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:14:38.651674 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:14:39.157461 run create_hlr_db(pid=7208): Launched 23:14:39.292018 bus /sierra_2: Setting Powered False 23:14:40.356906 run create_hlr_db(pid=7208): Terminated: ok {rc=0} 23:14:40.795025 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7210): Launched 23:14:41.100813 run osmo-hlr_10.42.42.2(pid=7211): Launched 23:14:41.218413 run osmo-stp_10.42.42.5: Starting osmo-stp 23:14:41.759406 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7213): Launched 23:14:42.065697 run osmo-stp_10.42.42.5(pid=7214): Launched 23:14:42.182996 run osmo-msc_10.42.42.6: Starting osmo-msc 23:14:42.737513 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7216): Launched 23:14:43.045685 run osmo-msc_10.42.42.6(pid=7217): Launched 23:14:43.219342 run osmo-stp_10.42.42.5(pid=7214): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7214)] 23:14:43.350157 run osmo-stp_10.42.42.5(pid=7214): stdout: | (launched: 2022-12-12_23:14:42.009519) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:14:43.480645 run osmo-stp_10.42.42.5(pid=7214): stderr: | [0;m[38;5;43m20221212231442178 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231442178 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231442179 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231442179 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231442182 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231442182 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231442183 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:14:43.609170 run osmo-stp_10.42.42.5(pid=7214): stdout: | (launched: 2022-12-12_23:14:42.009519) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:14:43.731373 run osmo-stp_10.42.42.5(pid=7214): stderr: | [0;m[38;5;43m20221212231442178 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231442178 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231442179 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231442179 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231442182 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231442182 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231442183 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:14:43.878069 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7214): Process ended prematurely: osmo-stp_10.42.42.5(pid=7214) [trial-2383↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7214)] [trial-2383↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 23:14:43.886801 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 23:14:43.913407 run osmo-hlr_10.42.42.2(pid=7211): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7211)] 23:14:43.960798 run osmo-hlr_10.42.42.2(pid=7211): stdout: | (launched: 2022-12-12_23:14:41.044833) 23:14:44.009813 run osmo-hlr_10.42.42.2(pid=7211): stderr: | [0;m[1;31m20221212231441222 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212231441223 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212231441223 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212231441223 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212231441223 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212231441223 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212231441235 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212231441244 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212231441244 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212231441244 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:14:44.078399 run osmo-msc_10.42.42.6(pid=7217): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7217)] 23:14:44.125409 run osmo-msc_10.42.42.6(pid=7217): stdout: | (launched: 2022-12-12_23:14:42.989359) 23:14:44.174206 run osmo-msc_10.42.42.6(pid=7217): stderr: | [0;m[38;5;43m20221212231443261 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212231443262 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4be3ee9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212231443262 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212231443262 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212231443262 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212231443262 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212231443264 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212231443265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212231443265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212231443265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:14:44.223546 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7210): Terminating (SIGTERM) 23:14:44.262821 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7213): Terminating (SIGTERM) 23:14:44.302165 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7216): Terminating (SIGTERM) 23:14:44.341825 --- ParallelTerminationStrategy: PID 7210 died... 23:14:44.360439 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7210): Terminated: ok {rc=0} 23:14:44.405159 --- ParallelTerminationStrategy: PID 7213 died... 23:14:44.423567 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7213): Terminated: ok {rc=0} 23:14:44.467285 --- ParallelTerminationStrategy: PID 7216 died... 23:14:44.485765 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7216): Terminated: ok {rc=0} 23:14:44.571394 bus /sierra_3: Setting Powered False 23:14:45.670612 bus /sierra_3: Setting Powered False 23:14:46.797689 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 23:14:48.050424 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:14:48.057058 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 23:14:48.089527 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 23:14:48.115853 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 23:14:48.166750 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 23:14:48.199374 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 23:14:48.225650 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 23:14:48.779185 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 23:14:48.828415 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 23:14:48.839796 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 23:14:48.890504 tst mo_mt_call.py: using LAC 32175 23:14:49.022579 tst mo_mt_call.py: using RAC 45 23:14:49.151697 tst mo_mt_call.py: using CellId 32175 23:14:49.282616 tst mo_mt_call.py: using BVCI 32176 23:14:49.404850 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 23:14:49.416923 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 23:14:49.428807 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 23:14:49.441445 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 23:14:49.454089 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 23:14:49.466471 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 23:14:49.586469 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 23:14:49.707834 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:14:50.215340 run create_hlr_db(pid=7222): Launched 23:14:50.348538 bus /sierra_2: Setting Powered False 23:14:51.413639 run create_hlr_db(pid=7222): Terminated: ok {rc=0} 23:14:51.867384 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7224): Launched 23:14:52.193669 run osmo-hlr_10.42.42.2(pid=7225): Launched 23:14:52.319933 run osmo-stp_10.42.42.5: Starting osmo-stp 23:14:52.885459 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7227): Launched 23:14:53.212897 run osmo-stp_10.42.42.5(pid=7228): Launched 23:14:53.338748 run osmo-msc_10.42.42.6: Starting osmo-msc 23:14:53.929587 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7230): Launched 23:14:54.256792 run osmo-msc_10.42.42.6(pid=7231): Launched 23:14:54.439349 run osmo-stp_10.42.42.5(pid=7228): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7228)] 23:14:54.576374 run osmo-stp_10.42.42.5(pid=7228): stdout: | (launched: 2022-12-12_23:14:53.153268) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:14:54.713673 run osmo-stp_10.42.42.5(pid=7228): stderr: | [0;m[38;5;43m20221212231453345 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231453345 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231453345 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231453346 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231453346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231453346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231453346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:14:54.849915 run osmo-stp_10.42.42.5(pid=7228): stdout: | (launched: 2022-12-12_23:14:53.153268) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:14:54.979063 run osmo-stp_10.42.42.5(pid=7228): stderr: | [0;m[38;5;43m20221212231453345 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231453345 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231453345 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231453346 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231453346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231453346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231453346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:14:55.133785 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7228): Process ended prematurely: osmo-stp_10.42.42.5(pid=7228) [trial-2383↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7228)] [trial-2383↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 23:14:55.143101 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 23:14:55.170831 run osmo-hlr_10.42.42.2(pid=7225): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7225)] 23:14:55.220055 run osmo-hlr_10.42.42.2(pid=7225): stdout: | (launched: 2022-12-12_23:14:52.134112) 23:14:55.271233 run osmo-hlr_10.42.42.2(pid=7225): stderr: | [0;m[1;31m20221212231452334 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212231452334 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212231452334 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212231452334 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212231452334 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212231452335 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212231452347 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212231452356 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212231452356 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212231452356 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:14:55.342902 run osmo-msc_10.42.42.6(pid=7231): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7231)] 23:14:55.391921 run osmo-msc_10.42.42.6(pid=7231): stdout: | (launched: 2022-12-12_23:14:54.197243) 23:14:55.443055 run osmo-msc_10.42.42.6(pid=7231): stderr: | [0;m[38;5;43m20221212231454522 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212231454523 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f10aa556c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212231454523 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212231454523 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212231454523 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212231454523 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212231454525 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212231454525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212231454525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212231454525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:14:55.494437 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7224): Terminating (SIGTERM) 23:14:55.535626 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7227): Terminating (SIGTERM) 23:14:55.577030 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7230): Terminating (SIGTERM) 23:14:55.618632 --- ParallelTerminationStrategy: PID 7224 died... 23:14:55.638206 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7224): Terminated: ok {rc=0} 23:14:55.684453 --- ParallelTerminationStrategy: PID 7227 died... 23:14:55.703917 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7227): Terminated: ok {rc=0} 23:14:55.749416 --- ParallelTerminationStrategy: PID 7230 died... 23:14:55.768920 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7230): Terminated: ok {rc=0} 23:14:55.854713 bus /sierra_3: Setting Powered False 23:14:56.952733 bus /sierra_3: Setting Powered False 23:14:58.067551 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2383 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 23:14:59.210727 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 23:14:59.222997 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 23:14:59.271639 tst mo_mt_call_osmux.py: using LAC 32176 23:14:59.391603 tst mo_mt_call_osmux.py: using RAC 46 23:14:59.511758 tst mo_mt_call_osmux.py: using CellId 32176 23:14:59.632465 tst mo_mt_call_osmux.py: using BVCI 32177 23:14:59.752642 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 23:14:59.764711 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 23:14:59.776575 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 23:14:59.788541 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 23:14:59.800547 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 23:14:59.812351 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 23:14:59.933194 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 23:15:00.054249 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:15:00.563295 run create_hlr_db(pid=7233): Launched 23:15:00.695757 bus /sierra_2: Setting Powered False 23:15:01.771561 run create_hlr_db(pid=7233): Terminated: ok {rc=0} 23:15:02.286688 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7238): Launched 23:15:02.622617 run osmo-hlr_10.42.42.2(pid=7239): Launched 23:15:02.747333 run osmo-stp_10.42.42.5: Starting osmo-stp 23:15:03.310508 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7241): Launched 23:15:03.637706 run osmo-stp_10.42.42.5(pid=7242): Launched 23:15:03.762348 run osmo-msc_10.42.42.6: Starting osmo-msc 23:15:04.354133 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7244): Launched 23:15:04.681994 run osmo-msc_10.42.42.6(pid=7245): Launched 23:15:04.864487 run osmo-stp_10.42.42.5(pid=7242): ERR: Terminated: ERROR {rc=1} [trial-2383↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7242)] 23:15:05.001924 run osmo-stp_10.42.42.5(pid=7242): stdout: | (launched: 2022-12-12_23:15:03.578141) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:15:05.139881 run osmo-stp_10.42.42.5(pid=7242): stderr: | [0;m[38;5;43m20221212231503773 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231503773 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231503774 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231503774 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231503774 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231503774 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231503775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:15:05.277283 run osmo-stp_10.42.42.5(pid=7242): stdout: | (launched: 2022-12-12_23:15:03.578141) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:15:05.408166 run osmo-stp_10.42.42.5(pid=7242): stderr: | [0;m[38;5;43m20221212231503773 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231503773 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231503774 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231503774 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231503774 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231503774 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231503775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:15:05.564264 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7242): Process ended prematurely: osmo-stp_10.42.42.5(pid=7242) [trial-2383↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7242)] [trial-2383↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 23:15:05.573649 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 23:15:05.601229 run osmo-hlr_10.42.42.2(pid=7239): ERR: Terminated: ERROR {rc=237} [trial-2383↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7239)] 23:15:05.650793 run osmo-hlr_10.42.42.2(pid=7239): stdout: | (launched: 2022-12-12_23:15:02.563121) 23:15:05.702002 run osmo-hlr_10.42.42.2(pid=7239): stderr: | [0;m[1;31m20221212231502762 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212231502762 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212231502762 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212231502762 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212231502762 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212231502762 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212231502775 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212231502784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212231502784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212231502784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:15:05.773390 run osmo-msc_10.42.42.6(pid=7245): ERR: Terminated: ERROR {rc=2} [trial-2383↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7245)] 23:15:05.822427 run osmo-msc_10.42.42.6(pid=7245): stdout: | (launched: 2022-12-12_23:15:04.622319) 23:15:05.873166 run osmo-msc_10.42.42.6(pid=7245): stderr: | [0;m[38;5;43m20221212231504945 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212231504945 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4222222c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212231504945 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212231504945 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212231504945 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212231504946 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212231504947 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212231504948 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212231504948 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212231504948 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:15:05.924354 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7238): Terminating (SIGTERM) 23:15:05.965603 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7241): Terminating (SIGTERM) 23:15:06.006733 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7244): Terminating (SIGTERM) 23:15:06.048209 --- ParallelTerminationStrategy: PID 7238 died... 23:15:06.068092 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7238): Terminated: ok {rc=0} 23:15:06.113815 --- ParallelTerminationStrategy: PID 7241 died... 23:15:06.133232 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7241): Terminated: ok {rc=0} 23:15:06.178960 --- ParallelTerminationStrategy: PID 7244 died... 23:15:06.198442 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7244): Terminated: ok {rc=0} 23:15:06.285204 bus /sierra_3: Setting Powered False 23:15:07.382979 bus /sierra_3: Setting Powered False 23:15:08.499105 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 emergency:nanobts+band-900 --------------------------------------------------------------------- 23:15:09.758069 tst emergency:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:15:09.763940 tst emergency:nanobts+band-900: Verifying 1 x bts (candidates: 11) 23:15:09.796711 tst emergency:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 23:15:09.824042 tst emergency:nanobts+band-900: Verifying 4 x modem (candidates: 12) 23:15:09.913762 tst emergency:nanobts+band-900: Reserving 1 x bts (candidates: 11) 23:15:09.946717 tst emergency:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 23:15:09.973622 tst emergency:nanobts+band-900: Reserving 4 x modem (candidates: 12) 23:15:10.556332 tst emergency:nanobts+band-900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2383 emergency:nanobts+band-900 emergency_mo_mt_call.py ---------------------------------------------- 23:15:10.561648 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 23:15:10.572934 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 23:15:10.624720 tst emergency_mo_mt_call.py: using LAC 32177 23:15:10.750021 tst emergency_mo_mt_call.py: using RAC 47 23:15:10.873911 tst emergency_mo_mt_call.py: using CellId 32177 23:15:10.997852 tst emergency_mo_mt_call.py: using BVCI 32178 23:15:11.113744 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 23:15:11.124899 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 23:15:11.136041 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 23:15:11.147070 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 23:15:11.158099 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 23:15:11.169112 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 23:15:11.285343 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 23:15:11.404777 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:15:11.901482 run create_hlr_db(pid=7251): Launched 23:15:12.031033 bus /sierra_2: Setting Powered False 23:15:13.094097 run create_hlr_db(pid=7251): Terminated: ok {rc=0} 23:15:13.523371 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7253): Launched 23:15:13.823822 run osmo-hlr_10.42.42.2(pid=7254): Launched 23:15:13.938884 run osmo-stp_10.42.42.5: Starting osmo-stp 23:15:14.456906 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7256): Launched 23:15:14.758509 run osmo-stp_10.42.42.5(pid=7257): Launched 23:15:14.883468 tst emergency_mo_mt_call.py: using MSISDN 8016 23:15:15.038249 run osmo-msc_10.42.42.6: Starting osmo-msc 23:15:15.582351 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7259): Launched 23:15:15.922343 run osmo-msc_10.42.42.6(pid=7260): Launched 23:15:16.399791 run osmo-stp_10.42.42.5(pid=7257): ERR: Terminated: ERROR {rc=1} [trial-2383↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7257)] 23:15:16.654168 run osmo-stp_10.42.42.5(pid=7257): stdout: | (launched: 2022-12-12_23:15:14.703479) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:15:16.872076 run osmo-stp_10.42.42.5(pid=7257): stderr: | [0;m[38;5;43m20221212231514873 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231514873 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231514874 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231514874 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231514874 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231514875 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231514875 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:15:17.013256 run osmo-stp_10.42.42.5(pid=7257): stdout: | (launched: 2022-12-12_23:15:14.703479) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:15:17.145761 run osmo-stp_10.42.42.5(pid=7257): stderr: | [0;m[38;5;43m20221212231514873 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231514873 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231514874 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231514874 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231514874 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231514875 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231514875 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:15:17.304811 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=7257): Process ended prematurely: osmo-stp_10.42.42.5(pid=7257) [trial-2383↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7257)] [trial-2383↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19] 23:15:17.314936 tst emergency_mo_mt_call.py:19: Test FAILED (6.7 sec) 23:15:17.345626 run osmo-hlr_10.42.42.2(pid=7254): ERR: Terminated: ERROR {rc=237} [trial-2383↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7254)] 23:15:17.398878 run osmo-hlr_10.42.42.2(pid=7254): stdout: | (launched: 2022-12-12_23:15:13.768751) 23:15:17.451821 run osmo-hlr_10.42.42.2(pid=7254): stderr: | [0;m[1;31m20221212231513948 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212231513948 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212231513948 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212231513948 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212231513948 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212231513948 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212231513960 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/emergency:nanobts+band-900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212231513969 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212231513969 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212231513969 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:15:17.524657 run osmo-msc_10.42.42.6(pid=7260): ERR: Terminated: ERROR {rc=2} [trial-2383↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7260)] 23:15:17.574789 run osmo-msc_10.42.42.6(pid=7260): stdout: | (launched: 2022-12-12_23:15:15.838485) 23:15:17.627866 run osmo-msc_10.42.42.6(pid=7260): stderr: | [0;m[38;5;43m20221212231516337 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212231516337 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb2221f0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212231516338 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212231516338 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212231516340 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212231516341 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212231516346 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212231516349 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212231516349 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212231516349 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:15:17.679888 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7253): Terminating (SIGTERM) 23:15:17.721903 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7256): Terminating (SIGTERM) 23:15:17.763384 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7259): Terminating (SIGTERM) 23:15:17.805153 --- ParallelTerminationStrategy: PID 7253 died... 23:15:17.824590 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7253): Terminated: ok {rc=0} 23:15:17.870361 --- ParallelTerminationStrategy: PID 7256 died... 23:15:17.889821 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7256): Terminated: ok {rc=0} 23:15:17.935527 --- ParallelTerminationStrategy: PID 7259 died... 23:15:17.955054 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7259): Terminated: ok {rc=0} 23:15:18.042276 bus /sierra_3: Setting Powered False 23:15:19.139902 bus /sierra_3: Setting Powered False 23:15:20.256128 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2383 emergency:nanobts+band-900 emergency_preemptive_call.py ---------------------------------------------- 23:15:21.342541 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 23:15:21.354044 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 23:15:21.407554 tst emergency_preemptive_call.py: using LAC 32178 23:15:21.534734 tst emergency_preemptive_call.py: using RAC 48 23:15:21.660677 tst emergency_preemptive_call.py: using CellId 32178 23:15:21.786695 tst emergency_preemptive_call.py: using BVCI 32179 23:15:21.904651 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 23:15:21.916053 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 23:15:21.927117 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 23:15:21.938197 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 23:15:21.949257 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 23:15:21.960294 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 23:15:22.075341 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 23:15:22.194228 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 23:15:22.310476 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 23:15:22.428711 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:15:22.929653 run create_hlr_db(pid=7262): Launched 23:15:23.060688 bus /sierra_2: Setting Powered False 23:15:24.124329 run create_hlr_db(pid=7262): Terminated: ok {rc=0} 23:15:24.573035 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7264): Launched 23:15:24.893745 run osmo-hlr_10.42.42.2(pid=7265): Launched 23:15:25.015598 run osmo-stp_10.42.42.5: Starting osmo-stp 23:15:25.572575 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7267): Launched 23:15:25.893268 run osmo-stp_10.42.42.5(pid=7268): Launched 23:15:26.025240 tst emergency_preemptive_call.py: using MSISDN 8017 23:15:26.188805 run osmo-msc_10.42.42.6: Starting osmo-msc 23:15:26.765658 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7270): Launched 23:15:27.086053 run osmo-msc_10.42.42.6(pid=7271): Launched 23:15:27.265559 run osmo-stp_10.42.42.5(pid=7268): ERR: Terminated: ERROR {rc=1} [trial-2383↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7268)] 23:15:27.401461 run osmo-stp_10.42.42.5(pid=7268): stdout: | (launched: 2022-12-12_23:15:25.834517) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:15:27.537561 run osmo-stp_10.42.42.5(pid=7268): stderr: | [0;m[38;5;43m20221212231526029 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231526029 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231526029 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231526030 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231526030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231526030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231526030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:15:27.672148 run osmo-stp_10.42.42.5(pid=7268): stdout: | (launched: 2022-12-12_23:15:25.834517) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:15:27.799646 run osmo-stp_10.42.42.5(pid=7268): stderr: | [0;m[38;5;43m20221212231526029 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231526029 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231526029 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231526030 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231526030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231526030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231526030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:15:27.952464 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=7268): Process ended prematurely: osmo-stp_10.42.42.5(pid=7268) [trial-2383↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7268)] [trial-2383↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32] 23:15:27.961253 tst emergency_preemptive_call.py:32: Test FAILED (6.6 sec) 23:15:27.988672 run osmo-hlr_10.42.42.2(pid=7265): ERR: Terminated: ERROR {rc=237} [trial-2383↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7265)] 23:15:28.038656 run osmo-hlr_10.42.42.2(pid=7265): stdout: | (launched: 2022-12-12_23:15:24.835428) 23:15:28.090115 run osmo-hlr_10.42.42.2(pid=7265): stderr: | [0;m[1;31m20221212231525034 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212231525034 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212231525034 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212231525034 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212231525034 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212231525034 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212231525046 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/emergency:nanobts+band-900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212231525055 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212231525055 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212231525055 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:15:28.162105 run osmo-msc_10.42.42.6(pid=7271): ERR: Terminated: ERROR {rc=2} [trial-2383↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7271)] 23:15:28.211783 run osmo-msc_10.42.42.6(pid=7271): stdout: | (launched: 2022-12-12_23:15:27.027743) 23:15:28.263122 run osmo-msc_10.42.42.6(pid=7271): stderr: | [0;m[38;5;43m20221212231527349 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212231527349 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f15fc5d7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212231527349 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212231527350 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212231527350 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212231527350 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212231527352 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212231527352 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212231527352 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212231527352 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:15:28.315115 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7264): Terminating (SIGTERM) 23:15:28.356481 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7267): Terminating (SIGTERM) 23:15:28.398048 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7270): Terminating (SIGTERM) 23:15:28.439705 --- ParallelTerminationStrategy: PID 7264 died... 23:15:28.459502 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7264): Terminated: ok {rc=0} 23:15:28.505491 --- ParallelTerminationStrategy: PID 7267 died... 23:15:28.524862 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7267): Terminated: ok {rc=0} 23:15:28.570806 --- ParallelTerminationStrategy: PID 7270 died... 23:15:28.590324 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7270): Terminated: ok {rc=0} 23:15:28.677325 bus /sierra_9: Setting Powered False 23:15:29.777137 bus /sierra_9: Setting Powered False 23:15:30.910420 bus /sierra_8: Setting Powered False 23:15:32.012476 bus /sierra_8: Setting Powered False 23:15:33.126319 bus /sierra_3: Setting Powered False 23:15:34.224717 bus /sierra_3: Setting Powered False 23:15:35.341022 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 emergency:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 gprs:nanobts+band-900 --------------------------------------------------------------------- 23:15:36.624596 tst gprs:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:15:36.630166 tst gprs:nanobts+band-900: Verifying 1 x bts (candidates: 11) 23:15:36.663325 tst gprs:nanobts+band-900: Verifying 9 x ip_address (candidates: 9) 23:15:36.702981 tst gprs:nanobts+band-900: Verifying 4 x modem (candidates: 12) 23:15:36.795526 tst gprs:nanobts+band-900: Reserving 1 x bts (candidates: 11) 23:15:36.828778 tst gprs:nanobts+band-900: Reserving 9 x ip_address (candidates: 9) 23:15:36.867843 tst gprs:nanobts+band-900: Reserving 4 x modem (candidates: 12) 23:15:37.455971 tst gprs:nanobts+band-900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2383 gprs:nanobts+band-900 cs_paging_gprs_active.py ---------------------------------------------- 23:15:37.510195 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 23:15:37.521395 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 23:15:37.567851 tst cs_paging_gprs_active.py: using LAC 32179 23:15:37.697091 tst cs_paging_gprs_active.py: using RAC 49 23:15:37.823902 tst cs_paging_gprs_active.py: using CellId 32179 23:15:37.947420 tst cs_paging_gprs_active.py: using BVCI 32180 23:15:38.062098 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 23:15:38.072876 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 23:15:38.083533 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 23:15:38.094501 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 23:15:38.105464 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 23:15:38.116109 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 23:15:38.127507 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 23:15:38.138390 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 23:15:38.149459 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 23:15:38.271395 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 23:15:38.394847 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 23:15:38.616660 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:15:38.946375 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7276): Launched 23:15:39.231914 run iperf3-srv_10.42.42.10(pid=7277): Launched 23:15:39.355620 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 23:15:39.576550 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:15:39.905379 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7278): Launched 23:15:40.193923 run iperf3-srv_10.42.42.10(pid=7279): Launched 23:15:40.316734 tst cs_paging_gprs_active.py:38: start network... 23:15:40.537473 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:15:41.045551 run create_hlr_db(pid=7280): Launched 23:15:41.179902 bus /sierra_2: Setting Powered False 23:15:42.244050 run create_hlr_db(pid=7280): Terminated: ok {rc=0} 23:15:42.681644 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7282): Launched 23:15:42.992584 run osmo-hlr_10.42.42.2(pid=7283): Launched 23:15:43.110027 run osmo-stp_10.42.42.5: Starting osmo-stp 23:15:43.654694 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7285): Launched 23:15:43.962856 run osmo-stp_10.42.42.5(pid=7286): Launched 23:15:44.081159 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:15:44.611635 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7288): Launched 23:15:44.730318 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:15:44.992253 run patchelf(pid=7289): Launched 23:15:45.163937 run osmo-stp_10.42.42.5(pid=7286): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7286)] 23:15:45.294055 run osmo-stp_10.42.42.5(pid=7286): stdout: | (launched: 2022-12-12_23:15:43.906167) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:15:45.425249 run osmo-stp_10.42.42.5(pid=7286): stderr: | [0;m[38;5;43m20221212231544077 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231544077 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231544077 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231544078 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231544080 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231544080 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231544080 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:15:45.556584 run osmo-stp_10.42.42.5(pid=7286): stdout: | (launched: 2022-12-12_23:15:43.906167) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:15:45.682646 run osmo-stp_10.42.42.5(pid=7286): stderr: | [0;m[38;5;43m20221212231544077 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231544077 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231544077 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231544078 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231544080 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231544080 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231544080 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:15:45.844133 run patchelf(pid=7289): Terminating (SIGINT) 23:15:46.046922 run patchelf(pid=7289): Terminated: ok {rc=0} 23:15:46.183315 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=7286): Process ended prematurely: osmo-stp_10.42.42.5(pid=7286) [trial-2383↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7286)] [trial-2383↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38] 23:15:46.194655 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 23:15:46.223572 run osmo-hlr_10.42.42.2(pid=7283): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:nanobts+band-900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7283)] 23:15:46.274259 run osmo-hlr_10.42.42.2(pid=7283): stdout: | (launched: 2022-12-12_23:15:42.935184) 23:15:46.327770 run osmo-hlr_10.42.42.2(pid=7283): stderr: | [0;m[1;31m20221212231543111 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212231543112 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212231543112 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212231543112 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212231543112 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212231543112 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212231543124 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:nanobts+band-900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212231543132 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212231543132 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212231543132 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:15:46.382357 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7276): Terminating (SIGTERM) 23:15:46.425630 run iperf3-srv_10.42.42.10(pid=7277): Terminating (SIGTERM) 23:15:46.469248 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7278): Terminating (SIGTERM) 23:15:46.512193 run iperf3-srv_10.42.42.10(pid=7279): Terminating (SIGTERM) 23:15:46.554803 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7282): Terminating (SIGTERM) 23:15:46.599464 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7285): Terminating (SIGTERM) 23:15:46.644112 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7288): Terminating (SIGTERM) 23:15:46.690043 --- ParallelTerminationStrategy: PID 7276 died... 23:15:46.710159 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7276): Terminated: ok {rc=0} 23:15:46.766592 --- ParallelTerminationStrategy: PID 7277 died... 23:15:46.788069 run iperf3-srv_10.42.42.10(pid=7277): Terminated {rc=256} 23:15:46.844553 --- ParallelTerminationStrategy: PID 7278 died... 23:15:46.868005 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7278): Terminated: ok {rc=0} 23:15:46.925182 --- ParallelTerminationStrategy: PID 7279 died... 23:15:46.948635 run iperf3-srv_10.42.42.10(pid=7279): Terminated {rc=256} 23:15:47.002680 --- ParallelTerminationStrategy: PID 7282 died... 23:15:47.023035 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7282): Terminated: ok {rc=0} 23:15:47.070737 --- ParallelTerminationStrategy: PID 7285 died... 23:15:47.091098 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7285): Terminated: ok {rc=0} 23:15:47.139328 --- ParallelTerminationStrategy: PID 7288 died... 23:15:47.160247 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7288): Terminated: ok {rc=0} 23:15:47.250668 bus /gobi_0: Setting Powered False 23:15:48.348076 bus /gobi_0: Setting Powered False 23:15:49.463237 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:nanobts+band-900 iperf3.py ---------------------------------------------- 23:15:50.614371 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 23:15:50.626262 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 23:15:50.677485 tst iperf3.py: using LAC 32180 23:15:50.807587 tst iperf3.py: using RAC 50 23:15:50.936309 tst iperf3.py: using CellId 32180 23:15:51.064868 tst iperf3.py: using BVCI 32181 23:15:51.178578 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 23:15:51.189648 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 23:15:51.200120 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 23:15:51.210841 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 23:15:51.221815 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 23:15:51.232594 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 23:15:51.243539 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 23:15:51.254281 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 23:15:51.265091 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 23:15:51.380505 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 23:15:51.587520 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:15:51.896445 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7290): Launched 23:15:52.164419 run iperf3-srv_10.42.42.10(pid=7291): Launched 23:15:52.279802 tst iperf3.py:8: start network... 23:15:52.486096 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:15:52.962140 run create_hlr_db(pid=7292): Launched 23:15:53.079744 bus /gobi_6: Setting Powered False 23:15:54.140291 run create_hlr_db(pid=7292): Terminated: ok {rc=0} 23:15:54.589539 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7294): Launched 23:15:54.918760 run osmo-hlr_10.42.42.2(pid=7295): Launched 23:15:55.045115 run osmo-stp_10.42.42.5: Starting osmo-stp 23:15:55.612212 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7297): Launched 23:15:55.939600 run osmo-stp_10.42.42.5(pid=7298): Launched 23:15:56.065540 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:15:56.631296 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7300): Launched 23:15:56.755951 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:15:57.033568 run patchelf(pid=7301): Launched 23:15:57.216942 run osmo-stp_10.42.42.5(pid=7298): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7298)] 23:15:57.356479 run osmo-stp_10.42.42.5(pid=7298): stdout: | (launched: 2022-12-12_23:15:55.879835) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:15:57.496805 run osmo-stp_10.42.42.5(pid=7298): stderr: | [0;m[38;5;43m20221212231556075 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231556075 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231556075 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231556075 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231556076 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231556076 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231556076 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:15:57.637609 run osmo-stp_10.42.42.5(pid=7298): stdout: | (launched: 2022-12-12_23:15:55.879835) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:15:57.772245 run osmo-stp_10.42.42.5(pid=7298): stderr: | [0;m[38;5;43m20221212231556075 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231556075 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231556075 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231556075 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231556076 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231556076 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231556076 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:15:57.932084 run patchelf(pid=7301): Terminating (SIGINT) 23:15:58.118200 run patchelf(pid=7301): Terminated: ok {rc=0} 23:15:58.251651 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7298): Process ended prematurely: osmo-stp_10.42.42.5(pid=7298) [trial-2383↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7298)] [trial-2383↪gprs:nanobts+band-900↪iperf3.py:8] 23:15:58.261766 tst iperf3.py:8: Test FAILED (7.7 sec) 23:15:58.289879 run osmo-hlr_10.42.42.2(pid=7295): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:nanobts+band-900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7295)] 23:15:58.340144 run osmo-hlr_10.42.42.2(pid=7295): stdout: | (launched: 2022-12-12_23:15:54.858976) 23:15:58.391314 run osmo-hlr_10.42.42.2(pid=7295): stderr: | [0;m[1;31m20221212231555058 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212231555058 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212231555058 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212231555058 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212231555058 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212231555058 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212231555074 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:nanobts+band-900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212231555084 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212231555084 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212231555084 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:15:58.442681 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7290): Terminating (SIGTERM) 23:15:58.483987 run iperf3-srv_10.42.42.10(pid=7291): Terminating (SIGTERM) 23:15:58.525247 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7294): Terminating (SIGTERM) 23:15:58.566486 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7297): Terminating (SIGTERM) 23:15:58.607688 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7300): Terminating (SIGTERM) 23:15:58.649158 --- ParallelTerminationStrategy: PID 7290 died... 23:15:58.668873 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7290): Terminated: ok {rc=0} 23:15:58.714257 --- ParallelTerminationStrategy: PID 7291 died... 23:15:58.733401 run iperf3-srv_10.42.42.10(pid=7291): Terminated {rc=256} 23:15:58.778553 --- ParallelTerminationStrategy: PID 7294 died... 23:15:58.797866 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7294): Terminated: ok {rc=0} 23:15:58.843150 --- ParallelTerminationStrategy: PID 7297 died... 23:15:58.862505 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7297): Terminated: ok {rc=0} 23:15:58.907808 --- ParallelTerminationStrategy: PID 7300 died... 23:15:58.927122 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7300): Terminated: ok {rc=0} 23:15:59.013834 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:nanobts+band-900 iperf3m4.py ---------------------------------------------- 23:16:00.163285 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 23:16:00.175419 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 23:16:00.223220 tst iperf3m4.py: using LAC 32181 23:16:00.355046 tst iperf3m4.py: using RAC 51 23:16:00.485627 tst iperf3m4.py: using CellId 32181 23:16:00.616218 tst iperf3m4.py: using BVCI 32182 23:16:00.731201 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 23:16:00.742173 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 23:16:00.752481 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 23:16:00.763415 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 23:16:00.774468 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 23:16:00.785397 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 23:16:00.797192 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 23:16:00.807709 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 23:16:00.818670 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 23:16:00.959848 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 23:16:01.084011 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 23:16:01.209586 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 23:16:01.335898 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 23:16:01.559788 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:16:01.884409 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7302): Launched 23:16:02.174054 run iperf3-srv_10.42.42.10(pid=7303): Launched 23:16:02.302280 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 23:16:02.509547 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:16:02.817923 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7304): Launched 23:16:03.086710 run iperf3-srv_10.42.42.10(pid=7305): Launched 23:16:03.203046 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 23:16:03.410111 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:16:03.719614 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7306): Launched 23:16:03.988015 run iperf3-srv_10.42.42.10(pid=7307): Launched 23:16:04.112295 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 23:16:04.335145 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:16:04.665602 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7308): Launched 23:16:04.952876 run iperf3-srv_10.42.42.10(pid=7309): Launched 23:16:05.076786 tst iperf3m4.py:8: start network... 23:16:05.297721 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:16:05.807140 run create_hlr_db(pid=7310): Launched 23:16:05.940244 bus /gobi_6: Setting Powered False 23:16:07.004884 run create_hlr_db(pid=7310): Terminated: ok {rc=0} 23:16:07.462283 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7312): Launched 23:16:07.790546 run osmo-hlr_10.42.42.2(pid=7313): Launched 23:16:07.915872 run osmo-stp_10.42.42.5: Starting osmo-stp 23:16:08.486332 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7315): Launched 23:16:08.815160 run osmo-stp_10.42.42.5(pid=7316): Launched 23:16:08.940220 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:16:09.507523 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7318): Launched 23:16:09.632737 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:16:09.910118 run patchelf(pid=7319): Launched 23:16:10.092856 run osmo-stp_10.42.42.5(pid=7316): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7316)] 23:16:10.231658 run osmo-stp_10.42.42.5(pid=7316): stdout: | (launched: 2022-12-12_23:16:08.755144) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:16:10.372258 run osmo-stp_10.42.42.5(pid=7316): stderr: | [0;m[38;5;43m20221212231608949 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231608949 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231608949 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231608950 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231608952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231608952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231608952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:16:10.512687 run osmo-stp_10.42.42.5(pid=7316): stdout: | (launched: 2022-12-12_23:16:08.755144) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:16:10.647250 run osmo-stp_10.42.42.5(pid=7316): stderr: | [0;m[38;5;43m20221212231608949 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231608949 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231608949 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231608950 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231608952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231608952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231608952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:16:10.806682 run patchelf(pid=7319): Terminating (SIGINT) 23:16:10.991774 run patchelf(pid=7319): Terminated: ok {rc=0} 23:16:11.125611 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7316): Process ended prematurely: osmo-stp_10.42.42.5(pid=7316) [trial-2383↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7316)] [trial-2383↪gprs:nanobts+band-900↪iperf3m4.py:8] 23:16:11.135562 tst iperf3m4.py:8: Test FAILED (11.0 sec) 23:16:11.164410 run osmo-hlr_10.42.42.2(pid=7313): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:nanobts+band-900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7313)] 23:16:11.214231 run osmo-hlr_10.42.42.2(pid=7313): stdout: | (launched: 2022-12-12_23:16:07.730646) 23:16:11.265840 run osmo-hlr_10.42.42.2(pid=7313): stderr: | [0;m[1;31m20221212231607933 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212231607933 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212231607933 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212231607933 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212231607933 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212231607933 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212231607945 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:nanobts+band-900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212231607953 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212231607953 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212231607953 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:16:11.317833 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7302): Terminating (SIGTERM) 23:16:11.359940 run iperf3-srv_10.42.42.10(pid=7303): Terminating (SIGTERM) 23:16:11.401920 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7304): Terminating (SIGTERM) 23:16:11.443850 run iperf3-srv_10.42.42.10(pid=7305): Terminating (SIGTERM) 23:16:11.485574 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7306): Terminating (SIGTERM) 23:16:11.527482 run iperf3-srv_10.42.42.10(pid=7307): Terminating (SIGTERM) 23:16:11.569172 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7308): Terminating (SIGTERM) 23:16:11.611068 run iperf3-srv_10.42.42.10(pid=7309): Terminating (SIGTERM) 23:16:11.652606 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7312): Terminating (SIGTERM) 23:16:11.694485 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7315): Terminating (SIGTERM) 23:16:11.736393 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7318): Terminating (SIGTERM) 23:16:11.778536 --- ParallelTerminationStrategy: PID 7302 died... 23:16:11.798603 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7302): Terminated: ok {rc=0} 23:16:11.845056 --- ParallelTerminationStrategy: PID 7303 died... 23:16:11.864761 run iperf3-srv_10.42.42.10(pid=7303): Terminated {rc=256} 23:16:11.910708 --- ParallelTerminationStrategy: PID 7304 died... 23:16:11.930353 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7304): Terminated: ok {rc=0} 23:16:11.976043 --- ParallelTerminationStrategy: PID 7305 died... 23:16:11.995668 run iperf3-srv_10.42.42.10(pid=7305): Terminated {rc=256} 23:16:12.041448 --- ParallelTerminationStrategy: PID 7306 died... 23:16:12.061135 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7306): Terminated: ok {rc=0} 23:16:12.107009 --- ParallelTerminationStrategy: PID 7307 died... 23:16:12.126371 run iperf3-srv_10.42.42.10(pid=7307): Terminated {rc=256} 23:16:12.171663 --- ParallelTerminationStrategy: PID 7308 died... 23:16:12.191055 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7308): Terminated: ok {rc=0} 23:16:12.236383 --- ParallelTerminationStrategy: PID 7309 died... 23:16:12.255621 run iperf3-srv_10.42.42.10(pid=7309): Terminated {rc=256} 23:16:12.300791 --- ParallelTerminationStrategy: PID 7312 died... 23:16:12.320152 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7312): Terminated: ok {rc=0} 23:16:12.365997 --- ParallelTerminationStrategy: PID 7315 died... 23:16:12.385552 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7315): Terminated: ok {rc=0} 23:16:12.431072 --- ParallelTerminationStrategy: PID 7318 died... 23:16:12.450664 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7318): Terminated: ok {rc=0} 23:16:12.537549 bus /gobi_4: Setting Powered False 23:16:13.635905 bus /gobi_4: Setting Powered False 23:16:14.750923 bus /gobi_1: Setting Powered False 23:16:15.861939 bus /gobi_1: Setting Powered False 23:16:16.988473 bus /gobi_0: Setting Powered False 23:16:18.085914 bus /gobi_0: Setting Powered False 23:16:19.202723 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:nanobts+band-900 ping.py ---------------------------------------------- 23:16:20.306538 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 23:16:20.318331 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 23:16:20.368118 tst ping.py: using LAC 32182 23:16:20.495155 tst ping.py: using RAC 52 23:16:20.621632 tst ping.py: using CellId 32182 23:16:20.747921 tst ping.py: using BVCI 32183 23:16:20.865472 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 23:16:20.876555 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 23:16:20.887596 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 23:16:20.898600 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 23:16:20.909527 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 23:16:20.920336 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 23:16:20.931425 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 23:16:20.942460 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 23:16:21.061303 tst ping.py:19: start network... 23:16:21.278894 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:16:21.776041 run create_hlr_db(pid=7320): Launched 23:16:21.906630 bus /gobi_6: Setting Powered False 23:16:22.969750 run create_hlr_db(pid=7320): Terminated: ok {rc=0} 23:16:23.417053 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7322): Launched 23:16:23.737258 run osmo-hlr_10.42.42.2(pid=7323): Launched 23:16:23.858921 run osmo-stp_10.42.42.5: Starting osmo-stp 23:16:24.414293 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7325): Launched 23:16:24.735770 run osmo-stp_10.42.42.5(pid=7326): Launched 23:16:24.857966 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:16:25.413159 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7328): Launched 23:16:25.535889 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:16:25.809148 run patchelf(pid=7329): Launched 23:16:25.988074 run osmo-stp_10.42.42.5(pid=7326): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7326)] 23:16:26.124490 run osmo-stp_10.42.42.5(pid=7326): stdout: | (launched: 2022-12-12_23:16:24.677224) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:16:26.262167 run osmo-stp_10.42.42.5(pid=7326): stderr: | [0;m[38;5;43m20221212231624869 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231624869 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231624869 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231624870 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231624872 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231624872 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231624872 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:16:26.400436 run osmo-stp_10.42.42.5(pid=7326): stdout: | (launched: 2022-12-12_23:16:24.677224) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:16:26.531913 run osmo-stp_10.42.42.5(pid=7326): stderr: | [0;m[38;5;43m20221212231624869 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231624869 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231624869 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231624870 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231624872 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231624872 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231624872 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:16:26.687765 run patchelf(pid=7329): Terminating (SIGINT) 23:16:26.870433 run patchelf(pid=7329): Terminated: ok {rc=0} 23:16:27.001225 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=7326): Process ended prematurely: osmo-stp_10.42.42.5(pid=7326) [trial-2383↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7326)] [trial-2383↪gprs:nanobts+band-900↪ping.py:22] 23:16:27.010663 tst ping.py:22: Test FAILED (6.7 sec) 23:16:27.038651 run osmo-hlr_10.42.42.2(pid=7323): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:nanobts+band-900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7323)] 23:16:27.088409 run osmo-hlr_10.42.42.2(pid=7323): stdout: | (launched: 2022-12-12_23:16:23.678676) 23:16:27.139693 run osmo-hlr_10.42.42.2(pid=7323): stderr: | [0;m[1;31m20221212231623877 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212231623878 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212231623878 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212231623878 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212231623878 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212231623878 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212231623890 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:nanobts+band-900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212231623900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212231623900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212231623900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:16:27.191989 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7322): Terminating (SIGTERM) 23:16:27.233541 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7325): Terminating (SIGTERM) 23:16:27.275027 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7328): Terminating (SIGTERM) 23:16:27.316849 --- ParallelTerminationStrategy: PID 7322 died... 23:16:27.337377 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7322): Terminated: ok {rc=0} 23:16:27.383202 --- ParallelTerminationStrategy: PID 7325 died... 23:16:27.402949 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7325): Terminated: ok {rc=0} 23:16:27.448664 --- ParallelTerminationStrategy: PID 7328 died... 23:16:27.468287 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7328): Terminated: ok {rc=0} 23:16:27.555040 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:nanobts+band-900 ping_idle_ping.py ---------------------------------------------- 23:16:28.642117 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 23:16:28.653688 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 23:16:28.703489 tst ping_idle_ping.py: using LAC 32183 23:16:28.831876 tst ping_idle_ping.py: using RAC 53 23:16:28.959300 tst ping_idle_ping.py: using CellId 32183 23:16:29.088479 tst ping_idle_ping.py: using BVCI 32184 23:16:29.207101 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 23:16:29.218487 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 23:16:29.229546 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 23:16:29.240556 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 23:16:29.251491 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 23:16:29.262451 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 23:16:29.273569 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 23:16:29.284913 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 23:16:29.400844 tst ping_idle_ping.py:24: start network... 23:16:29.618382 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:16:30.118387 run create_hlr_db(pid=7330): Launched 23:16:30.249175 bus /gobi_6: Setting Powered False 23:16:31.309174 run create_hlr_db(pid=7330): Terminated: ok {rc=0} 23:16:31.761987 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7332): Launched 23:16:32.089816 run osmo-hlr_10.42.42.2(pid=7333): Launched 23:16:32.328334 run osmo-stp_10.42.42.5: Starting osmo-stp 23:16:32.881700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7335): Launched 23:16:33.204541 run osmo-stp_10.42.42.5(pid=7336): Launched 23:16:33.328460 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:16:33.886356 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7338): Launched 23:16:34.009708 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:16:34.282637 run patchelf(pid=7339): Launched 23:16:34.463523 run osmo-stp_10.42.42.5(pid=7336): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7336)] 23:16:34.600240 run osmo-stp_10.42.42.5(pid=7336): stdout: | (launched: 2022-12-12_23:16:33.145762) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:16:34.738636 run osmo-stp_10.42.42.5(pid=7336): stderr: | [0;m[38;5;43m20221212231633338 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231633338 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231633338 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231633339 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231633339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231633339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231633339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:16:34.876383 run osmo-stp_10.42.42.5(pid=7336): stdout: | (launched: 2022-12-12_23:16:33.145762) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:16:35.008587 run osmo-stp_10.42.42.5(pid=7336): stderr: | [0;m[38;5;43m20221212231633338 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231633338 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231633338 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231633339 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231633339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231633339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231633339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:16:35.165171 run patchelf(pid=7339): Terminating (SIGINT) 23:16:35.348786 run patchelf(pid=7339): Terminated: ok {rc=0} 23:16:35.479965 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=7336): Process ended prematurely: osmo-stp_10.42.42.5(pid=7336) [trial-2383↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7336)] [trial-2383↪gprs:nanobts+band-900↪ping_idle_ping.py:27] 23:16:35.489345 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 23:16:35.517313 run osmo-hlr_10.42.42.2(pid=7333): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:nanobts+band-900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7333)] 23:16:35.566711 run osmo-hlr_10.42.42.2(pid=7333): stdout: | (launched: 2022-12-12_23:16:32.020863) 23:16:35.618180 run osmo-hlr_10.42.42.2(pid=7333): stderr: | [0;m[1;31m20221212231632234 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212231632234 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212231632234 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212231632234 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212231632234 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212231632234 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212231632247 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:nanobts+band-900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212231632260 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212231632260 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212231632260 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:16:35.669935 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7332): Terminating (SIGTERM) 23:16:35.711636 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7335): Terminating (SIGTERM) 23:16:35.753307 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7338): Terminating (SIGTERM) 23:16:35.795323 --- ParallelTerminationStrategy: PID 7332 died... 23:16:35.815280 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7332): Terminated: ok {rc=0} 23:16:35.861343 --- ParallelTerminationStrategy: PID 7335 died... 23:16:35.880551 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7335): Terminated: ok {rc=0} 23:16:35.926541 --- ParallelTerminationStrategy: PID 7338 died... 23:16:35.945992 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7338): Terminated: ok {rc=0} 23:16:36.033446 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2383 gprs:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 gprs:nanobts+band-900+mod-bts0-egprs --------------------------------------------------------------------- 23:16:37.329963 tst gprs:nanobts+band-900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:16:37.336069 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 23:16:37.369056 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 23:16:37.407375 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 23:16:37.493205 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 23:16:37.525464 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 23:16:37.563775 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 23:16:38.160781 tst gprs:nanobts+band-900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2383 gprs:nanobts+band-900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 23:16:38.214782 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:16:38.226317 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:16:38.276755 tst cs_paging_gprs_active.py: using LAC 32184 23:16:38.407355 tst cs_paging_gprs_active.py: using RAC 54 23:16:38.539106 tst cs_paging_gprs_active.py: using CellId 32184 23:16:38.669208 tst cs_paging_gprs_active.py: using BVCI 32185 23:16:38.788216 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:16:38.799726 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:16:38.810954 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:16:38.822128 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:16:38.833750 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:16:38.844900 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:16:38.856146 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:16:38.867200 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:16:38.878514 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:16:38.998004 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:16:39.118089 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 23:16:39.340916 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:16:39.670341 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7343): Launched 23:16:39.956177 run iperf3-srv_10.42.42.10(pid=7344): Launched 23:16:40.079356 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 23:16:40.301036 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:16:40.630546 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7345): Launched 23:16:40.915599 run iperf3-srv_10.42.42.10(pid=7346): Launched 23:16:41.038696 tst cs_paging_gprs_active.py:38: start network... 23:16:41.260635 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:16:41.770651 run create_hlr_db(pid=7347): Launched 23:16:41.902604 bus /gobi_6: Setting Powered False 23:16:42.966807 run create_hlr_db(pid=7347): Terminated: ok {rc=0} 23:16:43.404588 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7349): Launched 23:16:43.713348 run osmo-hlr_10.42.42.2(pid=7350): Launched 23:16:43.832283 run osmo-stp_10.42.42.5: Starting osmo-stp 23:16:44.381039 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7352): Launched 23:16:44.689775 run osmo-stp_10.42.42.5(pid=7353): Launched 23:16:44.808307 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:16:45.340095 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7355): Launched 23:16:45.459100 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:16:45.720383 run patchelf(pid=7356): Launched 23:16:45.897897 run osmo-stp_10.42.42.5(pid=7353): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7353)] 23:16:46.064373 run osmo-stp_10.42.42.5(pid=7353): stdout: | (launched: 2022-12-12_23:16:44.633164) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:16:46.213892 run osmo-stp_10.42.42.5(pid=7353): stderr: | [0;m[38;5;43m20221212231644805 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231644805 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231644805 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231644805 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231644808 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231644808 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231644808 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:16:46.359378 run osmo-stp_10.42.42.5(pid=7353): stdout: | (launched: 2022-12-12_23:16:44.633164) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:16:46.499188 run osmo-stp_10.42.42.5(pid=7353): stderr: | [0;m[38;5;43m20221212231644805 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231644805 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231644805 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231644805 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231644808 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231644808 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231644808 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:16:46.664675 run patchelf(pid=7356): Terminating (SIGINT) 23:16:46.855638 run patchelf(pid=7356): Terminated: ok {rc=0} 23:16:46.994788 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=7353): Process ended prematurely: osmo-stp_10.42.42.5(pid=7353) [trial-2383↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7353)] [trial-2383↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 23:16:47.006055 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 23:16:47.036338 run osmo-hlr_10.42.42.2(pid=7350): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7350)] 23:16:47.087308 run osmo-hlr_10.42.42.2(pid=7350): stdout: | (launched: 2022-12-12_23:16:43.656830) 23:16:47.139708 run osmo-hlr_10.42.42.2(pid=7350): stderr: | [0;m[1;31m20221212231643834 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212231643834 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212231643834 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212231643834 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212231643834 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212231643834 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212231643847 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:nanobts+band-900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212231643857 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212231643857 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212231643857 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:16:47.192541 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7343): Terminating (SIGTERM) 23:16:47.234250 run iperf3-srv_10.42.42.10(pid=7344): Terminating (SIGTERM) 23:16:47.275470 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7345): Terminating (SIGTERM) 23:16:47.317145 run iperf3-srv_10.42.42.10(pid=7346): Terminating (SIGTERM) 23:16:47.359378 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7349): Terminating (SIGTERM) 23:16:47.401789 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7352): Terminating (SIGTERM) 23:16:47.443628 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7355): Terminating (SIGTERM) 23:16:47.485365 --- ParallelTerminationStrategy: PID 7343 died... 23:16:47.505415 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7343): Terminated: ok {rc=0} 23:16:47.551632 --- ParallelTerminationStrategy: PID 7344 died... 23:16:47.571319 run iperf3-srv_10.42.42.10(pid=7344): Terminated {rc=256} 23:16:47.617108 --- ParallelTerminationStrategy: PID 7345 died... 23:16:47.636577 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7345): Terminated: ok {rc=0} 23:16:47.682413 --- ParallelTerminationStrategy: PID 7346 died... 23:16:47.702040 run iperf3-srv_10.42.42.10(pid=7346): Terminated {rc=256} 23:16:47.747562 --- ParallelTerminationStrategy: PID 7349 died... 23:16:47.767169 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7349): Terminated: ok {rc=0} 23:16:47.813067 --- ParallelTerminationStrategy: PID 7352 died... 23:16:47.832428 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7352): Terminated: ok {rc=0} 23:16:47.878093 --- ParallelTerminationStrategy: PID 7355 died... 23:16:47.897610 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7355): Terminated: ok {rc=0} 23:16:47.984176 bus /gobi_0: Setting Powered False 23:16:49.082903 bus /gobi_0: Setting Powered False 23:16:50.198516 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:nanobts+band-900+mod-bts0-egprs iperf3.py ---------------------------------------------- 23:16:51.349113 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:16:51.361219 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:16:51.416556 tst iperf3.py: using LAC 32185 23:16:51.545736 tst iperf3.py: using RAC 55 23:16:51.667534 tst iperf3.py: using CellId 32185 23:16:51.789229 tst iperf3.py: using BVCI 32186 23:16:51.902334 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:16:51.913554 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:16:51.924346 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:16:51.935574 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:16:51.946607 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:16:51.957184 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:16:51.968529 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:16:51.979376 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:16:51.990512 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:16:52.111055 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 23:16:52.333178 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:16:52.664193 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7357): Launched 23:16:52.950640 run iperf3-srv_10.42.42.10(pid=7358): Launched 23:16:53.074622 tst iperf3.py:8: start network... 23:16:53.297025 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:16:53.807356 run create_hlr_db(pid=7359): Launched 23:16:53.940633 bus /gobi_6: Setting Powered False 23:16:55.005671 run create_hlr_db(pid=7359): Terminated: ok {rc=0} 23:16:55.445577 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7361): Launched 23:16:55.755521 run osmo-hlr_10.42.42.2(pid=7362): Launched 23:16:55.873771 run osmo-stp_10.42.42.5: Starting osmo-stp 23:16:56.416062 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7364): Launched 23:16:56.725106 run osmo-stp_10.42.42.5(pid=7365): Launched 23:16:56.843996 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:16:57.376152 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7367): Launched 23:16:57.495877 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:16:57.757088 run patchelf(pid=7368): Launched 23:16:57.928712 run osmo-stp_10.42.42.5(pid=7365): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7365)] 23:16:58.059093 run osmo-stp_10.42.42.5(pid=7365): stdout: | (launched: 2022-12-12_23:16:56.668627) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:16:58.190848 run osmo-stp_10.42.42.5(pid=7365): stderr: | [0;m[38;5;43m20221212231656839 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231656839 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231656839 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231656840 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231656840 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231656840 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231656840 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:16:58.322820 run osmo-stp_10.42.42.5(pid=7365): stdout: | (launched: 2022-12-12_23:16:56.668627) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:16:58.449262 run osmo-stp_10.42.42.5(pid=7365): stderr: | [0;m[38;5;43m20221212231656839 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231656839 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231656839 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231656840 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231656840 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231656840 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231656840 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:16:58.598863 run patchelf(pid=7368): Terminating (SIGINT) 23:16:58.773460 run patchelf(pid=7368): Terminated: ok {rc=0} 23:16:58.898997 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7365): Process ended prematurely: osmo-stp_10.42.42.5(pid=7365) [trial-2383↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7365)] [trial-2383↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8] 23:16:58.908323 tst iperf3.py:8: Test FAILED (7.6 sec) 23:16:58.935526 run osmo-hlr_10.42.42.2(pid=7362): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7362)] 23:16:58.982957 run osmo-hlr_10.42.42.2(pid=7362): stdout: | (launched: 2022-12-12_23:16:55.699040) 23:16:59.031685 run osmo-hlr_10.42.42.2(pid=7362): stderr: | [0;m[1;31m20221212231655879 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212231655879 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212231655879 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212231655879 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212231655879 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212231655879 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212231655892 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:nanobts+band-900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212231655901 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212231655901 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212231655901 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:16:59.081220 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7357): Terminating (SIGTERM) 23:16:59.120254 run iperf3-srv_10.42.42.10(pid=7358): Terminating (SIGTERM) 23:16:59.161440 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7361): Terminating (SIGTERM) 23:16:59.205111 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7364): Terminating (SIGTERM) 23:16:59.246549 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7367): Terminating (SIGTERM) 23:16:59.288356 --- ParallelTerminationStrategy: PID 7357 died... 23:16:59.308291 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7357): Terminated: ok {rc=0} 23:16:59.355627 --- ParallelTerminationStrategy: PID 7358 died... 23:16:59.375218 run iperf3-srv_10.42.42.10(pid=7358): Terminated {rc=256} 23:16:59.421150 --- ParallelTerminationStrategy: PID 7361 died... 23:16:59.440789 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7361): Terminated: ok {rc=0} 23:16:59.487097 --- ParallelTerminationStrategy: PID 7364 died... 23:16:59.506768 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7364): Terminated: ok {rc=0} 23:16:59.552443 --- ParallelTerminationStrategy: PID 7367 died... 23:16:59.572020 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7367): Terminated: ok {rc=0} 23:16:59.659284 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:nanobts+band-900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 23:17:00.809094 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:17:00.821645 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:17:00.879374 tst iperf3m4.py: using LAC 32186 23:17:01.025541 tst iperf3m4.py: using RAC 56 23:17:01.196619 tst iperf3m4.py: using CellId 32186 23:17:01.322639 tst iperf3m4.py: using BVCI 32187 23:17:01.440491 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:17:01.452811 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:17:01.464668 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:17:01.477765 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:17:01.490166 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:17:01.504042 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:17:01.516044 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:17:01.529558 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:17:01.542572 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:17:01.676778 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:17:01.811512 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:17:01.964537 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:17:02.120595 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 23:17:02.346658 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:17:02.678577 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7372): Launched 23:17:02.964183 run iperf3-srv_10.42.42.10(pid=7373): Launched 23:17:03.087923 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 23:17:03.311297 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:17:03.642522 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7374): Launched 23:17:03.928689 run iperf3-srv_10.42.42.10(pid=7375): Launched 23:17:04.051675 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 23:17:04.272764 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:17:04.602774 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7376): Launched 23:17:04.888340 run iperf3-srv_10.42.42.10(pid=7377): Launched 23:17:05.011954 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 23:17:05.234233 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:17:05.565694 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7378): Launched 23:17:05.852622 run iperf3-srv_10.42.42.10(pid=7379): Launched 23:17:05.975446 tst iperf3m4.py:8: start network... 23:17:06.196591 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:17:06.706007 run create_hlr_db(pid=7380): Launched 23:17:06.840375 bus /gobi_6: Setting Powered False 23:17:07.904861 run create_hlr_db(pid=7380): Terminated: ok {rc=0} 23:17:08.341270 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7382): Launched 23:17:08.650127 run osmo-hlr_10.42.42.2(pid=7383): Launched 23:17:08.769482 run osmo-stp_10.42.42.5: Starting osmo-stp 23:17:09.314731 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7385): Launched 23:17:09.623181 run osmo-stp_10.42.42.5(pid=7386): Launched 23:17:09.742596 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:17:10.273341 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7388): Launched 23:17:10.391831 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:17:10.653654 run patchelf(pid=7389): Launched 23:17:10.826865 run osmo-stp_10.42.42.5(pid=7386): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7386)] 23:17:10.957219 run osmo-stp_10.42.42.5(pid=7386): stdout: | (launched: 2022-12-12_23:17:09.566537) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:17:11.089194 run osmo-stp_10.42.42.5(pid=7386): stderr: | [0;m[38;5;43m20221212231709737 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231709737 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231709737 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231709738 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231709738 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231709738 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231709738 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:17:11.221077 run osmo-stp_10.42.42.5(pid=7386): stdout: | (launched: 2022-12-12_23:17:09.566537) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:17:11.347661 run osmo-stp_10.42.42.5(pid=7386): stderr: | [0;m[38;5;43m20221212231709737 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231709737 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231709737 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231709738 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231709738 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231709738 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231709738 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:17:11.497290 run patchelf(pid=7389): Terminating (SIGINT) 23:17:11.673348 run patchelf(pid=7389): Terminated: ok {rc=0} 23:17:11.799026 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7386): Process ended prematurely: osmo-stp_10.42.42.5(pid=7386) [trial-2383↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7386)] [trial-2383↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8] 23:17:11.808335 tst iperf3m4.py:8: Test FAILED (11.0 sec) 23:17:11.836401 run osmo-hlr_10.42.42.2(pid=7383): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7383)] 23:17:11.884121 run osmo-hlr_10.42.42.2(pid=7383): stdout: | (launched: 2022-12-12_23:17:08.593620) 23:17:11.933217 run osmo-hlr_10.42.42.2(pid=7383): stderr: | [0;m[1;31m20221212231708769 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212231708769 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212231708769 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212231708769 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212231708769 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212231708769 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212231708781 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:nanobts+band-900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212231708790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212231708790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212231708790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:17:11.982481 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7372): Terminating (SIGTERM) 23:17:12.021888 run iperf3-srv_10.42.42.10(pid=7373): Terminating (SIGTERM) 23:17:12.061365 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7374): Terminating (SIGTERM) 23:17:12.101334 run iperf3-srv_10.42.42.10(pid=7375): Terminating (SIGTERM) 23:17:12.140626 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7376): Terminating (SIGTERM) 23:17:12.179766 run iperf3-srv_10.42.42.10(pid=7377): Terminating (SIGTERM) 23:17:12.218736 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7378): Terminating (SIGTERM) 23:17:12.258087 run iperf3-srv_10.42.42.10(pid=7379): Terminating (SIGTERM) 23:17:12.296919 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7382): Terminating (SIGTERM) 23:17:12.336040 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7385): Terminating (SIGTERM) 23:17:12.375164 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7388): Terminating (SIGTERM) 23:17:12.414385 --- ParallelTerminationStrategy: PID 7372 died... 23:17:12.433545 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7372): Terminated: ok {rc=0} 23:17:12.477313 --- ParallelTerminationStrategy: PID 7373 died... 23:17:12.495428 run iperf3-srv_10.42.42.10(pid=7373): Terminated {rc=256} 23:17:12.539631 --- ParallelTerminationStrategy: PID 7374 died... 23:17:12.557956 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7374): Terminated: ok {rc=0} 23:17:12.602049 --- ParallelTerminationStrategy: PID 7375 died... 23:17:12.620314 run iperf3-srv_10.42.42.10(pid=7375): Terminated {rc=256} 23:17:12.664317 --- ParallelTerminationStrategy: PID 7376 died... 23:17:12.682764 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7376): Terminated: ok {rc=0} 23:17:12.726144 --- ParallelTerminationStrategy: PID 7377 died... 23:17:12.744375 run iperf3-srv_10.42.42.10(pid=7377): Terminated {rc=256} 23:17:12.787879 --- ParallelTerminationStrategy: PID 7378 died... 23:17:12.806261 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7378): Terminated: ok {rc=0} 23:17:12.849961 --- ParallelTerminationStrategy: PID 7379 died... 23:17:12.868200 run iperf3-srv_10.42.42.10(pid=7379): Terminated {rc=256} 23:17:12.912159 --- ParallelTerminationStrategy: PID 7382 died... 23:17:12.930547 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7382): Terminated: ok {rc=0} 23:17:12.974138 --- ParallelTerminationStrategy: PID 7385 died... 23:17:12.992458 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7385): Terminated: ok {rc=0} 23:17:13.036845 --- ParallelTerminationStrategy: PID 7388 died... 23:17:13.055627 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7388): Terminated: ok {rc=0} 23:17:13.140889 bus /gobi_4: Setting Powered False 23:17:14.239489 bus /gobi_4: Setting Powered False 23:17:15.354248 bus /gobi_1: Setting Powered False 23:17:16.450089 bus /gobi_1: Setting Powered False 23:17:17.563666 bus /gobi_0: Setting Powered False 23:17:18.660306 bus /gobi_0: Setting Powered False 23:17:19.775394 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:nanobts+band-900+mod-bts0-egprs ping.py ---------------------------------------------- 23:17:20.875723 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:17:20.887138 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:17:20.936838 tst ping.py: using LAC 32187 23:17:21.058153 tst ping.py: using RAC 57 23:17:21.177564 tst ping.py: using CellId 32187 23:17:21.306574 tst ping.py: using BVCI 32188 23:17:21.426903 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:17:21.438576 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:17:21.450050 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:17:21.462207 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:17:21.474136 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:17:21.486144 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:17:21.498368 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:17:21.510367 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:17:21.627479 tst ping.py:19: start network... 23:17:21.844803 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:17:22.342819 run create_hlr_db(pid=7390): Launched 23:17:22.473106 bus /gobi_6: Setting Powered False 23:17:23.536233 run create_hlr_db(pid=7390): Terminated: ok {rc=0} 23:17:23.984829 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7392): Launched 23:17:24.305598 run osmo-hlr_10.42.42.2(pid=7393): Launched 23:17:24.430110 run osmo-stp_10.42.42.5: Starting osmo-stp 23:17:24.993219 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7395): Launched 23:17:25.315539 run osmo-stp_10.42.42.5(pid=7396): Launched 23:17:25.439122 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:17:25.996709 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7398): Launched 23:17:26.119803 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:17:26.393165 run patchelf(pid=7399): Launched 23:17:26.573084 run osmo-stp_10.42.42.5(pid=7396): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7396)] 23:17:26.709869 run osmo-stp_10.42.42.5(pid=7396): stdout: | (launched: 2022-12-12_23:17:25.256911) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:17:26.847715 run osmo-stp_10.42.42.5(pid=7396): stderr: | [0;m[38;5;43m20221212231725450 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231725450 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231725451 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231725451 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231725451 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231725451 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231725451 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:17:26.986141 run osmo-stp_10.42.42.5(pid=7396): stdout: | (launched: 2022-12-12_23:17:25.256911) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:17:27.118325 run osmo-stp_10.42.42.5(pid=7396): stderr: | [0;m[38;5;43m20221212231725450 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231725450 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231725451 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231725451 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231725451 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231725451 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231725451 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:17:27.275560 run patchelf(pid=7399): Terminating (SIGINT) 23:17:27.458633 run patchelf(pid=7399): Terminated: ok {rc=0} 23:17:27.589831 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=7396): Process ended prematurely: osmo-stp_10.42.42.5(pid=7396) [trial-2383↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7396)] [trial-2383↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22] 23:17:27.599445 tst ping.py:22: Test FAILED (6.7 sec) 23:17:27.627766 run osmo-hlr_10.42.42.2(pid=7393): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7393)] 23:17:27.677981 run osmo-hlr_10.42.42.2(pid=7393): stdout: | (launched: 2022-12-12_23:17:24.247090) 23:17:27.729810 run osmo-hlr_10.42.42.2(pid=7393): stderr: | [0;m[1;31m20221212231724447 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212231724447 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212231724447 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212231724447 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212231724447 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212231724447 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212231724459 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:nanobts+band-900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212231724468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212231724468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212231724468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:17:27.781678 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7392): Terminating (SIGTERM) 23:17:27.823041 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7395): Terminating (SIGTERM) 23:17:27.864648 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7398): Terminating (SIGTERM) 23:17:27.906708 --- ParallelTerminationStrategy: PID 7392 died... 23:17:27.926374 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7392): Terminated: ok {rc=0} 23:17:27.972638 --- ParallelTerminationStrategy: PID 7395 died... 23:17:27.992304 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7395): Terminated: ok {rc=0} 23:17:28.038136 --- ParallelTerminationStrategy: PID 7398 died... 23:17:28.057630 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7398): Terminated: ok {rc=0} 23:17:28.144261 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:nanobts+band-900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 23:17:29.231133 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:17:29.243153 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:17:29.294032 tst ping_idle_ping.py: using LAC 32188 23:17:29.415879 tst ping_idle_ping.py: using RAC 58 23:17:29.538031 tst ping_idle_ping.py: using CellId 32188 23:17:29.659982 tst ping_idle_ping.py: using BVCI 32189 23:17:29.771399 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:17:29.782359 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:17:29.793095 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:17:29.805228 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:17:29.816693 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:17:29.828353 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:17:29.839958 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:17:29.851407 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:17:29.968368 tst ping_idle_ping.py:24: start network... 23:17:30.173987 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:17:30.647909 run create_hlr_db(pid=7400): Launched 23:17:30.764293 bus /gobi_6: Setting Powered False 23:17:31.840489 run create_hlr_db(pid=7400): Terminated: ok {rc=0} 23:17:32.353409 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7402): Launched 23:17:32.679762 run osmo-hlr_10.42.42.2(pid=7403): Launched 23:17:32.803156 run osmo-stp_10.42.42.5: Starting osmo-stp 23:17:33.363579 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7405): Launched 23:17:33.687484 run osmo-stp_10.42.42.5(pid=7406): Launched 23:17:33.811025 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:17:34.371024 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7408): Launched 23:17:34.495552 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:17:34.769357 run patchelf(pid=7409): Launched 23:17:34.950532 run osmo-stp_10.42.42.5(pid=7406): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7406)] 23:17:35.088652 run osmo-stp_10.42.42.5(pid=7406): stdout: | (launched: 2022-12-12_23:17:33.628371) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:17:35.227985 run osmo-stp_10.42.42.5(pid=7406): stderr: | [0;m[38;5;43m20221212231733823 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231733823 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231733823 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231733823 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231733824 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231733824 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231733824 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:17:35.367972 run osmo-stp_10.42.42.5(pid=7406): stdout: | (launched: 2022-12-12_23:17:33.628371) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:17:35.501604 run osmo-stp_10.42.42.5(pid=7406): stderr: | [0;m[38;5;43m20221212231733823 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231733823 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231733823 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231733823 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231733824 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231733824 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231733824 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:17:35.659946 run patchelf(pid=7409): Terminating (SIGINT) 23:17:35.844266 run patchelf(pid=7409): Terminated: ok {rc=0} 23:17:35.976418 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=7406): Process ended prematurely: osmo-stp_10.42.42.5(pid=7406) [trial-2383↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7406)] [trial-2383↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27] 23:17:35.986014 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 23:17:36.014188 run osmo-hlr_10.42.42.2(pid=7403): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7403)] 23:17:36.064106 run osmo-hlr_10.42.42.2(pid=7403): stdout: | (launched: 2022-12-12_23:17:32.620565) 23:17:36.115675 run osmo-hlr_10.42.42.2(pid=7403): stderr: | [0;m[1;31m20221212231732821 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212231732821 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212231732821 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212231732821 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212231732821 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212231732821 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212231732834 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:nanobts+band-900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212231732842 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212231732842 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212231732842 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:17:36.167632 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7402): Terminating (SIGTERM) 23:17:36.209123 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7405): Terminating (SIGTERM) 23:17:36.250687 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7408): Terminating (SIGTERM) 23:17:36.292622 --- ParallelTerminationStrategy: PID 7402 died... 23:17:36.312737 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7402): Terminated: ok {rc=0} 23:17:36.359301 --- ParallelTerminationStrategy: PID 7405 died... 23:17:36.379310 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7405): Terminated: ok {rc=0} 23:17:36.425449 --- ParallelTerminationStrategy: PID 7408 died... 23:17:36.445165 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7408): Terminated: ok {rc=0} 23:17:36.531968 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2383 gprs:nanobts+band-900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 gprs:nanobts+band-900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 23:17:37.837413 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:17:37.845385 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 23:17:37.878881 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 23:17:37.918346 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 23:17:38.005230 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 23:17:38.037930 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 23:17:38.077307 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 23:17:38.674882 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2383 gprs:nanobts+band-900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 23:17:38.727315 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:17:38.738702 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:17:38.805024 tst cs_paging_gprs_active.py: using LAC 32189 23:17:38.932902 tst cs_paging_gprs_active.py: using RAC 59 23:17:39.060828 tst cs_paging_gprs_active.py: using CellId 32189 23:17:39.187875 tst cs_paging_gprs_active.py: using BVCI 32190 23:17:39.307956 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:17:39.319298 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:17:39.330524 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:17:39.341729 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:17:39.352811 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:17:39.364075 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:17:39.375772 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:17:39.387009 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:17:39.398358 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:17:39.516551 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:17:39.634501 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 23:17:39.842718 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:17:40.151462 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7413): Launched 23:17:40.419912 run iperf3-srv_10.42.42.10(pid=7414): Launched 23:17:40.535812 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 23:17:40.742686 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:17:41.051916 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7415): Launched 23:17:41.320669 run iperf3-srv_10.42.42.10(pid=7416): Launched 23:17:41.436397 tst cs_paging_gprs_active.py:38: start network... 23:17:41.642389 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:17:42.119883 run create_hlr_db(pid=7417): Launched 23:17:42.239579 bus /gobi_6: Setting Powered False 23:17:43.299981 run create_hlr_db(pid=7417): Terminated: ok {rc=0} 23:17:43.747338 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7419): Launched 23:17:44.076224 run osmo-hlr_10.42.42.2(pid=7420): Launched 23:17:44.201917 run osmo-stp_10.42.42.5: Starting osmo-stp 23:17:44.768108 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7422): Launched 23:17:45.097274 run osmo-stp_10.42.42.5(pid=7423): Launched 23:17:45.223086 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:17:45.791940 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7425): Launched 23:17:45.924831 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:17:46.224284 run patchelf(pid=7426): Launched 23:17:46.413286 run osmo-stp_10.42.42.5(pid=7423): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7423)] 23:17:46.549031 run osmo-stp_10.42.42.5(pid=7423): stdout: | (launched: 2022-12-12_23:17:45.037322) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:17:46.688353 run osmo-stp_10.42.42.5(pid=7423): stderr: | [0;m[38;5;43m20221212231745230 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231745230 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231745230 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231745231 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231745233 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231745233 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231745233 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:17:46.827228 run osmo-stp_10.42.42.5(pid=7423): stdout: | (launched: 2022-12-12_23:17:45.037322) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:17:46.959849 run osmo-stp_10.42.42.5(pid=7423): stderr: | [0;m[38;5;43m20221212231745230 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231745230 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231745230 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231745231 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231745233 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231745233 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231745233 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:17:47.117141 run patchelf(pid=7426): Terminating (SIGINT) 23:17:47.296813 run patchelf(pid=7426): Terminated: ok {rc=0} 23:17:47.423241 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=7423): Process ended prematurely: osmo-stp_10.42.42.5(pid=7423) [trial-2383↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7423)] [trial-2383↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 23:17:47.432782 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 23:17:47.460282 run osmo-hlr_10.42.42.2(pid=7420): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7420)] 23:17:47.508482 run osmo-hlr_10.42.42.2(pid=7420): stdout: | (launched: 2022-12-12_23:17:44.016411) 23:17:47.558206 run osmo-hlr_10.42.42.2(pid=7420): stderr: | [0;m[1;31m20221212231744219 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212231744219 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212231744219 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212231744219 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212231744219 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212231744219 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212231744231 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:nanobts+band-900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212231744241 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212231744241 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212231744242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:17:47.608258 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7413): Terminating (SIGTERM) 23:17:47.648069 run iperf3-srv_10.42.42.10(pid=7414): Terminating (SIGTERM) 23:17:47.687406 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7415): Terminating (SIGTERM) 23:17:47.727411 run iperf3-srv_10.42.42.10(pid=7416): Terminating (SIGTERM) 23:17:47.766704 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7419): Terminating (SIGTERM) 23:17:47.806584 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7422): Terminating (SIGTERM) 23:17:47.846637 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7425): Terminating (SIGTERM) 23:17:47.886880 --- ParallelTerminationStrategy: PID 7413 died... 23:17:47.905780 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7413): Terminated: ok {rc=0} 23:17:47.950349 --- ParallelTerminationStrategy: PID 7414 died... 23:17:47.969086 run iperf3-srv_10.42.42.10(pid=7414): Terminated {rc=256} 23:17:48.013485 --- ParallelTerminationStrategy: PID 7415 died... 23:17:48.032269 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7415): Terminated: ok {rc=0} 23:17:48.076612 --- ParallelTerminationStrategy: PID 7416 died... 23:17:48.095292 run iperf3-srv_10.42.42.10(pid=7416): Terminated {rc=256} 23:17:48.139418 --- ParallelTerminationStrategy: PID 7419 died... 23:17:48.158100 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7419): Terminated: ok {rc=0} 23:17:48.202143 --- ParallelTerminationStrategy: PID 7422 died... 23:17:48.220861 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7422): Terminated: ok {rc=0} 23:17:48.265259 --- ParallelTerminationStrategy: PID 7425 died... 23:17:48.284121 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7425): Terminated: ok {rc=0} 23:17:48.369405 bus /gobi_0: Setting Powered False 23:17:49.468372 bus /gobi_0: Setting Powered False 23:17:50.582847 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 23:17:51.728717 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:17:51.740241 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:17:51.808934 tst iperf3.py: using LAC 32190 23:17:51.930137 tst iperf3.py: using RAC 60 23:17:52.064426 tst iperf3.py: using CellId 32190 23:17:52.194987 tst iperf3.py: using BVCI 32191 23:17:52.316388 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:17:52.328067 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:17:52.339518 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:17:52.350806 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:17:52.361968 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:17:52.373238 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:17:52.384758 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:17:52.395960 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:17:52.407259 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:17:52.525292 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 23:17:52.733502 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:17:53.042942 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7427): Launched 23:17:53.311855 run iperf3-srv_10.42.42.10(pid=7428): Launched 23:17:53.427947 tst iperf3.py:8: start network... 23:17:53.635342 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:17:54.114854 run create_hlr_db(pid=7429): Launched 23:17:54.234060 bus /gobi_6: Setting Powered False 23:17:55.295334 run create_hlr_db(pid=7429): Terminated: ok {rc=0} 23:17:55.744098 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7431): Launched 23:17:56.074182 run osmo-hlr_10.42.42.2(pid=7432): Launched 23:17:56.200495 run osmo-stp_10.42.42.5: Starting osmo-stp 23:17:56.767991 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7434): Launched 23:17:57.097071 run osmo-stp_10.42.42.5(pid=7435): Launched 23:17:57.222904 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:17:57.791462 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7437): Launched 23:17:57.917596 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:17:58.198056 run patchelf(pid=7438): Launched 23:17:58.383270 run osmo-stp_10.42.42.5(pid=7435): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7435)] 23:17:58.522468 run osmo-stp_10.42.42.5(pid=7435): stdout: | (launched: 2022-12-12_23:17:57.036862) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:17:58.662619 run osmo-stp_10.42.42.5(pid=7435): stderr: | [0;m[38;5;43m20221212231757231 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231757232 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231757232 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231757232 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231757233 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231757233 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231757233 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:17:58.802988 run osmo-stp_10.42.42.5(pid=7435): stdout: | (launched: 2022-12-12_23:17:57.036862) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:17:58.937494 run osmo-stp_10.42.42.5(pid=7435): stderr: | [0;m[38;5;43m20221212231757231 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231757232 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231757232 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231757232 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231757233 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231757233 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231757233 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:17:59.096870 run patchelf(pid=7438): Terminating (SIGINT) 23:17:59.282349 run patchelf(pid=7438): Terminated: ok {rc=0} 23:17:59.415969 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7435): Process ended prematurely: osmo-stp_10.42.42.5(pid=7435) [trial-2383↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7435)] [trial-2383↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8] 23:17:59.426076 tst iperf3.py:8: Test FAILED (7.7 sec) 23:17:59.454556 run osmo-hlr_10.42.42.2(pid=7432): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7432)] 23:17:59.504035 run osmo-hlr_10.42.42.2(pid=7432): stdout: | (launched: 2022-12-12_23:17:56.014093) 23:17:59.555514 run osmo-hlr_10.42.42.2(pid=7432): stderr: | [0;m[1;31m20221212231756215 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212231756215 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212231756215 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212231756215 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212231756215 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212231756215 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212231756227 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212231756235 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212231756235 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212231756235 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:17:59.607346 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7427): Terminating (SIGTERM) 23:17:59.649104 run iperf3-srv_10.42.42.10(pid=7428): Terminating (SIGTERM) 23:17:59.690898 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7431): Terminating (SIGTERM) 23:17:59.732557 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7434): Terminating (SIGTERM) 23:17:59.774206 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7437): Terminating (SIGTERM) 23:17:59.815936 --- ParallelTerminationStrategy: PID 7427 died... 23:17:59.836069 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7427): Terminated: ok {rc=0} 23:17:59.882407 --- ParallelTerminationStrategy: PID 7428 died... 23:17:59.901976 run iperf3-srv_10.42.42.10(pid=7428): Terminated {rc=256} 23:17:59.948234 --- ParallelTerminationStrategy: PID 7431 died... 23:17:59.967767 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7431): Terminated: ok {rc=0} 23:18:00.013659 --- ParallelTerminationStrategy: PID 7434 died... 23:18:00.033318 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7434): Terminated: ok {rc=0} 23:18:00.079867 --- ParallelTerminationStrategy: PID 7437 died... 23:18:00.099614 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7437): Terminated: ok {rc=0} 23:18:00.187163 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 23:18:01.364869 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:18:01.377942 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:18:01.461159 tst iperf3m4.py: using LAC 32191 23:18:01.607252 tst iperf3m4.py: using RAC 61 23:18:01.770286 tst iperf3m4.py: using CellId 32191 23:18:01.925945 tst iperf3m4.py: using BVCI 32192 23:18:02.043713 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:18:02.055886 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:18:02.067765 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:18:02.080752 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:18:02.093484 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:18:02.107141 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:18:02.119087 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:18:02.131946 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:18:02.147128 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:18:02.268253 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:18:02.393708 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:18:02.513456 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:18:02.635515 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 23:18:02.857428 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:18:03.187414 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7439): Launched 23:18:03.474383 run iperf3-srv_10.42.42.10(pid=7440): Launched 23:18:03.597473 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 23:18:03.818388 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:18:04.148417 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7441): Launched 23:18:04.434088 run iperf3-srv_10.42.42.10(pid=7442): Launched 23:18:04.557727 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 23:18:04.779431 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:18:05.109149 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7443): Launched 23:18:05.394766 run iperf3-srv_10.42.42.10(pid=7444): Launched 23:18:05.518880 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 23:18:05.741322 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:18:06.072609 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7445): Launched 23:18:06.358872 run iperf3-srv_10.42.42.10(pid=7446): Launched 23:18:06.482371 tst iperf3m4.py:8: start network... 23:18:06.703940 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:18:07.213337 run create_hlr_db(pid=7447): Launched 23:18:07.346415 bus /gobi_6: Setting Powered False 23:18:08.411284 run create_hlr_db(pid=7447): Terminated: ok {rc=0} 23:18:08.850262 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7449): Launched 23:18:09.159915 run osmo-hlr_10.42.42.2(pid=7450): Launched 23:18:09.278764 run osmo-stp_10.42.42.5: Starting osmo-stp 23:18:09.815649 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7452): Launched 23:18:10.125451 run osmo-stp_10.42.42.5(pid=7453): Launched 23:18:10.245552 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:18:10.780614 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7455): Launched 23:18:10.898798 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:18:11.159694 run patchelf(pid=7456): Launched 23:18:11.331667 run osmo-stp_10.42.42.5(pid=7453): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7453)] 23:18:11.462388 run osmo-stp_10.42.42.5(pid=7453): stdout: | (launched: 2022-12-12_23:18:10.068286) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:18:11.594437 run osmo-stp_10.42.42.5(pid=7453): stderr: | [0;m[38;5;43m20221212231810241 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231810241 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231810242 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231810242 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231810243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231810243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231810243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:18:11.726179 run osmo-stp_10.42.42.5(pid=7453): stdout: | (launched: 2022-12-12_23:18:10.068286) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:18:11.852453 run osmo-stp_10.42.42.5(pid=7453): stderr: | [0;m[38;5;43m20221212231810241 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231810241 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231810242 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231810242 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231810243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231810243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231810243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:18:12.002151 run patchelf(pid=7456): Terminating (SIGINT) 23:18:12.178114 run patchelf(pid=7456): Terminated: ok {rc=0} 23:18:12.303833 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7453): Process ended prematurely: osmo-stp_10.42.42.5(pid=7453) [trial-2383↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7453)] [trial-2383↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 23:18:12.313448 tst iperf3m4.py:8: Test FAILED (11.0 sec) 23:18:12.340823 run osmo-hlr_10.42.42.2(pid=7450): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7450)] 23:18:12.389143 run osmo-hlr_10.42.42.2(pid=7450): stdout: | (launched: 2022-12-12_23:18:09.102854) 23:18:12.438126 run osmo-hlr_10.42.42.2(pid=7450): stderr: | [0;m[1;31m20221212231809281 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212231809281 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212231809281 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212231809281 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212231809281 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212231809281 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212231809294 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212231809303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212231809303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212231809303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:18:12.487567 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7439): Terminating (SIGTERM) 23:18:12.526958 run iperf3-srv_10.42.42.10(pid=7440): Terminating (SIGTERM) 23:18:12.566801 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7441): Terminating (SIGTERM) 23:18:12.606702 run iperf3-srv_10.42.42.10(pid=7442): Terminating (SIGTERM) 23:18:12.646339 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7443): Terminating (SIGTERM) 23:18:12.686023 run iperf3-srv_10.42.42.10(pid=7444): Terminating (SIGTERM) 23:18:12.725548 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7445): Terminating (SIGTERM) 23:18:12.765291 run iperf3-srv_10.42.42.10(pid=7446): Terminating (SIGTERM) 23:18:12.804753 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7449): Terminating (SIGTERM) 23:18:12.844015 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7452): Terminating (SIGTERM) 23:18:12.884237 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7455): Terminating (SIGTERM) 23:18:12.924216 --- ParallelTerminationStrategy: PID 7439 died... 23:18:12.943231 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7439): Terminated: ok {rc=0} 23:18:12.988152 --- ParallelTerminationStrategy: PID 7440 died... 23:18:13.006742 run iperf3-srv_10.42.42.10(pid=7440): Terminated {rc=256} 23:18:13.050776 --- ParallelTerminationStrategy: PID 7441 died... 23:18:13.069141 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7441): Terminated: ok {rc=0} 23:18:13.113177 --- ParallelTerminationStrategy: PID 7442 died... 23:18:13.131870 run iperf3-srv_10.42.42.10(pid=7442): Terminated {rc=256} 23:18:13.175790 --- ParallelTerminationStrategy: PID 7443 died... 23:18:13.194474 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7443): Terminated: ok {rc=0} 23:18:13.239203 --- ParallelTerminationStrategy: PID 7444 died... 23:18:13.257739 run iperf3-srv_10.42.42.10(pid=7444): Terminated {rc=256} 23:18:13.302099 --- ParallelTerminationStrategy: PID 7445 died... 23:18:13.320789 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7445): Terminated: ok {rc=0} 23:18:13.364868 --- ParallelTerminationStrategy: PID 7446 died... 23:18:13.384026 run iperf3-srv_10.42.42.10(pid=7446): Terminated {rc=256} 23:18:13.427853 --- ParallelTerminationStrategy: PID 7449 died... 23:18:13.446395 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7449): Terminated: ok {rc=0} 23:18:13.490114 --- ParallelTerminationStrategy: PID 7452 died... 23:18:13.508476 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7452): Terminated: ok {rc=0} 23:18:13.552588 --- ParallelTerminationStrategy: PID 7455 died... 23:18:13.571302 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7455): Terminated: ok {rc=0} 23:18:13.654856 bus /gobi_4: Setting Powered False 23:18:14.750311 bus /gobi_4: Setting Powered False 23:18:15.886730 bus /gobi_1: Setting Powered False 23:18:16.993764 bus /gobi_1: Setting Powered False 23:18:18.113957 bus /gobi_0: Setting Powered False 23:18:19.211215 bus /gobi_0: Setting Powered False 23:18:20.330136 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 23:18:21.428911 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:18:21.440655 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:18:21.507347 tst ping.py: using LAC 32192 23:18:21.626866 tst ping.py: using RAC 62 23:18:21.745758 tst ping.py: using CellId 32192 23:18:21.865121 tst ping.py: using BVCI 32193 23:18:21.977416 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:18:21.988415 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:18:21.999149 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:18:22.010123 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:18:22.021118 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:18:22.032149 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:18:22.043381 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:18:22.054412 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:18:22.174700 tst ping.py:19: start network... 23:18:22.393947 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:18:22.894263 run create_hlr_db(pid=7457): Launched 23:18:23.025127 bus /gobi_6: Setting Powered False 23:18:24.088932 run create_hlr_db(pid=7457): Terminated: ok {rc=0} 23:18:24.521328 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7459): Launched 23:18:24.825153 run osmo-hlr_10.42.42.2(pid=7460): Launched 23:18:24.941892 run osmo-stp_10.42.42.5: Starting osmo-stp 23:18:25.481574 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7462): Launched 23:18:25.785795 run osmo-stp_10.42.42.5(pid=7463): Launched 23:18:25.901302 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:18:26.424623 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7465): Launched 23:18:26.541256 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:18:26.799823 run patchelf(pid=7466): Launched 23:18:26.969106 run osmo-stp_10.42.42.5(pid=7463): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7463)] 23:18:27.097601 run osmo-stp_10.42.42.5(pid=7463): stdout: | (launched: 2022-12-12_23:18:25.730245) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:18:27.226992 run osmo-stp_10.42.42.5(pid=7463): stderr: | [0;m[38;5;43m20221212231825902 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231825903 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231825903 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231825903 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231825904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231825904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231825904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:18:27.357216 run osmo-stp_10.42.42.5(pid=7463): stdout: | (launched: 2022-12-12_23:18:25.730245) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:18:27.481434 run osmo-stp_10.42.42.5(pid=7463): stderr: | [0;m[38;5;43m20221212231825902 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231825903 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231825903 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231825903 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231825904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231825904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231825904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:18:27.628114 run patchelf(pid=7466): Terminating (SIGINT) 23:18:27.799816 run patchelf(pid=7466): Terminated: ok {rc=0} 23:18:27.923264 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=7463): Process ended prematurely: osmo-stp_10.42.42.5(pid=7463) [trial-2383↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7463)] [trial-2383↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22] 23:18:27.931997 tst ping.py:22: Test FAILED (6.5 sec) 23:18:27.958306 run osmo-hlr_10.42.42.2(pid=7460): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7460)] 23:18:28.005884 run osmo-hlr_10.42.42.2(pid=7460): stdout: | (launched: 2022-12-12_23:18:24.769718) 23:18:28.054969 run osmo-hlr_10.42.42.2(pid=7460): stderr: | [0;m[1;31m20221212231824944 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212231824944 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212231824944 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212231824944 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212231824944 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212231824945 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212231824957 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212231824966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212231824966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212231824966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:18:28.104238 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7459): Terminating (SIGTERM) 23:18:28.143854 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7462): Terminating (SIGTERM) 23:18:28.183589 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7465): Terminating (SIGTERM) 23:18:28.223718 --- ParallelTerminationStrategy: PID 7459 died... 23:18:28.242833 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7459): Terminated: ok {rc=0} 23:18:28.287819 --- ParallelTerminationStrategy: PID 7462 died... 23:18:28.306534 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7462): Terminated: ok {rc=0} 23:18:28.350648 --- ParallelTerminationStrategy: PID 7465 died... 23:18:28.369399 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7465): Terminated: ok {rc=0} 23:18:28.454896 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 23:18:29.543056 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:18:29.555166 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:18:29.626434 tst ping_idle_ping.py: using LAC 32193 23:18:29.754637 tst ping_idle_ping.py: using RAC 63 23:18:29.883216 tst ping_idle_ping.py: using CellId 32193 23:18:30.011766 tst ping_idle_ping.py: using BVCI 32194 23:18:30.129479 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:18:30.140942 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:18:30.152284 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:18:30.164358 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:18:30.176561 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:18:30.188445 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:18:30.200427 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:18:30.212263 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:18:30.328664 tst ping_idle_ping.py:24: start network... 23:18:30.534807 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:18:31.034435 run create_hlr_db(pid=7467): Launched 23:18:31.187124 bus /gobi_6: Setting Powered False 23:18:32.250817 run create_hlr_db(pid=7467): Terminated: ok {rc=0} 23:18:32.691628 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7469): Launched 23:18:32.997798 run osmo-hlr_10.42.42.2(pid=7470): Launched 23:18:33.115301 run osmo-stp_10.42.42.5: Starting osmo-stp 23:18:33.641332 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7472): Launched 23:18:33.945202 run osmo-stp_10.42.42.5(pid=7473): Launched 23:18:34.061590 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:18:34.586138 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7475): Launched 23:18:34.702632 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:18:34.959679 run patchelf(pid=7476): Launched 23:18:35.129315 run osmo-stp_10.42.42.5(pid=7473): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7473)] 23:18:35.258141 run osmo-stp_10.42.42.5(pid=7473): stdout: | (launched: 2022-12-12_23:18:33.889396) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:18:35.388221 run osmo-stp_10.42.42.5(pid=7473): stderr: | [0;m[38;5;43m20221212231834062 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231834063 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231834063 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231834063 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231834064 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231834064 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231834064 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:18:35.518111 run osmo-stp_10.42.42.5(pid=7473): stdout: | (launched: 2022-12-12_23:18:33.889396) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:18:35.642438 run osmo-stp_10.42.42.5(pid=7473): stderr: | [0;m[38;5;43m20221212231834062 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231834063 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231834063 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231834063 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231834064 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231834064 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231834064 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:18:35.789304 run patchelf(pid=7476): Terminating (SIGINT) 23:18:35.961571 run patchelf(pid=7476): Terminated: ok {rc=0} 23:18:36.085384 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=7473): Process ended prematurely: osmo-stp_10.42.42.5(pid=7473) [trial-2383↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7473)] [trial-2383↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 23:18:36.094188 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 23:18:36.121659 run osmo-hlr_10.42.42.2(pid=7470): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7470)] 23:18:36.169419 run osmo-hlr_10.42.42.2(pid=7470): stdout: | (launched: 2022-12-12_23:18:32.941319) 23:18:36.218623 run osmo-hlr_10.42.42.2(pid=7470): stderr: | [0;m[1;31m20221212231833119 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212231833119 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212231833119 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212231833119 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212231833119 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212231833119 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212231833132 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212231833142 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212231833142 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212231833142 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:18:36.268251 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7469): Terminating (SIGTERM) 23:18:36.307502 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7472): Terminating (SIGTERM) 23:18:36.347141 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7475): Terminating (SIGTERM) 23:18:36.387263 --- ParallelTerminationStrategy: PID 7469 died... 23:18:36.406303 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7469): Terminated: ok {rc=0} 23:18:36.450527 --- ParallelTerminationStrategy: PID 7472 died... 23:18:36.468879 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7472): Terminated: ok {rc=0} 23:18:36.512867 --- ParallelTerminationStrategy: PID 7475 died... 23:18:36.531784 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7475): Terminated: ok {rc=0} 23:18:36.615115 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2383 gprs:nanobts+band-900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 23:18:37.920343 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:18:37.927332 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 23:18:37.959810 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 23:18:37.997913 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 23:18:38.083325 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 23:18:38.115134 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 23:18:38.153421 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 23:18:38.751504 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2383 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 23:18:38.800402 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:18:38.811684 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 23:18:38.860806 tst cs_paging_gprs_active.py: using LAC 32194 23:18:38.982822 tst cs_paging_gprs_active.py: using RAC 64 23:18:39.104853 tst cs_paging_gprs_active.py: using CellId 32194 23:18:39.227623 tst cs_paging_gprs_active.py: using BVCI 32195 23:18:39.340824 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:18:39.352200 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:18:39.363216 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:18:39.374553 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:18:39.386004 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:18:39.397297 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:18:39.408646 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:18:39.420019 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:18:39.431599 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 23:18:39.551694 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 23:18:39.667337 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 23:18:39.872683 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:18:40.196870 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7480): Launched 23:18:40.481307 run iperf3-srv_10.42.42.10(pid=7481): Launched 23:18:40.603321 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 23:18:40.822570 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:18:41.148578 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7482): Launched 23:18:41.431433 run iperf3-srv_10.42.42.10(pid=7483): Launched 23:18:41.553647 tst cs_paging_gprs_active.py:38: start network... 23:18:41.772544 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:18:42.278849 run create_hlr_db(pid=7484): Launched 23:18:42.411517 bus /gobi_6: Setting Powered False 23:18:43.475737 run create_hlr_db(pid=7484): Terminated: ok {rc=0} 23:18:43.911541 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7486): Launched 23:18:44.217605 run osmo-hlr_10.42.42.2(pid=7487): Launched 23:18:44.336541 run osmo-stp_10.42.42.5: Starting osmo-stp 23:18:44.866409 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7489): Launched 23:18:45.170455 run osmo-stp_10.42.42.5(pid=7490): Launched 23:18:45.288201 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:18:45.815280 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7492): Launched 23:18:45.959858 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:18:46.260154 run patchelf(pid=7493): Launched 23:18:46.458514 run osmo-stp_10.42.42.5(pid=7490): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7490)] 23:18:46.601539 run osmo-stp_10.42.42.5(pid=7490): stdout: | (launched: 2022-12-12_23:18:45.115089) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:18:46.743789 run osmo-stp_10.42.42.5(pid=7490): stderr: | [0;m[38;5;43m20221212231845286 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231845287 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231845287 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231845287 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231845288 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231845288 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231845288 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:18:46.888353 run osmo-stp_10.42.42.5(pid=7490): stdout: | (launched: 2022-12-12_23:18:45.115089) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:18:47.027708 run osmo-stp_10.42.42.5(pid=7490): stderr: | [0;m[38;5;43m20221212231845286 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231845287 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231845287 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231845287 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231845288 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231845288 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231845288 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:18:47.189621 run patchelf(pid=7493): Terminating (SIGINT) 23:18:47.373707 run patchelf(pid=7493): Terminated: ok {rc=0} 23:18:47.506690 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=7490): Process ended prematurely: osmo-stp_10.42.42.5(pid=7490) [trial-2383↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7490)] [trial-2383↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 23:18:47.516874 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 23:18:47.545580 run osmo-hlr_10.42.42.2(pid=7487): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7487)] 23:18:47.595535 run osmo-hlr_10.42.42.2(pid=7487): stdout: | (launched: 2022-12-12_23:18:44.161818) 23:18:47.647157 run osmo-hlr_10.42.42.2(pid=7487): stderr: | [0;m[1;31m20221212231844339 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212231844339 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212231844339 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212231844339 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212231844339 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212231844339 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212231844351 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212231844362 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212231844362 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212231844362 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:18:47.698797 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7480): Terminating (SIGTERM) 23:18:47.740195 run iperf3-srv_10.42.42.10(pid=7481): Terminating (SIGTERM) 23:18:47.781763 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7482): Terminating (SIGTERM) 23:18:47.823173 run iperf3-srv_10.42.42.10(pid=7483): Terminating (SIGTERM) 23:18:47.864618 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7486): Terminating (SIGTERM) 23:18:47.906160 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7489): Terminating (SIGTERM) 23:18:47.947674 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7492): Terminating (SIGTERM) 23:18:47.989310 --- ParallelTerminationStrategy: PID 7480 died... 23:18:48.009268 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7480): Terminated: ok {rc=0} 23:18:48.055143 --- ParallelTerminationStrategy: PID 7481 died... 23:18:48.074552 run iperf3-srv_10.42.42.10(pid=7481): Terminated {rc=256} 23:18:48.120010 --- ParallelTerminationStrategy: PID 7482 died... 23:18:48.139400 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7482): Terminated: ok {rc=0} 23:18:48.185355 --- ParallelTerminationStrategy: PID 7483 died... 23:18:48.204615 run iperf3-srv_10.42.42.10(pid=7483): Terminated {rc=256} 23:18:48.249977 --- ParallelTerminationStrategy: PID 7486 died... 23:18:48.269248 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7486): Terminated: ok {rc=0} 23:18:48.314762 --- ParallelTerminationStrategy: PID 7489 died... 23:18:48.334190 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7489): Terminated: ok {rc=0} 23:18:48.379605 --- ParallelTerminationStrategy: PID 7492 died... 23:18:48.398930 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7492): Terminated: ok {rc=0} 23:18:48.486500 bus /gobi_0: Setting Powered False 23:18:49.586381 bus /gobi_0: Setting Powered False 23:18:50.704833 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 23:18:51.850895 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:18:51.862894 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 23:18:51.917431 tst iperf3.py: using LAC 32195 23:18:52.037379 tst iperf3.py: using RAC 65 23:18:52.156171 tst iperf3.py: using CellId 32195 23:18:52.275201 tst iperf3.py: using BVCI 32196 23:18:52.388885 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:18:52.400313 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:18:52.411496 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:18:52.422694 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:18:52.434354 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:18:52.445478 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:18:52.457311 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:18:52.468637 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:18:52.480322 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 23:18:52.598273 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 23:18:52.802987 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:18:53.108743 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7495): Launched 23:18:53.374032 run iperf3-srv_10.42.42.10(pid=7496): Launched 23:18:53.488637 tst iperf3.py:8: start network... 23:18:53.693294 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:18:54.199949 run create_hlr_db(pid=7497): Launched 23:18:54.329062 bus /gobi_6: Setting Powered False 23:18:55.393237 run create_hlr_db(pid=7497): Terminated: ok {rc=0} 23:18:55.828091 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7499): Launched 23:18:56.153666 run osmo-hlr_10.42.42.2(pid=7500): Launched 23:18:56.277552 run osmo-stp_10.42.42.5: Starting osmo-stp 23:18:56.840699 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7502): Launched 23:18:57.164902 run osmo-stp_10.42.42.5(pid=7503): Launched 23:18:57.288795 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:18:57.849434 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7505): Launched 23:18:57.974253 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:18:58.250594 run patchelf(pid=7506): Launched 23:18:58.432107 run osmo-stp_10.42.42.5(pid=7503): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7503)] 23:18:58.569796 run osmo-stp_10.42.42.5(pid=7503): stdout: | (launched: 2022-12-12_23:18:57.105868) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:18:58.708457 run osmo-stp_10.42.42.5(pid=7503): stderr: | [0;m[38;5;43m20221212231857302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231857302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231857302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231857303 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231857303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231857303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231857303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:18:58.847330 run osmo-stp_10.42.42.5(pid=7503): stdout: | (launched: 2022-12-12_23:18:57.105868) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:18:58.980048 run osmo-stp_10.42.42.5(pid=7503): stderr: | [0;m[38;5;43m20221212231857302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231857302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231857302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231857303 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231857303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231857303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231857303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:18:59.138024 run patchelf(pid=7506): Terminating (SIGINT) 23:18:59.320938 run patchelf(pid=7506): Terminated: ok {rc=0} 23:18:59.453589 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7503): Process ended prematurely: osmo-stp_10.42.42.5(pid=7503) [trial-2383↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7503)] [trial-2383↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 23:18:59.463801 tst iperf3.py:8: Test FAILED (7.6 sec) 23:18:59.491986 run osmo-hlr_10.42.42.2(pid=7500): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7500)] 23:18:59.541825 run osmo-hlr_10.42.42.2(pid=7500): stdout: | (launched: 2022-12-12_23:18:56.094977) 23:18:59.593277 run osmo-hlr_10.42.42.2(pid=7500): stderr: | [0;m[1;31m20221212231856292 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212231856292 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212231856292 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212231856292 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212231856293 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212231856293 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212231856305 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212231856313 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212231856314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212231856314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:18:59.645181 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7495): Terminating (SIGTERM) 23:18:59.686391 run iperf3-srv_10.42.42.10(pid=7496): Terminating (SIGTERM) 23:18:59.727713 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7499): Terminating (SIGTERM) 23:18:59.769080 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7502): Terminating (SIGTERM) 23:18:59.810238 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7505): Terminating (SIGTERM) 23:18:59.851621 --- ParallelTerminationStrategy: PID 7495 died... 23:18:59.871448 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7495): Terminated: ok {rc=0} 23:18:59.917428 --- ParallelTerminationStrategy: PID 7496 died... 23:18:59.936468 run iperf3-srv_10.42.42.10(pid=7496): Terminated {rc=256} 23:18:59.982105 --- ParallelTerminationStrategy: PID 7499 died... 23:19:00.001388 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7499): Terminated: ok {rc=0} 23:19:00.046787 --- ParallelTerminationStrategy: PID 7502 died... 23:19:00.066034 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7502): Terminated: ok {rc=0} 23:19:00.111369 --- ParallelTerminationStrategy: PID 7505 died... 23:19:00.130628 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7505): Terminated: ok {rc=0} 23:19:00.217087 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 23:19:01.368060 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:19:01.381026 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 23:19:01.438052 tst iperf3m4.py: using LAC 32196 23:19:01.598440 tst iperf3m4.py: using RAC 66 23:19:01.721898 tst iperf3m4.py: using CellId 32196 23:19:01.844725 tst iperf3m4.py: using BVCI 32197 23:19:01.961607 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:19:01.974246 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:19:01.987804 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:19:02.002496 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:19:02.016927 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:19:02.029344 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:19:02.042922 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:19:02.056228 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:19:02.069926 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 23:19:02.192188 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 23:19:02.314494 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 23:19:02.434410 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 23:19:02.555848 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 23:19:02.776475 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:19:03.102831 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7507): Launched 23:19:03.385696 run iperf3-srv_10.42.42.10(pid=7508): Launched 23:19:03.508062 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 23:19:03.728528 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:19:04.056065 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7509): Launched 23:19:04.338438 run iperf3-srv_10.42.42.10(pid=7510): Launched 23:19:04.461646 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 23:19:04.681414 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:19:05.007786 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7511): Launched 23:19:05.290661 run iperf3-srv_10.42.42.10(pid=7512): Launched 23:19:05.412718 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 23:19:05.631867 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:19:05.957317 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7513): Launched 23:19:06.239314 run iperf3-srv_10.42.42.10(pid=7514): Launched 23:19:06.361028 tst iperf3m4.py:8: start network... 23:19:06.580810 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:19:07.084124 run create_hlr_db(pid=7515): Launched 23:19:07.215350 bus /gobi_6: Setting Powered False 23:19:08.279356 run create_hlr_db(pid=7515): Terminated: ok {rc=0} 23:19:08.714359 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7517): Launched 23:19:09.018618 run osmo-hlr_10.42.42.2(pid=7518): Launched 23:19:09.135237 run osmo-stp_10.42.42.5: Starting osmo-stp 23:19:09.662453 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7520): Launched 23:19:09.968724 run osmo-stp_10.42.42.5(pid=7521): Launched 23:19:10.086513 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:19:10.616537 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7523): Launched 23:19:10.734137 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:19:10.993733 run patchelf(pid=7524): Launched 23:19:11.163561 run osmo-stp_10.42.42.5(pid=7521): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7521)] 23:19:11.293302 run osmo-stp_10.42.42.5(pid=7521): stdout: | (launched: 2022-12-12_23:19:09.912456) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:19:11.424184 run osmo-stp_10.42.42.5(pid=7521): stderr: | [0;m[38;5;43m20221212231910087 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231910087 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231910087 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231910087 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231910088 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231910088 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231910088 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:19:11.555636 run osmo-stp_10.42.42.5(pid=7521): stdout: | (launched: 2022-12-12_23:19:09.912456) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:19:11.681580 run osmo-stp_10.42.42.5(pid=7521): stderr: | [0;m[38;5;43m20221212231910087 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231910087 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231910087 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231910087 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231910088 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231910088 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231910088 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:19:11.830602 run patchelf(pid=7524): Terminating (SIGINT) 23:19:12.005310 run patchelf(pid=7524): Terminated: ok {rc=0} 23:19:12.130567 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7521): Process ended prematurely: osmo-stp_10.42.42.5(pid=7521) [trial-2383↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7521)] [trial-2383↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 23:19:12.140010 tst iperf3m4.py:8: Test FAILED (10.8 sec) 23:19:12.167022 run osmo-hlr_10.42.42.2(pid=7518): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7518)] 23:19:12.214708 run osmo-hlr_10.42.42.2(pid=7518): stdout: | (launched: 2022-12-12_23:19:08.963073) 23:19:12.263583 run osmo-hlr_10.42.42.2(pid=7518): stderr: | [0;m[1;31m20221212231909139 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212231909139 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212231909139 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212231909139 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212231909139 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212231909139 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212231909182 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212231909192 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212231909192 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212231909192 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:19:12.313087 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7507): Terminating (SIGTERM) 23:19:12.352242 run iperf3-srv_10.42.42.10(pid=7508): Terminating (SIGTERM) 23:19:12.391513 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7509): Terminating (SIGTERM) 23:19:12.430803 run iperf3-srv_10.42.42.10(pid=7510): Terminating (SIGTERM) 23:19:12.469840 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7511): Terminating (SIGTERM) 23:19:12.509828 run iperf3-srv_10.42.42.10(pid=7512): Terminating (SIGTERM) 23:19:12.549250 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7513): Terminating (SIGTERM) 23:19:12.588362 run iperf3-srv_10.42.42.10(pid=7514): Terminating (SIGTERM) 23:19:12.627382 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7517): Terminating (SIGTERM) 23:19:12.666660 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7520): Terminating (SIGTERM) 23:19:12.705886 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7523): Terminating (SIGTERM) 23:19:12.745319 --- ParallelTerminationStrategy: PID 7507 died... 23:19:12.764008 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7507): Terminated: ok {rc=0} 23:19:12.807555 --- ParallelTerminationStrategy: PID 7508 died... 23:19:12.825645 run iperf3-srv_10.42.42.10(pid=7508): Terminated {rc=256} 23:19:12.869094 --- ParallelTerminationStrategy: PID 7509 died... 23:19:12.887372 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7509): Terminated: ok {rc=0} 23:19:12.930887 --- ParallelTerminationStrategy: PID 7510 died... 23:19:12.949191 run iperf3-srv_10.42.42.10(pid=7510): Terminated {rc=256} 23:19:12.992912 --- ParallelTerminationStrategy: PID 7511 died... 23:19:13.011405 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7511): Terminated: ok {rc=0} 23:19:13.055111 --- ParallelTerminationStrategy: PID 7512 died... 23:19:13.073427 run iperf3-srv_10.42.42.10(pid=7512): Terminated {rc=256} 23:19:13.117062 --- ParallelTerminationStrategy: PID 7513 died... 23:19:13.135298 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7513): Terminated: ok {rc=0} 23:19:13.178795 --- ParallelTerminationStrategy: PID 7514 died... 23:19:13.197005 run iperf3-srv_10.42.42.10(pid=7514): Terminated {rc=256} 23:19:13.240454 --- ParallelTerminationStrategy: PID 7517 died... 23:19:13.258786 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7517): Terminated: ok {rc=0} 23:19:13.302381 --- ParallelTerminationStrategy: PID 7520 died... 23:19:13.320654 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7520): Terminated: ok {rc=0} 23:19:13.364380 --- ParallelTerminationStrategy: PID 7523 died... 23:19:13.382711 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7523): Terminated: ok {rc=0} 23:19:13.467916 bus /gobi_4: Setting Powered False 23:19:14.566325 bus /gobi_4: Setting Powered False 23:19:15.681909 bus /gobi_1: Setting Powered False 23:19:16.779048 bus /gobi_1: Setting Powered False 23:19:17.897213 bus /gobi_0: Setting Powered False 23:19:18.994857 bus /gobi_0: Setting Powered False 23:19:20.111418 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 23:19:21.209636 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:19:21.221699 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 23:19:21.277259 tst ping.py: using LAC 32197 23:19:21.394446 tst ping.py: using RAC 67 23:19:21.512224 tst ping.py: using CellId 32197 23:19:21.628616 tst ping.py: using BVCI 32198 23:19:21.737430 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:19:21.748690 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:19:21.759880 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:19:21.771406 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:19:21.782953 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:19:21.794597 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:19:21.806189 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:19:21.817635 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 23:19:21.933440 tst ping.py:19: start network... 23:19:22.134627 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:19:22.598846 run create_hlr_db(pid=7525): Launched 23:19:22.713486 bus /gobi_6: Setting Powered False 23:19:23.773198 run create_hlr_db(pid=7525): Terminated: ok {rc=0} 23:19:24.211153 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7527): Launched 23:19:24.514811 run osmo-hlr_10.42.42.2(pid=7528): Launched 23:19:24.630461 run osmo-stp_10.42.42.5: Starting osmo-stp 23:19:25.162679 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7530): Launched 23:19:25.462100 run osmo-stp_10.42.42.5(pid=7531): Launched 23:19:25.577262 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:19:26.093671 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7533): Launched 23:19:26.209075 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:19:26.463418 run patchelf(pid=7534): Launched 23:19:26.630609 run osmo-stp_10.42.42.5(pid=7531): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7531)] 23:19:26.757960 run osmo-stp_10.42.42.5(pid=7531): stdout: | (launched: 2022-12-12_23:19:25.407381) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:19:26.886073 run osmo-stp_10.42.42.5(pid=7531): stderr: | [0;m[38;5;43m20221212231925576 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231925576 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231925576 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231925576 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231925577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231925577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231925577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:19:27.014537 run osmo-stp_10.42.42.5(pid=7531): stdout: | (launched: 2022-12-12_23:19:25.407381) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:19:27.137106 run osmo-stp_10.42.42.5(pid=7531): stderr: | [0;m[38;5;43m20221212231925576 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231925576 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231925576 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231925576 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231925577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231925577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231925577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:19:27.282677 run patchelf(pid=7534): Terminating (SIGINT) 23:19:27.453935 run patchelf(pid=7534): Terminated: ok {rc=0} 23:19:27.576537 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=7531): Process ended prematurely: osmo-stp_10.42.42.5(pid=7531) [trial-2383↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7531)] [trial-2383↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 23:19:27.585341 tst ping.py:22: Test FAILED (6.4 sec) 23:19:27.611767 run osmo-hlr_10.42.42.2(pid=7528): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7528)] 23:19:27.658864 run osmo-hlr_10.42.42.2(pid=7528): stdout: | (launched: 2022-12-12_23:19:24.460346) 23:19:27.707417 run osmo-hlr_10.42.42.2(pid=7528): stderr: | [0;m[1;31m20221212231924638 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212231924638 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212231924638 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212231924638 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212231924638 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212231924638 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212231924650 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212231924658 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212231924659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212231924659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:19:27.756472 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7527): Terminating (SIGTERM) 23:19:27.795575 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7530): Terminating (SIGTERM) 23:19:27.834832 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7533): Terminating (SIGTERM) 23:19:27.874022 --- ParallelTerminationStrategy: PID 7527 died... 23:19:27.892716 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7527): Terminated: ok {rc=0} 23:19:27.936621 --- ParallelTerminationStrategy: PID 7530 died... 23:19:27.954921 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7530): Terminated: ok {rc=0} 23:19:27.998494 --- ParallelTerminationStrategy: PID 7533 died... 23:19:28.016715 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7533): Terminated: ok {rc=0} 23:19:28.099682 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2383 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 23:19:29.183200 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:19:29.195100 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 23:19:29.247808 tst ping_idle_ping.py: using LAC 32198 23:19:29.365443 tst ping_idle_ping.py: using RAC 68 23:19:29.491100 tst ping_idle_ping.py: using CellId 32198 23:19:29.617135 tst ping_idle_ping.py: using BVCI 32199 23:19:29.734714 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:19:29.746949 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:19:29.758779 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:19:29.770813 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:19:29.782801 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:19:29.794928 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:19:29.806867 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:19:29.818689 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 23:19:29.934106 tst ping_idle_ping.py:24: start network... 23:19:30.137475 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:19:30.606912 run create_hlr_db(pid=7535): Launched 23:19:30.723584 bus /gobi_6: Setting Powered False 23:19:31.782096 run create_hlr_db(pid=7535): Terminated: ok {rc=0} 23:19:32.239157 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7537): Launched 23:19:32.546515 run osmo-hlr_10.42.42.2(pid=7538): Launched 23:19:32.664560 run osmo-stp_10.42.42.5: Starting osmo-stp 23:19:33.199872 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7540): Launched 23:19:33.500542 run osmo-stp_10.42.42.5(pid=7541): Launched 23:19:33.616325 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:19:34.136782 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7543): Launched 23:19:34.253222 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:19:34.510867 run patchelf(pid=7547): Launched 23:19:34.679102 run osmo-stp_10.42.42.5(pid=7541): ERR: Terminated: ERROR {rc=1} [trial-2383↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7541)] 23:19:34.807185 run osmo-stp_10.42.42.5(pid=7541): stdout: | (launched: 2022-12-12_23:19:33.445372) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:19:34.936189 run osmo-stp_10.42.42.5(pid=7541): stderr: | [0;m[38;5;43m20221212231933617 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231933618 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231933618 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231933618 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231933619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231933619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231933619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:19:35.065633 run osmo-stp_10.42.42.5(pid=7541): stdout: | (launched: 2022-12-12_23:19:33.445372) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:19:35.188715 run osmo-stp_10.42.42.5(pid=7541): stderr: | [0;m[38;5;43m20221212231933617 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231933618 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231933618 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231933618 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231933619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231933619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231933619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:19:35.335285 run patchelf(pid=7547): Terminating (SIGINT) 23:19:35.506170 run patchelf(pid=7547): Terminated: ok {rc=0} 23:19:35.629156 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=7541): Process ended prematurely: osmo-stp_10.42.42.5(pid=7541) [trial-2383↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7541)] [trial-2383↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 23:19:35.637928 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 23:19:35.664862 run osmo-hlr_10.42.42.2(pid=7538): ERR: Terminated: ERROR {rc=237} [trial-2383↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7538)] 23:19:35.712846 run osmo-hlr_10.42.42.2(pid=7538): stdout: | (launched: 2022-12-12_23:19:32.491496) 23:19:35.762640 run osmo-hlr_10.42.42.2(pid=7538): stderr: | [0;m[1;31m20221212231932665 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212231932665 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212231932665 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212231932666 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212231932666 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212231932666 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212231932678 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212231932686 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212231932686 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212231932686 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:19:35.812724 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7537): Terminating (SIGTERM) 23:19:35.852578 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7540): Terminating (SIGTERM) 23:19:35.892148 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7543): Terminating (SIGTERM) 23:19:35.932083 --- ParallelTerminationStrategy: PID 7537 died... 23:19:35.951305 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7537): Terminated: ok {rc=0} 23:19:35.995150 --- ParallelTerminationStrategy: PID 7540 died... 23:19:36.013567 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7540): Terminated: ok {rc=0} 23:19:36.057664 --- ParallelTerminationStrategy: PID 7543 died... 23:19:36.076102 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7543): Terminated: ok {rc=0} 23:19:36.161353 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2383 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 23:19:37.485172 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:19:37.493377 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 23:19:37.526776 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 23:19:37.562214 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 23:19:37.615611 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 23:19:37.648200 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 23:19:37.683120 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 23:19:38.246625 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2383 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 23:19:38.251945 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:19:38.263955 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 23:19:38.332563 tst switch_tch_pdch.py: using LAC 32199 23:19:38.460292 tst switch_tch_pdch.py: using RAC 69 23:19:38.580274 tst switch_tch_pdch.py: using CellId 32199 23:19:38.699541 tst switch_tch_pdch.py: using BVCI 32200 23:19:38.811351 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:19:38.823074 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:19:38.834538 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:19:38.846534 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:19:38.858359 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:19:38.870133 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:19:38.882029 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:19:38.893873 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:19:39.012352 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:19:39.134913 tst switch_tch_pdch.py:51: start network... 23:19:39.350194 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:19:39.844642 run create_hlr_db(pid=7551): Launched 23:19:39.975202 bus /gobi_6: Setting Powered False 23:19:41.038769 run create_hlr_db(pid=7551): Terminated: ok {rc=0} 23:19:41.467167 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7554): Launched 23:19:41.768215 run osmo-hlr_10.42.42.2(pid=7555): Launched 23:19:41.883278 run osmo-stp_10.42.42.5: Starting osmo-stp 23:19:42.401258 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7557): Launched 23:19:42.703100 run osmo-stp_10.42.42.5(pid=7558): Launched 23:19:42.819519 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:19:43.339013 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7560): Launched 23:19:43.454088 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:19:43.708289 run patchelf(pid=7561): Launched 23:19:43.876178 run osmo-stp_10.42.42.5(pid=7558): ERR: Terminated: ERROR {rc=1} [trial-2383↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7558)] 23:19:44.004059 run osmo-stp_10.42.42.5(pid=7558): stdout: | (launched: 2022-12-12_23:19:42.648041) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:19:44.133179 run osmo-stp_10.42.42.5(pid=7558): stderr: | [0;m[38;5;43m20221212231942819 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231942820 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231942820 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231942820 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231942821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231942821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231942821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:19:44.262607 run osmo-stp_10.42.42.5(pid=7558): stdout: | (launched: 2022-12-12_23:19:42.648041) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:19:44.386076 run osmo-stp_10.42.42.5(pid=7558): stderr: | [0;m[38;5;43m20221212231942819 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212231942820 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212231942820 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212231942820 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212231942821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212231942821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212231942821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:19:44.532531 run patchelf(pid=7561): Terminating (SIGINT) 23:19:44.703773 run patchelf(pid=7561): Terminated: ok {rc=0} 23:19:44.827873 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=7558): Process ended prematurely: osmo-stp_10.42.42.5(pid=7558) [trial-2383↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7558)] [trial-2383↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 23:19:44.836738 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 23:19:44.863295 run osmo-hlr_10.42.42.2(pid=7555): ERR: Terminated: ERROR {rc=237} [trial-2383↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7555)] 23:19:44.910957 run osmo-hlr_10.42.42.2(pid=7555): stdout: | (launched: 2022-12-12_23:19:41.713320) 23:19:44.960161 run osmo-hlr_10.42.42.2(pid=7555): stderr: | [0;m[1;31m20221212231941891 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212231941891 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212231941891 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212231941891 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212231941891 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212231941891 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212231941909 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212231941918 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212231941918 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212231941918 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:19:45.009792 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7554): Terminating (SIGTERM) 23:19:45.049396 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7557): Terminating (SIGTERM) 23:19:45.088749 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7560): Terminating (SIGTERM) 23:19:45.128516 --- ParallelTerminationStrategy: PID 7554 died... 23:19:45.147434 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7554): Terminated: ok {rc=0} 23:19:45.191368 --- ParallelTerminationStrategy: PID 7557 died... 23:19:45.209846 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7557): Terminated: ok {rc=0} 23:19:45.253845 --- ParallelTerminationStrategy: PID 7560 died... 23:19:45.272432 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7560): Terminated: ok {rc=0} 23:19:45.357267 bus /gobi_0: Setting Powered False 23:19:46.459312 bus /gobi_0: Setting Powered False 23:19:47.571850 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2383 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 nitb_smpp --------------------------------------------------------------------- 23:19:48.828458 tst nitb_smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:19:48.831520 tst nitb_smpp: Verifying 1 x bts (candidates: 11) 23:19:48.852818 tst nitb_smpp: Verifying 1 x ip_address (candidates: 9) 23:19:48.859858 tst nitb_smpp: Verifying 1 x modem (candidates: 12) 23:19:48.893834 tst nitb_smpp: Reserving 1 x bts (candidates: 11) 23:19:48.914904 tst nitb_smpp: Reserving 1 x ip_address (candidates: 9) 23:19:48.921842 tst nitb_smpp: Reserving 1 x modem (candidates: 12) 23:19:49.442209 tst nitb_smpp: RESERVED RESOURCES for nitb_smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2383 nitb_smpp esme_connect_policy_acceptall.py ---------------------------------------------- 23:19:49.448347 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 23:19:49.468320 tst esme_connect_policy_acceptall.py: using MSISDN 8018 23:19:49.610011 run osmo-nitb_10.42.42.2: Starting osmo-nitb 23:19:50.220506 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7565): Launched 23:19:50.545956 run osmo-nitb_10.42.42.2(pid=7566): Launched 23:19:50.727142 run osmo-nitb_10.42.42.2(pid=7566): ERR: Terminated: ERROR {rc=2} [trial-2383↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7566)] 23:19:50.873661 run osmo-nitb_10.42.42.2(pid=7566): stdout: | (launched: 2022-12-12_23:19:50.487385) 23:19:51.020674 run osmo-nitb_10.42.42.2(pid=7566): stderr: | (launched: 2022-12-12_23:19:50.535759) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:19:51.167992 run osmo-nitb_10.42.42.2(pid=7566): stdout: | (launched: 2022-12-12_23:19:50.487385) 23:19:51.308723 run osmo-nitb_10.42.42.2(pid=7566): stderr: | (launched: 2022-12-12_23:19:50.535759) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fa469b2b268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=7566): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7566) [trial-2383↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7566)] 23:19:51.670026 tst osmo-nitb_10.42.42.2(pid=7566): stdout: | (launched: 2022-12-12_23:19:50.487385) 23:19:51.802331 tst osmo-nitb_10.42.42.2(pid=7566): stderr: | (launched: 2022-12-12_23:19:50.535759) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:19:51.958433 tst esme_connect_policy_acceptall.py:18: ERR: Error: osmo-nitb_10.42.42.2(pid=7566): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7566) [trial-2383↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7566)] [trial-2383↪nitb_smpp↪esme_connect_policy_acceptall.py:18] 23:19:51.967259 tst esme_connect_policy_acceptall.py:18: Test FAILED (2.5 sec) 23:19:51.974188 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7565): Terminating (SIGTERM) 23:19:52.184306 --- ParallelTerminationStrategy: PID 7565 died... 23:19:52.206238 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7565): Terminated: ok {rc=0} ---------------------------------------------- trial-2383 nitb_smpp esme_connect_policy_closed.py ---------------------------------------------- 23:19:52.256458 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 23:19:52.277922 tst esme_connect_policy_closed.py: using MSISDN 8019 23:19:52.407435 tst esme_connect_policy_closed.py: using MSISDN 8020 23:19:52.528488 run osmo-nitb_10.42.42.2: Starting osmo-nitb 23:19:53.139614 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7567): Launched 23:19:53.466527 run osmo-nitb_10.42.42.2(pid=7568): Launched 23:19:53.643228 run osmo-nitb_10.42.42.2(pid=7568): ERR: Terminated: ERROR {rc=2} [trial-2383↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7568)] 23:19:53.777895 run osmo-nitb_10.42.42.2(pid=7568): stdout: | (launched: 2022-12-12_23:19:53.407266) 23:19:53.914460 run osmo-nitb_10.42.42.2(pid=7568): stderr: | (launched: 2022-12-12_23:19:53.456206) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:19:54.050926 run osmo-nitb_10.42.42.2(pid=7568): stdout: | (launched: 2022-12-12_23:19:53.407266) 23:19:54.180938 run osmo-nitb_10.42.42.2(pid=7568): stderr: | (launched: 2022-12-12_23:19:53.456206) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:19:54.336867 tst esme_connect_policy_closed.py:24: ERR: Error: osmo-nitb_10.42.42.2(pid=7568): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7568) [trial-2383↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7568)] [trial-2383↪nitb_smpp↪esme_connect_policy_closed.py:24] 23:19:54.346052 tst esme_connect_policy_closed.py:24: Test FAILED (2.1 sec) 23:19:54.352851 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7567): Terminating (SIGTERM) 23:19:54.562944 --- ParallelTerminationStrategy: PID 7567 died... 23:19:54.584201 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7567): Terminated: ok {rc=0} ---------------------------------------------- trial-2383 nitb_smpp esme_ms_sms_storeforward.py ---------------------------------------------- 23:19:54.634373 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 23:19:54.645863 tst nitb_smpp: Using 1 x bts (candidates: 1) 23:19:54.681609 tst esme_ms_sms_storeforward.py: using LAC 32200 23:19:54.813043 tst esme_ms_sms_storeforward.py: using RAC 70 23:19:54.942916 tst esme_ms_sms_storeforward.py: using CellId 32200 23:19:55.072686 tst esme_ms_sms_storeforward.py: using BVCI 32201 23:19:55.192341 tst nitb_smpp: Using 1 x modem (candidates: 1) 23:19:55.319548 tst esme_ms_sms_storeforward.py: using MSISDN 8021 23:19:55.434790 tst esme_ms_sms_storeforward.py:20: start nitb and bts... 23:19:55.645570 run osmo-nitb_10.42.42.2: Starting osmo-nitb 23:19:56.305339 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7570): Launched 23:19:56.635513 run osmo-nitb_10.42.42.2(pid=7571): Launched 23:19:56.812345 run osmo-nitb_10.42.42.2(pid=7571): ERR: Terminated: ERROR {rc=2} [trial-2383↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7571)] 23:19:56.947768 run osmo-nitb_10.42.42.2(pid=7571): stdout: | (launched: 2022-12-12_23:19:56.575843) 23:19:57.083888 run osmo-nitb_10.42.42.2(pid=7571): stderr: | (launched: 2022-12-12_23:19:56.625330) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:19:57.220081 run osmo-nitb_10.42.42.2(pid=7571): stdout: | (launched: 2022-12-12_23:19:56.575843) 23:19:57.350502 run osmo-nitb_10.42.42.2(pid=7571): stderr: | (launched: 2022-12-12_23:19:56.625330) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:19:57.506855 tst esme_ms_sms_storeforward.py:23: ERR: Error: osmo-nitb_10.42.42.2(pid=7571): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7571) [trial-2383↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7571)] [trial-2383↪nitb_smpp↪esme_ms_sms_storeforward.py:23] 23:19:57.515445 tst esme_ms_sms_storeforward.py:23: Test FAILED (2.9 sec) 23:19:57.522347 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7570): Terminating (SIGTERM) 23:19:57.732187 --- ParallelTerminationStrategy: PID 7570 died... 23:19:57.753337 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7570): Terminated: ok {rc=0} 23:19:57.839762 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2383 nitb_smpp esme_ms_sms_transaction.py ---------------------------------------------- 23:19:58.927349 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 23:19:58.939005 tst nitb_smpp: Using 1 x bts (candidates: 1) 23:19:58.977204 tst esme_ms_sms_transaction.py: using LAC 32201 23:19:59.108071 tst esme_ms_sms_transaction.py: using RAC 71 23:19:59.237040 tst esme_ms_sms_transaction.py: using CellId 32201 23:19:59.365423 tst esme_ms_sms_transaction.py: using BVCI 32202 23:19:59.485940 tst nitb_smpp: Using 1 x modem (candidates: 1) 23:19:59.617393 tst esme_ms_sms_transaction.py: using MSISDN 8022 23:19:59.737959 tst esme_ms_sms_transaction.py:18: start nitb and bts... 23:19:59.959223 run osmo-nitb_10.42.42.2: Starting osmo-nitb 23:20:00.623869 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7572): Launched 23:20:00.969370 run osmo-nitb_10.42.42.2(pid=7573): Launched 23:20:01.181538 run osmo-nitb_10.42.42.2(pid=7573): ERR: Terminated: ERROR {rc=2} [trial-2383↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7573)] 23:20:01.330378 run osmo-nitb_10.42.42.2(pid=7573): stdout: | (launched: 2022-12-12_23:20:00.902327) 23:20:01.480915 run osmo-nitb_10.42.42.2(pid=7573): stderr: | (launched: 2022-12-12_23:20:00.951983) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:20:01.631052 run osmo-nitb_10.42.42.2(pid=7573): stdout: | (launched: 2022-12-12_23:20:00.902327) 23:20:01.780564 run osmo-nitb_10.42.42.2(pid=7573): stderr: | (launched: 2022-12-12_23:20:00.951983) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fa469b2b268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=7573): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7573) [trial-2383↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7573)] 23:20:02.122196 tst osmo-nitb_10.42.42.2(pid=7573): stdout: | (launched: 2022-12-12_23:20:00.902327) 23:20:02.268125 tst osmo-nitb_10.42.42.2(pid=7573): stderr: | (launched: 2022-12-12_23:20:00.951983) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:20:02.415623 tst esme_ms_sms_transaction.py:21: ERR: Error: osmo-nitb_10.42.42.2(pid=7573): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7573) [trial-2383↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7573)] [trial-2383↪nitb_smpp↪esme_ms_sms_transaction.py:21] 23:20:02.424067 tst esme_ms_sms_transaction.py:21: Test FAILED (3.5 sec) 23:20:02.430667 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7572): Terminating (SIGTERM) 23:20:02.641761 --- ParallelTerminationStrategy: PID 7572 died... 23:20:02.662778 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7572): Terminated: ok {rc=0} 23:20:02.749414 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 nitb_smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 smpp --------------------------------------------------------------------- 23:20:03.914307 tst smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:20:03.917451 tst smpp: Verifying 1 x bts (candidates: 11) 23:20:03.938475 tst smpp: Verifying 6 x ip_address (candidates: 9) 23:20:03.964922 tst smpp: Verifying 1 x modem (candidates: 12) 23:20:04.000406 tst smpp: Reserving 1 x bts (candidates: 11) 23:20:04.020686 tst smpp: Reserving 6 x ip_address (candidates: 9) 23:20:04.046983 tst smpp: Reserving 1 x modem (candidates: 12) 23:20:04.573383 tst smpp: RESERVED RESOURCES for smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2383 smpp esme_connect_policy_acceptall.py ---------------------------------------------- 23:20:04.578536 tst smpp: Using 1 x ip_address (candidates: 6) 23:20:04.589115 tst smpp: Using 1 x ip_address (candidates: 6) 23:20:04.599855 tst smpp: Using 1 x ip_address (candidates: 6) 23:20:04.610931 tst smpp: Using 1 x ip_address (candidates: 6) 23:20:04.630371 tst esme_connect_policy_acceptall.py: using MSISDN 8023 23:20:04.746195 run osmo-stp_10.42.42.4: Starting osmo-stp 23:20:05.273633 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=7580): Launched 23:20:05.583754 run osmo-stp_10.42.42.4(pid=7581): Launched 23:20:05.702565 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:20:06.179642 run create_hlr_db(pid=7582): Launched 23:20:06.297571 bus /sierra_2: Setting Powered False 23:20:07.358655 run create_hlr_db(pid=7582): Terminated: ok {rc=0} 23:20:07.805655 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7584): Launched 23:20:08.132472 run osmo-hlr_10.42.42.2(pid=7585): Launched 23:20:08.257637 run osmo-msc_10.42.42.5: Starting osmo-msc 23:20:08.854983 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7587): Launched 23:20:09.183206 run osmo-msc_10.42.42.5(pid=7588): Launched 23:20:09.424533 run osmo-hlr_10.42.42.2(pid=7585): ERR: Terminated: ERROR {rc=237} [trial-2383↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7585)] 23:20:09.565257 run osmo-hlr_10.42.42.2(pid=7585): stdout: | (launched: 2022-12-12_23:20:08.073507) 23:20:09.703883 run osmo-hlr_10.42.42.2(pid=7585): stderr: | [0;m[1;31m20221212232008272 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212232008272 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212232008272 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212232008272 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212232008272 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212232008272 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212232008285 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212232008293 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212232008293 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212232008293 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:20:09.840402 run osmo-hlr_10.42.42.2(pid=7585): stdout: | (launched: 2022-12-12_23:20:08.073507) 23:20:09.970696 run osmo-hlr_10.42.42.2(pid=7585): stderr: | [0;m[1;31m20221212232008272 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212232008272 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212232008272 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212232008272 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212232008272 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212232008272 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212232008285 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212232008293 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212232008293 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212232008293 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:20:10.126670 tst esme_connect_policy_acceptall.py:23: ERR: Error: osmo-hlr_10.42.42.2(pid=7585): Process ended prematurely: osmo-hlr_10.42.42.2(pid=7585) [trial-2383↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7585)] [trial-2383↪smpp↪esme_connect_policy_acceptall.py:23] 23:20:10.135479 tst esme_connect_policy_acceptall.py:23: Test FAILED (5.6 sec) 23:20:10.162530 run osmo-msc_10.42.42.5(pid=7588): ERR: Terminated: ERROR {rc=9} [trial-2383↪smpp↪esme_connect_policy_acceptall.py↪esme_connect_policy_acceptall.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=7588)] 23:20:10.212353 run osmo-msc_10.42.42.5(pid=7588): stdout: | (launched: 2022-12-12_23:20:09.124084) 23:20:10.263931 run osmo-msc_10.42.42.5(pid=7588): stderr: | [0;m[38;5;43m20221212232009490 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | [0;m[38;5;43m20221212232009490 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | [0;m[38;5;43m20221212232009490 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;45m20221212232009490 [1;33mDLSCCP[0;m[38;5;45m [1;33mNOTICE[0;m[38;5;45m OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | [0;m[38;5;43m20221212232009491 [1;33mDLSS7[0;m[38;5;43m [1;33mNOTICE[0;m[38;5;43m 0: Creating SCCP instance (osmo_ss7.c:458) | [0;m[38;5;45m20221212232009491 [1;32mDLSCCP[0;m[38;5;45m [1;32mINFO[0;m[38;5;45m Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | [0;m[38;5;43m20221212232009491 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | [0;m20221212232009491 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221212232009491 [1;31mDSGS[0;m [1;31mERROR[0;m SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 23:20:10.315961 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=7580): Terminating (SIGTERM) 23:20:10.358174 run osmo-stp_10.42.42.4(pid=7581): Terminating (SIGTERM) 23:20:10.399749 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7584): Terminating (SIGTERM) 23:20:10.442625 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7587): Terminating (SIGTERM) 23:20:10.487889 --- ParallelTerminationStrategy: PID 7580 died... 23:20:10.508824 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=7580): Terminated: ok {rc=0} 23:20:10.557140 --- ParallelTerminationStrategy: PID 7581 died... 23:20:10.576252 run osmo-stp_10.42.42.4(pid=7581): Terminated: ok {rc=0} 23:20:10.621713 --- ParallelTerminationStrategy: PID 7584 died... 23:20:10.640849 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7584): Terminated: ok {rc=0} 23:20:10.686909 --- ParallelTerminationStrategy: PID 7587 died... 23:20:10.706216 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7587): Terminated: ok {rc=0} ---------------------------------------------- trial-2383 smpp esme_connect_policy_closed.py ---------------------------------------------- 23:20:10.756685 tst smpp: Using 1 x ip_address (candidates: 6) 23:20:10.768223 tst smpp: Using 1 x bts (candidates: 1) 23:20:10.804695 tst esme_connect_policy_closed.py: using LAC 32202 23:20:10.937199 tst esme_connect_policy_closed.py: using RAC 72 23:20:11.065700 tst esme_connect_policy_closed.py: using CellId 32202 23:20:11.196556 tst esme_connect_policy_closed.py: using BVCI 32203 23:20:11.315996 tst smpp: Using 1 x ip_address (candidates: 6) 23:20:11.326849 tst smpp: Using 1 x ip_address (candidates: 6) 23:20:11.337706 tst smpp: Using 1 x ip_address (candidates: 6) 23:20:11.357941 tst esme_connect_policy_closed.py: using MSISDN 8024 23:20:11.488749 tst esme_connect_policy_closed.py: using MSISDN 8025 23:20:11.608620 run osmo-stp_10.42.42.4: Starting osmo-stp 23:20:12.170736 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=7591): Launched 23:20:12.498904 run osmo-stp_10.42.42.4(pid=7592): Launched 23:20:12.624351 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:20:13.132773 run create_hlr_db(pid=7593): Launched 23:20:14.325378 run create_hlr_db(pid=7593): Terminated: ok {rc=0} 23:20:14.670954 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7595): Launched 23:20:14.998129 run osmo-hlr_10.42.42.2(pid=7596): Launched 23:20:15.121624 run osmo-msc_10.42.42.5: Starting osmo-msc 23:20:15.699120 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7598): Launched 23:20:16.049713 run osmo-msc_10.42.42.5(pid=7599): Launched 23:20:16.427746 run osmo-hlr_10.42.42.2(pid=7596): ERR: Terminated: ERROR {rc=237} [trial-2383↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7596)] 23:20:16.642492 run osmo-hlr_10.42.42.2(pid=7596): stdout: | (launched: 2022-12-12_23:20:14.938426) 23:20:16.819603 run osmo-hlr_10.42.42.2(pid=7596): stderr: | [0;m[1;31m20221212232015114 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212232015114 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212232015114 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212232015114 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212232015115 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212232015115 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212232015129 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212232015137 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212232015138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212232015138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:20:17.013371 run osmo-hlr_10.42.42.2(pid=7596): stdout: | (launched: 2022-12-12_23:20:14.938426) 23:20:17.150094 run osmo-hlr_10.42.42.2(pid=7596): stderr: | [0;m[1;31m20221212232015114 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212232015114 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212232015114 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212232015114 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212232015115 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212232015115 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212232015129 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212232015137 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212232015138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212232015138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:20:17.311310 tst esme_connect_policy_closed.py:31: ERR: Error: osmo-hlr_10.42.42.2(pid=7596): Process ended prematurely: osmo-hlr_10.42.42.2(pid=7596) [trial-2383↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7596)] [trial-2383↪smpp↪esme_connect_policy_closed.py:31] 23:20:17.320283 tst esme_connect_policy_closed.py:31: Test FAILED (6.6 sec) 23:20:17.348634 run osmo-msc_10.42.42.5(pid=7599): ERR: Terminated: ERROR {rc=9} [trial-2383↪smpp↪esme_connect_policy_closed.py↪esme_connect_policy_closed.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=7599)] 23:20:17.400597 run osmo-msc_10.42.42.5(pid=7599): stdout: | (launched: 2022-12-12_23:20:15.981474) 23:20:17.453915 run osmo-msc_10.42.42.5(pid=7599): stderr: | [0;m[38;5;43m20221212232016541 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | [0;m[38;5;43m20221212232016541 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | [0;m[38;5;43m20221212232016541 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;45m20221212232016541 [1;33mDLSCCP[0;m[38;5;45m [1;33mNOTICE[0;m[38;5;45m OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | [0;m[38;5;43m20221212232016541 [1;33mDLSS7[0;m[38;5;43m [1;33mNOTICE[0;m[38;5;43m 0: Creating SCCP instance (osmo_ss7.c:458) | [0;m[38;5;45m20221212232016541 [1;32mDLSCCP[0;m[38;5;45m [1;32mINFO[0;m[38;5;45m Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | [0;m[38;5;43m20221212232016542 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | [0;m20221212232016542 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221212232016542 [1;31mDSGS[0;m [1;31mERROR[0;m SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 23:20:17.507140 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=7591): Terminating (SIGTERM) 23:20:17.549785 run osmo-stp_10.42.42.4(pid=7592): Terminating (SIGTERM) 23:20:17.592431 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7595): Terminating (SIGTERM) 23:20:17.635892 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7598): Terminating (SIGTERM) 23:20:17.679922 --- ParallelTerminationStrategy: PID 7591 died... 23:20:17.700481 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=7591): Terminated: ok {rc=0} 23:20:17.750410 --- ParallelTerminationStrategy: PID 7592 died... 23:20:17.769923 run osmo-stp_10.42.42.4(pid=7592): Terminated: ok {rc=0} 23:20:17.817192 --- ParallelTerminationStrategy: PID 7595 died... 23:20:17.836705 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7595): Terminated: ok {rc=0} 23:20:17.883785 --- ParallelTerminationStrategy: PID 7598 died... 23:20:17.903325 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7598): Terminated: ok {rc=0} ---------------------------------------------- trial-2383 smpp esme_ms_sms_storeforward.py ---------------------------------------------- 23:20:17.955375 tst smpp: Using 1 x ip_address (candidates: 6) 23:20:17.966865 tst smpp: Using 1 x bts (candidates: 1) 23:20:18.004308 tst esme_ms_sms_storeforward.py: using LAC 32203 23:20:18.137062 tst esme_ms_sms_storeforward.py: using RAC 73 23:20:18.266182 tst esme_ms_sms_storeforward.py: using CellId 32203 23:20:18.396788 tst esme_ms_sms_storeforward.py: using BVCI 32204 23:20:18.511951 tst smpp: Using 1 x ip_address (candidates: 6) 23:20:18.522640 tst smpp: Using 1 x ip_address (candidates: 6) 23:20:18.532771 tst smpp: Using 1 x ip_address (candidates: 6) 23:20:18.544361 tst smpp: Using 1 x ip_address (candidates: 6) 23:20:18.555656 tst smpp: Using 1 x ip_address (candidates: 6) 23:20:18.566866 tst smpp: Using 1 x modem (candidates: 1) 23:20:18.699286 tst esme_ms_sms_storeforward.py: using MSISDN 8026 23:20:18.819557 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:20:19.331797 run create_hlr_db(pid=7602): Launched 23:20:20.524446 run create_hlr_db(pid=7602): Terminated: ok {rc=0} 23:20:20.871397 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7604): Launched 23:20:21.200817 run osmo-hlr_10.42.42.2(pid=7605): Launched 23:20:21.324776 run osmo-stp_10.42.42.5: Starting osmo-stp 23:20:21.878471 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7607): Launched 23:20:22.190597 run osmo-stp_10.42.42.5(pid=7608): Launched 23:20:22.310362 run osmo-msc_10.42.42.6: Starting osmo-msc 23:20:22.869652 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7610): Launched 23:20:23.181261 run osmo-msc_10.42.42.6(pid=7611): Launched 23:20:23.356104 run osmo-stp_10.42.42.5(pid=7608): ERR: Terminated: ERROR {rc=1} [trial-2383↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7608)] 23:20:23.487541 run osmo-stp_10.42.42.5(pid=7608): stdout: | (launched: 2022-12-12_23:20:22.134192) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:20:23.618679 run osmo-stp_10.42.42.5(pid=7608): stderr: | [0;m[38;5;43m20221212232022304 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212232022304 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212232022305 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212232022305 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212232022307 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212232022307 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212232022307 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:20:23.747551 run osmo-stp_10.42.42.5(pid=7608): stdout: | (launched: 2022-12-12_23:20:22.134192) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:20:23.870636 run osmo-stp_10.42.42.5(pid=7608): stderr: | [0;m[38;5;43m20221212232022304 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212232022304 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212232022305 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212232022305 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212232022307 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212232022307 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212232022307 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:20:24.017940 tst esme_ms_sms_storeforward.py:30: ERR: Error: osmo-stp_10.42.42.5(pid=7608): Process ended prematurely: osmo-stp_10.42.42.5(pid=7608) [trial-2383↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7608)] [trial-2383↪smpp↪esme_ms_sms_storeforward.py:30] 23:20:24.026091 tst esme_ms_sms_storeforward.py:30: Test FAILED (6.1 sec) 23:20:24.052215 run osmo-hlr_10.42.42.2(pid=7605): ERR: Terminated: ERROR {rc=237} [trial-2383↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7605)] 23:20:24.100371 run osmo-hlr_10.42.42.2(pid=7605): stdout: | (launched: 2022-12-12_23:20:21.141249) 23:20:24.150012 run osmo-hlr_10.42.42.2(pid=7605): stderr: | [0;m[1;31m20221212232021321 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212232021321 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212232021321 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212232021321 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212232021321 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212232021321 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212232021332 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/smpp/esme_ms_sms_storeforward.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212232021340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212232021341 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212232021341 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:20:24.219060 run osmo-msc_10.42.42.6(pid=7611): ERR: Terminated: ERROR {rc=2} [trial-2383↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7611)] 23:20:24.266839 run osmo-msc_10.42.42.6(pid=7611): stdout: | (launched: 2022-12-12_23:20:23.124709) 23:20:24.316374 run osmo-msc_10.42.42.6(pid=7611): stderr: | [0;m[38;5;43m20221212232023397 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212232023398 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fbb08d9ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212232023398 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212232023398 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212232023398 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212232023398 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212232023400 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212232023401 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212232023401 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212232023401 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:20:24.366360 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7604): Terminating (SIGTERM) 23:20:24.406005 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7607): Terminating (SIGTERM) 23:20:24.445746 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7610): Terminating (SIGTERM) 23:20:24.485760 --- ParallelTerminationStrategy: PID 7604 died... 23:20:24.504516 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7604): Terminated: ok {rc=0} 23:20:24.548611 --- ParallelTerminationStrategy: PID 7607 died... 23:20:24.567121 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7607): Terminated: ok {rc=0} 23:20:24.611487 --- ParallelTerminationStrategy: PID 7610 died... 23:20:24.630519 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7610): Terminated: ok {rc=0} 23:20:24.716226 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2383 smpp esme_ms_sms_transaction.py ---------------------------------------------- 23:20:25.804798 tst smpp: Using 1 x ip_address (candidates: 6) 23:20:25.816277 tst smpp: Using 1 x bts (candidates: 1) 23:20:25.853435 tst esme_ms_sms_transaction.py: using LAC 32204 23:20:25.984555 tst esme_ms_sms_transaction.py: using RAC 74 23:20:26.114348 tst esme_ms_sms_transaction.py: using CellId 32204 23:20:26.243112 tst esme_ms_sms_transaction.py: using BVCI 32205 23:20:26.363738 tst smpp: Using 1 x ip_address (candidates: 6) 23:20:26.374843 tst smpp: Using 1 x ip_address (candidates: 6) 23:20:26.385632 tst smpp: Using 1 x ip_address (candidates: 6) 23:20:26.396276 tst smpp: Using 1 x ip_address (candidates: 6) 23:20:26.407497 tst smpp: Using 1 x ip_address (candidates: 6) 23:20:26.419571 tst smpp: Using 1 x modem (candidates: 1) 23:20:26.551772 tst esme_ms_sms_transaction.py: using MSISDN 8027 23:20:26.666994 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:20:27.147820 run create_hlr_db(pid=7613): Launched 23:20:27.265646 bus /sierra_2: Setting Powered False 23:20:28.326946 run create_hlr_db(pid=7613): Terminated: ok {rc=0} 23:20:28.755994 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7615): Launched 23:20:29.066952 run osmo-hlr_10.42.42.2(pid=7616): Launched 23:20:29.186153 run osmo-stp_10.42.42.5: Starting osmo-stp 23:20:29.726261 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7618): Launched 23:20:30.034740 run osmo-stp_10.42.42.5(pid=7619): Launched 23:20:30.153513 run osmo-msc_10.42.42.6: Starting osmo-msc 23:20:30.710731 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7621): Launched 23:20:31.056130 run osmo-msc_10.42.42.6(pid=7622): Launched 23:20:31.435724 run osmo-stp_10.42.42.5(pid=7619): ERR: Terminated: ERROR {rc=1} [trial-2383↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7619)] 23:20:31.728523 run osmo-stp_10.42.42.5(pid=7619): stdout: | (launched: 2022-12-12_23:20:29.978520) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:20:31.914911 run osmo-stp_10.42.42.5(pid=7619): stderr: | [0;m[38;5;43m20221212232030149 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212232030149 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212232030150 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212232030150 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212232030150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212232030151 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212232030151 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:20:32.056174 run osmo-stp_10.42.42.5(pid=7619): stdout: | (launched: 2022-12-12_23:20:29.978520) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:20:32.191020 run osmo-stp_10.42.42.5(pid=7619): stderr: | [0;m[38;5;43m20221212232030149 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212232030149 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212232030150 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212232030150 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212232030150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212232030151 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212232030151 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:20:32.350673 tst esme_ms_sms_transaction.py:28: ERR: Error: osmo-stp_10.42.42.5(pid=7619): Process ended prematurely: osmo-stp_10.42.42.5(pid=7619) [trial-2383↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7619)] [trial-2383↪smpp↪esme_ms_sms_transaction.py:28] 23:20:32.359468 tst esme_ms_sms_transaction.py:28: Test FAILED (6.5 sec) 23:20:32.386660 run osmo-hlr_10.42.42.2(pid=7616): ERR: Terminated: ERROR {rc=237} [trial-2383↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7616)] 23:20:32.437151 run osmo-hlr_10.42.42.2(pid=7616): stdout: | (launched: 2022-12-12_23:20:29.010516) 23:20:32.489252 run osmo-hlr_10.42.42.2(pid=7616): stderr: | [0;m[1;31m20221212232029188 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212232029188 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212232029188 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212232029188 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212232029189 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212232029189 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212232029200 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/smpp/esme_ms_sms_transaction.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212232029209 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212232029209 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212232029209 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:20:32.561710 run osmo-msc_10.42.42.6(pid=7622): ERR: Terminated: ERROR {rc=2} [trial-2383↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7622)] 23:20:32.611522 run osmo-msc_10.42.42.6(pid=7622): stdout: | (launched: 2022-12-12_23:20:30.991224) 23:20:32.663218 run osmo-msc_10.42.42.6(pid=7622): stderr: | [0;m[38;5;43m20221212232031551 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212232031551 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5dc9988c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212232031551 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212232031552 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212232031552 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212232031552 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212232031554 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212232031554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212232031554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212232031555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:20:32.715033 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7615): Terminating (SIGTERM) 23:20:32.757035 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7618): Terminating (SIGTERM) 23:20:32.798881 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7621): Terminating (SIGTERM) 23:20:32.841211 --- ParallelTerminationStrategy: PID 7615 died... 23:20:32.861443 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7615): Terminated: ok {rc=0} 23:20:32.907541 --- ParallelTerminationStrategy: PID 7618 died... 23:20:32.927090 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7618): Terminated: ok {rc=0} 23:20:32.973264 --- ParallelTerminationStrategy: PID 7621 died... 23:20:32.992723 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7621): Terminated: ok {rc=0} 23:20:33.081105 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 encryption --------------------------------------------------------------------- 23:20:34.274444 tst encryption: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:20:34.277409 tst encryption: Verifying 1 x bts (candidates: 11) 23:20:34.298229 tst encryption: Verifying 6 x ip_address (candidates: 9) 23:20:34.326036 tst encryption: Verifying 1 x modem (candidates: 12) 23:20:34.358862 tst encryption: Reserving 1 x bts (candidates: 11) 23:20:34.379538 tst encryption: Reserving 6 x ip_address (candidates: 9) 23:20:34.406439 tst encryption: Reserving 1 x modem (candidates: 12) 23:20:34.935726 tst encryption: RESERVED RESOURCES for encryption: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2383 encryption register_a5_0_authopt.py ---------------------------------------------- 23:20:34.987547 tst encryption: Using 1 x ip_address (candidates: 6) 23:20:34.998114 tst encryption: Using 1 x bts (candidates: 1) 23:20:35.034896 tst register_a5_0_authopt.py: using LAC 32205 23:20:35.158383 tst register_a5_0_authopt.py: using RAC 75 23:20:35.281310 tst register_a5_0_authopt.py: using CellId 32205 23:20:35.405084 tst register_a5_0_authopt.py: using BVCI 32206 23:20:35.520788 tst encryption: Using 1 x ip_address (candidates: 6) 23:20:35.531612 tst encryption: Using 1 x ip_address (candidates: 6) 23:20:35.541992 tst encryption: Using 1 x ip_address (candidates: 6) 23:20:35.552653 tst encryption: Using 1 x ip_address (candidates: 6) 23:20:35.563435 tst encryption: Using 1 x ip_address (candidates: 6) 23:20:35.574150 tst encryption: Using 1 x modem (candidates: 1) 23:20:35.694006 tst register_a5_0_authopt.py:8: start network... 23:20:35.919545 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:20:36.434168 run create_hlr_db(pid=7627): Launched 23:20:36.569983 bus /sierra_2: Setting Powered False 23:20:37.635093 run create_hlr_db(pid=7627): Terminated: ok {rc=0} 23:20:38.080294 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7629): Launched 23:20:38.412492 run osmo-hlr_10.42.42.2(pid=7630): Launched 23:20:38.539918 run osmo-stp_10.42.42.5: Starting osmo-stp 23:20:39.111791 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7632): Launched 23:20:39.443288 run osmo-stp_10.42.42.5(pid=7633): Launched 23:20:39.569906 run osmo-msc_10.42.42.6: Starting osmo-msc 23:20:40.166979 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7635): Launched 23:20:40.499098 run osmo-msc_10.42.42.6(pid=7636): Launched 23:20:40.683018 run osmo-stp_10.42.42.5(pid=7633): ERR: Terminated: ERROR {rc=1} [trial-2383↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7633)] 23:20:40.823277 run osmo-stp_10.42.42.5(pid=7633): stdout: | (launched: 2022-12-12_23:20:39.383196) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:20:40.963732 run osmo-stp_10.42.42.5(pid=7633): stderr: | [0;m[38;5;43m20221212232039576 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212232039576 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212232039577 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212232039577 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212232039580 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212232039580 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212232039580 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:20:41.102969 run osmo-stp_10.42.42.5(pid=7633): stdout: | (launched: 2022-12-12_23:20:39.383196) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:20:41.235522 run osmo-stp_10.42.42.5(pid=7633): stderr: | [0;m[38;5;43m20221212232039576 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212232039576 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212232039577 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212232039577 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212232039580 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212232039580 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212232039580 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:20:41.393512 tst register_a5_0_authopt.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7633): Process ended prematurely: osmo-stp_10.42.42.5(pid=7633) [trial-2383↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7633)] [trial-2383↪encryption↪register_a5_0_authopt.py:8] 23:20:41.402948 tst register_a5_0_authopt.py:8: Test FAILED (6.5 sec) 23:20:41.430359 run osmo-hlr_10.42.42.2(pid=7630): ERR: Terminated: ERROR {rc=237} [trial-2383↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7630)] 23:20:41.480564 run osmo-hlr_10.42.42.2(pid=7630): stdout: | (launched: 2022-12-12_23:20:38.352551) 23:20:41.532053 run osmo-hlr_10.42.42.2(pid=7630): stderr: | [0;m[1;31m20221212232038554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212232038554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212232038554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212232038554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212232038554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212232038554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212232038568 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/encryption/register_a5_0_authopt.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212232038578 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212232038578 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212232038578 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:20:41.603842 run osmo-msc_10.42.42.6(pid=7636): ERR: Terminated: ERROR {rc=2} [trial-2383↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7636)] 23:20:41.653386 run osmo-msc_10.42.42.6(pid=7636): stdout: | (launched: 2022-12-12_23:20:40.438571) 23:20:41.704597 run osmo-msc_10.42.42.6(pid=7636): stderr: | [0;m[38;5;43m20221212232040763 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212232040763 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ffad0a5dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212232040763 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212232040763 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212232040763 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212232040763 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212232040765 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212232040766 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212232040766 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212232040766 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:20:41.756185 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7629): Terminating (SIGTERM) 23:20:41.798352 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7632): Terminating (SIGTERM) 23:20:41.840032 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7635): Terminating (SIGTERM) 23:20:41.881985 --- ParallelTerminationStrategy: PID 7629 died... 23:20:41.901970 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7629): Terminated: ok {rc=0} 23:20:41.947850 --- ParallelTerminationStrategy: PID 7632 died... 23:20:41.967314 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7632): Terminated: ok {rc=0} 23:20:42.013134 --- ParallelTerminationStrategy: PID 7635 died... 23:20:42.032525 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7635): Terminated: ok {rc=0} 23:20:42.119009 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2383 encryption register_a5_0_authreq.py ---------------------------------------------- 23:20:43.270866 tst encryption: Using 1 x ip_address (candidates: 6) 23:20:43.282418 tst encryption: Using 1 x bts (candidates: 1) 23:20:43.319512 tst register_a5_0_authreq.py: using LAC 32206 23:20:43.449467 tst register_a5_0_authreq.py: using RAC 76 23:20:43.584903 tst register_a5_0_authreq.py: using CellId 32206 23:20:43.715130 tst register_a5_0_authreq.py: using BVCI 32207 23:20:43.837727 tst encryption: Using 1 x ip_address (candidates: 6) 23:20:43.848587 tst encryption: Using 1 x ip_address (candidates: 6) 23:20:43.859405 tst encryption: Using 1 x ip_address (candidates: 6) 23:20:43.870146 tst encryption: Using 1 x ip_address (candidates: 6) 23:20:43.880852 tst encryption: Using 1 x ip_address (candidates: 6) 23:20:43.891616 tst encryption: Using 1 x modem (candidates: 1) 23:20:44.012614 tst register_a5_0_authreq.py:8: start network... 23:20:44.236891 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:20:44.749328 run create_hlr_db(pid=7638): Launched 23:20:44.884196 bus /sierra_2: Setting Powered False 23:20:45.958025 run create_hlr_db(pid=7638): Terminated: ok {rc=0} 23:20:46.519172 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7640): Launched 23:20:46.873743 run osmo-hlr_10.42.42.2(pid=7641): Launched 23:20:47.010650 run osmo-stp_10.42.42.5: Starting osmo-stp 23:20:47.670916 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7643): Launched 23:20:47.981777 run osmo-stp_10.42.42.5(pid=7644): Launched 23:20:48.102939 run osmo-msc_10.42.42.6: Starting osmo-msc 23:20:48.669714 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7646): Launched 23:20:48.984014 run osmo-msc_10.42.42.6(pid=7647): Launched 23:20:49.159375 run osmo-stp_10.42.42.5(pid=7644): ERR: Terminated: ERROR {rc=1} [trial-2383↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7644)] 23:20:49.292498 run osmo-stp_10.42.42.5(pid=7644): stdout: | (launched: 2022-12-12_23:20:47.925547) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:20:49.427818 run osmo-stp_10.42.42.5(pid=7644): stderr: | [0;m[38;5;43m20221212232048097 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212232048097 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212232048097 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212232048098 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212232048100 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212232048100 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212232048100 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:20:49.560111 run osmo-stp_10.42.42.5(pid=7644): stdout: | (launched: 2022-12-12_23:20:47.925547) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:20:49.685515 run osmo-stp_10.42.42.5(pid=7644): stderr: | [0;m[38;5;43m20221212232048097 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212232048097 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212232048097 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212232048098 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212232048100 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212232048100 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212232048100 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:20:49.835694 tst register_a5_0_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7644): Process ended prematurely: osmo-stp_10.42.42.5(pid=7644) [trial-2383↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7644)] [trial-2383↪encryption↪register_a5_0_authreq.py:8] 23:20:49.844359 tst register_a5_0_authreq.py:8: Test FAILED (6.6 sec) 23:20:49.870873 run osmo-hlr_10.42.42.2(pid=7641): ERR: Terminated: ERROR {rc=237} [trial-2383↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7641)] 23:20:49.918328 run osmo-hlr_10.42.42.2(pid=7641): stdout: | (launched: 2022-12-12_23:20:46.803802) 23:20:49.967294 run osmo-hlr_10.42.42.2(pid=7641): stderr: | [0;m[1;31m20221212232047235 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212232047235 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212232047235 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212232047235 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212232047235 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212232047236 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212232047264 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/encryption/register_a5_0_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212232047272 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212232047272 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212232047272 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:20:50.035798 run osmo-msc_10.42.42.6(pid=7647): ERR: Terminated: ERROR {rc=2} [trial-2383↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7647)] 23:20:50.083640 run osmo-msc_10.42.42.6(pid=7647): stdout: | (launched: 2022-12-12_23:20:48.926889) 23:20:50.132753 run osmo-msc_10.42.42.6(pid=7647): stderr: | [0;m[38;5;43m20221212232049204 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212232049204 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7e9dec6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212232049204 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212232049204 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212232049204 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212232049205 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212232049206 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212232049207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212232049207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212232049207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:20:50.182307 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7640): Terminating (SIGTERM) 23:20:50.221881 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7643): Terminating (SIGTERM) 23:20:50.261684 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7646): Terminating (SIGTERM) 23:20:50.301203 --- ParallelTerminationStrategy: PID 7640 died... 23:20:50.320446 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7640): Terminated: ok {rc=0} 23:20:50.365201 --- ParallelTerminationStrategy: PID 7643 died... 23:20:50.383555 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7643): Terminated: ok {rc=0} 23:20:50.428116 --- ParallelTerminationStrategy: PID 7646 died... 23:20:50.446569 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7646): Terminated: ok {rc=0} 23:20:50.532326 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2383 encryption register_a5_1_authreq.py ---------------------------------------------- 23:20:51.682943 tst encryption: Using 1 x ip_address (candidates: 6) 23:20:51.694091 tst encryption: Using 1 x bts (candidates: 1) 23:20:51.729930 tst register_a5_1_authreq.py: using LAC 32207 23:20:51.853162 tst register_a5_1_authreq.py: using RAC 77 23:20:51.978487 tst register_a5_1_authreq.py: using CellId 32207 23:20:52.106679 tst register_a5_1_authreq.py: using BVCI 32208 23:20:52.221931 tst encryption: Using 1 x ip_address (candidates: 6) 23:20:52.232214 tst encryption: Using 1 x ip_address (candidates: 6) 23:20:52.242608 tst encryption: Using 1 x ip_address (candidates: 6) 23:20:52.253158 tst encryption: Using 1 x ip_address (candidates: 6) 23:20:52.263583 tst encryption: Using 1 x ip_address (candidates: 6) 23:20:52.274137 tst encryption: Using 1 x modem (candidates: 1) 23:20:52.393817 tst register_a5_1_authreq.py:8: start network... 23:20:52.620837 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:20:53.136299 run create_hlr_db(pid=7653): Launched 23:20:53.270931 bus /sierra_2: Setting Powered False 23:20:54.336299 run create_hlr_db(pid=7653): Terminated: ok {rc=0} 23:20:54.781754 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7655): Launched 23:20:55.096404 run osmo-hlr_10.42.42.2(pid=7656): Launched 23:20:55.216359 run osmo-stp_10.42.42.5: Starting osmo-stp 23:20:55.762417 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7658): Launched 23:20:56.073808 run osmo-stp_10.42.42.5(pid=7659): Launched 23:20:56.193606 run osmo-msc_10.42.42.6: Starting osmo-msc 23:20:56.767859 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7661): Launched 23:20:57.081116 run osmo-msc_10.42.42.6(pid=7662): Launched 23:20:57.257616 run osmo-stp_10.42.42.5(pid=7659): ERR: Terminated: ERROR {rc=1} [trial-2383↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7659)] 23:20:57.391446 run osmo-stp_10.42.42.5(pid=7659): stdout: | (launched: 2022-12-12_23:20:56.017202) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:20:57.524401 run osmo-stp_10.42.42.5(pid=7659): stderr: | [0;m[38;5;43m20221212232056189 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212232056189 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212232056189 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212232056190 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212232056192 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212232056192 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212232056192 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:20:57.654533 run osmo-stp_10.42.42.5(pid=7659): stdout: | (launched: 2022-12-12_23:20:56.017202) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:20:57.778881 run osmo-stp_10.42.42.5(pid=7659): stderr: | [0;m[38;5;43m20221212232056189 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212232056189 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212232056189 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212232056190 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212232056192 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212232056192 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212232056192 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:20:57.927527 tst register_a5_1_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7659): Process ended prematurely: osmo-stp_10.42.42.5(pid=7659) [trial-2383↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7659)] [trial-2383↪encryption↪register_a5_1_authreq.py:8] 23:20:57.936291 tst register_a5_1_authreq.py:8: Test FAILED (6.3 sec) 23:20:57.962889 run osmo-hlr_10.42.42.2(pid=7656): ERR: Terminated: ERROR {rc=237} [trial-2383↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7656)] 23:20:58.010445 run osmo-hlr_10.42.42.2(pid=7656): stdout: | (launched: 2022-12-12_23:20:55.038536) 23:20:58.059899 run osmo-hlr_10.42.42.2(pid=7656): stderr: | [0;m[1;31m20221212232055217 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212232055217 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212232055217 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212232055217 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212232055217 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212232055217 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212232055229 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/encryption/register_a5_1_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212232055237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212232055237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212232055237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:20:58.128645 run osmo-msc_10.42.42.6(pid=7662): ERR: Terminated: ERROR {rc=2} [trial-2383↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7662)] 23:20:58.176159 run osmo-msc_10.42.42.6(pid=7662): stdout: | (launched: 2022-12-12_23:20:57.023843) 23:20:58.225375 run osmo-msc_10.42.42.6(pid=7662): stderr: | [0;m[38;5;43m20221212232057304 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212232057304 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f48733bec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212232057304 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212232057304 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212232057304 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212232057304 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212232057306 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212232057306 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212232057307 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212232057307 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:20:58.275135 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7655): Terminating (SIGTERM) 23:20:58.314932 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7658): Terminating (SIGTERM) 23:20:58.354223 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7661): Terminating (SIGTERM) 23:20:58.394310 --- ParallelTerminationStrategy: PID 7655 died... 23:20:58.413166 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7655): Terminated: ok {rc=0} 23:20:58.457173 --- ParallelTerminationStrategy: PID 7658 died... 23:20:58.475590 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7658): Terminated: ok {rc=0} 23:20:58.519603 --- ParallelTerminationStrategy: PID 7661 died... 23:20:58.538243 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7661): Terminated: ok {rc=0} 23:20:58.624127 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2383 encryption register_a5_3_authreq.py ---------------------------------------------- 23:20:59.773941 tst encryption: Using 1 x ip_address (candidates: 6) 23:20:59.784916 tst encryption: Using 1 x bts (candidates: 1) 23:20:59.821420 tst register_a5_3_authreq.py: using LAC 32208 23:20:59.946907 tst register_a5_3_authreq.py: using RAC 78 23:21:00.072376 tst register_a5_3_authreq.py: using CellId 32208 23:21:00.198348 tst register_a5_3_authreq.py: using BVCI 32209 23:21:00.313149 tst encryption: Using 1 x ip_address (candidates: 6) 23:21:00.323569 tst encryption: Using 1 x ip_address (candidates: 6) 23:21:00.333970 tst encryption: Using 1 x ip_address (candidates: 6) 23:21:00.344943 tst encryption: Using 1 x ip_address (candidates: 6) 23:21:00.355234 tst encryption: Using 1 x ip_address (candidates: 6) 23:21:00.366660 tst encryption: Using 1 x modem (candidates: 1) 23:21:00.498952 tst register_a5_3_authreq.py:8: start network... 23:21:00.725555 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:21:01.337542 run create_hlr_db(pid=7664): Launched 23:21:01.508323 bus /sierra_2: Setting Powered False 23:21:02.573885 run create_hlr_db(pid=7664): Terminated: ok {rc=0} 23:21:03.018047 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7666): Launched 23:21:03.332015 run osmo-hlr_10.42.42.2(pid=7667): Launched 23:21:03.452690 run osmo-stp_10.42.42.5: Starting osmo-stp 23:21:04.026899 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7669): Launched 23:21:04.359298 run osmo-stp_10.42.42.5(pid=7670): Launched 23:21:04.486657 run osmo-msc_10.42.42.6: Starting osmo-msc 23:21:05.087511 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7672): Launched 23:21:05.421091 run osmo-msc_10.42.42.6(pid=7673): Launched 23:21:05.606622 run osmo-stp_10.42.42.5(pid=7670): ERR: Terminated: ERROR {rc=1} [trial-2383↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7670)] 23:21:05.746797 run osmo-stp_10.42.42.5(pid=7670): stdout: | (launched: 2022-12-12_23:21:04.299234) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:21:05.887718 run osmo-stp_10.42.42.5(pid=7670): stderr: | [0;m[38;5;43m20221212232104494 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212232104494 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212232104494 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212232104495 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212232104495 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212232104495 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212232104495 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:21:06.027162 run osmo-stp_10.42.42.5(pid=7670): stdout: | (launched: 2022-12-12_23:21:04.299234) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:21:06.159734 run osmo-stp_10.42.42.5(pid=7670): stderr: | [0;m[38;5;43m20221212232104494 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212232104494 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212232104494 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212232104495 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212232104495 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212232104495 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212232104495 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:21:06.318192 tst register_a5_3_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7670): Process ended prematurely: osmo-stp_10.42.42.5(pid=7670) [trial-2383↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7670)] [trial-2383↪encryption↪register_a5_3_authreq.py:8] 23:21:06.327606 tst register_a5_3_authreq.py:8: Test FAILED (6.6 sec) 23:21:06.355408 run osmo-hlr_10.42.42.2(pid=7667): ERR: Terminated: ERROR {rc=237} [trial-2383↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7667)] 23:21:06.405347 run osmo-hlr_10.42.42.2(pid=7667): stdout: | (launched: 2022-12-12_23:21:03.275370) 23:21:06.456644 run osmo-hlr_10.42.42.2(pid=7667): stderr: | [0;m[1;31m20221212232103456 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212232103456 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212232103456 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212232103456 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212232103456 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212232103456 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212232103476 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/encryption/register_a5_3_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212232103485 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212232103486 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212232103486 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:21:06.528540 run osmo-msc_10.42.42.6(pid=7673): ERR: Terminated: ERROR {rc=2} [trial-2383↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7673)] 23:21:06.578277 run osmo-msc_10.42.42.6(pid=7673): stdout: | (launched: 2022-12-12_23:21:05.360338) 23:21:06.629777 run osmo-msc_10.42.42.6(pid=7673): stderr: | [0;m[38;5;43m20221212232105685 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212232105685 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f71de961c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212232105685 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212232105685 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212232105685 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212232105685 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212232105687 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212232105687 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212232105687 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212232105687 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:21:06.681534 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7666): Terminating (SIGTERM) 23:21:06.722970 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7669): Terminating (SIGTERM) 23:21:06.764582 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7672): Terminating (SIGTERM) 23:21:06.806576 --- ParallelTerminationStrategy: PID 7666 died... 23:21:06.826591 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7666): Terminated: ok {rc=0} 23:21:06.872586 --- ParallelTerminationStrategy: PID 7669 died... 23:21:06.892094 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7669): Terminated: ok {rc=0} 23:21:06.938484 --- ParallelTerminationStrategy: PID 7672 died... 23:21:06.957922 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7672): Terminated: ok {rc=0} 23:21:07.044478 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 encryption FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 4g:srsenb-rftype@zmq+srsue-rftype@zmq --------------------------------------------------------------------- 23:21:08.253677 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:21:08.258981 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x enb (candidates: 2) 23:21:08.278366 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x modem (candidates: 12) 23:21:08.306888 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x run_node (candidates: 1) 23:21:08.333104 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x enb (candidates: 2) 23:21:08.352558 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x modem (candidates: 12) 23:21:08.379646 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x run_node (candidates: 1) 23:21:08.889450 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: RESERVED RESOURCES for 4g: enb srsENB-zmq modem srsUE-zmq_1 run_node e55cbce541824969b492cc4fa86bdef69cf65e7d ---------------------------------------------- trial-2383 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover.py ---------------------------------------------- 23:21:08.894956 tst handover.py:11: TEST_CONFIG: {} 23:21:09.104925 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 23:21:09.121034 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 23:21:09.144057 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 23:21:09.196132 tst handover.py: using MSISDN 8028 23:21:09.311950 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8028', subscriber_id=0} 23:21:09.422117 run srsepc_10.42.42.118: Starting srsepc 23:21:11.268434 run rm-remote-dir(pid=7678): Launched 23:21:11.391763 bus /sierra_2: Setting Powered False 23:21:12.458382 run rm-remote-dir(pid=7678): Terminated: ok {rc=0} 23:21:12.905429 run mk-remote-dir(pid=7679): Launched 23:21:14.085500 run mk-remote-dir(pid=7679): Terminated: ok {rc=0} 23:21:14.374702 run scp-inst-to-remote(pid=7680): Launched 23:21:16.568326 run scp-inst-to-remote(pid=7680): Terminated: ok {rc=0} 23:21:16.923034 run rm-remote-dir(pid=7682): Launched 23:21:18.159011 run rm-remote-dir(pid=7682): Terminated: ok {rc=0} 23:21:18.499132 run mk-remote-dir(pid=7683): Launched 23:21:19.681106 run mk-remote-dir(pid=7683): Terminated: ok {rc=0} 23:21:19.970633 run scp-cfg-to-remote(pid=7684): Launched 23:21:21.148626 run scp-cfg-to-remote(pid=7684): Terminated: ok {rc=0} 23:21:21.435831 run scp-db-to-remote(pid=7686): Launched 23:21:22.615633 run scp-db-to-remote(pid=7686): Terminated: ok {rc=0} 23:21:22.748594 run srsepc_10.42.42.118: Setting RPATH for srsepc 23:21:23.061254 run patchelf(pid=7688): Launched 23:21:24.239520 run patchelf(pid=7688): Terminated: ok {rc=0} 23:21:24.372398 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 23:21:24.685029 run setcap-netadm(pid=7689): Launched 23:21:25.862586 run setcap-netadm(pid=7689): Terminated: ok {rc=0} 23:21:26.189610 run srsepc(pid=7690): Launched 23:21:26.305414 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 23:21:27.432519 run rm-remote-dir(pid=7691): Launched 23:21:27.612007 run srsepc(pid=7690): ERR: Terminated: ERROR {rc=127} [trial-2383↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=7690)] 23:21:27.748147 run srsepc(pid=7690): stdout: | (launched: 2022-12-12_23:21:26.132654) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 23:21:27.885190 run srsepc(pid=7690): stderr: | (launched: 2022-12-12_23:21:26.178952) | Connection to 10.42.42.116 closed. 23:21:28.021964 run srsepc(pid=7690): stdout: | (launched: 2022-12-12_23:21:26.132654) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 23:21:28.154571 run srsepc(pid=7690): stderr: | (launched: 2022-12-12_23:21:26.178952) | Connection to 10.42.42.116 closed. 23:21:28.310106 run rm-remote-dir(pid=7691): Terminating (SIGINT) 23:21:28.491896 run rm-remote-dir(pid=7691): Terminated: ok {rc=0} 23:21:28.622618 tst handover.py:37: ERR: Error: srsepc(pid=7690): Process ended prematurely: srsepc(pid=7690) [trial-2383↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=7690)] [trial-2383↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37] 23:21:28.632283 tst handover.py:37: Test FAILED (19.7 sec) 23:21:28.709368 run scp-back-log(pid=7692): Launched 23:21:29.785938 run scp-back-log(pid=7692): ERR: Terminated: ERROR {rc=1} [trial-2383↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=7692)] 23:21:29.846709 run scp-back-log(pid=7692): stdout: | (launched: 2022-12-12_23:21:28.678970) 23:21:29.908768 run scp-back-log(pid=7692): stderr: | (launched: 2022-12-12_23:21:28.698634) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 23:21:29.978575 tst srsepc_10.42.42.118: Error('scp-back-log(pid=7692): launch_sync(): local process exited with status 1 [trial-2383↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=7692)]') ---------------------------------------------- trial-2383 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_bidir.py ---------------------------------------------- 23:21:30.023960 tst iperf3_bidir.py:13: Number of physical ue: 1 23:21:30.233993 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 23:21:30.276132 tst iperf3_bidir.py:20: ue index0: srsue_10.42.42.116 23:21:30.486228 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 23:21:30.501943 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 23:21:30.533877 tst iperf3_bidir.py: using MSISDN 8029 23:21:30.647084 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8029', subscriber_id=0} 23:21:30.755857 run srsepc_10.42.42.118: Starting srsepc 23:21:31.422301 run rm-remote-dir(pid=7694): Launched 23:21:32.672694 run rm-remote-dir(pid=7694): Terminated: ok {rc=0} 23:21:33.015816 run mk-remote-dir(pid=7695): Launched 23:21:34.196105 run mk-remote-dir(pid=7695): Terminated: ok {rc=0} 23:21:34.485769 run scp-inst-to-remote(pid=7696): Launched 23:21:36.666942 run scp-inst-to-remote(pid=7696): Terminated: ok {rc=0} 23:21:37.006318 run rm-remote-dir(pid=7698): Launched 23:21:38.187941 run rm-remote-dir(pid=7698): Terminated: ok {rc=0} 23:21:38.527982 run mk-remote-dir(pid=7699): Launched 23:21:39.709245 run mk-remote-dir(pid=7699): Terminated: ok {rc=0} 23:21:39.999281 run scp-cfg-to-remote(pid=7700): Launched 23:21:41.179040 run scp-cfg-to-remote(pid=7700): Terminated: ok {rc=0} 23:21:41.466392 run scp-db-to-remote(pid=7702): Launched 23:21:42.645744 run scp-db-to-remote(pid=7702): Terminated: ok {rc=0} 23:21:42.779148 run srsepc_10.42.42.118: Setting RPATH for srsepc 23:21:43.091986 run patchelf(pid=7704): Launched 23:21:44.270855 run patchelf(pid=7704): Terminated: ok {rc=0} 23:21:44.403734 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 23:21:44.716853 run setcap-netadm(pid=7705): Launched 23:21:45.915231 run setcap-netadm(pid=7705): Terminated: ok {rc=0} 23:21:46.313307 run srsepc(pid=7706): Launched 23:21:46.481565 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 23:21:47.790158 run rm-remote-dir(pid=7707): Launched 23:21:47.982531 run srsepc(pid=7706): ERR: Terminated: ERROR {rc=127} [trial-2383↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=7706)] 23:21:48.128617 run srsepc(pid=7706): stdout: | (launched: 2022-12-12_23:21:46.248445) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 23:21:48.273682 run srsepc(pid=7706): stderr: | (launched: 2022-12-12_23:21:46.296247) | Connection to 10.42.42.116 closed. 23:21:48.418596 run srsepc(pid=7706): stdout: | (launched: 2022-12-12_23:21:46.248445) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 23:21:48.558758 run srsepc(pid=7706): stderr: | (launched: 2022-12-12_23:21:46.296247) | Connection to 10.42.42.116 closed. 23:21:48.724433 run rm-remote-dir(pid=7707): Terminating (SIGINT) 23:21:48.916706 run rm-remote-dir(pid=7707): Terminated: ok {rc=0} 23:21:49.055563 tst iperf3_bidir.py:42: ERR: Error: srsepc(pid=7706): Process ended prematurely: srsepc(pid=7706) [trial-2383↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=7706)] [trial-2383↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42] 23:21:49.066146 tst iperf3_bidir.py:42: Test FAILED (19.0 sec) 23:21:49.146231 run scp-back-log(pid=7708): Launched 23:21:50.226612 run scp-back-log(pid=7708): ERR: Terminated: ERROR {rc=1} [trial-2383↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=7708)] 23:21:50.290578 run scp-back-log(pid=7708): stdout: | (launched: 2022-12-12_23:21:49.115044) 23:21:50.355650 run scp-back-log(pid=7708): stderr: | (launched: 2022-12-12_23:21:49.135661) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 23:21:50.429703 tst srsepc_10.42.42.118: Error('scp-back-log(pid=7708): launch_sync(): local process exited with status 1 [trial-2383↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=7708)]') ---------------------------------------------- trial-2383 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_dl.py ---------------------------------------------- 23:21:50.477201 tst iperf3_dl.py:13: Number of physical ue: 1 23:21:50.701784 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 23:21:50.746440 tst iperf3_dl.py:20: ue index0: srsue_10.42.42.116 23:21:50.969446 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 23:21:50.985772 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 23:21:51.018524 tst iperf3_dl.py: using MSISDN 8030 23:21:51.139098 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8030', subscriber_id=0} 23:21:51.255378 run srsepc_10.42.42.118: Starting srsepc 23:21:51.935489 run rm-remote-dir(pid=7710): Launched 23:21:53.129845 run rm-remote-dir(pid=7710): Terminated: ok {rc=0} 23:21:53.490873 run mk-remote-dir(pid=7711): Launched 23:21:54.684651 run mk-remote-dir(pid=7711): Terminated: ok {rc=0} 23:21:54.992652 run scp-inst-to-remote(pid=7712): Launched 23:21:57.182590 run scp-inst-to-remote(pid=7712): Terminated: ok {rc=0} 23:21:57.521590 run rm-remote-dir(pid=7714): Launched 23:21:58.703354 run rm-remote-dir(pid=7714): Terminated: ok {rc=0} 23:21:59.044008 run mk-remote-dir(pid=7715): Launched 23:22:00.225596 run mk-remote-dir(pid=7715): Terminated: ok {rc=0} 23:22:00.515640 run scp-cfg-to-remote(pid=7716): Launched 23:22:01.694666 run scp-cfg-to-remote(pid=7716): Terminated: ok {rc=0} 23:22:01.998403 run scp-db-to-remote(pid=7718): Launched 23:22:03.254493 run scp-db-to-remote(pid=7718): Terminated: ok {rc=0} 23:22:03.387668 run srsepc_10.42.42.118: Setting RPATH for srsepc 23:22:03.701400 run patchelf(pid=7720): Launched 23:22:04.880187 run patchelf(pid=7720): Terminated: ok {rc=0} 23:22:05.013863 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 23:22:05.327372 run setcap-netadm(pid=7721): Launched 23:22:06.506418 run setcap-netadm(pid=7721): Terminated: ok {rc=0} 23:22:06.834265 run srsepc(pid=7722): Launched 23:22:06.950005 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 23:22:08.077202 run rm-remote-dir(pid=7723): Launched 23:22:08.256307 run srsepc(pid=7722): ERR: Terminated: ERROR {rc=127} [trial-2383↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=7722)] 23:22:08.392207 run srsepc(pid=7722): stdout: | (launched: 2022-12-12_23:22:06.777390) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 23:22:08.528787 run srsepc(pid=7722): stderr: | (launched: 2022-12-12_23:22:06.823568) | Connection to 10.42.42.116 closed. 23:22:08.665142 run srsepc(pid=7722): stdout: | (launched: 2022-12-12_23:22:06.777390) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 23:22:08.796093 run srsepc(pid=7722): stderr: | (launched: 2022-12-12_23:22:06.823568) | Connection to 10.42.42.116 closed. 23:22:08.951717 run rm-remote-dir(pid=7723): Terminating (SIGINT) 23:22:09.133457 run rm-remote-dir(pid=7723): Terminated: ok {rc=0} 23:22:09.264508 tst iperf3_dl.py:42: ERR: Error: srsepc(pid=7722): Process ended prematurely: srsepc(pid=7722) [trial-2383↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=7722)] [trial-2383↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42] 23:22:09.274544 tst iperf3_dl.py:42: Test FAILED (18.8 sec) 23:22:09.351077 run scp-back-log(pid=7724): Launched 23:22:10.426897 run scp-back-log(pid=7724): ERR: Terminated: ERROR {rc=1} [trial-2383↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=7724)] 23:22:10.486783 run scp-back-log(pid=7724): stdout: | (launched: 2022-12-12_23:22:09.320835) 23:22:10.548721 run scp-back-log(pid=7724): stderr: | (launched: 2022-12-12_23:22:09.340433) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 23:22:10.617781 tst srsepc_10.42.42.118: Error('scp-back-log(pid=7724): launch_sync(): local process exited with status 1 [trial-2383↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=7724)]') ---------------------------------------------- trial-2383 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_ul.py ---------------------------------------------- 23:22:10.662378 tst iperf3_ul.py:13: Number of physical ue: 1 23:22:10.873248 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 23:22:10.915011 tst iperf3_ul.py:20: ue index0: srsue_10.42.42.116 23:22:11.123071 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 23:22:11.138628 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 23:22:11.173675 tst iperf3_ul.py: using MSISDN 8031 23:22:11.287153 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8031', subscriber_id=0} 23:22:11.396554 run srsepc_10.42.42.118: Starting srsepc 23:22:12.037376 run rm-remote-dir(pid=7726): Launched 23:22:13.221156 run rm-remote-dir(pid=7726): Terminated: ok {rc=0} 23:22:13.562923 run mk-remote-dir(pid=7727): Launched 23:22:14.744908 run mk-remote-dir(pid=7727): Terminated: ok {rc=0} 23:22:15.035322 run scp-inst-to-remote(pid=7728): Launched 23:22:17.221823 run scp-inst-to-remote(pid=7728): Terminated: ok {rc=0} 23:22:17.591304 run rm-remote-dir(pid=7730): Launched 23:22:18.774598 run rm-remote-dir(pid=7730): Terminated: ok {rc=0} 23:22:19.115657 run mk-remote-dir(pid=7731): Launched 23:22:20.297695 run mk-remote-dir(pid=7731): Terminated: ok {rc=0} 23:22:20.589096 run scp-cfg-to-remote(pid=7732): Launched 23:22:21.769805 run scp-cfg-to-remote(pid=7732): Terminated: ok {rc=0} 23:22:22.060447 run scp-db-to-remote(pid=7734): Launched 23:22:23.241083 run scp-db-to-remote(pid=7734): Terminated: ok {rc=0} 23:22:23.375296 run srsepc_10.42.42.118: Setting RPATH for srsepc 23:22:23.689597 run patchelf(pid=7736): Launched 23:22:24.868289 run patchelf(pid=7736): Terminated: ok {rc=0} 23:22:25.002109 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 23:22:25.315463 run setcap-netadm(pid=7737): Launched 23:22:26.494798 run setcap-netadm(pid=7737): Terminated: ok {rc=0} 23:22:26.823468 run srsepc(pid=7738): Launched 23:22:26.939430 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 23:22:28.067347 run rm-remote-dir(pid=7739): Launched 23:22:28.246753 run srsepc(pid=7738): ERR: Terminated: ERROR {rc=127} [trial-2383↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=7738)] 23:22:28.383195 run srsepc(pid=7738): stdout: | (launched: 2022-12-12_23:22:26.767041) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 23:22:28.520303 run srsepc(pid=7738): stderr: | (launched: 2022-12-12_23:22:26.813436) | Connection to 10.42.42.116 closed. 23:22:28.657402 run srsepc(pid=7738): stdout: | (launched: 2022-12-12_23:22:26.767041) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 23:22:28.789669 run srsepc(pid=7738): stderr: | (launched: 2022-12-12_23:22:26.813436) | Connection to 10.42.42.116 closed. 23:22:28.946176 run rm-remote-dir(pid=7739): Terminating (SIGINT) 23:22:29.128260 run rm-remote-dir(pid=7739): Terminated: ok {rc=0} 23:22:29.259415 tst iperf3_ul.py:42: ERR: Error: srsepc(pid=7738): Process ended prematurely: srsepc(pid=7738) [trial-2383↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=7738)] [trial-2383↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42] 23:22:29.269276 tst iperf3_ul.py:42: Test FAILED (18.6 sec) 23:22:29.346370 run scp-back-log(pid=7740): Launched 23:22:30.422369 run scp-back-log(pid=7740): ERR: Terminated: ERROR {rc=1} [trial-2383↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=7740)] 23:22:30.482710 run scp-back-log(pid=7740): stdout: | (launched: 2022-12-12_23:22:29.315931) 23:22:30.545231 run scp-back-log(pid=7740): stderr: | (launched: 2022-12-12_23:22:29.335480) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 23:22:30.615044 tst srsepc_10.42.42.118: Error('scp-back-log(pid=7740): launch_sync(): local process exited with status 1 [trial-2383↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=7740)]') ---------------------------------------------- trial-2383 4g:srsenb-rftype@zmq+srsue-rftype@zmq ping.py ---------------------------------------------- 23:22:30.660459 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 23:22:30.676802 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 23:22:30.699957 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 23:22:30.748156 tst ping.py: using MSISDN 8032 23:22:30.868547 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8032', subscriber_id=0} 23:22:30.990797 run srsepc_10.42.42.118: Starting srsepc 23:22:31.702101 run rm-remote-dir(pid=7742): Launched 23:22:33.032738 run rm-remote-dir(pid=7742): Terminated: ok {rc=0} 23:22:33.373159 run mk-remote-dir(pid=7743): Launched 23:22:34.553135 run mk-remote-dir(pid=7743): Terminated: ok {rc=0} 23:22:34.842669 run scp-inst-to-remote(pid=7744): Launched 23:22:37.026392 run scp-inst-to-remote(pid=7744): Terminated: ok {rc=0} 23:22:37.387325 run rm-remote-dir(pid=7746): Launched 23:22:38.579314 run rm-remote-dir(pid=7746): Terminated: ok {rc=0} 23:22:38.919652 run mk-remote-dir(pid=7747): Launched 23:22:40.100252 run mk-remote-dir(pid=7747): Terminated: ok {rc=0} 23:22:40.391164 run scp-cfg-to-remote(pid=7748): Launched 23:22:41.571498 run scp-cfg-to-remote(pid=7748): Terminated: ok {rc=0} 23:22:41.860365 run scp-db-to-remote(pid=7750): Launched 23:22:43.039738 run scp-db-to-remote(pid=7750): Terminated: ok {rc=0} 23:22:43.173178 run srsepc_10.42.42.118: Setting RPATH for srsepc 23:22:43.486696 run patchelf(pid=7752): Launched 23:22:44.664628 run patchelf(pid=7752): Terminated: ok {rc=0} 23:22:44.797966 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 23:22:45.110541 run setcap-netadm(pid=7753): Launched 23:22:46.320389 run setcap-netadm(pid=7753): Terminated: ok {rc=0} 23:22:46.723549 run srsepc(pid=7754): Launched 23:22:46.973913 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 23:22:48.251640 run rm-remote-dir(pid=7755): Launched 23:22:48.445147 run srsepc(pid=7754): ERR: Terminated: ERROR {rc=127} [trial-2383↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=7754)] 23:22:48.592746 run srsepc(pid=7754): stdout: | (launched: 2022-12-12_23:22:46.658171) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 23:22:48.738826 run srsepc(pid=7754): stderr: | (launched: 2022-12-12_23:22:46.705520) | Connection to 10.42.42.116 closed. 23:22:48.884778 run srsepc(pid=7754): stdout: | (launched: 2022-12-12_23:22:46.658171) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 23:22:49.025166 run srsepc(pid=7754): stderr: | (launched: 2022-12-12_23:22:46.705520) | Connection to 10.42.42.116 closed. 23:22:49.191957 run rm-remote-dir(pid=7755): Terminating (SIGINT) 23:22:49.384857 run rm-remote-dir(pid=7755): Terminated: ok {rc=0} 23:22:49.523917 tst ping.py:16: ERR: Error: srsepc(pid=7754): Process ended prematurely: srsepc(pid=7754) [trial-2383↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=7754)] [trial-2383↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16] 23:22:49.534818 tst ping.py:16: Test FAILED (18.9 sec) 23:22:49.614794 run scp-back-log(pid=7756): Launched 23:22:50.695270 run scp-back-log(pid=7756): ERR: Terminated: ERROR {rc=1} [trial-2383↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=7756)] 23:22:50.759301 run scp-back-log(pid=7756): stdout: | (launched: 2022-12-12_23:22:49.583539) 23:22:50.824715 run scp-back-log(pid=7756): stderr: | (launched: 2022-12-12_23:22:49.604220) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 23:22:50.898349 tst srsepc_10.42.42.118: Error('scp-back-log(pid=7756): launch_sync(): local process exited with status 1 [trial-2383↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=7756)]') ---------------------------------------------- trial-2383 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mo_ping.py ---------------------------------------------- 23:22:50.946754 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 23:22:50.963913 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 23:22:50.987654 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 23:22:51.039245 tst rrc_idle_mo_ping.py: using MSISDN 8033 23:22:51.163731 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8033', subscriber_id=0} 23:22:51.280182 run srsepc_10.42.42.118: Starting srsepc 23:22:51.959777 run rm-remote-dir(pid=7758): Launched 23:22:53.154063 run rm-remote-dir(pid=7758): Terminated: ok {rc=0} 23:22:53.515825 run mk-remote-dir(pid=7759): Launched 23:22:54.710335 run mk-remote-dir(pid=7759): Terminated: ok {rc=0} 23:22:55.019122 run scp-inst-to-remote(pid=7760): Launched 23:22:57.204528 run scp-inst-to-remote(pid=7760): Terminated: ok {rc=0} 23:22:57.544527 run rm-remote-dir(pid=7762): Launched 23:22:58.726602 run rm-remote-dir(pid=7762): Terminated: ok {rc=0} 23:22:59.067290 run mk-remote-dir(pid=7763): Launched 23:23:00.249201 run mk-remote-dir(pid=7763): Terminated: ok {rc=0} 23:23:00.540320 run scp-cfg-to-remote(pid=7764): Launched 23:23:01.734213 run scp-cfg-to-remote(pid=7764): Terminated: ok {rc=0} 23:23:02.114786 run scp-db-to-remote(pid=7766): Launched 23:23:03.361607 run scp-db-to-remote(pid=7766): Terminated: ok {rc=0} 23:23:03.495929 run srsepc_10.42.42.118: Setting RPATH for srsepc 23:23:03.809565 run patchelf(pid=7768): Launched 23:23:04.988759 run patchelf(pid=7768): Terminated: ok {rc=0} 23:23:05.122110 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 23:23:05.436086 run setcap-netadm(pid=7769): Launched 23:23:06.615107 run setcap-netadm(pid=7769): Terminated: ok {rc=0} 23:23:06.943009 run srsepc(pid=7770): Launched 23:23:07.058956 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 23:23:08.185705 run rm-remote-dir(pid=7771): Launched 23:23:08.364593 run srsepc(pid=7770): ERR: Terminated: ERROR {rc=127} [trial-2383↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=7770)] 23:23:08.501109 run srsepc(pid=7770): stdout: | (launched: 2022-12-12_23:23:06.886277) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 23:23:08.637767 run srsepc(pid=7770): stderr: | (launched: 2022-12-12_23:23:06.932524) | Connection to 10.42.42.116 closed. 23:23:08.774126 run srsepc(pid=7770): stdout: | (launched: 2022-12-12_23:23:06.886277) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 23:23:08.905538 run srsepc(pid=7770): stderr: | (launched: 2022-12-12_23:23:06.932524) | Connection to 10.42.42.116 closed. 23:23:09.061346 run rm-remote-dir(pid=7771): Terminating (SIGINT) 23:23:09.243433 run rm-remote-dir(pid=7771): Terminated: ok {rc=0} 23:23:09.374427 tst rrc_idle_mo_ping.py:16: ERR: Error: srsepc(pid=7770): Process ended prematurely: srsepc(pid=7770) [trial-2383↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=7770)] [trial-2383↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16] 23:23:09.384211 tst rrc_idle_mo_ping.py:16: Test FAILED (18.4 sec) 23:23:09.460812 run scp-back-log(pid=7772): Launched 23:23:10.535408 run scp-back-log(pid=7772): ERR: Terminated: ERROR {rc=1} [trial-2383↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=7772)] 23:23:10.595868 run scp-back-log(pid=7772): stdout: | (launched: 2022-12-12_23:23:09.430972) 23:23:10.658076 run scp-back-log(pid=7772): stderr: | (launched: 2022-12-12_23:23:09.450495) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 23:23:10.727744 tst srsepc_10.42.42.118: Error('scp-back-log(pid=7772): launch_sync(): local process exited with status 1 [trial-2383↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=7772)]') ---------------------------------------------- trial-2383 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mt_ping.py ---------------------------------------------- 23:23:10.773413 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 23:23:10.789988 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 23:23:10.812842 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 23:23:10.864567 tst rrc_idle_mt_ping.py: using MSISDN 8034 23:23:10.981959 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8034', subscriber_id=0} 23:23:11.091699 run srsepc_10.42.42.118: Starting srsepc 23:23:11.731713 run rm-remote-dir(pid=7774): Launched 23:23:12.912584 run rm-remote-dir(pid=7774): Terminated: ok {rc=0} 23:23:13.253949 run mk-remote-dir(pid=7775): Launched 23:23:14.436072 run mk-remote-dir(pid=7775): Terminated: ok {rc=0} 23:23:14.727059 run scp-inst-to-remote(pid=7776): Launched 23:23:16.916903 run scp-inst-to-remote(pid=7776): Terminated: ok {rc=0} 23:23:17.302955 run rm-remote-dir(pid=7778): Launched 23:23:18.513301 run rm-remote-dir(pid=7778): Terminated: ok {rc=0} 23:23:18.854609 run mk-remote-dir(pid=7779): Launched 23:23:20.035888 run mk-remote-dir(pid=7779): Terminated: ok {rc=0} 23:23:20.326774 run scp-cfg-to-remote(pid=7780): Launched 23:23:21.507300 run scp-cfg-to-remote(pid=7780): Terminated: ok {rc=0} 23:23:21.797041 run scp-db-to-remote(pid=7782): Launched 23:23:22.979526 run scp-db-to-remote(pid=7782): Terminated: ok {rc=0} 23:23:23.113524 run srsepc_10.42.42.118: Setting RPATH for srsepc 23:23:23.428016 run patchelf(pid=7784): Launched 23:23:24.607826 run patchelf(pid=7784): Terminated: ok {rc=0} 23:23:24.741532 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 23:23:25.056304 run setcap-netadm(pid=7785): Launched 23:23:26.236165 run setcap-netadm(pid=7785): Terminated: ok {rc=0} 23:23:26.566053 run srsepc(pid=7786): Launched 23:23:26.682094 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 23:23:27.807464 run rm-remote-dir(pid=7787): Launched 23:23:27.986232 run srsepc(pid=7786): ERR: Terminated: ERROR {rc=127} [trial-2383↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=7786)] 23:23:28.122267 run srsepc(pid=7786): stdout: | (launched: 2022-12-12_23:23:26.508414) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 23:23:28.259122 run srsepc(pid=7786): stderr: | (launched: 2022-12-12_23:23:26.555345) | Connection to 10.42.42.116 closed. 23:23:28.395505 run srsepc(pid=7786): stdout: | (launched: 2022-12-12_23:23:26.508414) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 23:23:28.527428 run srsepc(pid=7786): stderr: | (launched: 2022-12-12_23:23:26.555345) | Connection to 10.42.42.116 closed. 23:23:28.683611 run rm-remote-dir(pid=7787): Terminating (SIGINT) 23:23:28.864607 run rm-remote-dir(pid=7787): Terminated: ok {rc=0} 23:23:28.995919 tst rrc_idle_mt_ping.py:16: ERR: Error: srsepc(pid=7786): Process ended prematurely: srsepc(pid=7786) [trial-2383↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=7786)] [trial-2383↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16] 23:23:29.005734 tst rrc_idle_mt_ping.py:16: Test FAILED (18.2 sec) 23:23:29.082117 run scp-back-log(pid=7788): Launched 23:23:30.158550 run scp-back-log(pid=7788): ERR: Terminated: ERROR {rc=1} [trial-2383↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=7788)] 23:23:30.219352 run scp-back-log(pid=7788): stdout: | (launched: 2022-12-12_23:23:29.052117) 23:23:30.281300 run scp-back-log(pid=7788): stderr: | (launched: 2022-12-12_23:23:29.071713) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 23:23:30.350718 tst srsepc_10.42.42.118: Error('scp-back-log(pid=7788): launch_sync(): local process exited with status 1 [trial-2383↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=7788)]') --------------------------------------------------------------------- trial-2383 4g:srsenb-rftype@zmq+srsue-rftype@zmq FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 handover_2G:nanobts+bts1-oc2g --------------------------------------------------------------------- 23:23:30.478556 tst handover_2G:nanobts+bts1-oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:23:30.483568 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x bts (candidates: 11) 23:23:30.525087 tst handover_2G:nanobts+bts1-oc2g: Verifying 6 x ip_address (candidates: 9) 23:23:30.551627 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x modem (candidates: 12) 23:23:30.603392 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x bts (candidates: 11) 23:23:30.645336 tst handover_2G:nanobts+bts1-oc2g: Reserving 6 x ip_address (candidates: 9) 23:23:30.671454 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x modem (candidates: 12) 23:23:31.260472 tst handover_2G:nanobts+bts1-oc2g: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 handover_2G:nanobts+bts1-oc2g handover.py ---------------------------------------------- 23:23:31.266296 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 23:23:31.280603 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 23:23:31.326209 tst handover.py: using LAC 32209 23:23:31.460144 tst handover.py: using RAC 79 23:23:31.583016 tst handover.py: using CellId 32209 23:23:31.725514 tst handover.py: using BVCI 32210 23:23:31.869019 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 23:23:31.917357 tst handover.py: using LAC 32210 23:23:32.080054 tst handover.py: using RAC 80 23:23:32.245790 tst handover.py: using CellId 32210 23:23:32.378652 tst handover.py: using BVCI 32211 23:23:32.497153 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 23:23:32.508388 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 23:23:32.519459 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 23:23:32.530663 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 23:23:32.541867 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 23:23:32.553495 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 23:23:32.673885 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 23:23:32.794661 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:23:33.298159 run create_hlr_db(pid=7795): Launched 23:23:34.487725 run create_hlr_db(pid=7795): Terminated: ok {rc=0} 23:23:34.832072 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7797): Launched 23:23:35.157075 run osmo-hlr_10.42.42.2(pid=7798): Launched 23:23:35.281918 run osmo-stp_10.42.42.5: Starting osmo-stp 23:23:35.842323 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7800): Launched 23:23:36.168563 run osmo-stp_10.42.42.5(pid=7801): Launched 23:23:36.293153 run osmo-msc_10.42.42.6: Starting osmo-msc 23:23:36.882885 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7803): Launched 23:23:37.207447 run osmo-msc_10.42.42.6(pid=7804): Launched 23:23:37.388217 run osmo-stp_10.42.42.5(pid=7801): ERR: Terminated: ERROR {rc=1} [trial-2383↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7801)] 23:23:37.526041 run osmo-stp_10.42.42.5(pid=7801): stdout: | (launched: 2022-12-12_23:23:36.109704) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:23:37.663556 run osmo-stp_10.42.42.5(pid=7801): stderr: | [0;m[38;5;43m20221212232336302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212232336302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212232336303 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212232336303 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212232336303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212232336303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212232336303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:23:37.800156 run osmo-stp_10.42.42.5(pid=7801): stdout: | (launched: 2022-12-12_23:23:36.109704) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:23:37.928793 run osmo-stp_10.42.42.5(pid=7801): stderr: | [0;m[38;5;43m20221212232336302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212232336302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212232336303 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212232336303 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212232336303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212232336303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212232336303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:23:38.083153 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=7801): Process ended prematurely: osmo-stp_10.42.42.5(pid=7801) [trial-2383↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7801)] [trial-2383↪handover_2G:nanobts+bts1-oc2g↪handover.py:18] 23:23:38.091812 tst handover.py:18: Test FAILED (6.8 sec) 23:23:38.119036 run osmo-hlr_10.42.42.2(pid=7798): ERR: Terminated: ERROR {rc=237} [trial-2383↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7798)] 23:23:38.168560 run osmo-hlr_10.42.42.2(pid=7798): stdout: | (launched: 2022-12-12_23:23:35.098138) 23:23:38.219787 run osmo-hlr_10.42.42.2(pid=7798): stderr: | [0;m[1;31m20221212232335299 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212232335299 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212232335299 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212232335299 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212232335299 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212232335299 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212232335315 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/handover_2G:nanobts+bts1-oc2g/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212232335325 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212232335325 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212232335325 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:23:38.291321 run osmo-msc_10.42.42.6(pid=7804): ERR: Terminated: ERROR {rc=2} [trial-2383↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7804)] 23:23:38.341081 run osmo-msc_10.42.42.6(pid=7804): stdout: | (launched: 2022-12-12_23:23:37.148308) 23:23:38.392342 run osmo-msc_10.42.42.6(pid=7804): stderr: | [0;m[38;5;43m20221212232337471 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212232337471 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5bef93cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212232337472 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212232337472 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212232337472 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212232337472 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212232337474 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212232337474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212232337474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212232337474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:23:38.443858 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7797): Terminating (SIGTERM) 23:23:38.485434 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7800): Terminating (SIGTERM) 23:23:38.526970 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7803): Terminating (SIGTERM) 23:23:38.569089 --- ParallelTerminationStrategy: PID 7797 died... 23:23:38.588786 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7797): Terminated: ok {rc=0} 23:23:38.635017 --- ParallelTerminationStrategy: PID 7800 died... 23:23:38.654341 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7800): Terminated: ok {rc=0} 23:23:38.700461 --- ParallelTerminationStrategy: PID 7803 died... 23:23:38.719805 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7803): Terminated: ok {rc=0} 23:23:38.806001 bus /sierra_3: Setting Powered False 23:23:39.903407 bus /sierra_3: Setting Powered False 23:23:41.015472 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 handover_2G:nanobts+bts1-oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 handover_2G:nanobts+bts1-octphy --------------------------------------------------------------------- 23:23:42.261963 tst handover_2G:nanobts+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:23:42.267381 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x bts (candidates: 11) 23:23:42.307796 tst handover_2G:nanobts+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 23:23:42.335237 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x modem (candidates: 12) 23:23:42.387590 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x bts (candidates: 11) 23:23:42.427977 tst handover_2G:nanobts+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 23:23:42.455007 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x modem (candidates: 12) 23:23:43.009853 tst handover_2G:nanobts+bts1-octphy: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 handover_2G:nanobts+bts1-octphy handover.py ---------------------------------------------- 23:23:43.015179 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 23:23:43.026571 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 23:23:43.064416 tst handover.py: using LAC 32211 23:23:43.192688 tst handover.py: using RAC 81 23:23:43.319611 tst handover.py: using CellId 32211 23:23:43.448542 tst handover.py: using BVCI 32212 23:23:43.568776 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 23:23:43.604006 tst handover.py: using LAC 32212 23:23:43.731622 tst handover.py: using RAC 82 23:23:43.870100 tst handover.py: using CellId 32212 23:23:44.006777 tst handover.py: using BVCI 32213 23:23:44.126948 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 23:23:44.138231 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 23:23:44.149337 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 23:23:44.160361 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 23:23:44.171599 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 23:23:44.182633 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 23:23:44.300666 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 23:23:44.417874 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:23:44.866699 run create_hlr_db(pid=7810): Launched 23:23:44.985208 bus /sierra_2: Setting Powered False 23:23:46.045176 run create_hlr_db(pid=7810): Terminated: ok {rc=0} 23:23:46.469535 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7822): Launched 23:23:46.881639 run osmo-hlr_10.42.42.2(pid=7849): Launched 23:23:47.119925 run osmo-stp_10.42.42.5: Starting osmo-stp 23:23:47.879142 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7875): Launched 23:23:48.244215 run osmo-stp_10.42.42.5(pid=7894): Launched 23:23:48.526904 run osmo-msc_10.42.42.6: Starting osmo-msc 23:23:49.317817 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8017): Launched 23:23:49.734010 run osmo-msc_10.42.42.6(pid=8072): Launched 23:23:50.113660 run osmo-stp_10.42.42.5(pid=7894): ERR: Terminated: ERROR {rc=1} [trial-2383↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7894)] 23:23:50.276847 run osmo-stp_10.42.42.5(pid=7894): stdout: | (launched: 2022-12-12_23:23:48.174038) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:23:50.497486 run osmo-stp_10.42.42.5(pid=7894): stderr: | [0;m[38;5;43m20221212232348547 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212232348547 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212232348547 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212232348547 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212232348548 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212232348548 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212232348548 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:23:50.704756 run osmo-stp_10.42.42.5(pid=7894): stdout: | (launched: 2022-12-12_23:23:48.174038) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:23:50.840511 run osmo-stp_10.42.42.5(pid=7894): stderr: | [0;m[38;5;43m20221212232348547 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212232348547 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212232348547 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212232348547 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212232348548 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212232348548 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212232348548 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:23:51.001834 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=7894): Process ended prematurely: osmo-stp_10.42.42.5(pid=7894) [trial-2383↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7894)] [trial-2383↪handover_2G:nanobts+bts1-octphy↪handover.py:18] 23:23:51.011720 tst handover.py:18: Test FAILED (8.0 sec) 23:23:51.041364 run osmo-hlr_10.42.42.2(pid=7849): ERR: Terminated: ERROR {rc=237} [trial-2383↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7849)] 23:23:51.092674 run osmo-hlr_10.42.42.2(pid=7849): stdout: | (launched: 2022-12-12_23:23:46.791325) 23:23:51.146121 run osmo-hlr_10.42.42.2(pid=7849): stderr: | [0;m[1;31m20221212232347143 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212232347143 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212232347143 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212232347143 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212232347143 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212232347143 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212232347167 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/handover_2G:nanobts+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212232347189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212232347189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212232347189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:23:51.221106 run osmo-msc_10.42.42.6(pid=8072): ERR: Terminated: ERROR {rc=2} [trial-2383↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8072)] 23:23:51.274329 run osmo-msc_10.42.42.6(pid=8072): stdout: | (launched: 2022-12-12_23:23:49.643164) 23:23:51.326753 run osmo-msc_10.42.42.6(pid=8072): stderr: | [0;m[38;5;43m20221212232350351 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212232350351 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd646bacc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212232350351 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212232350351 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212232350351 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212232350351 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212232350361 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212232350362 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212232350362 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212232350362 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:23:51.379667 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7822): Terminating (SIGTERM) 23:23:51.423118 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7875): Terminating (SIGTERM) 23:23:51.468431 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8017): Terminating (SIGTERM) 23:23:51.511858 --- ParallelTerminationStrategy: PID 7822 died... 23:23:51.532127 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7822): Terminated: ok {rc=0} 23:23:51.580068 --- ParallelTerminationStrategy: PID 7875 died... 23:23:51.600626 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7875): Terminated: ok {rc=0} 23:23:51.649276 --- ParallelTerminationStrategy: PID 8017 died... 23:23:51.669940 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8017): Terminated: ok {rc=0} 23:23:51.759217 bus /sierra_3: Setting Powered False 23:23:52.861257 bus /sierra_3: Setting Powered False 23:23:53.979889 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 handover_2G:nanobts+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 handover_2G:nanobts+bts1-trx-lms --------------------------------------------------------------------- 23:23:55.233707 tst handover_2G:nanobts+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:23:55.240125 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 23:23:55.296359 tst handover_2G:nanobts+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 23:23:55.325461 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 23:23:55.378326 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 23:23:55.435554 tst handover_2G:nanobts+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 23:23:55.464302 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 23:23:56.013634 tst handover_2G:nanobts+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 handover_2G:nanobts+bts1-trx-lms handover.py ---------------------------------------------- 23:23:56.020633 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 23:23:56.034180 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 23:23:56.073528 tst handover.py: using LAC 32213 23:23:56.203470 tst handover.py: using RAC 83 23:23:56.337599 tst handover.py: using CellId 32213 23:23:56.469441 tst handover.py: using BVCI 32214 23:23:56.595186 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 23:23:56.646628 tst handover.py: using LAC 32214 23:23:56.777772 tst handover.py: using RAC 84 23:23:56.913948 tst handover.py: using CellId 32214 23:23:57.046364 tst handover.py: using BVCI 32215 23:23:57.167880 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 23:23:57.180822 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 23:23:57.193233 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 23:23:57.205757 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 23:23:57.218171 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 23:23:57.232459 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 23:23:57.355324 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 23:23:57.480259 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:23:57.979616 run create_hlr_db(pid=8095): Launched 23:23:58.149362 bus /sierra_2: Setting Powered False 23:23:59.215634 run create_hlr_db(pid=8095): Terminated: ok {rc=0} 23:23:59.664526 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8097): Launched 23:24:00.021697 run osmo-hlr_10.42.42.2(pid=8098): Launched 23:24:00.277646 run osmo-stp_10.42.42.5: Starting osmo-stp 23:24:00.904075 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8100): Launched 23:24:01.242074 run osmo-stp_10.42.42.5(pid=8101): Launched 23:24:01.484662 run osmo-msc_10.42.42.6: Starting osmo-msc 23:24:02.185709 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8103): Launched 23:24:02.514947 run osmo-msc_10.42.42.6(pid=8104): Launched 23:24:02.869395 run osmo-stp_10.42.42.5(pid=8101): ERR: Terminated: ERROR {rc=1} [trial-2383↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8101)] 23:24:03.062846 run osmo-stp_10.42.42.5(pid=8101): stdout: | (launched: 2022-12-12_23:24:01.179599) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:24:03.331447 run osmo-stp_10.42.42.5(pid=8101): stderr: | [0;m[38;5;43m20221212232401512 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212232401512 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212232401524 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212232401525 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212232401525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212232401525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212232401525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:24:03.473450 run osmo-stp_10.42.42.5(pid=8101): stdout: | (launched: 2022-12-12_23:24:01.179599) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:24:03.608264 run osmo-stp_10.42.42.5(pid=8101): stderr: | [0;m[38;5;43m20221212232401512 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212232401512 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212232401524 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212232401525 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212232401525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212232401525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212232401525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:24:03.770351 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8101): Process ended prematurely: osmo-stp_10.42.42.5(pid=8101) [trial-2383↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8101)] [trial-2383↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18] 23:24:03.780279 tst handover.py:18: Test FAILED (7.8 sec) 23:24:03.809635 run osmo-hlr_10.42.42.2(pid=8098): ERR: Terminated: ERROR {rc=237} [trial-2383↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8098)] 23:24:03.862325 run osmo-hlr_10.42.42.2(pid=8098): stdout: | (launched: 2022-12-12_23:23:59.950088) 23:24:03.916080 run osmo-hlr_10.42.42.2(pid=8098): stderr: | [0;m[1;31m20221212232400263 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212232400263 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212232400263 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212232400263 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212232400264 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212232400264 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212232400291 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/handover_2G:nanobts+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212232400307 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212232400308 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212232400308 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:24:03.990968 run osmo-msc_10.42.42.6(pid=8104): ERR: Terminated: ERROR {rc=2} [trial-2383↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8104)] 23:24:04.043379 run osmo-msc_10.42.42.6(pid=8104): stdout: | (launched: 2022-12-12_23:24:02.452237) 23:24:04.096640 run osmo-msc_10.42.42.6(pid=8104): stderr: | [0;m[38;5;43m20221212232403077 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212232403077 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1041a1cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212232403077 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212232403077 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212232403078 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212232403078 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212232403079 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212232403080 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212232403080 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212232403080 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:24:04.150882 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8097): Terminating (SIGTERM) 23:24:04.194367 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8100): Terminating (SIGTERM) 23:24:04.241289 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8103): Terminating (SIGTERM) 23:24:04.286178 --- ParallelTerminationStrategy: PID 8097 died... 23:24:04.307220 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8097): Terminated: ok {rc=0} 23:24:04.355390 --- ParallelTerminationStrategy: PID 8100 died... 23:24:04.375761 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8100): Terminated: ok {rc=0} 23:24:04.423358 --- ParallelTerminationStrategy: PID 8103 died... 23:24:04.444646 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8103): Terminated: ok {rc=0} 23:24:04.535654 bus /sierra_3: Setting Powered False 23:24:05.640342 bus /sierra_3: Setting Powered False 23:24:06.759784 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 handover_2G:nanobts+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 handover_2G:nanobts+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 23:24:08.032383 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:24:08.040011 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 23:24:08.092578 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 23:24:08.121355 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 23:24:08.173992 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 23:24:08.226455 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 23:24:08.257084 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 23:24:08.807939 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 handover_2G:nanobts+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 23:24:08.814994 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:24:08.827949 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 23:24:08.867816 tst handover.py: using LAC 32215 23:24:09.000157 tst handover.py: using RAC 85 23:24:09.132043 tst handover.py: using CellId 32215 23:24:09.266540 tst handover.py: using BVCI 32216 23:24:09.391721 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 23:24:09.439167 tst handover.py: using LAC 32216 23:24:09.572314 tst handover.py: using RAC 86 23:24:09.704441 tst handover.py: using CellId 32216 23:24:09.835021 tst handover.py: using BVCI 32217 23:24:09.960146 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:24:09.972359 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:24:09.984617 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:24:09.996713 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:24:10.008782 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:24:10.021149 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 23:24:10.146882 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 23:24:10.264814 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:24:10.732209 run create_hlr_db(pid=8109): Launched 23:24:10.888816 bus /sierra_2: Setting Powered False 23:24:11.953232 run create_hlr_db(pid=8109): Terminated: ok {rc=0} 23:24:12.365443 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8112): Launched 23:24:12.675163 run osmo-hlr_10.42.42.2(pid=8113): Launched 23:24:12.793172 run osmo-stp_10.42.42.5: Starting osmo-stp 23:24:13.295432 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8115): Launched 23:24:13.602240 run osmo-stp_10.42.42.5(pid=8116): Launched 23:24:13.720503 run osmo-msc_10.42.42.6: Starting osmo-msc 23:24:14.254096 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8118): Launched 23:24:14.562404 run osmo-msc_10.42.42.6(pid=8119): Launched 23:24:14.735349 run osmo-stp_10.42.42.5(pid=8116): ERR: Terminated: ERROR {rc=1} [trial-2383↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8116)] 23:24:14.866651 run osmo-stp_10.42.42.5(pid=8116): stdout: | (launched: 2022-12-12_23:24:13.546123) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:24:14.996679 run osmo-stp_10.42.42.5(pid=8116): stderr: | [0;m[38;5;43m20221212232413718 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212232413719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212232413719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212232413719 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212232413720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212232413720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212232413720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:24:15.124356 run osmo-stp_10.42.42.5(pid=8116): stdout: | (launched: 2022-12-12_23:24:13.546123) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:24:15.246414 run osmo-stp_10.42.42.5(pid=8116): stderr: | [0;m[38;5;43m20221212232413718 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212232413719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212232413719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212232413719 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212232413720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212232413720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212232413720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:24:15.392442 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8116): Process ended prematurely: osmo-stp_10.42.42.5(pid=8116) [trial-2383↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8116)] [trial-2383↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18] 23:24:15.400628 tst handover.py:18: Test FAILED (6.6 sec) 23:24:15.426758 run osmo-hlr_10.42.42.2(pid=8113): ERR: Terminated: ERROR {rc=237} [trial-2383↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8113)] 23:24:15.474590 run osmo-hlr_10.42.42.2(pid=8113): stdout: | (launched: 2022-12-12_23:24:12.618945) 23:24:15.523802 run osmo-hlr_10.42.42.2(pid=8113): stderr: | [0;m[1;31m20221212232412792 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212232412792 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212232412792 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212232412793 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212232412793 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212232412793 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212232412806 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/handover_2G:nanobts+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212232412814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212232412814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212232412814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:24:15.592354 run osmo-msc_10.42.42.6(pid=8119): ERR: Terminated: ERROR {rc=2} [trial-2383↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8119)] 23:24:15.640201 run osmo-msc_10.42.42.6(pid=8119): stdout: | (launched: 2022-12-12_23:24:14.506000) 23:24:15.689277 run osmo-msc_10.42.42.6(pid=8119): stderr: | [0;m[38;5;43m20221212232414778 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212232414778 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f10e5001c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212232414778 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212232414778 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212232414778 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212232414778 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212232414780 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212232414780 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212232414781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212232414781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:24:15.738802 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8112): Terminating (SIGTERM) 23:24:15.778197 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8115): Terminating (SIGTERM) 23:24:15.817921 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8118): Terminating (SIGTERM) 23:24:15.870875 --- ParallelTerminationStrategy: PID 8112 died... 23:24:15.891564 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8112): Terminated: ok {rc=0} 23:24:15.948755 --- ParallelTerminationStrategy: PID 8115 died... 23:24:15.969720 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8115): Terminated: ok {rc=0} 23:24:16.017532 --- ParallelTerminationStrategy: PID 8118 died... 23:24:16.038706 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8118): Terminated: ok {rc=0} 23:24:16.132879 bus /sierra_3: Setting Powered False 23:24:17.233156 bus /sierra_3: Setting Powered False 23:24:18.350254 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 handover_2G:nanobts+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 handover_2G:nanobts+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 23:24:19.603538 tst handover_2G:nanobts+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:24:19.608654 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 23:24:19.663959 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 23:24:19.690570 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 23:24:19.742168 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 23:24:19.796704 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 23:24:19.822894 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 23:24:20.372246 tst handover_2G:nanobts+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 handover_2G:nanobts+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 23:24:20.377399 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:24:20.388235 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 23:24:20.426402 tst handover.py: using LAC 32217 23:24:20.548858 tst handover.py: using RAC 87 23:24:20.670046 tst handover.py: using CellId 32217 23:24:20.792798 tst handover.py: using BVCI 32218 23:24:20.904569 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 23:24:20.953363 tst handover.py: using LAC 32218 23:24:21.076018 tst handover.py: using RAC 88 23:24:21.198166 tst handover.py: using CellId 32218 23:24:21.323808 tst handover.py: using BVCI 32219 23:24:21.437300 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:24:21.448211 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:24:21.458972 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:24:21.470131 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:24:21.481256 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:24:21.492219 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 23:24:21.611900 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 23:24:21.729538 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:24:22.177532 run create_hlr_db(pid=8124): Launched 23:24:22.296110 bus /sierra_2: Setting Powered False 23:24:23.357103 run create_hlr_db(pid=8124): Terminated: ok {rc=0} 23:24:23.775019 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8126): Launched 23:24:24.101434 run osmo-hlr_10.42.42.2(pid=8127): Launched 23:24:24.226865 run osmo-stp_10.42.42.5: Starting osmo-stp 23:24:24.763410 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8129): Launched 23:24:25.089505 run osmo-stp_10.42.42.5(pid=8130): Launched 23:24:25.215353 run osmo-msc_10.42.42.6: Starting osmo-msc 23:24:25.780407 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8132): Launched 23:24:26.106370 run osmo-msc_10.42.42.6(pid=8133): Launched 23:24:26.287916 run osmo-stp_10.42.42.5(pid=8130): ERR: Terminated: ERROR {rc=1} [trial-2383↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8130)] 23:24:26.425314 run osmo-stp_10.42.42.5(pid=8130): stdout: | (launched: 2022-12-12_23:24:25.030627) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:24:26.562556 run osmo-stp_10.42.42.5(pid=8130): stderr: | [0;m[38;5;43m20221212232425223 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212232425223 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212232425224 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212232425224 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212232425225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212232425225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212232425225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:24:26.699181 run osmo-stp_10.42.42.5(pid=8130): stdout: | (launched: 2022-12-12_23:24:25.030627) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:24:26.828344 run osmo-stp_10.42.42.5(pid=8130): stderr: | [0;m[38;5;43m20221212232425223 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212232425223 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212232425224 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212232425224 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212232425225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212232425225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212232425225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:24:26.983101 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8130): Process ended prematurely: osmo-stp_10.42.42.5(pid=8130) [trial-2383↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8130)] [trial-2383↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18] 23:24:26.992271 tst handover.py:18: Test FAILED (6.6 sec) 23:24:27.020021 run osmo-hlr_10.42.42.2(pid=8127): ERR: Terminated: ERROR {rc=237} [trial-2383↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8127)] 23:24:27.071253 run osmo-hlr_10.42.42.2(pid=8127): stdout: | (launched: 2022-12-12_23:24:24.042302) 23:24:27.122753 run osmo-hlr_10.42.42.2(pid=8127): stderr: | [0;m[1;31m20221212232424241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212232424241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212232424241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212232424241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212232424241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212232424241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212232424254 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/handover_2G:nanobts+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212232424263 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212232424263 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212232424263 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:24:27.194058 run osmo-msc_10.42.42.6(pid=8133): ERR: Terminated: ERROR {rc=2} [trial-2383↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8133)] 23:24:27.243337 run osmo-msc_10.42.42.6(pid=8133): stdout: | (launched: 2022-12-12_23:24:26.047212) 23:24:27.294383 run osmo-msc_10.42.42.6(pid=8133): stderr: | [0;m[38;5;43m20221212232426372 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212232426372 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7202a7ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212232426372 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212232426372 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212232426373 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212232426373 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212232426374 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212232426375 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212232426375 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212232426375 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:24:27.345762 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8126): Terminating (SIGTERM) 23:24:27.386758 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8129): Terminating (SIGTERM) 23:24:27.427819 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8132): Terminating (SIGTERM) 23:24:27.469346 --- ParallelTerminationStrategy: PID 8126 died... 23:24:27.489288 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8126): Terminated: ok {rc=0} 23:24:27.534901 --- ParallelTerminationStrategy: PID 8129 died... 23:24:27.554361 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8129): Terminated: ok {rc=0} 23:24:27.600262 --- ParallelTerminationStrategy: PID 8132 died... 23:24:27.619719 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8132): Terminated: ok {rc=0} 23:24:27.707408 bus /sierra_3: Setting Powered False 23:24:28.806197 bus /sierra_3: Setting Powered False 23:24:29.922970 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 handover_2G:nanobts+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 handover_2G:nanobts+bts1-sysmo --------------------------------------------------------------------- 23:24:31.194857 tst handover_2G:nanobts+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:24:31.200659 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x bts (candidates: 11) 23:24:31.247965 tst handover_2G:nanobts+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 23:24:31.278523 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x modem (candidates: 12) 23:24:31.332556 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x bts (candidates: 11) 23:24:31.397912 tst handover_2G:nanobts+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 23:24:31.431658 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x modem (candidates: 12) 23:24:31.971386 tst handover_2G:nanobts+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 handover_2G:nanobts+bts1-sysmo handover.py ---------------------------------------------- 23:24:31.977609 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:24:31.989040 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 23:24:32.029170 tst handover.py: using LAC 32219 23:24:32.161776 tst handover.py: using RAC 89 23:24:32.287187 tst handover.py: using CellId 32219 23:24:32.409284 tst handover.py: using BVCI 32220 23:24:32.522808 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 23:24:32.558817 tst handover.py: using LAC 32220 23:24:32.679513 tst handover.py: using RAC 90 23:24:32.800177 tst handover.py: using CellId 32220 23:24:32.921963 tst handover.py: using BVCI 32221 23:24:33.033458 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:24:33.044203 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:24:33.054886 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:24:33.065821 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:24:33.076633 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:24:33.087479 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 23:24:33.208397 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 23:24:33.326169 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:24:33.777006 run create_hlr_db(pid=8138): Launched 23:24:33.894459 bus /sierra_2: Setting Powered False 23:24:34.955302 run create_hlr_db(pid=8138): Terminated: ok {rc=0} 23:24:35.373604 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8140): Launched 23:24:35.701420 run osmo-hlr_10.42.42.2(pid=8141): Launched 23:24:35.826005 run osmo-stp_10.42.42.5: Starting osmo-stp 23:24:36.365550 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8143): Launched 23:24:36.693921 run osmo-stp_10.42.42.5(pid=8144): Launched 23:24:36.818847 run osmo-msc_10.42.42.6: Starting osmo-msc 23:24:37.380665 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8146): Launched 23:24:37.706311 run osmo-msc_10.42.42.6(pid=8147): Launched 23:24:37.888244 run osmo-stp_10.42.42.5(pid=8144): ERR: Terminated: ERROR {rc=1} [trial-2383↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8144)] 23:24:38.025333 run osmo-stp_10.42.42.5(pid=8144): stdout: | (launched: 2022-12-12_23:24:36.634564) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:24:38.162840 run osmo-stp_10.42.42.5(pid=8144): stderr: | [0;m[38;5;43m20221212232436825 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212232436825 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212232436825 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212232436826 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212232436826 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212232436826 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212232436826 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:24:38.299032 run osmo-stp_10.42.42.5(pid=8144): stdout: | (launched: 2022-12-12_23:24:36.634564) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:24:38.428267 run osmo-stp_10.42.42.5(pid=8144): stderr: | [0;m[38;5;43m20221212232436825 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212232436825 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212232436825 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212232436826 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212232436826 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212232436826 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212232436826 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:24:38.583445 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8144): Process ended prematurely: osmo-stp_10.42.42.5(pid=8144) [trial-2383↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8144)] [trial-2383↪handover_2G:nanobts+bts1-sysmo↪handover.py:18] 23:24:38.592072 tst handover.py:18: Test FAILED (6.6 sec) 23:24:38.619273 run osmo-hlr_10.42.42.2(pid=8141): ERR: Terminated: ERROR {rc=237} [trial-2383↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8141)] 23:24:38.669382 run osmo-hlr_10.42.42.2(pid=8141): stdout: | (launched: 2022-12-12_23:24:35.642120) 23:24:38.720584 run osmo-hlr_10.42.42.2(pid=8141): stderr: | [0;m[1;31m20221212232435841 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212232435841 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212232435841 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212232435841 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212232435841 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212232435841 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212232435854 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/handover_2G:nanobts+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212232435863 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212232435863 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212232435863 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:24:38.791915 run osmo-msc_10.42.42.6(pid=8147): ERR: Terminated: ERROR {rc=2} [trial-2383↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8147)] 23:24:38.841091 run osmo-msc_10.42.42.6(pid=8147): stdout: | (launched: 2022-12-12_23:24:37.647235) 23:24:38.892155 run osmo-msc_10.42.42.6(pid=8147): stderr: | [0;m[38;5;43m20221212232437969 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212232437969 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fbd49d08c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212232437969 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212232437969 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212232437969 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212232437969 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212232437971 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212232437972 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212232437972 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212232437972 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:24:38.943616 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8140): Terminating (SIGTERM) 23:24:38.984743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8143): Terminating (SIGTERM) 23:24:39.025885 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8146): Terminating (SIGTERM) 23:24:39.067347 --- ParallelTerminationStrategy: PID 8140 died... 23:24:39.086902 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8140): Terminated: ok {rc=0} 23:24:39.132647 --- ParallelTerminationStrategy: PID 8143 died... 23:24:39.151911 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8143): Terminated: ok {rc=0} 23:24:39.197442 --- ParallelTerminationStrategy: PID 8146 died... 23:24:39.216661 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8146): Terminated: ok {rc=0} 23:24:39.303166 bus /sierra_3: Setting Powered False 23:24:40.399947 bus /sierra_3: Setting Powered False 23:24:41.517283 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 handover_2G:nanobts+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 handover_2G:nanobts+bts1-trx-b200 --------------------------------------------------------------------- 23:24:42.760857 tst handover_2G:nanobts+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:24:42.766124 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 23:24:42.819556 tst handover_2G:nanobts+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 23:24:42.845718 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 23:24:42.897740 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 23:24:42.950993 tst handover_2G:nanobts+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 23:24:42.977199 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 23:24:43.525321 tst handover_2G:nanobts+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 handover_2G:nanobts+bts1-trx-b200 handover.py ---------------------------------------------- 23:24:43.530546 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:24:43.541428 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 23:24:43.578661 tst handover.py: using LAC 32221 23:24:43.698947 tst handover.py: using RAC 91 23:24:43.821302 tst handover.py: using CellId 32221 23:24:43.951324 tst handover.py: using BVCI 32222 23:24:44.072542 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 23:24:44.122978 tst handover.py: using LAC 32222 23:24:44.254995 tst handover.py: using RAC 92 23:24:44.376763 tst handover.py: using CellId 32222 23:24:44.495674 tst handover.py: using BVCI 32223 23:24:44.607733 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:24:44.618762 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:24:44.629589 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:24:44.640392 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:24:44.651336 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:24:44.662185 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 23:24:44.779869 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 23:24:44.897316 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:24:45.349668 run create_hlr_db(pid=8152): Launched 23:24:45.467696 bus /sierra_2: Setting Powered False 23:24:46.531261 run create_hlr_db(pid=8152): Terminated: ok {rc=0} 23:24:47.028099 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8154): Launched 23:24:47.346165 run osmo-hlr_10.42.42.2(pid=8155): Launched 23:24:47.464701 run osmo-stp_10.42.42.5: Starting osmo-stp 23:24:47.967129 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8157): Launched 23:24:48.274752 run osmo-stp_10.42.42.5(pid=8158): Launched 23:24:48.391992 run osmo-msc_10.42.42.6: Starting osmo-msc 23:24:48.921731 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8160): Launched 23:24:49.232525 run osmo-msc_10.42.42.6(pid=8161): Launched 23:24:49.404311 run osmo-stp_10.42.42.5(pid=8158): ERR: Terminated: ERROR {rc=1} [trial-2383↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8158)] 23:24:49.533162 run osmo-stp_10.42.42.5(pid=8158): stdout: | (launched: 2022-12-12_23:24:48.218117) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:24:49.661805 run osmo-stp_10.42.42.5(pid=8158): stderr: | [0;m[38;5;43m20221212232448390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212232448390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212232448390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212232448391 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212232448391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212232448391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212232448391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:24:49.787882 run osmo-stp_10.42.42.5(pid=8158): stdout: | (launched: 2022-12-12_23:24:48.218117) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:24:49.907910 run osmo-stp_10.42.42.5(pid=8158): stderr: | [0;m[38;5;43m20221212232448390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212232448390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212232448390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212232448391 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212232448391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212232448391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212232448391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:24:50.051699 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8158): Process ended prematurely: osmo-stp_10.42.42.5(pid=8158) [trial-2383↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8158)] [trial-2383↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18] 23:24:50.059820 tst handover.py:18: Test FAILED (6.5 sec) 23:24:50.085687 run osmo-hlr_10.42.42.2(pid=8155): ERR: Terminated: ERROR {rc=237} [trial-2383↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8155)] 23:24:50.133447 run osmo-hlr_10.42.42.2(pid=8155): stdout: | (launched: 2022-12-12_23:24:47.289817) 23:24:50.182349 run osmo-hlr_10.42.42.2(pid=8155): stderr: | [0;m[1;31m20221212232447467 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212232447467 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212232447467 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212232447467 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212232447467 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212232447467 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212232447500 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/handover_2G:nanobts+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212232447510 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212232447510 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212232447510 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:24:50.250562 run osmo-msc_10.42.42.6(pid=8161): ERR: Terminated: ERROR {rc=2} [trial-2383↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8161)] 23:24:50.297570 run osmo-msc_10.42.42.6(pid=8161): stdout: | (launched: 2022-12-12_23:24:49.177191) 23:24:50.346202 run osmo-msc_10.42.42.6(pid=8161): stderr: | [0;m[38;5;43m20221212232449452 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212232449452 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe5c807bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212232449452 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212232449452 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212232449453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212232449453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212232449454 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212232449455 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212232449455 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212232449456 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:24:50.395267 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8154): Terminating (SIGTERM) 23:24:50.434669 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8157): Terminating (SIGTERM) 23:24:50.473966 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8160): Terminating (SIGTERM) 23:24:50.513465 --- ParallelTerminationStrategy: PID 8154 died... 23:24:50.532027 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8154): Terminated: ok {rc=0} 23:24:50.575926 --- ParallelTerminationStrategy: PID 8157 died... 23:24:50.594193 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8157): Terminated: ok {rc=0} 23:24:50.637645 --- ParallelTerminationStrategy: PID 8160 died... 23:24:50.655898 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8160): Terminated: ok {rc=0} 23:24:50.740120 bus /sierra_3: Setting Powered False 23:24:51.839105 bus /sierra_3: Setting Powered False 23:24:52.954634 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 handover_2G:nanobts+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 handover_2G:nanobts+bts1-trx-umtrx --------------------------------------------------------------------- 23:24:54.213131 tst handover_2G:nanobts+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:24:54.218600 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 23:24:54.271473 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 23:24:54.297581 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 23:24:54.349376 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 23:24:54.403204 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 23:24:54.430404 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 23:24:54.974972 tst handover_2G:nanobts+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 handover_2G:nanobts+bts1-trx-umtrx handover.py ---------------------------------------------- 23:24:54.980390 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:24:54.991306 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 23:24:55.028525 tst handover.py: using LAC 32223 23:24:55.145885 tst handover.py: using RAC 93 23:24:55.265083 tst handover.py: using CellId 32223 23:24:55.392245 tst handover.py: using BVCI 32224 23:24:55.511817 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 23:24:55.560101 tst handover.py: using LAC 32224 23:24:55.685302 tst handover.py: using RAC 94 23:24:55.809772 tst handover.py: using CellId 32224 23:24:55.936499 tst handover.py: using BVCI 32225 23:24:56.053818 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:24:56.065284 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:24:56.076452 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:24:56.087651 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:24:56.099009 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:24:56.110271 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 23:24:56.226221 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 23:24:56.345613 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:24:56.818483 run create_hlr_db(pid=8167): Launched 23:24:56.948743 bus /sierra_2: Setting Powered False 23:24:58.012733 run create_hlr_db(pid=8167): Terminated: ok {rc=0} 23:24:58.418862 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8169): Launched 23:24:58.721240 run osmo-hlr_10.42.42.2(pid=8170): Launched 23:24:58.837687 run osmo-stp_10.42.42.5: Starting osmo-stp 23:24:59.350707 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8172): Launched 23:24:59.653363 run osmo-stp_10.42.42.5(pid=8173): Launched 23:24:59.770017 run osmo-msc_10.42.42.6: Starting osmo-msc 23:25:00.290819 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8175): Launched 23:25:00.592806 run osmo-msc_10.42.42.6(pid=8176): Launched 23:25:00.762357 run osmo-stp_10.42.42.5(pid=8173): ERR: Terminated: ERROR {rc=1} [trial-2383↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8173)] 23:25:00.959212 run osmo-stp_10.42.42.5(pid=8173): stdout: | (launched: 2022-12-12_23:24:59.598334) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:25:01.094747 run osmo-stp_10.42.42.5(pid=8173): stderr: | [0;m[38;5;43m20221212232459766 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212232459766 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212232459766 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212232459767 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212232459769 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212232459769 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212232459769 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:25:01.225818 run osmo-stp_10.42.42.5(pid=8173): stdout: | (launched: 2022-12-12_23:24:59.598334) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:25:01.350500 run osmo-stp_10.42.42.5(pid=8173): stderr: | [0;m[38;5;43m20221212232459766 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212232459766 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212232459766 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212232459767 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212232459769 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212232459769 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212232459769 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:25:01.498905 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8173): Process ended prematurely: osmo-stp_10.42.42.5(pid=8173) [trial-2383↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8173)] [trial-2383↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18] 23:25:01.508205 tst handover.py:18: Test FAILED (6.5 sec) 23:25:01.536251 run osmo-hlr_10.42.42.2(pid=8170): ERR: Terminated: ERROR {rc=237} [trial-2383↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8170)] 23:25:01.587059 run osmo-hlr_10.42.42.2(pid=8170): stdout: | (launched: 2022-12-12_23:24:58.666411) 23:25:01.638618 run osmo-hlr_10.42.42.2(pid=8170): stderr: | [0;m[1;31m20221212232458842 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212232458843 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212232458843 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212232458843 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212232458843 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212232458843 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212232458854 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/handover_2G:nanobts+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212232458862 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212232458863 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212232458863 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:25:01.709619 run osmo-msc_10.42.42.6(pid=8176): ERR: Terminated: ERROR {rc=2} [trial-2383↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8176)] 23:25:01.768862 run osmo-msc_10.42.42.6(pid=8176): stdout: | (launched: 2022-12-12_23:25:00.537755) 23:25:01.824335 run osmo-msc_10.42.42.6(pid=8176): stderr: | [0;m[38;5;43m20221212232500810 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212232500810 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fae0394fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212232500810 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212232500810 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212232500810 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212232500811 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212232500812 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212232500813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212232500813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212232500813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:25:01.876094 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8169): Terminating (SIGTERM) 23:25:01.918350 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8172): Terminating (SIGTERM) 23:25:01.960171 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8175): Terminating (SIGTERM) 23:25:02.003454 --- ParallelTerminationStrategy: PID 8169 died... 23:25:02.023003 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8169): Terminated: ok {rc=0} 23:25:02.069863 --- ParallelTerminationStrategy: PID 8172 died... 23:25:02.089342 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8172): Terminated: ok {rc=0} 23:25:02.136185 --- ParallelTerminationStrategy: PID 8175 died... 23:25:02.155760 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8175): Terminated: ok {rc=0} 23:25:02.242479 bus /sierra_3: Setting Powered False 23:25:03.337504 bus /sierra_3: Setting Powered False 23:25:04.450755 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 handover_2G:nanobts+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 handover_2G:oc2g+bts1-octphy --------------------------------------------------------------------- 23:25:05.706235 tst handover_2G:oc2g+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:25:05.711097 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x bts (candidates: 11) 23:25:05.747672 tst handover_2G:oc2g+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 23:25:05.773682 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x modem (candidates: 12) 23:25:05.822719 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x bts (candidates: 11) 23:25:05.858625 tst handover_2G:oc2g+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 23:25:05.884476 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x modem (candidates: 12) 23:25:06.434626 tst handover_2G:oc2g+bts1-octphy: RESERVED RESOURCES for handover_2G: bts OC-2G OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 handover_2G:oc2g+bts1-octphy handover.py ---------------------------------------------- 23:25:06.439638 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 23:25:06.450337 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 23:25:06.483958 tst handover.py: using LAC 32225 23:25:06.609404 tst handover.py: using RAC 95 23:25:06.734979 tst handover.py: using CellId 32225 23:25:06.859671 tst handover.py: using BVCI 32226 23:25:06.978706 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 23:25:07.011925 tst handover.py: using LAC 32226 23:25:07.137617 tst handover.py: using RAC 96 23:25:07.263144 tst handover.py: using CellId 32226 23:25:07.388383 tst handover.py: using BVCI 32227 23:25:07.507796 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 23:25:07.519108 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 23:25:07.530159 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 23:25:07.541323 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 23:25:07.552417 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 23:25:07.563720 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 23:25:07.678575 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 23:25:07.800572 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:25:08.245540 run create_hlr_db(pid=8185): Launched 23:25:08.362119 bus /sierra_2: Setting Powered False 23:25:09.423367 run create_hlr_db(pid=8185): Terminated: ok {rc=0} 23:25:09.837052 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8187): Launched 23:25:10.159584 run osmo-hlr_10.42.42.2(pid=8188): Launched 23:25:10.283166 run osmo-stp_10.42.42.5: Starting osmo-stp 23:25:10.811296 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8190): Launched 23:25:11.133285 run osmo-stp_10.42.42.5(pid=8191): Launched 23:25:11.257110 run osmo-msc_10.42.42.6: Starting osmo-msc 23:25:11.814717 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8193): Launched 23:25:12.137752 run osmo-msc_10.42.42.6(pid=8194): Launched 23:25:12.318327 run osmo-stp_10.42.42.5(pid=8191): ERR: Terminated: ERROR {rc=1} [trial-2383↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8191)] 23:25:12.455047 run osmo-stp_10.42.42.5(pid=8191): stdout: | (launched: 2022-12-12_23:25:11.075000) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:25:12.592078 run osmo-stp_10.42.42.5(pid=8191): stderr: | [0;m[38;5;43m20221212232511270 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212232511270 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212232511270 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212232511270 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212232511271 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212232511271 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212232511271 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:25:12.728733 run osmo-stp_10.42.42.5(pid=8191): stdout: | (launched: 2022-12-12_23:25:11.075000) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:25:12.857501 run osmo-stp_10.42.42.5(pid=8191): stderr: | [0;m[38;5;43m20221212232511270 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212232511270 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212232511270 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212232511270 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212232511271 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212232511271 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212232511271 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:25:13.011341 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8191): Process ended prematurely: osmo-stp_10.42.42.5(pid=8191) [trial-2383↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8191)] [trial-2383↪handover_2G:oc2g+bts1-octphy↪handover.py:18] 23:25:13.020152 tst handover.py:18: Test FAILED (6.6 sec) 23:25:13.047063 run osmo-hlr_10.42.42.2(pid=8188): ERR: Terminated: ERROR {rc=237} [trial-2383↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8188)] 23:25:13.096276 run osmo-hlr_10.42.42.2(pid=8188): stdout: | (launched: 2022-12-12_23:25:10.101604) 23:25:13.148137 run osmo-hlr_10.42.42.2(pid=8188): stderr: | [0;m[1;31m20221212232510302 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212232510302 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212232510302 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212232510302 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212232510302 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212232510302 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212232510317 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/handover_2G:oc2g+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212232510327 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212232510327 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212232510327 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:25:13.219330 run osmo-msc_10.42.42.6(pid=8194): ERR: Terminated: ERROR {rc=2} [trial-2383↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8194)] 23:25:13.269274 run osmo-msc_10.42.42.6(pid=8194): stdout: | (launched: 2022-12-12_23:25:12.079587) 23:25:13.320153 run osmo-msc_10.42.42.6(pid=8194): stderr: | [0;m[38;5;43m20221212232512403 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212232512403 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb9b8510c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212232512404 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212232512404 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212232512404 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212232512404 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212232512406 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212232512406 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212232512406 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212232512406 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:25:13.371570 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8187): Terminating (SIGTERM) 23:25:13.412864 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8190): Terminating (SIGTERM) 23:25:13.454013 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8193): Terminating (SIGTERM) 23:25:13.495249 --- ParallelTerminationStrategy: PID 8187 died... 23:25:13.514667 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8187): Terminated: ok {rc=0} 23:25:13.560145 --- ParallelTerminationStrategy: PID 8190 died... 23:25:13.579496 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8190): Terminated: ok {rc=0} 23:25:13.625322 --- ParallelTerminationStrategy: PID 8193 died... 23:25:13.644559 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8193): Terminated: ok {rc=0} 23:25:13.730791 bus /sierra_3: Setting Powered False 23:25:14.827458 bus /sierra_3: Setting Powered False 23:25:15.943948 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 handover_2G:oc2g+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 handover_2G:oc2g+bts1-trx-lms --------------------------------------------------------------------- 23:25:17.204598 tst handover_2G:oc2g+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:25:17.210629 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 23:25:17.264246 tst handover_2G:oc2g+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 23:25:17.292084 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 23:25:17.346439 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 23:25:17.398853 tst handover_2G:oc2g+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 23:25:17.425713 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 23:25:17.973739 tst handover_2G:oc2g+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OC-2G LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 handover_2G:oc2g+bts1-trx-lms handover.py ---------------------------------------------- 23:25:17.978962 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 23:25:17.990241 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 23:25:18.024277 tst handover.py: using LAC 32227 23:25:18.145304 tst handover.py: using RAC 97 23:25:18.275434 tst handover.py: using CellId 32227 23:25:18.399041 tst handover.py: using BVCI 32228 23:25:18.510541 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 23:25:18.558170 tst handover.py: using LAC 32228 23:25:18.687383 tst handover.py: using RAC 98 23:25:18.813427 tst handover.py: using CellId 32228 23:25:18.940824 tst handover.py: using BVCI 32229 23:25:19.057800 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 23:25:19.068875 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 23:25:19.079899 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 23:25:19.090862 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 23:25:19.101966 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 23:25:19.112994 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 23:25:19.230828 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 23:25:19.346925 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:25:19.792591 run create_hlr_db(pid=8199): Launched 23:25:19.909715 bus /sierra_2: Setting Powered False 23:25:20.970180 run create_hlr_db(pid=8199): Terminated: ok {rc=0} 23:25:21.384778 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8201): Launched 23:25:21.708357 run osmo-hlr_10.42.42.2(pid=8202): Launched 23:25:21.832900 run osmo-stp_10.42.42.5: Starting osmo-stp 23:25:22.361890 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8204): Launched 23:25:22.685272 run osmo-stp_10.42.42.5(pid=8205): Launched 23:25:22.809508 run osmo-msc_10.42.42.6: Starting osmo-msc 23:25:23.366786 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8207): Launched 23:25:23.691193 run osmo-msc_10.42.42.6(pid=8208): Launched 23:25:23.871844 run osmo-stp_10.42.42.5(pid=8205): ERR: Terminated: ERROR {rc=1} [trial-2383↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8205)] 23:25:24.007935 run osmo-stp_10.42.42.5(pid=8205): stdout: | (launched: 2022-12-12_23:25:22.627061) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:25:24.145239 run osmo-stp_10.42.42.5(pid=8205): stderr: | [0;m[38;5;43m20221212232522818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212232522818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212232522818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212232522819 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212232522821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212232522821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212232522821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:25:24.280312 run osmo-stp_10.42.42.5(pid=8205): stdout: | (launched: 2022-12-12_23:25:22.627061) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:25:24.409398 run osmo-stp_10.42.42.5(pid=8205): stderr: | [0;m[38;5;43m20221212232522818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212232522818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212232522818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212232522819 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212232522821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212232522821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212232522821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:25:24.562929 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8205): Process ended prematurely: osmo-stp_10.42.42.5(pid=8205) [trial-2383↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8205)] [trial-2383↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18] 23:25:24.571749 tst handover.py:18: Test FAILED (6.6 sec) 23:25:24.599249 run osmo-hlr_10.42.42.2(pid=8202): ERR: Terminated: ERROR {rc=237} [trial-2383↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8202)] 23:25:24.649066 run osmo-hlr_10.42.42.2(pid=8202): stdout: | (launched: 2022-12-12_23:25:21.649814) 23:25:24.700345 run osmo-hlr_10.42.42.2(pid=8202): stderr: | [0;m[1;31m20221212232521849 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212232521849 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212232521849 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212232521849 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212232521849 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212232521849 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212232521861 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/handover_2G:oc2g+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212232521870 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212232521870 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212232521870 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:25:24.771620 run osmo-msc_10.42.42.6(pid=8208): ERR: Terminated: ERROR {rc=2} [trial-2383↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8208)] 23:25:24.820865 run osmo-msc_10.42.42.6(pid=8208): stdout: | (launched: 2022-12-12_23:25:23.632841) 23:25:24.872270 run osmo-msc_10.42.42.6(pid=8208): stderr: | [0;m[38;5;43m20221212232523953 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212232523953 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd5e2004c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212232523954 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212232523954 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212232523954 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212232523954 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212232523956 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212232523956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212232523956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212232523956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:25:24.923551 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8201): Terminating (SIGTERM) 23:25:24.964736 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8204): Terminating (SIGTERM) 23:25:25.006051 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8207): Terminating (SIGTERM) 23:25:25.047810 --- ParallelTerminationStrategy: PID 8201 died... 23:25:25.067577 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8201): Terminated: ok {rc=0} 23:25:25.113416 --- ParallelTerminationStrategy: PID 8204 died... 23:25:25.132817 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8204): Terminated: ok {rc=0} 23:25:25.178586 --- ParallelTerminationStrategy: PID 8207 died... 23:25:25.198029 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8207): Terminated: ok {rc=0} 23:25:25.286242 bus /sierra_3: Setting Powered False 23:25:26.384913 bus /sierra_3: Setting Powered False 23:25:27.501580 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 handover_2G:oc2g+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 handover_2G:oc2g+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 23:25:28.751841 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:25:28.756813 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 23:25:28.802668 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 23:25:28.828995 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 23:25:28.881769 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 23:25:28.928452 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 23:25:28.954310 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 23:25:29.503443 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OC-2G LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 handover_2G:oc2g+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 23:25:29.508495 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:25:29.519468 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 23:25:29.554403 tst handover.py: using LAC 32229 23:25:29.676144 tst handover.py: using RAC 99 23:25:29.795815 tst handover.py: using CellId 32229 23:25:29.917357 tst handover.py: using BVCI 32230 23:25:30.027530 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 23:25:30.072193 tst handover.py: using LAC 32230 23:25:30.193347 tst handover.py: using RAC 100 23:25:30.314528 tst handover.py: using CellId 32230 23:25:30.436673 tst handover.py: using BVCI 32231 23:25:30.547276 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:25:30.558226 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:25:30.568763 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:25:30.579791 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:25:30.590956 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:25:30.601990 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 23:25:30.721393 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 23:25:30.851450 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:25:31.359370 run create_hlr_db(pid=8214): Launched 23:25:31.516065 bus /sierra_2: Setting Powered False 23:25:32.580300 run create_hlr_db(pid=8214): Terminated: ok {rc=0} 23:25:32.989677 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8216): Launched 23:25:33.293016 run osmo-hlr_10.42.42.2(pid=8217): Launched 23:25:33.410309 run osmo-stp_10.42.42.5: Starting osmo-stp 23:25:33.911330 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8219): Launched 23:25:34.213816 run osmo-stp_10.42.42.5(pid=8220): Launched 23:25:34.329548 run osmo-msc_10.42.42.6: Starting osmo-msc 23:25:34.852371 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8222): Launched 23:25:35.155736 run osmo-msc_10.42.42.6(pid=8223): Launched 23:25:35.327351 run osmo-stp_10.42.42.5(pid=8220): ERR: Terminated: ERROR {rc=1} [trial-2383↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8220)] 23:25:35.455928 run osmo-stp_10.42.42.5(pid=8220): stdout: | (launched: 2022-12-12_23:25:34.158976) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:25:35.585284 run osmo-stp_10.42.42.5(pid=8220): stderr: | [0;m[38;5;43m20221212232534330 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212232534330 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212232534331 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212232534331 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212232534331 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212232534332 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212232534332 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:25:35.712169 run osmo-stp_10.42.42.5(pid=8220): stdout: | (launched: 2022-12-12_23:25:34.158976) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:25:35.833085 run osmo-stp_10.42.42.5(pid=8220): stderr: | [0;m[38;5;43m20221212232534330 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212232534330 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212232534331 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212232534331 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212232534331 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212232534332 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212232534332 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:25:35.977640 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8220): Process ended prematurely: osmo-stp_10.42.42.5(pid=8220) [trial-2383↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8220)] [trial-2383↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18] 23:25:35.985747 tst handover.py:18: Test FAILED (6.5 sec) 23:25:36.011476 run osmo-hlr_10.42.42.2(pid=8217): ERR: Terminated: ERROR {rc=237} [trial-2383↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8217)] 23:25:36.059422 run osmo-hlr_10.42.42.2(pid=8217): stdout: | (launched: 2022-12-12_23:25:33.237957) 23:25:36.108647 run osmo-hlr_10.42.42.2(pid=8217): stderr: | [0;m[1;31m20221212232533414 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212232533414 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212232533414 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212232533414 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212232533414 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212232533414 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212232533426 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/handover_2G:oc2g+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212232533434 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212232533434 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212232533434 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:25:36.176614 run osmo-msc_10.42.42.6(pid=8223): ERR: Terminated: ERROR {rc=2} [trial-2383↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8223)] 23:25:36.223611 run osmo-msc_10.42.42.6(pid=8223): stdout: | (launched: 2022-12-12_23:25:35.100739) 23:25:36.272195 run osmo-msc_10.42.42.6(pid=8223): stderr: | [0;m[38;5;43m20221212232535372 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212232535372 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f24581c7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212232535372 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212232535373 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212232535373 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212232535373 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212232535375 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212232535375 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212232535375 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212232535375 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:25:36.321536 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8216): Terminating (SIGTERM) 23:25:36.360211 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8219): Terminating (SIGTERM) 23:25:36.399519 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8222): Terminating (SIGTERM) 23:25:36.438874 --- ParallelTerminationStrategy: PID 8216 died... 23:25:36.457503 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8216): Terminated: ok {rc=0} 23:25:36.501079 --- ParallelTerminationStrategy: PID 8219 died... 23:25:36.519161 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8219): Terminated: ok {rc=0} 23:25:36.562463 --- ParallelTerminationStrategy: PID 8222 died... 23:25:36.580744 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8222): Terminated: ok {rc=0} 23:25:36.665289 bus /sierra_3: Setting Powered False 23:25:37.763263 bus /sierra_3: Setting Powered False 23:25:38.877577 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 handover_2G:oc2g+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 handover_2G:oc2g+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 23:25:40.134761 tst handover_2G:oc2g+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:25:40.140303 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 23:25:40.192042 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 23:25:40.219198 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 23:25:40.272238 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 23:25:40.324192 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 23:25:40.351142 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 23:25:40.902225 tst handover_2G:oc2g+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 handover_2G:oc2g+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 23:25:40.907446 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:25:40.918890 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 23:25:40.954175 tst handover.py: using LAC 32231 23:25:41.082572 tst handover.py: using RAC 101 23:25:41.210919 tst handover.py: using CellId 32231 23:25:41.340663 tst handover.py: using BVCI 32232 23:25:41.460419 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 23:25:41.511272 tst handover.py: using LAC 32232 23:25:41.639506 tst handover.py: using RAC 102 23:25:41.768713 tst handover.py: using CellId 32232 23:25:41.898212 tst handover.py: using BVCI 32233 23:25:42.031685 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:25:42.043034 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:25:42.054185 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:25:42.065946 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:25:42.077715 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:25:42.089462 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 23:25:42.207819 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 23:25:42.329032 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:25:42.773875 run create_hlr_db(pid=8228): Launched 23:25:42.890420 bus /sierra_2: Setting Powered False 23:25:43.950691 run create_hlr_db(pid=8228): Terminated: ok {rc=0} 23:25:44.346713 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8230): Launched 23:25:44.649555 run osmo-hlr_10.42.42.2(pid=8231): Launched 23:25:44.766398 run osmo-stp_10.42.42.5: Starting osmo-stp 23:25:45.267312 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8233): Launched 23:25:45.569975 run osmo-stp_10.42.42.5(pid=8234): Launched 23:25:45.685914 run osmo-msc_10.42.42.6: Starting osmo-msc 23:25:46.233762 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8236): Launched 23:25:46.581681 run osmo-msc_10.42.42.6(pid=8237): Launched 23:25:46.851044 run osmo-stp_10.42.42.5(pid=8234): ERR: Terminated: ERROR {rc=1} [trial-2383↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8234)] 23:25:47.103025 run osmo-stp_10.42.42.5(pid=8234): stdout: | (launched: 2022-12-12_23:25:45.514512) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:25:47.328141 run osmo-stp_10.42.42.5(pid=8234): stderr: | [0;m[38;5;43m20221212232545685 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212232545685 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212232545686 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212232545686 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212232545688 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212232545688 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212232545689 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:25:47.463480 run osmo-stp_10.42.42.5(pid=8234): stdout: | (launched: 2022-12-12_23:25:45.514512) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:25:47.593088 run osmo-stp_10.42.42.5(pid=8234): stderr: | [0;m[38;5;43m20221212232545685 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212232545685 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212232545686 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212232545686 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212232545688 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212232545688 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212232545689 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:25:47.748673 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8234): Process ended prematurely: osmo-stp_10.42.42.5(pid=8234) [trial-2383↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8234)] [trial-2383↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18] 23:25:47.757751 tst handover.py:18: Test FAILED (6.8 sec) 23:25:47.784860 run osmo-hlr_10.42.42.2(pid=8231): ERR: Terminated: ERROR {rc=237} [trial-2383↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8231)] 23:25:47.834631 run osmo-hlr_10.42.42.2(pid=8231): stdout: | (launched: 2022-12-12_23:25:44.594326) 23:25:47.885911 run osmo-hlr_10.42.42.2(pid=8231): stderr: | [0;m[1;31m20221212232544772 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212232544772 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212232544772 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212232544772 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212232544772 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212232544773 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212232544783 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/handover_2G:oc2g+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212232544792 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212232544792 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212232544792 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:25:47.957117 run osmo-msc_10.42.42.6(pid=8237): ERR: Terminated: ERROR {rc=2} [trial-2383↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8237)] 23:25:48.006644 run osmo-msc_10.42.42.6(pid=8237): stdout: | (launched: 2022-12-12_23:25:46.513510) 23:25:48.057852 run osmo-msc_10.42.42.6(pid=8237): stderr: | [0;m[38;5;43m20221212232547061 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212232547061 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f23d6d46c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212232547062 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212232547062 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212232547062 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212232547062 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212232547064 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212232547064 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212232547064 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212232547064 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:25:48.109503 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8230): Terminating (SIGTERM) 23:25:48.150384 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8233): Terminating (SIGTERM) 23:25:48.191494 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8236): Terminating (SIGTERM) 23:25:48.232710 --- ParallelTerminationStrategy: PID 8230 died... 23:25:48.252471 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8230): Terminated: ok {rc=0} 23:25:48.298028 --- ParallelTerminationStrategy: PID 8233 died... 23:25:48.317424 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8233): Terminated: ok {rc=0} 23:25:48.362819 --- ParallelTerminationStrategy: PID 8236 died... 23:25:48.382200 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8236): Terminated: ok {rc=0} 23:25:48.468646 bus /sierra_3: Setting Powered False 23:25:49.564769 bus /sierra_3: Setting Powered False 23:25:50.679022 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 handover_2G:oc2g+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 handover_2G:oc2g+bts1-sysmo --------------------------------------------------------------------- 23:25:51.937109 tst handover_2G:oc2g+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:25:51.942404 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x bts (candidates: 11) 23:25:51.981028 tst handover_2G:oc2g+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 23:25:52.008250 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x modem (candidates: 12) 23:25:52.062309 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x bts (candidates: 11) 23:25:52.099909 tst handover_2G:oc2g+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 23:25:52.125933 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x modem (candidates: 12) 23:25:52.671296 tst handover_2G:oc2g+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 handover_2G:oc2g+bts1-sysmo handover.py ---------------------------------------------- 23:25:52.676623 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:25:52.687405 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 23:25:52.721350 tst handover.py: using LAC 32233 23:25:52.840356 tst handover.py: using RAC 103 23:25:52.960030 tst handover.py: using CellId 32233 23:25:53.079174 tst handover.py: using BVCI 32234 23:25:53.190959 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 23:25:53.225691 tst handover.py: using LAC 32234 23:25:53.354366 tst handover.py: using RAC 104 23:25:53.482951 tst handover.py: using CellId 32234 23:25:53.610423 tst handover.py: using BVCI 32235 23:25:53.730595 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:25:53.741881 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:25:53.752709 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:25:53.763679 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:25:53.774735 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:25:53.785716 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 23:25:53.900878 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 23:25:54.019935 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:25:54.493494 run create_hlr_db(pid=8242): Launched 23:25:54.624847 bus /sierra_2: Setting Powered False 23:25:55.684557 run create_hlr_db(pid=8242): Terminated: ok {rc=0} 23:25:56.079323 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8244): Launched 23:25:56.381242 run osmo-hlr_10.42.42.2(pid=8245): Launched 23:25:56.497580 run osmo-stp_10.42.42.5: Starting osmo-stp 23:25:57.007649 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8247): Launched 23:25:57.310108 run osmo-stp_10.42.42.5(pid=8248): Launched 23:25:57.426206 run osmo-msc_10.42.42.6: Starting osmo-msc 23:25:57.949175 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8250): Launched 23:25:58.251588 run osmo-msc_10.42.42.6(pid=8251): Launched 23:25:58.421855 run osmo-stp_10.42.42.5(pid=8248): ERR: Terminated: ERROR {rc=1} [trial-2383↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8248)] 23:25:58.550407 run osmo-stp_10.42.42.5(pid=8248): stdout: | (launched: 2022-12-12_23:25:57.255415) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:25:58.678863 run osmo-stp_10.42.42.5(pid=8248): stderr: | [0;m[38;5;43m20221212232557427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212232557427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212232557427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212232557427 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212232557428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212232557428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212232557428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:25:58.804473 run osmo-stp_10.42.42.5(pid=8248): stdout: | (launched: 2022-12-12_23:25:57.255415) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:25:58.924586 run osmo-stp_10.42.42.5(pid=8248): stderr: | [0;m[38;5;43m20221212232557427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212232557427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212232557427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212232557427 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212232557428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212232557428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212232557428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:25:59.068223 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8248): Process ended prematurely: osmo-stp_10.42.42.5(pid=8248) [trial-2383↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8248)] [trial-2383↪handover_2G:oc2g+bts1-sysmo↪handover.py:18] 23:25:59.076513 tst handover.py:18: Test FAILED (6.4 sec) 23:25:59.102584 run osmo-hlr_10.42.42.2(pid=8245): ERR: Terminated: ERROR {rc=237} [trial-2383↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8245)] 23:25:59.150002 run osmo-hlr_10.42.42.2(pid=8245): stdout: | (launched: 2022-12-12_23:25:56.326623) 23:25:59.198625 run osmo-hlr_10.42.42.2(pid=8245): stderr: | [0;m[1;31m20221212232556501 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212232556501 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212232556501 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212232556501 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212232556501 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212232556502 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212232556514 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/handover_2G:oc2g+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212232556524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212232556524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212232556524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:25:59.267307 run osmo-msc_10.42.42.6(pid=8251): ERR: Terminated: ERROR {rc=2} [trial-2383↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8251)] 23:25:59.314549 run osmo-msc_10.42.42.6(pid=8251): stdout: | (launched: 2022-12-12_23:25:58.196617) 23:25:59.363389 run osmo-msc_10.42.42.6(pid=8251): stderr: | [0;m[38;5;43m20221212232558468 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212232558469 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f667977bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212232558469 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212232558469 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212232558469 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212232558469 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212232558471 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212232558471 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212232558471 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212232558472 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:25:59.412683 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8244): Terminating (SIGTERM) 23:25:59.451921 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8247): Terminating (SIGTERM) 23:25:59.491436 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8250): Terminating (SIGTERM) 23:25:59.531055 --- ParallelTerminationStrategy: PID 8244 died... 23:25:59.549868 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8244): Terminated: ok {rc=0} 23:25:59.594210 --- ParallelTerminationStrategy: PID 8247 died... 23:25:59.612442 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8247): Terminated: ok {rc=0} 23:25:59.655640 --- ParallelTerminationStrategy: PID 8250 died... 23:25:59.674370 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8250): Terminated: ok {rc=0} 23:25:59.758382 bus /sierra_3: Setting Powered False 23:26:00.862906 bus /sierra_3: Setting Powered False 23:26:01.983619 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 handover_2G:oc2g+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 handover_2G:oc2g+bts1-trx-b200 --------------------------------------------------------------------- 23:26:03.218143 tst handover_2G:oc2g+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:26:03.224102 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 23:26:03.274629 tst handover_2G:oc2g+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 23:26:03.300545 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 23:26:03.349485 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 23:26:03.398502 tst handover_2G:oc2g+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 23:26:03.424305 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 23:26:03.978514 tst handover_2G:oc2g+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OC-2G Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 handover_2G:oc2g+bts1-trx-b200 handover.py ---------------------------------------------- 23:26:03.983783 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:26:03.994523 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 23:26:04.028906 tst handover.py: using LAC 32235 23:26:04.146294 tst handover.py: using RAC 105 23:26:04.265240 tst handover.py: using CellId 32235 23:26:04.383746 tst handover.py: using BVCI 32236 23:26:04.493715 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 23:26:04.539714 tst handover.py: using LAC 32236 23:26:04.657612 tst handover.py: using RAC 106 23:26:04.777800 tst handover.py: using CellId 32236 23:26:04.895506 tst handover.py: using BVCI 32237 23:26:05.013545 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:26:05.024271 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:26:05.034912 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:26:05.045874 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:26:05.056831 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:26:05.067758 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 23:26:05.186354 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 23:26:05.307738 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:26:05.778817 run create_hlr_db(pid=8256): Launched 23:26:05.909141 bus /sierra_2: Setting Powered False 23:26:06.969721 run create_hlr_db(pid=8256): Terminated: ok {rc=0} 23:26:07.364025 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8258): Launched 23:26:07.667125 run osmo-hlr_10.42.42.2(pid=8259): Launched 23:26:07.782566 run osmo-stp_10.42.42.5: Starting osmo-stp 23:26:08.275362 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8261): Launched 23:26:08.576897 run osmo-stp_10.42.42.5(pid=8262): Launched 23:26:08.693850 run osmo-msc_10.42.42.6: Starting osmo-msc 23:26:09.216216 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8264): Launched 23:26:09.519361 run osmo-msc_10.42.42.6(pid=8265): Launched 23:26:09.689634 run osmo-stp_10.42.42.5(pid=8262): ERR: Terminated: ERROR {rc=1} [trial-2383↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8262)] 23:26:09.818892 run osmo-stp_10.42.42.5(pid=8262): stdout: | (launched: 2022-12-12_23:26:08.522372) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:26:09.946728 run osmo-stp_10.42.42.5(pid=8262): stderr: | [0;m[38;5;43m20221212232608694 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212232608694 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212232608695 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212232608695 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212232608695 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212232608696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212232608696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:26:10.073131 run osmo-stp_10.42.42.5(pid=8262): stdout: | (launched: 2022-12-12_23:26:08.522372) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:26:10.193187 run osmo-stp_10.42.42.5(pid=8262): stderr: | [0;m[38;5;43m20221212232608694 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212232608694 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212232608695 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212232608695 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212232608695 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212232608696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212232608696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:26:10.337229 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8262): Process ended prematurely: osmo-stp_10.42.42.5(pid=8262) [trial-2383↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8262)] [trial-2383↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18] 23:26:10.345484 tst handover.py:18: Test FAILED (6.4 sec) 23:26:10.370860 run osmo-hlr_10.42.42.2(pid=8259): ERR: Terminated: ERROR {rc=237} [trial-2383↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8259)] 23:26:10.418191 run osmo-hlr_10.42.42.2(pid=8259): stdout: | (launched: 2022-12-12_23:26:07.612033) 23:26:10.466311 run osmo-hlr_10.42.42.2(pid=8259): stderr: | [0;m[1;31m20221212232607790 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212232607790 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212232607790 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212232607790 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212232607790 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212232607790 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212232607801 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/handover_2G:oc2g+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212232607810 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212232607810 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212232607810 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:26:10.534596 run osmo-msc_10.42.42.6(pid=8265): ERR: Terminated: ERROR {rc=2} [trial-2383↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8265)] 23:26:10.581533 run osmo-msc_10.42.42.6(pid=8265): stdout: | (launched: 2022-12-12_23:26:09.464655) 23:26:10.630209 run osmo-msc_10.42.42.6(pid=8265): stderr: | [0;m[38;5;43m20221212232609739 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212232609739 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f22ca6dac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212232609739 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212232609739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212232609740 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212232609740 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212232609742 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212232609742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212232609742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212232609742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:26:10.679364 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8258): Terminating (SIGTERM) 23:26:10.718091 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8261): Terminating (SIGTERM) 23:26:10.757664 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8264): Terminating (SIGTERM) 23:26:10.797229 --- ParallelTerminationStrategy: PID 8258 died... 23:26:10.816372 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8258): Terminated: ok {rc=0} 23:26:10.859805 --- ParallelTerminationStrategy: PID 8261 died... 23:26:10.878142 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8261): Terminated: ok {rc=0} 23:26:10.921553 --- ParallelTerminationStrategy: PID 8264 died... 23:26:10.939590 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8264): Terminated: ok {rc=0} 23:26:11.021319 bus /sierra_3: Setting Powered False 23:26:12.116421 bus /sierra_3: Setting Powered False 23:26:13.233686 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 handover_2G:oc2g+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 handover_2G:oc2g+bts1-trx-umtrx --------------------------------------------------------------------- 23:26:14.487673 tst handover_2G:oc2g+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:26:14.492515 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 23:26:14.541819 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 23:26:14.567832 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 23:26:14.620114 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 23:26:14.669417 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 23:26:14.695432 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 23:26:15.244833 tst handover_2G:oc2g+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OC-2G UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 handover_2G:oc2g+bts1-trx-umtrx handover.py ---------------------------------------------- 23:26:15.250223 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:26:15.261082 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 23:26:15.295332 tst handover.py: using LAC 32237 23:26:15.415667 tst handover.py: using RAC 107 23:26:15.534099 tst handover.py: using CellId 32237 23:26:15.656264 tst handover.py: using BVCI 32238 23:26:15.767787 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 23:26:15.815506 tst handover.py: using LAC 32238 23:26:15.966520 tst handover.py: using RAC 108 23:26:16.093634 tst handover.py: using CellId 32238 23:26:16.255302 tst handover.py: using BVCI 32239 23:26:16.369548 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:26:16.381300 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:26:16.392817 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:26:16.405208 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:26:16.418103 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:26:16.430559 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 23:26:16.567484 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 23:26:16.701701 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:26:17.227569 run create_hlr_db(pid=8271): Launched 23:26:17.391828 bus /sierra_2: Setting Powered False 23:26:18.456065 run create_hlr_db(pid=8271): Terminated: ok {rc=0} 23:26:18.876617 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8273): Launched 23:26:19.199054 run osmo-hlr_10.42.42.2(pid=8274): Launched 23:26:19.322603 run osmo-stp_10.42.42.5: Starting osmo-stp 23:26:19.851201 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8276): Launched 23:26:20.173518 run osmo-stp_10.42.42.5(pid=8277): Launched 23:26:20.297380 run osmo-msc_10.42.42.6: Starting osmo-msc 23:26:20.855704 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8279): Launched 23:26:21.178699 run osmo-msc_10.42.42.6(pid=8280): Launched 23:26:21.359310 run osmo-stp_10.42.42.5(pid=8277): ERR: Terminated: ERROR {rc=1} [trial-2383↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8277)] 23:26:21.495417 run osmo-stp_10.42.42.5(pid=8277): stdout: | (launched: 2022-12-12_23:26:20.115557) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:26:21.632031 run osmo-stp_10.42.42.5(pid=8277): stderr: | [0;m[38;5;43m20221212232620307 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212232620308 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212232620308 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212232620308 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212232620309 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212232620309 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212232620309 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:26:21.768119 run osmo-stp_10.42.42.5(pid=8277): stdout: | (launched: 2022-12-12_23:26:20.115557) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:26:21.897112 run osmo-stp_10.42.42.5(pid=8277): stderr: | [0;m[38;5;43m20221212232620307 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212232620308 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212232620308 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212232620308 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212232620309 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212232620309 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212232620309 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:26:22.051895 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8277): Process ended prematurely: osmo-stp_10.42.42.5(pid=8277) [trial-2383↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8277)] [trial-2383↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18] 23:26:22.060685 tst handover.py:18: Test FAILED (6.8 sec) 23:26:22.087874 run osmo-hlr_10.42.42.2(pid=8274): ERR: Terminated: ERROR {rc=237} [trial-2383↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8274)] 23:26:22.137475 run osmo-hlr_10.42.42.2(pid=8274): stdout: | (launched: 2022-12-12_23:26:19.141115) 23:26:22.188887 run osmo-hlr_10.42.42.2(pid=8274): stderr: | [0;m[1;31m20221212232619339 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212232619339 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212232619339 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212232619339 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212232619339 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212232619339 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212232619351 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/handover_2G:oc2g+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212232619359 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212232619359 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212232619359 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:26:22.259866 run osmo-msc_10.42.42.6(pid=8280): ERR: Terminated: ERROR {rc=2} [trial-2383↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8280)] 23:26:22.308873 run osmo-msc_10.42.42.6(pid=8280): stdout: | (launched: 2022-12-12_23:26:21.120210) 23:26:22.359544 run osmo-msc_10.42.42.6(pid=8280): stderr: | [0;m[38;5;43m20221212232621443 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212232621445 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f82466a3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212232621445 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212232621445 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212232621445 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212232621445 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212232621447 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212232621447 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212232621447 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212232621447 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:26:22.410552 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8273): Terminating (SIGTERM) 23:26:22.451711 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8276): Terminating (SIGTERM) 23:26:22.492797 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8279): Terminating (SIGTERM) 23:26:22.534388 --- ParallelTerminationStrategy: PID 8273 died... 23:26:22.554392 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8273): Terminated: ok {rc=0} 23:26:22.600042 --- ParallelTerminationStrategy: PID 8276 died... 23:26:22.619493 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8276): Terminated: ok {rc=0} 23:26:22.665466 --- ParallelTerminationStrategy: PID 8279 died... 23:26:22.684850 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8279): Terminated: ok {rc=0} 23:26:22.771210 bus /sierra_3: Setting Powered False 23:26:23.866481 bus /sierra_3: Setting Powered False 23:26:24.979615 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 handover_2G:oc2g+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 handover_2G:octphy+bts1-trx-lms --------------------------------------------------------------------- 23:26:26.230337 tst handover_2G:octphy+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:26:26.237169 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 23:26:26.287376 tst handover_2G:octphy+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 23:26:26.314769 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 23:26:26.369344 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 23:26:26.418752 tst handover_2G:octphy+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 23:26:26.444546 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 23:26:26.993947 tst handover_2G:octphy+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 handover_2G:octphy+bts1-trx-lms handover.py ---------------------------------------------- 23:26:27.000355 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 23:26:27.012088 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 23:26:27.046885 tst handover.py: using LAC 32239 23:26:27.171286 tst handover.py: using RAC 109 23:26:27.291931 tst handover.py: using CellId 32239 23:26:27.410525 tst handover.py: using BVCI 32240 23:26:27.521932 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 23:26:27.567988 tst handover.py: using LAC 32240 23:26:27.691109 tst handover.py: using RAC 110 23:26:27.811133 tst handover.py: using CellId 32240 23:26:27.929687 tst handover.py: using BVCI 32241 23:26:28.040693 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 23:26:28.051606 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 23:26:28.062413 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 23:26:28.074210 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 23:26:28.085811 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 23:26:28.097410 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 23:26:28.218649 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 23:26:28.339030 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:26:28.810578 run create_hlr_db(pid=8285): Launched 23:26:28.941163 bus /sierra_2: Setting Powered False 23:26:30.000256 run create_hlr_db(pid=8285): Terminated: ok {rc=0} 23:26:30.396693 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8287): Launched 23:26:30.699219 run osmo-hlr_10.42.42.2(pid=8288): Launched 23:26:30.816012 run osmo-stp_10.42.42.5: Starting osmo-stp 23:26:31.446977 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8290): Launched 23:26:31.791339 run osmo-stp_10.42.42.5(pid=8291): Launched 23:26:32.056030 run osmo-msc_10.42.42.6: Starting osmo-msc 23:26:32.713601 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8293): Launched 23:26:33.037373 run osmo-msc_10.42.42.6(pid=8294): Launched 23:26:33.218466 run osmo-stp_10.42.42.5(pid=8291): ERR: Terminated: ERROR {rc=1} [trial-2383↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8291)] 23:26:33.355543 run osmo-stp_10.42.42.5(pid=8291): stdout: | (launched: 2022-12-12_23:26:31.710964) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:26:33.493265 run osmo-stp_10.42.42.5(pid=8291): stderr: | [0;m[38;5;43m20221212232632016 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212232632016 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212232632016 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212232632017 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212232632019 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212232632019 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212232632019 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:26:33.629360 run osmo-stp_10.42.42.5(pid=8291): stdout: | (launched: 2022-12-12_23:26:31.710964) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:26:33.759183 run osmo-stp_10.42.42.5(pid=8291): stderr: | [0;m[38;5;43m20221212232632016 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212232632016 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212232632016 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212232632017 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212232632019 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212232632019 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212232632019 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:26:33.913426 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8291): Process ended prematurely: osmo-stp_10.42.42.5(pid=8291) [trial-2383↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8291)] [trial-2383↪handover_2G:octphy+bts1-trx-lms↪handover.py:18] 23:26:33.922116 tst handover.py:18: Test FAILED (6.9 sec) 23:26:33.948842 run osmo-hlr_10.42.42.2(pid=8288): ERR: Terminated: ERROR {rc=237} [trial-2383↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8288)] 23:26:33.998487 run osmo-hlr_10.42.42.2(pid=8288): stdout: | (launched: 2022-12-12_23:26:30.644357) 23:26:34.049551 run osmo-hlr_10.42.42.2(pid=8288): stderr: | [0;m[1;31m20221212232630819 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212232630819 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212232630819 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212232630819 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212232630819 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212232630819 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212232630840 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/handover_2G:octphy+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212232630852 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212232630856 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212232630856 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:26:34.120564 run osmo-msc_10.42.42.6(pid=8294): ERR: Terminated: ERROR {rc=2} [trial-2383↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8294)] 23:26:34.169790 run osmo-msc_10.42.42.6(pid=8294): stdout: | (launched: 2022-12-12_23:26:32.978878) 23:26:34.220465 run osmo-msc_10.42.42.6(pid=8294): stderr: | [0;m[38;5;43m20221212232633303 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212232633303 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f120b921c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212232633303 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212232633303 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212232633303 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212232633304 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212232633305 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212232633306 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212232633306 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212232633306 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:26:34.271670 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8287): Terminating (SIGTERM) 23:26:34.312700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8290): Terminating (SIGTERM) 23:26:34.353912 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8293): Terminating (SIGTERM) 23:26:34.395268 --- ParallelTerminationStrategy: PID 8287 died... 23:26:34.414934 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8287): Terminated: ok {rc=0} 23:26:34.460738 --- ParallelTerminationStrategy: PID 8290 died... 23:26:34.479942 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8290): Terminated: ok {rc=0} 23:26:34.525128 --- ParallelTerminationStrategy: PID 8293 died... 23:26:34.544163 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8293): Terminated: ok {rc=0} 23:26:34.630264 bus /sierra_3: Setting Powered False 23:26:35.728792 bus /sierra_3: Setting Powered False 23:26:36.843200 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 handover_2G:octphy+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 handover_2G:octphy+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 23:26:38.101272 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:26:38.106605 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 23:26:38.152061 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 23:26:38.178916 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 23:26:38.231643 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 23:26:38.277511 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 23:26:38.304536 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 23:26:38.855587 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 handover_2G:octphy+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 23:26:38.862543 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:26:38.874157 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 23:26:38.908422 tst handover.py: using LAC 32241 23:26:39.030819 tst handover.py: using RAC 111 23:26:39.150658 tst handover.py: using CellId 32241 23:26:39.268368 tst handover.py: using BVCI 32242 23:26:39.379012 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 23:26:39.425144 tst handover.py: using LAC 32242 23:26:39.544521 tst handover.py: using RAC 112 23:26:39.662383 tst handover.py: using CellId 32242 23:26:39.780673 tst handover.py: using BVCI 32243 23:26:39.891488 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:26:39.902761 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:26:39.913653 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:26:39.924358 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:26:39.935694 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:26:39.946852 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 23:26:40.065223 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 23:26:40.186272 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:26:40.660615 run create_hlr_db(pid=8299): Launched 23:26:40.791743 bus /sierra_2: Setting Powered False 23:26:41.852171 run create_hlr_db(pid=8299): Terminated: ok {rc=0} 23:26:42.267490 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8301): Launched 23:26:42.589982 run osmo-hlr_10.42.42.2(pid=8302): Launched 23:26:42.714306 run osmo-stp_10.42.42.5: Starting osmo-stp 23:26:43.240608 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8304): Launched 23:26:43.562487 run osmo-stp_10.42.42.5(pid=8305): Launched 23:26:43.686320 run osmo-msc_10.42.42.6: Starting osmo-msc 23:26:44.242491 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8307): Launched 23:26:44.566243 run osmo-msc_10.42.42.6(pid=8308): Launched 23:26:44.747568 run osmo-stp_10.42.42.5(pid=8305): ERR: Terminated: ERROR {rc=1} [trial-2383↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8305)] 23:26:44.883623 run osmo-stp_10.42.42.5(pid=8305): stdout: | (launched: 2022-12-12_23:26:43.504254) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:26:45.020218 run osmo-stp_10.42.42.5(pid=8305): stderr: | [0;m[38;5;43m20221212232643698 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212232643698 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212232643698 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212232643699 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212232643699 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212232643699 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212232643699 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:26:45.155596 run osmo-stp_10.42.42.5(pid=8305): stdout: | (launched: 2022-12-12_23:26:43.504254) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:26:45.283759 run osmo-stp_10.42.42.5(pid=8305): stderr: | [0;m[38;5;43m20221212232643698 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212232643698 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212232643698 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212232643699 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212232643699 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212232643699 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212232643699 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:26:45.439303 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8305): Process ended prematurely: osmo-stp_10.42.42.5(pid=8305) [trial-2383↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8305)] [trial-2383↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18] 23:26:45.448002 tst handover.py:18: Test FAILED (6.6 sec) 23:26:45.475106 run osmo-hlr_10.42.42.2(pid=8302): ERR: Terminated: ERROR {rc=237} [trial-2383↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8302)] 23:26:45.524385 run osmo-hlr_10.42.42.2(pid=8302): stdout: | (launched: 2022-12-12_23:26:42.531843) 23:26:45.575431 run osmo-hlr_10.42.42.2(pid=8302): stderr: | [0;m[1;31m20221212232642730 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212232642730 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212232642730 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212232642730 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212232642730 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212232642730 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212232642750 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/handover_2G:octphy+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212232642760 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212232642760 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212232642760 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:26:45.646483 run osmo-msc_10.42.42.6(pid=8308): ERR: Terminated: ERROR {rc=2} [trial-2383↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8308)] 23:26:45.696038 run osmo-msc_10.42.42.6(pid=8308): stdout: | (launched: 2022-12-12_23:26:44.507804) 23:26:45.747107 run osmo-msc_10.42.42.6(pid=8308): stderr: | [0;m[38;5;43m20221212232644830 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212232644830 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f086abbbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212232644831 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212232644831 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212232644831 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212232644831 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212232644833 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212232644833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212232644833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212232644833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:26:45.798330 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8301): Terminating (SIGTERM) 23:26:45.841485 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8304): Terminating (SIGTERM) 23:26:45.913463 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8307): Terminating (SIGTERM) 23:26:45.955376 --- ParallelTerminationStrategy: PID 8301 died... 23:26:45.979262 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8301): Terminated: ok {rc=0} 23:26:46.025742 --- ParallelTerminationStrategy: PID 8304 died... 23:26:46.045525 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8304): Terminated: ok {rc=0} 23:26:46.095392 --- ParallelTerminationStrategy: PID 8307 died... 23:26:46.115265 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8307): Terminated: ok {rc=0} 23:26:46.203536 bus /sierra_3: Setting Powered False 23:26:47.305258 bus /sierra_3: Setting Powered False 23:26:48.419825 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 handover_2G:octphy+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 handover_2G:octphy+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 23:26:49.670766 tst handover_2G:octphy+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:26:49.676897 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 23:26:49.726838 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 23:26:49.753079 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 23:26:49.813416 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 23:26:49.862260 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 23:26:49.888042 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 23:26:50.429166 tst handover_2G:octphy+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 handover_2G:octphy+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 23:26:50.434265 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:26:50.445088 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 23:26:50.478405 tst handover.py: using LAC 32243 23:26:50.596584 tst handover.py: using RAC 113 23:26:50.715456 tst handover.py: using CellId 32243 23:26:50.836161 tst handover.py: using BVCI 32244 23:26:50.948087 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 23:26:50.996109 tst handover.py: using LAC 32244 23:26:51.118133 tst handover.py: using RAC 114 23:26:51.250715 tst handover.py: using CellId 32244 23:26:51.371782 tst handover.py: using BVCI 32245 23:26:51.483288 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:26:51.494177 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:26:51.504864 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:26:51.515797 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:26:51.526842 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:26:51.537810 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 23:26:51.655449 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 23:26:51.773190 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:26:52.217200 run create_hlr_db(pid=8313): Launched 23:26:52.333296 bus /sierra_2: Setting Powered False 23:26:53.393418 run create_hlr_db(pid=8313): Terminated: ok {rc=0} 23:26:53.806537 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8315): Launched 23:26:54.128490 run osmo-hlr_10.42.42.2(pid=8316): Launched 23:26:54.252619 run osmo-stp_10.42.42.5: Starting osmo-stp 23:26:54.782849 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8318): Launched 23:26:55.105216 run osmo-stp_10.42.42.5(pid=8319): Launched 23:26:55.229127 run osmo-msc_10.42.42.6: Starting osmo-msc 23:26:55.785222 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8321): Launched 23:26:56.107717 run osmo-msc_10.42.42.6(pid=8322): Launched 23:26:56.288655 run osmo-stp_10.42.42.5(pid=8319): ERR: Terminated: ERROR {rc=1} [trial-2383↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8319)] 23:26:56.425191 run osmo-stp_10.42.42.5(pid=8319): stdout: | (launched: 2022-12-12_23:26:55.046949) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:26:56.561524 run osmo-stp_10.42.42.5(pid=8319): stderr: | [0;m[38;5;43m20221212232655238 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212232655238 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212232655239 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212232655239 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212232655239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212232655239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212232655240 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:26:56.697582 run osmo-stp_10.42.42.5(pid=8319): stdout: | (launched: 2022-12-12_23:26:55.046949) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:26:56.825840 run osmo-stp_10.42.42.5(pid=8319): stderr: | [0;m[38;5;43m20221212232655238 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212232655238 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212232655239 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212232655239 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212232655239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212232655239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212232655240 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:26:56.979396 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8319): Process ended prematurely: osmo-stp_10.42.42.5(pid=8319) [trial-2383↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8319)] [trial-2383↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18] 23:26:56.988031 tst handover.py:18: Test FAILED (6.5 sec) 23:26:57.015014 run osmo-hlr_10.42.42.2(pid=8316): ERR: Terminated: ERROR {rc=237} [trial-2383↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8316)] 23:26:57.064053 run osmo-hlr_10.42.42.2(pid=8316): stdout: | (launched: 2022-12-12_23:26:54.070521) 23:26:57.115135 run osmo-hlr_10.42.42.2(pid=8316): stderr: | [0;m[1;31m20221212232654268 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212232654268 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212232654268 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212232654268 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212232654269 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212232654269 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212232654281 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/handover_2G:octphy+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212232654289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212232654290 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212232654290 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:26:57.186405 run osmo-msc_10.42.42.6(pid=8322): ERR: Terminated: ERROR {rc=2} [trial-2383↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8322)] 23:26:57.235666 run osmo-msc_10.42.42.6(pid=8322): stdout: | (launched: 2022-12-12_23:26:56.049327) 23:26:57.286699 run osmo-msc_10.42.42.6(pid=8322): stderr: | [0;m[38;5;43m20221212232656373 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212232656374 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f91fe990c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212232656374 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212232656374 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212232656374 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212232656374 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212232656376 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212232656377 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212232656377 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212232656377 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:26:57.338113 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8315): Terminating (SIGTERM) 23:26:57.378983 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8318): Terminating (SIGTERM) 23:26:57.419938 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8321): Terminating (SIGTERM) 23:26:57.461373 --- ParallelTerminationStrategy: PID 8315 died... 23:26:57.481149 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8315): Terminated: ok {rc=0} 23:26:57.526787 --- ParallelTerminationStrategy: PID 8318 died... 23:26:57.546050 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8318): Terminated: ok {rc=0} 23:26:57.591819 --- ParallelTerminationStrategy: PID 8321 died... 23:26:57.611096 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8321): Terminated: ok {rc=0} 23:26:57.697371 bus /sierra_3: Setting Powered False 23:26:58.795860 bus /sierra_3: Setting Powered False 23:26:59.911975 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 handover_2G:octphy+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 handover_2G:octphy+bts1-sysmo --------------------------------------------------------------------- 23:27:01.174073 tst handover_2G:octphy+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:27:01.180258 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x bts (candidates: 11) 23:27:01.227868 tst handover_2G:octphy+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 23:27:01.264006 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x modem (candidates: 12) 23:27:01.326934 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x bts (candidates: 11) 23:27:01.373490 tst handover_2G:octphy+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 23:27:01.402297 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x modem (candidates: 12) 23:27:01.962692 tst handover_2G:octphy+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 handover_2G:octphy+bts1-sysmo handover.py ---------------------------------------------- 23:27:01.969425 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:27:01.983874 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 23:27:02.025566 tst handover.py: using LAC 32245 23:27:02.155060 tst handover.py: using RAC 115 23:27:02.284054 tst handover.py: using CellId 32245 23:27:02.411792 tst handover.py: using BVCI 32246 23:27:02.529553 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 23:27:02.564795 tst handover.py: using LAC 32246 23:27:02.686417 tst handover.py: using RAC 116 23:27:02.806400 tst handover.py: using CellId 32246 23:27:02.925823 tst handover.py: using BVCI 32247 23:27:03.038057 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:27:03.048773 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:27:03.059443 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:27:03.070264 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:27:03.081183 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:27:03.091937 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 23:27:03.210970 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 23:27:03.327679 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:27:03.772739 run create_hlr_db(pid=8327): Launched 23:27:03.887987 bus /sierra_2: Setting Powered False 23:27:04.948867 run create_hlr_db(pid=8327): Terminated: ok {rc=0} 23:27:05.345563 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8329): Launched 23:27:05.650234 run osmo-hlr_10.42.42.2(pid=8330): Launched 23:27:05.766889 run osmo-stp_10.42.42.5: Starting osmo-stp 23:27:06.262594 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8332): Launched 23:27:06.564745 run osmo-stp_10.42.42.5(pid=8333): Launched 23:27:06.681271 run osmo-msc_10.42.42.6: Starting osmo-msc 23:27:07.213422 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8335): Launched 23:27:07.518065 run osmo-msc_10.42.42.6(pid=8336): Launched 23:27:07.687942 run osmo-stp_10.42.42.5(pid=8333): ERR: Terminated: ERROR {rc=1} [trial-2383↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8333)] 23:27:07.816810 run osmo-stp_10.42.42.5(pid=8333): stdout: | (launched: 2022-12-12_23:27:06.510146) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:27:07.945320 run osmo-stp_10.42.42.5(pid=8333): stderr: | [0;m[38;5;43m20221212232706679 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212232706680 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212232706680 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212232706680 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212232706681 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212232706681 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212232706681 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:27:08.072274 run osmo-stp_10.42.42.5(pid=8333): stdout: | (launched: 2022-12-12_23:27:06.510146) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:27:08.193696 run osmo-stp_10.42.42.5(pid=8333): stderr: | [0;m[38;5;43m20221212232706679 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212232706680 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212232706680 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212232706680 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212232706681 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212232706681 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212232706681 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:27:08.338943 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8333): Process ended prematurely: osmo-stp_10.42.42.5(pid=8333) [trial-2383↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8333)] [trial-2383↪handover_2G:octphy+bts1-sysmo↪handover.py:18] 23:27:08.347239 tst handover.py:18: Test FAILED (6.4 sec) 23:27:08.372815 run osmo-hlr_10.42.42.2(pid=8330): ERR: Terminated: ERROR {rc=237} [trial-2383↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8330)] 23:27:08.420901 run osmo-hlr_10.42.42.2(pid=8330): stdout: | (launched: 2022-12-12_23:27:05.594951) 23:27:08.469261 run osmo-hlr_10.42.42.2(pid=8330): stderr: | [0;m[1;31m20221212232705771 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212232705771 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212232705771 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212232705771 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212232705771 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212232705771 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212232705782 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/handover_2G:octphy+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212232705790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212232705790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212232705790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:27:08.538041 run osmo-msc_10.42.42.6(pid=8336): ERR: Terminated: ERROR {rc=2} [trial-2383↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8336)] 23:27:08.585215 run osmo-msc_10.42.42.6(pid=8336): stdout: | (launched: 2022-12-12_23:27:07.462468) 23:27:08.633991 run osmo-msc_10.42.42.6(pid=8336): stderr: | [0;m[38;5;43m20221212232707735 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212232707736 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff535ed2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212232707736 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212232707736 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212232707736 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212232707736 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212232707738 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212232707739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212232707739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212232707739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:27:08.683318 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8329): Terminating (SIGTERM) 23:27:08.722190 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8332): Terminating (SIGTERM) 23:27:08.761639 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8335): Terminating (SIGTERM) 23:27:08.801753 --- ParallelTerminationStrategy: PID 8329 died... 23:27:08.820610 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8329): Terminated: ok {rc=0} 23:27:08.864398 --- ParallelTerminationStrategy: PID 8332 died... 23:27:08.882627 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8332): Terminated: ok {rc=0} 23:27:08.926066 --- ParallelTerminationStrategy: PID 8335 died... 23:27:08.944239 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8335): Terminated: ok {rc=0} 23:27:09.027195 bus /sierra_3: Setting Powered False 23:27:10.124450 bus /sierra_3: Setting Powered False 23:27:11.238754 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 handover_2G:octphy+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 handover_2G:octphy+bts1-trx-b200 --------------------------------------------------------------------- 23:27:12.480762 tst handover_2G:octphy+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:27:12.486415 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 23:27:12.535827 tst handover_2G:octphy+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 23:27:12.562824 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 23:27:12.614726 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 23:27:12.663785 tst handover_2G:octphy+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 23:27:12.690607 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 23:27:13.242854 tst handover_2G:octphy+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 handover_2G:octphy+bts1-trx-b200 handover.py ---------------------------------------------- 23:27:13.248108 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:27:13.259341 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 23:27:13.296126 tst handover.py: using LAC 32247 23:27:13.417355 tst handover.py: using RAC 117 23:27:13.535266 tst handover.py: using CellId 32247 23:27:13.654164 tst handover.py: using BVCI 32248 23:27:13.765123 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 23:27:13.811442 tst handover.py: using LAC 32248 23:27:13.938667 tst handover.py: using RAC 118 23:27:14.063301 tst handover.py: using CellId 32248 23:27:14.183178 tst handover.py: using BVCI 32249 23:27:14.294251 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:27:14.304934 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:27:14.315648 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:27:14.326587 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:27:14.337745 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:27:14.348353 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 23:27:14.468628 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 23:27:14.583630 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:27:15.026409 run create_hlr_db(pid=8341): Launched 23:27:15.142684 bus /sierra_2: Setting Powered False 23:27:16.204623 run create_hlr_db(pid=8341): Terminated: ok {rc=0} 23:27:16.621656 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8343): Launched 23:27:16.946907 run osmo-hlr_10.42.42.2(pid=8344): Launched 23:27:17.091813 run osmo-stp_10.42.42.5: Starting osmo-stp 23:27:17.670617 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8346): Launched 23:27:17.973917 run osmo-stp_10.42.42.5(pid=8347): Launched 23:27:18.089338 run osmo-msc_10.42.42.6: Starting osmo-msc 23:27:18.611124 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8349): Launched 23:27:18.914845 run osmo-msc_10.42.42.6(pid=8350): Launched 23:27:19.086167 run osmo-stp_10.42.42.5(pid=8347): ERR: Terminated: ERROR {rc=1} [trial-2383↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8347)] 23:27:19.215291 run osmo-stp_10.42.42.5(pid=8347): stdout: | (launched: 2022-12-12_23:27:17.918828) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:27:19.343814 run osmo-stp_10.42.42.5(pid=8347): stderr: | [0;m[38;5;43m20221212232718088 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212232718089 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212232718089 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212232718089 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212232718091 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212232718092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212232718092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:27:19.470717 run osmo-stp_10.42.42.5(pid=8347): stdout: | (launched: 2022-12-12_23:27:17.918828) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:27:19.591855 run osmo-stp_10.42.42.5(pid=8347): stderr: | [0;m[38;5;43m20221212232718088 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212232718089 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212232718089 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212232718089 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212232718091 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212232718092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212232718092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:27:19.736745 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8347): Process ended prematurely: osmo-stp_10.42.42.5(pid=8347) [trial-2383↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8347)] [trial-2383↪handover_2G:octphy+bts1-trx-b200↪handover.py:18] 23:27:19.745150 tst handover.py:18: Test FAILED (6.5 sec) 23:27:19.771719 run osmo-hlr_10.42.42.2(pid=8344): ERR: Terminated: ERROR {rc=237} [trial-2383↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8344)] 23:27:19.820780 run osmo-hlr_10.42.42.2(pid=8344): stdout: | (launched: 2022-12-12_23:27:16.888418) 23:27:19.869666 run osmo-hlr_10.42.42.2(pid=8344): stderr: | [0;m[1;31m20221212232717225 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212232717225 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212232717225 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212232717225 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212232717225 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212232717225 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212232717238 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/handover_2G:octphy+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212232717246 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212232717246 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212232717246 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:27:19.939786 run osmo-msc_10.42.42.6(pid=8350): ERR: Terminated: ERROR {rc=2} [trial-2383↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8350)] 23:27:19.987602 run osmo-msc_10.42.42.6(pid=8350): stdout: | (launched: 2022-12-12_23:27:18.859645) 23:27:20.037080 run osmo-msc_10.42.42.6(pid=8350): stderr: | [0;m[38;5;43m20221212232719132 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212232719132 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fee4b252c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212232719132 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212232719132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212232719132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212232719132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212232719134 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212232719134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212232719135 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212232719135 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:27:20.086796 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8343): Terminating (SIGTERM) 23:27:20.125990 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8346): Terminating (SIGTERM) 23:27:20.166056 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8349): Terminating (SIGTERM) 23:27:20.206697 --- ParallelTerminationStrategy: PID 8343 died... 23:27:20.225603 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8343): Terminated: ok {rc=0} 23:27:20.269357 --- ParallelTerminationStrategy: PID 8346 died... 23:27:20.288208 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8346): Terminated: ok {rc=0} 23:27:20.331671 --- ParallelTerminationStrategy: PID 8349 died... 23:27:20.350225 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8349): Terminated: ok {rc=0} 23:27:20.434672 bus /sierra_3: Setting Powered False 23:27:21.534264 bus /sierra_3: Setting Powered False 23:27:22.651152 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 handover_2G:octphy+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 handover_2G:octphy+bts1-trx-umtrx --------------------------------------------------------------------- 23:27:23.900657 tst handover_2G:octphy+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:27:23.905578 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 23:27:23.954280 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 23:27:23.980241 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 23:27:24.031130 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 23:27:24.078543 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 23:27:24.104687 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 23:27:24.655019 tst handover_2G:octphy+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 handover_2G:octphy+bts1-trx-umtrx handover.py ---------------------------------------------- 23:27:24.660096 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:27:24.670813 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 23:27:24.704075 tst handover.py: using LAC 32249 23:27:24.832837 tst handover.py: using RAC 119 23:27:24.959678 tst handover.py: using CellId 32249 23:27:25.081320 tst handover.py: using BVCI 32250 23:27:25.191806 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 23:27:25.242324 tst handover.py: using LAC 32250 23:27:25.362195 tst handover.py: using RAC 120 23:27:25.482199 tst handover.py: using CellId 32250 23:27:25.603144 tst handover.py: using BVCI 32251 23:27:25.722017 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:27:25.733394 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:27:25.744337 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:27:25.755418 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:27:25.766532 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:27:25.777580 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 23:27:25.894404 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 23:27:26.011996 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:27:26.458737 run create_hlr_db(pid=8355): Launched 23:27:26.576401 bus /sierra_2: Setting Powered False 23:27:27.637254 run create_hlr_db(pid=8355): Terminated: ok {rc=0} 23:27:28.052248 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8357): Launched 23:27:28.376298 run osmo-hlr_10.42.42.2(pid=8358): Launched 23:27:28.501379 run osmo-stp_10.42.42.5: Starting osmo-stp 23:27:29.031966 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8360): Launched 23:27:29.355172 run osmo-stp_10.42.42.5(pid=8361): Launched 23:27:29.479882 run osmo-msc_10.42.42.6: Starting osmo-msc 23:27:30.039823 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8363): Launched 23:27:30.363375 run osmo-msc_10.42.42.6(pid=8364): Launched 23:27:30.545329 run osmo-stp_10.42.42.5(pid=8361): ERR: Terminated: ERROR {rc=1} [trial-2383↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8361)] 23:27:30.683093 run osmo-stp_10.42.42.5(pid=8361): stdout: | (launched: 2022-12-12_23:27:29.296504) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:27:30.820606 run osmo-stp_10.42.42.5(pid=8361): stderr: | [0;m[38;5;43m20221212232729490 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212232729490 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212232729490 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212232729491 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212232729491 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212232729491 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212232729491 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:27:30.992128 run osmo-stp_10.42.42.5(pid=8361): stdout: | (launched: 2022-12-12_23:27:29.296504) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:27:31.123685 run osmo-stp_10.42.42.5(pid=8361): stderr: | [0;m[38;5;43m20221212232729490 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212232729490 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212232729490 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212232729491 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212232729491 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212232729491 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212232729491 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:27:31.283682 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8361): Process ended prematurely: osmo-stp_10.42.42.5(pid=8361) [trial-2383↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8361)] [trial-2383↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18] 23:27:31.294981 tst handover.py:18: Test FAILED (6.6 sec) 23:27:31.331577 run osmo-hlr_10.42.42.2(pid=8358): ERR: Terminated: ERROR {rc=237} [trial-2383↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8358)] 23:27:31.393430 run osmo-hlr_10.42.42.2(pid=8358): stdout: | (launched: 2022-12-12_23:27:28.317885) 23:27:31.455808 run osmo-hlr_10.42.42.2(pid=8358): stderr: | [0;m[1;31m20221212232728520 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212232728520 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212232728520 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212232728520 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212232728520 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212232728520 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212232728532 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/handover_2G:octphy+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212232728540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212232728540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212232728540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:27:31.534146 run osmo-msc_10.42.42.6(pid=8364): ERR: Terminated: ERROR {rc=2} [trial-2383↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8364)] 23:27:31.585260 run osmo-msc_10.42.42.6(pid=8364): stdout: | (launched: 2022-12-12_23:27:30.304563) 23:27:31.637328 run osmo-msc_10.42.42.6(pid=8364): stderr: | [0;m[38;5;43m20221212232730626 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212232730626 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f851e508c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212232730627 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212232730627 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212232730627 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212232730627 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212232730629 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212232730629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212232730629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212232730629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:27:31.691506 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8357): Terminating (SIGTERM) 23:27:31.734199 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8360): Terminating (SIGTERM) 23:27:31.777878 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8363): Terminating (SIGTERM) 23:27:31.820882 --- ParallelTerminationStrategy: PID 8357 died... 23:27:31.841174 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8357): Terminated: ok {rc=0} 23:27:31.890212 --- ParallelTerminationStrategy: PID 8360 died... 23:27:31.910168 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8360): Terminated: ok {rc=0} 23:27:31.956592 --- ParallelTerminationStrategy: PID 8363 died... 23:27:31.976590 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8363): Terminated: ok {rc=0} 23:27:32.064378 bus /sierra_3: Setting Powered False 23:27:33.162781 bus /sierra_3: Setting Powered False 23:27:34.277448 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 handover_2G:octphy+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 handover_2G:trx-lms+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 23:27:35.523649 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:27:35.528600 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 23:27:35.586400 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 23:27:35.612316 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 23:27:35.664647 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 23:27:35.722984 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 23:27:35.748807 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 23:27:36.298702 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 23:27:36.303801 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:27:36.314682 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 23:27:36.365482 tst handover.py: using LAC 32251 23:27:36.484388 tst handover.py: using RAC 121 23:27:36.602157 tst handover.py: using CellId 32251 23:27:36.721286 tst handover.py: using BVCI 32252 23:27:36.831118 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 23:27:36.877034 tst handover.py: using LAC 32252 23:27:36.995869 tst handover.py: using RAC 122 23:27:37.114325 tst handover.py: using CellId 32252 23:27:37.239845 tst handover.py: using BVCI 32253 23:27:37.356314 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:27:37.367274 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:27:37.378043 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:27:37.389199 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:27:37.400225 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 23:27:37.413154 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 23:27:37.530855 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 23:27:37.646291 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:27:38.091228 run create_hlr_db(pid=8369): Launched 23:27:38.207669 bus /sierra_2: Setting Powered False 23:27:39.267361 run create_hlr_db(pid=8369): Terminated: ok {rc=0} 23:27:39.681416 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8371): Launched 23:27:40.006842 run osmo-hlr_10.42.42.2(pid=8372): Launched 23:27:40.131271 run osmo-stp_10.42.42.5: Starting osmo-stp 23:27:40.661638 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8374): Launched 23:27:40.984293 run osmo-stp_10.42.42.5(pid=8375): Launched 23:27:41.107832 run osmo-msc_10.42.42.6: Starting osmo-msc 23:27:41.663595 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8377): Launched 23:27:41.986262 run osmo-msc_10.42.42.6(pid=8378): Launched 23:27:42.167024 run osmo-stp_10.42.42.5(pid=8375): ERR: Terminated: ERROR {rc=1} [trial-2383↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8375)] 23:27:42.303615 run osmo-stp_10.42.42.5(pid=8375): stdout: | (launched: 2022-12-12_23:27:40.926097) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:27:42.440475 run osmo-stp_10.42.42.5(pid=8375): stderr: | [0;m[38;5;43m20221212232741118 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212232741118 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212232741119 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212232741119 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212232741120 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212232741120 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212232741120 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:27:42.576886 run osmo-stp_10.42.42.5(pid=8375): stdout: | (launched: 2022-12-12_23:27:40.926097) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:27:42.705657 run osmo-stp_10.42.42.5(pid=8375): stderr: | [0;m[38;5;43m20221212232741118 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212232741118 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212232741119 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212232741119 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212232741120 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212232741120 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212232741120 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:27:42.859255 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8375): Process ended prematurely: osmo-stp_10.42.42.5(pid=8375) [trial-2383↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8375)] [trial-2383↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18] 23:27:42.867797 tst handover.py:18: Test FAILED (6.6 sec) 23:27:42.894750 run osmo-hlr_10.42.42.2(pid=8372): ERR: Terminated: ERROR {rc=237} [trial-2383↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8372)] 23:27:42.943864 run osmo-hlr_10.42.42.2(pid=8372): stdout: | (launched: 2022-12-12_23:27:39.948047) 23:27:42.994765 run osmo-hlr_10.42.42.2(pid=8372): stderr: | [0;m[1;31m20221212232740147 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212232740148 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212232740148 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212232740148 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212232740148 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212232740148 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212232740160 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/handover_2G:trx-lms+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212232740168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212232740168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212232740169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:27:43.065792 run osmo-msc_10.42.42.6(pid=8378): ERR: Terminated: ERROR {rc=2} [trial-2383↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8378)] 23:27:43.114679 run osmo-msc_10.42.42.6(pid=8378): stdout: | (launched: 2022-12-12_23:27:41.927875) 23:27:43.165367 run osmo-msc_10.42.42.6(pid=8378): stderr: | [0;m[38;5;43m20221212232742250 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212232742250 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7faafc22ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212232742250 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212232742250 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212232742250 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212232742250 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212232742252 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212232742252 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212232742253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212232742253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:27:43.216345 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8371): Terminating (SIGTERM) 23:27:43.257079 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8374): Terminating (SIGTERM) 23:27:43.298522 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8377): Terminating (SIGTERM) 23:27:43.339742 --- ParallelTerminationStrategy: PID 8371 died... 23:27:43.359379 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8371): Terminated: ok {rc=0} 23:27:43.404635 --- ParallelTerminationStrategy: PID 8374 died... 23:27:43.423894 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8374): Terminated: ok {rc=0} 23:27:43.468807 --- ParallelTerminationStrategy: PID 8377 died... 23:27:43.488232 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8377): Terminated: ok {rc=0} 23:27:43.573602 bus /sierra_3: Setting Powered False 23:27:44.669034 bus /sierra_3: Setting Powered False 23:27:45.785179 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 handover_2G:trx-lms+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 handover_2G:trx-lms+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 23:27:47.105548 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:27:47.111713 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 23:27:47.176382 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 23:27:47.204695 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 23:27:47.258068 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 23:27:47.322162 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 23:27:47.348181 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 23:27:47.900173 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 handover_2G:trx-lms+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 23:27:47.906516 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:27:47.918337 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 23:27:47.970063 tst handover.py: using LAC 32253 23:27:48.098260 tst handover.py: using RAC 123 23:27:48.225416 tst handover.py: using CellId 32253 23:27:48.351637 tst handover.py: using BVCI 32254 23:27:48.469135 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 23:27:48.518340 tst handover.py: using LAC 32254 23:27:48.646578 tst handover.py: using RAC 124 23:27:48.772732 tst handover.py: using CellId 32254 23:27:48.898817 tst handover.py: using BVCI 32255 23:27:49.015969 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:27:49.027239 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:27:49.038382 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:27:49.049598 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:27:49.060803 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:27:49.071910 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 23:27:49.189579 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 23:27:49.306309 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:27:49.750331 run create_hlr_db(pid=8383): Launched 23:27:49.866688 bus /sierra_2: Setting Powered False 23:27:50.926295 run create_hlr_db(pid=8383): Terminated: ok {rc=0} 23:27:51.339334 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8385): Launched 23:27:51.663203 run osmo-hlr_10.42.42.2(pid=8386): Launched 23:27:51.787662 run osmo-stp_10.42.42.5: Starting osmo-stp 23:27:52.354759 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8388): Launched 23:27:52.677622 run osmo-stp_10.42.42.5(pid=8389): Launched 23:27:52.801226 run osmo-msc_10.42.42.6: Starting osmo-msc 23:27:53.356522 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8391): Launched 23:27:53.678063 run osmo-msc_10.42.42.6(pid=8392): Launched 23:27:53.858736 run osmo-stp_10.42.42.5(pid=8389): ERR: Terminated: ERROR {rc=1} [trial-2383↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8389)] 23:27:53.994775 run osmo-stp_10.42.42.5(pid=8389): stdout: | (launched: 2022-12-12_23:27:52.618944) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:27:54.131588 run osmo-stp_10.42.42.5(pid=8389): stderr: | [0;m[38;5;43m20221212232752812 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212232752812 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212232752812 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212232752813 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212232752813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212232752813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212232752813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:27:54.266934 run osmo-stp_10.42.42.5(pid=8389): stdout: | (launched: 2022-12-12_23:27:52.618944) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:27:54.394929 run osmo-stp_10.42.42.5(pid=8389): stderr: | [0;m[38;5;43m20221212232752812 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212232752812 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212232752812 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212232752813 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212232752813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212232752813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212232752813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:27:54.548142 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8389): Process ended prematurely: osmo-stp_10.42.42.5(pid=8389) [trial-2383↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8389)] [trial-2383↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18] 23:27:54.556766 tst handover.py:18: Test FAILED (6.6 sec) 23:27:54.584177 run osmo-hlr_10.42.42.2(pid=8386): ERR: Terminated: ERROR {rc=237} [trial-2383↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8386)] 23:27:54.633408 run osmo-hlr_10.42.42.2(pid=8386): stdout: | (launched: 2022-12-12_23:27:51.604497) 23:27:54.684527 run osmo-hlr_10.42.42.2(pid=8386): stderr: | [0;m[1;31m20221212232751801 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212232751801 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212232751801 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212232751801 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212232751801 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212232751801 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212232751814 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/handover_2G:trx-lms+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212232751822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212232751822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212232751822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:27:54.755441 run osmo-msc_10.42.42.6(pid=8392): ERR: Terminated: ERROR {rc=2} [trial-2383↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8392)] 23:27:54.804285 run osmo-msc_10.42.42.6(pid=8392): stdout: | (launched: 2022-12-12_23:27:53.619715) 23:27:54.854802 run osmo-msc_10.42.42.6(pid=8392): stderr: | [0;m[38;5;43m20221212232753942 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212232753942 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3a1a8f2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212232753942 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212232753942 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212232753943 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212232753943 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212232753944 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212232753945 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212232753945 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212232753945 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:27:54.905648 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8385): Terminating (SIGTERM) 23:27:54.946466 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8388): Terminating (SIGTERM) 23:27:54.987419 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8391): Terminating (SIGTERM) 23:27:55.028935 --- ParallelTerminationStrategy: PID 8385 died... 23:27:55.048295 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8385): Terminated: ok {rc=0} 23:27:55.093901 --- ParallelTerminationStrategy: PID 8388 died... 23:27:55.113226 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8388): Terminated: ok {rc=0} 23:27:55.158716 --- ParallelTerminationStrategy: PID 8391 died... 23:27:55.178069 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8391): Terminated: ok {rc=0} 23:27:55.264017 bus /sierra_3: Setting Powered False 23:27:56.362389 bus /sierra_3: Setting Powered False 23:27:57.477694 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 handover_2G:trx-lms+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 handover_2G:trx-lms+bts1-sysmo --------------------------------------------------------------------- 23:27:58.750819 tst handover_2G:trx-lms+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:27:58.756324 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x bts (candidates: 11) 23:27:58.807796 tst handover_2G:trx-lms+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 23:27:58.834916 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x modem (candidates: 12) 23:27:58.887194 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x bts (candidates: 11) 23:27:58.938478 tst handover_2G:trx-lms+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 23:27:58.965485 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x modem (candidates: 12) 23:27:59.516584 tst handover_2G:trx-lms+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 handover_2G:trx-lms+bts1-sysmo handover.py ---------------------------------------------- 23:27:59.522002 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:27:59.533099 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 23:27:59.581677 tst handover.py: using LAC 32255 23:27:59.702818 tst handover.py: using RAC 125 23:27:59.824065 tst handover.py: using CellId 32255 23:27:59.945389 tst handover.py: using BVCI 32256 23:28:00.055791 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 23:28:00.090563 tst handover.py: using LAC 32256 23:28:00.211459 tst handover.py: using RAC 126 23:28:00.334749 tst handover.py: using CellId 32256 23:28:00.453556 tst handover.py: using BVCI 32257 23:28:00.566140 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:28:00.576816 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:28:00.587301 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:28:00.598048 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:28:00.608871 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:28:00.619643 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 23:28:00.740090 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 23:28:00.862995 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:28:01.365687 run create_hlr_db(pid=8397): Launched 23:28:01.516632 bus /sierra_2: Setting Powered False 23:28:02.576703 run create_hlr_db(pid=8397): Terminated: ok {rc=0} 23:28:02.993834 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8399): Launched 23:28:03.317487 run osmo-hlr_10.42.42.2(pid=8400): Launched 23:28:03.442561 run osmo-stp_10.42.42.5: Starting osmo-stp 23:28:03.975148 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8402): Launched 23:28:04.297976 run osmo-stp_10.42.42.5(pid=8403): Launched 23:28:04.421933 run osmo-msc_10.42.42.6: Starting osmo-msc 23:28:04.979512 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8405): Launched 23:28:05.302787 run osmo-msc_10.42.42.6(pid=8406): Launched 23:28:05.484848 run osmo-stp_10.42.42.5(pid=8403): ERR: Terminated: ERROR {rc=1} [trial-2383↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8403)] 23:28:05.622569 run osmo-stp_10.42.42.5(pid=8403): stdout: | (launched: 2022-12-12_23:28:04.239649) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:28:05.760602 run osmo-stp_10.42.42.5(pid=8403): stderr: | [0;m[38;5;43m20221212232804431 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212232804431 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212232804431 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212232804433 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212232804433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212232804433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212232804433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:28:05.896399 run osmo-stp_10.42.42.5(pid=8403): stdout: | (launched: 2022-12-12_23:28:04.239649) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:28:06.025208 run osmo-stp_10.42.42.5(pid=8403): stderr: | [0;m[38;5;43m20221212232804431 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212232804431 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212232804431 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212232804433 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212232804433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212232804433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212232804433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:28:06.179165 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8403): Process ended prematurely: osmo-stp_10.42.42.5(pid=8403) [trial-2383↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8403)] [trial-2383↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18] 23:28:06.187950 tst handover.py:18: Test FAILED (6.7 sec) 23:28:06.215243 run osmo-hlr_10.42.42.2(pid=8400): ERR: Terminated: ERROR {rc=237} [trial-2383↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8400)] 23:28:06.265099 run osmo-hlr_10.42.42.2(pid=8400): stdout: | (launched: 2022-12-12_23:28:03.258900) 23:28:06.316659 run osmo-hlr_10.42.42.2(pid=8400): stderr: | [0;m[1;31m20221212232803459 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212232803459 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212232803459 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212232803459 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212232803459 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212232803459 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212232803471 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/handover_2G:trx-lms+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212232803480 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212232803480 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212232803480 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:28:06.388594 run osmo-msc_10.42.42.6(pid=8406): ERR: Terminated: ERROR {rc=2} [trial-2383↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8406)] 23:28:06.438239 run osmo-msc_10.42.42.6(pid=8406): stdout: | (launched: 2022-12-12_23:28:05.244233) 23:28:06.489749 run osmo-msc_10.42.42.6(pid=8406): stderr: | [0;m[38;5;43m20221212232805566 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212232805566 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff68bb05c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212232805566 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212232805566 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212232805566 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212232805567 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212232805568 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212232805569 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212232805569 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212232805569 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:28:06.541447 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8399): Terminating (SIGTERM) 23:28:06.583093 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8402): Terminating (SIGTERM) 23:28:06.624759 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8405): Terminating (SIGTERM) 23:28:06.666732 --- ParallelTerminationStrategy: PID 8399 died... 23:28:06.686746 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8399): Terminated: ok {rc=0} 23:28:06.733047 --- ParallelTerminationStrategy: PID 8402 died... 23:28:06.752679 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8402): Terminated: ok {rc=0} 23:28:06.798699 --- ParallelTerminationStrategy: PID 8405 died... 23:28:06.818062 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8405): Terminated: ok {rc=0} 23:28:06.904692 bus /sierra_3: Setting Powered False 23:28:08.003182 bus /sierra_3: Setting Powered False 23:28:09.117667 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 handover_2G:trx-lms+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 handover_2G:trx-lms+bts1-trx-b200 --------------------------------------------------------------------- 23:28:10.369823 tst handover_2G:trx-lms+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:28:10.376525 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 23:28:10.440118 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 23:28:10.467243 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 23:28:10.521792 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 23:28:10.584926 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 23:28:10.611277 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 23:28:11.157908 tst handover_2G:trx-lms+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 handover_2G:trx-lms+bts1-trx-b200 handover.py ---------------------------------------------- 23:28:11.163209 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:28:11.174209 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 23:28:11.221461 tst handover.py: using LAC 32257 23:28:11.350166 tst handover.py: using RAC 127 23:28:11.477471 tst handover.py: using CellId 32257 23:28:11.609500 tst handover.py: using BVCI 32258 23:28:11.728645 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 23:28:11.776353 tst handover.py: using LAC 32258 23:28:11.903263 tst handover.py: using RAC 128 23:28:12.027881 tst handover.py: using CellId 32258 23:28:12.147764 tst handover.py: using BVCI 32259 23:28:12.258351 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:28:12.269345 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:28:12.279917 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:28:12.291132 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:28:12.302515 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:28:12.313648 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 23:28:12.428407 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 23:28:12.547660 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:28:13.023819 run create_hlr_db(pid=8411): Launched 23:28:13.155824 bus /sierra_2: Setting Powered False 23:28:14.219467 run create_hlr_db(pid=8411): Terminated: ok {rc=0} 23:28:14.628390 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8413): Launched 23:28:14.934892 run osmo-hlr_10.42.42.2(pid=8414): Launched 23:28:15.053165 run osmo-stp_10.42.42.5: Starting osmo-stp 23:28:15.571633 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8416): Launched 23:28:15.905644 run osmo-stp_10.42.42.5(pid=8417): Launched 23:28:16.126100 run osmo-msc_10.42.42.6: Starting osmo-msc 23:28:16.877664 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8419): Launched 23:28:17.220031 run osmo-msc_10.42.42.6(pid=8420): Launched 23:28:17.451216 run osmo-stp_10.42.42.5(pid=8417): ERR: Terminated: ERROR {rc=1} [trial-2383↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8417)] 23:28:17.584298 run osmo-stp_10.42.42.5(pid=8417): stdout: | (launched: 2022-12-12_23:28:15.822072) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:28:17.713429 run osmo-stp_10.42.42.5(pid=8417): stderr: | [0;m[38;5;43m20221212232816220 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212232816220 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212232816221 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212232816222 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212232816225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212232816225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212232816225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:28:17.841501 run osmo-stp_10.42.42.5(pid=8417): stdout: | (launched: 2022-12-12_23:28:15.822072) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:28:17.963437 run osmo-stp_10.42.42.5(pid=8417): stderr: | [0;m[38;5;43m20221212232816220 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212232816220 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212232816221 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212232816222 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212232816225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212232816225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212232816225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:28:18.109124 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8417): Process ended prematurely: osmo-stp_10.42.42.5(pid=8417) [trial-2383↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8417)] [trial-2383↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18] 23:28:18.117314 tst handover.py:18: Test FAILED (6.9 sec) 23:28:18.143464 run osmo-hlr_10.42.42.2(pid=8414): ERR: Terminated: ERROR {rc=237} [trial-2383↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8414)] 23:28:18.191489 run osmo-hlr_10.42.42.2(pid=8414): stdout: | (launched: 2022-12-12_23:28:14.879543) 23:28:18.241123 run osmo-hlr_10.42.42.2(pid=8414): stderr: | [0;m[1;31m20221212232815054 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212232815055 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212232815055 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212232815055 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212232815055 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212232815055 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212232815068 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/handover_2G:trx-lms+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212232815076 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212232815077 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212232815077 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:28:18.310191 run osmo-msc_10.42.42.6(pid=8420): ERR: Terminated: ERROR {rc=2} [trial-2383↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8420)] 23:28:18.358091 run osmo-msc_10.42.42.6(pid=8420): stdout: | (launched: 2022-12-12_23:28:17.149796) 23:28:18.407487 run osmo-msc_10.42.42.6(pid=8420): stderr: | [0;m[38;5;43m20221212232817451 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212232817451 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd1431d5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212232817451 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212232817451 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212232817452 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212232817452 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212232817454 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212232817454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212232817454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212232817454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:28:18.457385 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8413): Terminating (SIGTERM) 23:28:18.497381 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8416): Terminating (SIGTERM) 23:28:18.537633 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8419): Terminating (SIGTERM) 23:28:18.577944 --- ParallelTerminationStrategy: PID 8413 died... 23:28:18.597218 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8413): Terminated: ok {rc=0} 23:28:18.641876 --- ParallelTerminationStrategy: PID 8416 died... 23:28:18.660370 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8416): Terminated: ok {rc=0} 23:28:18.704711 --- ParallelTerminationStrategy: PID 8419 died... 23:28:18.723280 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8419): Terminated: ok {rc=0} 23:28:18.808781 bus /sierra_3: Setting Powered False 23:28:19.907354 bus /sierra_3: Setting Powered False 23:28:21.022462 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 handover_2G:trx-lms+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 handover_2G:trx-lms+bts1-trx-umtrx --------------------------------------------------------------------- 23:28:22.288759 tst handover_2G:trx-lms+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:28:22.293931 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 23:28:22.355286 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 23:28:22.381400 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 23:28:22.434781 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 23:28:22.499266 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 23:28:22.526474 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 23:28:23.069292 tst handover_2G:trx-lms+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 handover_2G:trx-lms+bts1-trx-umtrx handover.py ---------------------------------------------- 23:28:23.074389 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:28:23.085208 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 23:28:23.132588 tst handover.py: using LAC 32259 23:28:23.251498 tst handover.py: using RAC 129 23:28:23.373145 tst handover.py: using CellId 32259 23:28:23.500819 tst handover.py: using BVCI 32260 23:28:23.619178 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 23:28:23.667666 tst handover.py: using LAC 32260 23:28:23.789306 tst handover.py: using RAC 130 23:28:23.911721 tst handover.py: using CellId 32260 23:28:24.033857 tst handover.py: using BVCI 32261 23:28:24.145758 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:28:24.156444 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:28:24.167107 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:28:24.178493 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:28:24.189866 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:28:24.201112 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 23:28:24.322088 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 23:28:24.440045 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:28:24.886276 run create_hlr_db(pid=8425): Launched 23:28:25.002440 bus /sierra_2: Setting Powered False 23:28:26.062614 run create_hlr_db(pid=8425): Terminated: ok {rc=0} 23:28:26.459184 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8427): Launched 23:28:26.763078 run osmo-hlr_10.42.42.2(pid=8428): Launched 23:28:26.879609 run osmo-stp_10.42.42.5: Starting osmo-stp 23:28:27.394293 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8430): Launched 23:28:27.699538 run osmo-stp_10.42.42.5(pid=8431): Launched 23:28:27.816665 run osmo-msc_10.42.42.6: Starting osmo-msc 23:28:28.351565 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8433): Launched 23:28:28.675423 run osmo-msc_10.42.42.6(pid=8434): Launched 23:28:28.856500 run osmo-stp_10.42.42.5(pid=8431): ERR: Terminated: ERROR {rc=1} [trial-2383↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8431)] 23:28:28.993306 run osmo-stp_10.42.42.5(pid=8431): stdout: | (launched: 2022-12-12_23:28:27.641867) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:28:29.130431 run osmo-stp_10.42.42.5(pid=8431): stderr: | [0;m[38;5;43m20221212232827812 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212232827813 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212232827813 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212232827813 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212232827814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212232827814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212232827814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:28:29.265346 run osmo-stp_10.42.42.5(pid=8431): stdout: | (launched: 2022-12-12_23:28:27.641867) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:28:29.393622 run osmo-stp_10.42.42.5(pid=8431): stderr: | [0;m[38;5;43m20221212232827812 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212232827813 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212232827813 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212232827813 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212232827814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212232827814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212232827814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:28:29.547375 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8431): Process ended prematurely: osmo-stp_10.42.42.5(pid=8431) [trial-2383↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8431)] [trial-2383↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18] 23:28:29.555936 tst handover.py:18: Test FAILED (6.5 sec) 23:28:29.583466 run osmo-hlr_10.42.42.2(pid=8428): ERR: Terminated: ERROR {rc=237} [trial-2383↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8428)] 23:28:29.633127 run osmo-hlr_10.42.42.2(pid=8428): stdout: | (launched: 2022-12-12_23:28:26.708016) 23:28:29.684085 run osmo-hlr_10.42.42.2(pid=8428): stderr: | [0;m[1;31m20221212232826885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212232826885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212232826885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212232826885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212232826885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212232826885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212232826896 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/handover_2G:trx-lms+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212232826905 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212232826905 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212232826905 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:28:29.755766 run osmo-msc_10.42.42.6(pid=8434): ERR: Terminated: ERROR {rc=2} [trial-2383↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8434)] 23:28:29.805150 run osmo-msc_10.42.42.6(pid=8434): stdout: | (launched: 2022-12-12_23:28:28.616837) 23:28:29.855891 run osmo-msc_10.42.42.6(pid=8434): stderr: | [0;m[38;5;43m20221212232828936 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212232828937 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0e7ab92c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212232828937 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212232828937 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212232828937 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212232828937 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212232828939 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212232828939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212232828939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212232828939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:28:29.907099 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8427): Terminating (SIGTERM) 23:28:29.948280 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8430): Terminating (SIGTERM) 23:28:29.989625 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8433): Terminating (SIGTERM) 23:28:30.031081 --- ParallelTerminationStrategy: PID 8427 died... 23:28:30.050906 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8427): Terminated: ok {rc=0} 23:28:30.096570 --- ParallelTerminationStrategy: PID 8430 died... 23:28:30.115969 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8430): Terminated: ok {rc=0} 23:28:30.161342 --- ParallelTerminationStrategy: PID 8433 died... 23:28:30.180735 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8433): Terminated: ok {rc=0} 23:28:30.267361 bus /sierra_3: Setting Powered False 23:28:31.363413 bus /sierra_3: Setting Powered False 23:28:32.475195 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 handover_2G:trx-lms+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 23:28:33.747443 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:28:33.753237 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 23:28:33.813669 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 23:28:33.840826 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 23:28:33.894010 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 23:28:33.955099 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 23:28:33.982120 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 23:28:34.534876 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 23:28:34.540217 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:28:34.551850 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 23:28:34.596459 tst handover.py: using LAC 32261 23:28:34.723897 tst handover.py: using RAC 131 23:28:34.852439 tst handover.py: using CellId 32261 23:28:34.980456 tst handover.py: using BVCI 32262 23:28:35.098038 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 23:28:35.148895 tst handover.py: using LAC 32262 23:28:35.278168 tst handover.py: using RAC 132 23:28:35.410188 tst handover.py: using CellId 32262 23:28:35.537193 tst handover.py: using BVCI 32263 23:28:35.655053 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:28:35.666615 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:28:35.677999 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:28:35.689396 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:28:35.700773 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:28:35.712530 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 23:28:35.832362 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 23:28:35.949018 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:28:36.422870 run create_hlr_db(pid=8439): Launched 23:28:36.553444 bus /sierra_2: Setting Powered False 23:28:37.617947 run create_hlr_db(pid=8439): Terminated: ok {rc=0} 23:28:38.040447 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8441): Launched 23:28:38.362815 run osmo-hlr_10.42.42.2(pid=8442): Launched 23:28:38.486558 run osmo-stp_10.42.42.5: Starting osmo-stp 23:28:39.015615 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8444): Launched 23:28:39.339046 run osmo-stp_10.42.42.5(pid=8445): Launched 23:28:39.462523 run osmo-msc_10.42.42.6: Starting osmo-msc 23:28:40.021070 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8447): Launched 23:28:40.344039 run osmo-msc_10.42.42.6(pid=8448): Launched 23:28:40.525393 run osmo-stp_10.42.42.5(pid=8445): ERR: Terminated: ERROR {rc=1} [trial-2383↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8445)] 23:28:40.661900 run osmo-stp_10.42.42.5(pid=8445): stdout: | (launched: 2022-12-12_23:28:39.280421) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:28:40.799245 run osmo-stp_10.42.42.5(pid=8445): stderr: | [0;m[38;5;43m20221212232839475 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212232839475 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212232839475 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212232839476 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212232839476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212232839476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212232839476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:28:40.935285 run osmo-stp_10.42.42.5(pid=8445): stdout: | (launched: 2022-12-12_23:28:39.280421) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:28:41.064265 run osmo-stp_10.42.42.5(pid=8445): stderr: | [0;m[38;5;43m20221212232839475 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212232839475 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212232839475 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212232839476 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212232839476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212232839476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212232839476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:28:41.218310 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8445): Process ended prematurely: osmo-stp_10.42.42.5(pid=8445) [trial-2383↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8445)] [trial-2383↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18] 23:28:41.226896 tst handover.py:18: Test FAILED (6.7 sec) 23:28:41.253981 run osmo-hlr_10.42.42.2(pid=8442): ERR: Terminated: ERROR {rc=237} [trial-2383↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8442)] 23:28:41.303374 run osmo-hlr_10.42.42.2(pid=8442): stdout: | (launched: 2022-12-12_23:28:38.304277) 23:28:41.354702 run osmo-hlr_10.42.42.2(pid=8442): stderr: | [0;m[1;31m20221212232838504 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212232838504 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212232838504 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212232838504 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212232838504 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212232838504 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212232838517 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212232838525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212232838526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212232838526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:28:41.425861 run osmo-msc_10.42.42.6(pid=8448): ERR: Terminated: ERROR {rc=2} [trial-2383↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8448)] 23:28:41.475065 run osmo-msc_10.42.42.6(pid=8448): stdout: | (launched: 2022-12-12_23:28:40.285426) 23:28:41.526081 run osmo-msc_10.42.42.6(pid=8448): stderr: | [0;m[38;5;43m20221212232840610 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212232840610 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f03a3f3ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212232840611 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212232840611 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212232840611 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212232840611 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212232840613 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212232840613 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212232840613 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212232840613 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:28:41.577641 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8441): Terminating (SIGTERM) 23:28:41.618535 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8444): Terminating (SIGTERM) 23:28:41.659622 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8447): Terminating (SIGTERM) 23:28:41.700854 --- ParallelTerminationStrategy: PID 8441 died... 23:28:41.720597 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8441): Terminated: ok {rc=0} 23:28:41.766023 --- ParallelTerminationStrategy: PID 8444 died... 23:28:41.785151 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8444): Terminated: ok {rc=0} 23:28:41.830222 --- ParallelTerminationStrategy: PID 8447 died... 23:28:41.849451 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8447): Terminated: ok {rc=0} 23:28:41.935771 bus /sierra_3: Setting Powered False 23:28:43.031983 bus /sierra_3: Setting Powered False 23:28:44.148297 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 handover_2G:trx-lms-limenet-micro+bts1-sysmo --------------------------------------------------------------------- 23:28:45.417934 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:28:45.423417 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x bts (candidates: 11) 23:28:45.470506 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 23:28:45.497583 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x modem (candidates: 12) 23:28:45.550797 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x bts (candidates: 11) 23:28:45.598659 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 23:28:45.625912 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x modem (candidates: 12) 23:28:46.197300 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover.py ---------------------------------------------- 23:28:46.206329 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:28:46.221496 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 23:28:46.281267 tst handover.py: using LAC 32263 23:28:46.413747 tst handover.py: using RAC 133 23:28:46.572093 tst handover.py: using CellId 32263 23:28:46.702203 tst handover.py: using BVCI 32264 23:28:46.853898 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 23:28:46.895705 tst handover.py: using LAC 32264 23:28:47.054376 tst handover.py: using RAC 134 23:28:47.177516 tst handover.py: using CellId 32264 23:28:47.321060 tst handover.py: using BVCI 32265 23:28:47.440436 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:28:47.451918 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:28:47.463129 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:28:47.474381 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:28:47.485700 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:28:47.496886 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 23:28:47.613482 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 23:28:47.735024 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:28:48.208251 run create_hlr_db(pid=8453): Launched 23:28:48.339126 bus /sierra_2: Setting Powered False 23:28:49.404094 run create_hlr_db(pid=8453): Terminated: ok {rc=0} 23:28:49.809884 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8455): Launched 23:28:50.112531 run osmo-hlr_10.42.42.2(pid=8456): Launched 23:28:50.229115 run osmo-stp_10.42.42.5: Starting osmo-stp 23:28:50.738788 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8458): Launched 23:28:51.042376 run osmo-stp_10.42.42.5(pid=8459): Launched 23:28:51.159078 run osmo-msc_10.42.42.6: Starting osmo-msc 23:28:51.681967 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8461): Launched 23:28:51.984574 run osmo-msc_10.42.42.6(pid=8462): Launched 23:28:52.155196 run osmo-stp_10.42.42.5(pid=8459): ERR: Terminated: ERROR {rc=1} [trial-2383↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8459)] 23:28:52.284267 run osmo-stp_10.42.42.5(pid=8459): stdout: | (launched: 2022-12-12_23:28:50.987111) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:28:52.412866 run osmo-stp_10.42.42.5(pid=8459): stderr: | [0;m[38;5;43m20221212232851157 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212232851157 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212232851158 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212232851158 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212232851159 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212232851159 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212232851159 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:28:52.539522 run osmo-stp_10.42.42.5(pid=8459): stdout: | (launched: 2022-12-12_23:28:50.987111) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:28:52.660004 run osmo-stp_10.42.42.5(pid=8459): stderr: | [0;m[38;5;43m20221212232851157 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212232851157 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212232851158 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212232851158 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212232851159 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212232851159 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212232851159 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:28:52.804154 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8459): Process ended prematurely: osmo-stp_10.42.42.5(pid=8459) [trial-2383↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8459)] [trial-2383↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18] 23:28:52.812541 tst handover.py:18: Test FAILED (6.6 sec) 23:28:52.838830 run osmo-hlr_10.42.42.2(pid=8456): ERR: Terminated: ERROR {rc=237} [trial-2383↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8456)] 23:28:52.886753 run osmo-hlr_10.42.42.2(pid=8456): stdout: | (launched: 2022-12-12_23:28:50.057352) 23:28:52.935806 run osmo-hlr_10.42.42.2(pid=8456): stderr: | [0;m[1;31m20221212232850234 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212232850234 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212232850234 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212232850234 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212232850234 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212232850234 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212232850246 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/handover_2G:trx-lms-limenet-micro+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212232850255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212232850255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212232850255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:28:53.003401 run osmo-msc_10.42.42.6(pid=8462): ERR: Terminated: ERROR {rc=2} [trial-2383↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8462)] 23:28:53.050357 run osmo-msc_10.42.42.6(pid=8462): stdout: | (launched: 2022-12-12_23:28:51.929628) 23:28:53.098962 run osmo-msc_10.42.42.6(pid=8462): stderr: | [0;m[38;5;43m20221212232852202 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212232852202 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f49f3d84c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212232852202 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212232852202 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212232852202 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212232852203 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212232852204 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212232852205 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212232852205 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212232852205 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:28:53.148321 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8455): Terminating (SIGTERM) 23:28:53.187121 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8458): Terminating (SIGTERM) 23:28:53.226547 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8461): Terminating (SIGTERM) 23:28:53.265975 --- ParallelTerminationStrategy: PID 8455 died... 23:28:53.284155 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8455): Terminated: ok {rc=0} 23:28:53.327994 --- ParallelTerminationStrategy: PID 8458 died... 23:28:53.346249 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8458): Terminated: ok {rc=0} 23:28:53.389827 --- ParallelTerminationStrategy: PID 8461 died... 23:28:53.408087 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8461): Terminated: ok {rc=0} 23:28:53.490089 bus /sierra_3: Setting Powered False 23:28:54.586981 bus /sierra_3: Setting Powered False 23:28:55.705531 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 handover_2G:trx-lms-limenet-micro+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 --------------------------------------------------------------------- 23:28:56.952762 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:28:56.957884 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 23:28:57.016056 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 23:28:57.042352 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 23:28:57.093342 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 23:28:57.151976 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 23:28:57.178088 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 23:28:57.728070 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover.py ---------------------------------------------- 23:28:57.733192 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:28:57.744087 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 23:28:57.788766 tst handover.py: using LAC 32265 23:28:57.908186 tst handover.py: using RAC 135 23:28:58.027241 tst handover.py: using CellId 32265 23:28:58.148027 tst handover.py: using BVCI 32266 23:28:58.259946 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 23:28:58.307511 tst handover.py: using LAC 32266 23:28:58.427387 tst handover.py: using RAC 136 23:28:58.558002 tst handover.py: using CellId 32266 23:28:58.690392 tst handover.py: using BVCI 32267 23:28:58.810244 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:28:58.821700 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:28:58.832867 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:28:58.844774 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:28:58.856708 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:28:58.868536 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 23:28:58.989954 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 23:28:59.106878 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:28:59.553311 run create_hlr_db(pid=8467): Launched 23:28:59.671537 bus /sierra_2: Setting Powered False 23:29:00.732286 run create_hlr_db(pid=8467): Terminated: ok {rc=0} 23:29:01.173762 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8469): Launched 23:29:01.518763 run osmo-hlr_10.42.42.2(pid=8470): Launched 23:29:01.768425 run osmo-stp_10.42.42.5: Starting osmo-stp 23:29:02.405200 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8472): Launched 23:29:02.729705 run osmo-stp_10.42.42.5(pid=8473): Launched 23:29:02.854155 run osmo-msc_10.42.42.6: Starting osmo-msc 23:29:03.415513 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8475): Launched 23:29:03.741182 run osmo-msc_10.42.42.6(pid=8476): Launched 23:29:03.922615 run osmo-stp_10.42.42.5(pid=8473): ERR: Terminated: ERROR {rc=1} [trial-2383↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8473)] 23:29:04.059362 run osmo-stp_10.42.42.5(pid=8473): stdout: | (launched: 2022-12-12_23:29:02.670881) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:29:04.196761 run osmo-stp_10.42.42.5(pid=8473): stderr: | [0;m[38;5;43m20221212232902862 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212232902862 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212232902862 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212232902863 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212232902863 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212232902863 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212232902863 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:29:04.333389 run osmo-stp_10.42.42.5(pid=8473): stdout: | (launched: 2022-12-12_23:29:02.670881) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:29:04.462545 run osmo-stp_10.42.42.5(pid=8473): stderr: | [0;m[38;5;43m20221212232902862 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212232902862 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212232902862 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212232902863 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212232902863 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212232902863 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212232902863 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:29:04.617096 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8473): Process ended prematurely: osmo-stp_10.42.42.5(pid=8473) [trial-2383↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8473)] [trial-2383↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18] 23:29:04.625862 tst handover.py:18: Test FAILED (6.9 sec) 23:29:04.652828 run osmo-hlr_10.42.42.2(pid=8470): ERR: Terminated: ERROR {rc=237} [trial-2383↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8470)] 23:29:04.702678 run osmo-hlr_10.42.42.2(pid=8470): stdout: | (launched: 2022-12-12_23:29:01.451139) 23:29:04.754072 run osmo-hlr_10.42.42.2(pid=8470): stderr: | [0;m[1;31m20221212232901769 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212232901769 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212232901769 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212232901769 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212232901769 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212232901769 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212232901790 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/handover_2G:trx-lms-limenet-micro+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212232901802 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212232901802 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212232901802 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:29:04.825611 run osmo-msc_10.42.42.6(pid=8476): ERR: Terminated: ERROR {rc=2} [trial-2383↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8476)] 23:29:04.874755 run osmo-msc_10.42.42.6(pid=8476): stdout: | (launched: 2022-12-12_23:29:03.681980) 23:29:04.925652 run osmo-msc_10.42.42.6(pid=8476): stderr: | [0;m[38;5;43m20221212232904004 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212232904004 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f658364ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212232904005 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212232904005 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212232904005 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212232904005 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212232904007 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212232904007 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212232904007 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212232904007 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:29:04.976905 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8469): Terminating (SIGTERM) 23:29:05.018134 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8472): Terminating (SIGTERM) 23:29:05.059290 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8475): Terminating (SIGTERM) 23:29:05.100856 --- ParallelTerminationStrategy: PID 8469 died... 23:29:05.120726 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8469): Terminated: ok {rc=0} 23:29:05.166341 --- ParallelTerminationStrategy: PID 8472 died... 23:29:05.185740 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8472): Terminated: ok {rc=0} 23:29:05.231890 --- ParallelTerminationStrategy: PID 8475 died... 23:29:05.251285 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8475): Terminated: ok {rc=0} 23:29:05.337561 bus /sierra_3: Setting Powered False 23:29:06.436287 bus /sierra_3: Setting Powered False 23:29:07.552110 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx --------------------------------------------------------------------- 23:29:08.817539 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:29:08.823729 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 23:29:08.882787 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 23:29:08.909808 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 23:29:08.962825 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 23:29:09.021646 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 23:29:09.048536 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 23:29:09.597416 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover.py ---------------------------------------------- 23:29:09.602760 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:29:09.613866 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 23:29:09.658047 tst handover.py: using LAC 32267 23:29:09.780084 tst handover.py: using RAC 137 23:29:09.901372 tst handover.py: using CellId 32267 23:29:10.022371 tst handover.py: using BVCI 32268 23:29:10.134794 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 23:29:10.181453 tst handover.py: using LAC 32268 23:29:10.309344 tst handover.py: using RAC 138 23:29:10.437447 tst handover.py: using CellId 32268 23:29:10.564691 tst handover.py: using BVCI 32269 23:29:10.684917 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:29:10.696514 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:29:10.707880 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:29:10.719223 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:29:10.730856 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:29:10.742190 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 23:29:10.859340 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 23:29:10.975847 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:29:11.423010 run create_hlr_db(pid=8481): Launched 23:29:11.539520 bus /sierra_2: Setting Powered False 23:29:12.601127 run create_hlr_db(pid=8481): Terminated: ok {rc=0} 23:29:13.016942 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8483): Launched 23:29:13.342034 run osmo-hlr_10.42.42.2(pid=8484): Launched 23:29:13.466424 run osmo-stp_10.42.42.5: Starting osmo-stp 23:29:13.997509 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8486): Launched 23:29:14.322733 run osmo-stp_10.42.42.5(pid=8487): Launched 23:29:14.447023 run osmo-msc_10.42.42.6: Starting osmo-msc 23:29:15.005764 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8489): Launched 23:29:15.331699 run osmo-msc_10.42.42.6(pid=8490): Launched 23:29:15.512469 run osmo-stp_10.42.42.5(pid=8487): ERR: Terminated: ERROR {rc=1} [trial-2383↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8487)] 23:29:15.649560 run osmo-stp_10.42.42.5(pid=8487): stdout: | (launched: 2022-12-12_23:29:14.263806) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:29:15.786830 run osmo-stp_10.42.42.5(pid=8487): stderr: | [0;m[38;5;43m20221212232914457 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212232914457 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212232914457 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212232914458 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212232914458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212232914458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212232914458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:29:15.943090 run osmo-stp_10.42.42.5(pid=8487): stdout: | (launched: 2022-12-12_23:29:14.263806) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:29:16.073921 run osmo-stp_10.42.42.5(pid=8487): stderr: | [0;m[38;5;43m20221212232914457 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212232914457 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212232914457 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212232914458 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212232914458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212232914458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212232914458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:29:16.230487 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8487): Process ended prematurely: osmo-stp_10.42.42.5(pid=8487) [trial-2383↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8487)] [trial-2383↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18] 23:29:16.240189 tst handover.py:18: Test FAILED (6.6 sec) 23:29:16.268785 run osmo-hlr_10.42.42.2(pid=8484): ERR: Terminated: ERROR {rc=237} [trial-2383↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8484)] 23:29:16.319514 run osmo-hlr_10.42.42.2(pid=8484): stdout: | (launched: 2022-12-12_23:29:13.283036) 23:29:16.372056 run osmo-hlr_10.42.42.2(pid=8484): stderr: | [0;m[1;31m20221212232913483 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212232913484 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212232913484 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212232913484 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212232913484 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212232913484 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212232913500 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212232913509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212232913509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212232913509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:29:16.444890 run osmo-msc_10.42.42.6(pid=8490): ERR: Terminated: ERROR {rc=2} [trial-2383↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8490)] 23:29:16.495239 run osmo-msc_10.42.42.6(pid=8490): stdout: | (launched: 2022-12-12_23:29:15.271986) 23:29:16.547399 run osmo-msc_10.42.42.6(pid=8490): stderr: | [0;m[38;5;43m20221212232915596 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212232915596 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f80bbfadc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212232915596 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212232915596 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212232915596 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212232915597 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212232915598 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212232915599 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212232915599 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212232915599 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:29:16.600531 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8483): Terminating (SIGTERM) 23:29:16.643533 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8486): Terminating (SIGTERM) 23:29:16.687419 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8489): Terminating (SIGTERM) 23:29:16.730214 --- ParallelTerminationStrategy: PID 8483 died... 23:29:16.750390 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8483): Terminated: ok {rc=0} 23:29:16.796903 --- ParallelTerminationStrategy: PID 8486 died... 23:29:16.817331 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8486): Terminated: ok {rc=0} 23:29:16.865155 --- ParallelTerminationStrategy: PID 8489 died... 23:29:16.885494 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8489): Terminated: ok {rc=0} 23:29:16.975079 bus /sierra_3: Setting Powered False 23:29:18.072908 bus /sierra_3: Setting Powered False 23:29:19.184684 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 handover_2G:trx-sysmocell5000+bts1-sysmo --------------------------------------------------------------------- 23:29:20.457397 tst handover_2G:trx-sysmocell5000+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:29:20.462806 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x bts (candidates: 11) 23:29:20.515047 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 23:29:20.542130 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x modem (candidates: 12) 23:29:20.592463 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x bts (candidates: 11) 23:29:20.644345 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 23:29:20.671471 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x modem (candidates: 12) 23:29:21.221263 tst handover_2G:trx-sysmocell5000+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 handover_2G:trx-sysmocell5000+bts1-sysmo handover.py ---------------------------------------------- 23:29:21.226578 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:29:21.237500 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 23:29:21.285995 tst handover.py: using LAC 32269 23:29:21.406804 tst handover.py: using RAC 139 23:29:21.524676 tst handover.py: using CellId 32269 23:29:21.642681 tst handover.py: using BVCI 32270 23:29:21.753503 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 23:29:21.786349 tst handover.py: using LAC 32270 23:29:21.903640 tst handover.py: using RAC 140 23:29:22.025226 tst handover.py: using CellId 32270 23:29:22.143936 tst handover.py: using BVCI 32271 23:29:22.254648 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:29:22.265613 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:29:22.276087 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:29:22.286743 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:29:22.298014 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 23:29:22.308932 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 23:29:22.428165 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 23:29:22.546156 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:29:22.992439 run create_hlr_db(pid=8495): Launched 23:29:23.109924 bus /sierra_2: Setting Powered False 23:29:24.170277 run create_hlr_db(pid=8495): Terminated: ok {rc=0} 23:29:24.569187 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8497): Launched 23:29:24.874707 run osmo-hlr_10.42.42.2(pid=8498): Launched 23:29:24.992221 run osmo-stp_10.42.42.5: Starting osmo-stp 23:29:25.505833 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8500): Launched 23:29:25.811478 run osmo-stp_10.42.42.5(pid=8501): Launched 23:29:25.928526 run osmo-msc_10.42.42.6: Starting osmo-msc 23:29:26.454093 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8503): Launched 23:29:26.759502 run osmo-msc_10.42.42.6(pid=8504): Launched 23:29:26.931308 run osmo-stp_10.42.42.5(pid=8501): ERR: Terminated: ERROR {rc=1} [trial-2383↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8501)] 23:29:27.061131 run osmo-stp_10.42.42.5(pid=8501): stdout: | (launched: 2022-12-12_23:29:25.755666) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:29:27.191090 run osmo-stp_10.42.42.5(pid=8501): stderr: | [0;m[38;5;43m20221212232925928 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212232925928 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212232925929 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212232925929 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212232925929 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212232925930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212232925930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:29:27.318558 run osmo-stp_10.42.42.5(pid=8501): stdout: | (launched: 2022-12-12_23:29:25.755666) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:29:27.440399 run osmo-stp_10.42.42.5(pid=8501): stderr: | [0;m[38;5;43m20221212232925928 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212232925928 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212232925929 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212232925929 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212232925929 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212232925930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212232925930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:29:27.585828 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8501): Process ended prematurely: osmo-stp_10.42.42.5(pid=8501) [trial-2383↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8501)] [trial-2383↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18] 23:29:27.593920 tst handover.py:18: Test FAILED (6.4 sec) 23:29:27.619693 run osmo-hlr_10.42.42.2(pid=8498): ERR: Terminated: ERROR {rc=237} [trial-2383↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8498)] 23:29:27.667548 run osmo-hlr_10.42.42.2(pid=8498): stdout: | (launched: 2022-12-12_23:29:24.818460) 23:29:27.716553 run osmo-hlr_10.42.42.2(pid=8498): stderr: | [0;m[1;31m20221212232924995 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212232924995 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212232924995 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212232924996 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212232924996 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212232924996 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212232925006 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/handover_2G:trx-sysmocell5000+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212232925014 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212232925014 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212232925014 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:29:27.785286 run osmo-msc_10.42.42.6(pid=8504): ERR: Terminated: ERROR {rc=2} [trial-2383↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8504)] 23:29:27.832455 run osmo-msc_10.42.42.6(pid=8504): stdout: | (launched: 2022-12-12_23:29:26.704010) 23:29:27.881413 run osmo-msc_10.42.42.6(pid=8504): stderr: | [0;m[38;5;43m20221212232926977 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212232926977 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc557ee4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212232926977 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212232926977 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212232926977 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212232926978 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212232926979 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212232926980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212232926980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212232926980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:29:27.930987 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8497): Terminating (SIGTERM) 23:29:27.970292 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8500): Terminating (SIGTERM) 23:29:28.009612 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8503): Terminating (SIGTERM) 23:29:28.049234 --- ParallelTerminationStrategy: PID 8497 died... 23:29:28.068075 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8497): Terminated: ok {rc=0} 23:29:28.111547 --- ParallelTerminationStrategy: PID 8500 died... 23:29:28.129780 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8500): Terminated: ok {rc=0} 23:29:28.173250 --- ParallelTerminationStrategy: PID 8503 died... 23:29:28.191428 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8503): Terminated: ok {rc=0} 23:29:28.275853 bus /sierra_3: Setting Powered False 23:29:29.373744 bus /sierra_3: Setting Powered False 23:29:30.487288 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 handover_2G:trx-sysmocell5000+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 handover_2G:trx-sysmocell5000+bts1-trx-b200 --------------------------------------------------------------------- 23:29:31.741538 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:29:31.746581 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 23:29:31.812377 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 23:29:31.840812 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 23:29:31.893350 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 23:29:31.981102 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 23:29:32.017153 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 23:29:32.539107 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 handover_2G:trx-sysmocell5000+bts1-trx-b200 handover.py ---------------------------------------------- 23:29:32.544636 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:29:32.556168 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 23:29:32.605560 tst handover.py: using LAC 32271 23:29:32.737563 tst handover.py: using RAC 141 23:29:32.864288 tst handover.py: using CellId 32271 23:29:32.993141 tst handover.py: using BVCI 32272 23:29:33.112081 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 23:29:33.159898 tst handover.py: using LAC 32272 23:29:33.285404 tst handover.py: using RAC 142 23:29:33.411912 tst handover.py: using CellId 32272 23:29:33.533194 tst handover.py: using BVCI 32273 23:29:33.643658 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:29:33.654724 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:29:33.665639 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:29:33.677120 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:29:33.688474 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:29:33.699446 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 23:29:33.820641 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 23:29:33.937521 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:29:34.383463 run create_hlr_db(pid=8509): Launched 23:29:34.503688 bus /sierra_2: Setting Powered False 23:29:35.564876 run create_hlr_db(pid=8509): Terminated: ok {rc=0} 23:29:35.980031 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8513): Launched 23:29:36.305601 run osmo-hlr_10.42.42.2(pid=8514): Launched 23:29:36.430930 run osmo-stp_10.42.42.5: Starting osmo-stp 23:29:36.965619 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8516): Launched 23:29:37.291510 run osmo-stp_10.42.42.5(pid=8517): Launched 23:29:37.416287 run osmo-msc_10.42.42.6: Starting osmo-msc 23:29:37.977116 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8519): Launched 23:29:38.301722 run osmo-msc_10.42.42.6(pid=8520): Launched 23:29:38.483431 run osmo-stp_10.42.42.5(pid=8517): ERR: Terminated: ERROR {rc=1} [trial-2383↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8517)] 23:29:38.620141 run osmo-stp_10.42.42.5(pid=8517): stdout: | (launched: 2022-12-12_23:29:37.232528) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:29:38.757586 run osmo-stp_10.42.42.5(pid=8517): stderr: | [0;m[38;5;43m20221212232937423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212232937423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212232937424 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212232937424 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212232937425 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212232937425 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212232937425 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:29:38.893456 run osmo-stp_10.42.42.5(pid=8517): stdout: | (launched: 2022-12-12_23:29:37.232528) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:29:39.022418 run osmo-stp_10.42.42.5(pid=8517): stderr: | [0;m[38;5;43m20221212232937423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212232937423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212232937424 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212232937424 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212232937425 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212232937425 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212232937425 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:29:39.176441 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8517): Process ended prematurely: osmo-stp_10.42.42.5(pid=8517) [trial-2383↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8517)] [trial-2383↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18] 23:29:39.185299 tst handover.py:18: Test FAILED (6.6 sec) 23:29:39.212164 run osmo-hlr_10.42.42.2(pid=8514): ERR: Terminated: ERROR {rc=237} [trial-2383↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8514)] 23:29:39.261266 run osmo-hlr_10.42.42.2(pid=8514): stdout: | (launched: 2022-12-12_23:29:36.246709) 23:29:39.312463 run osmo-hlr_10.42.42.2(pid=8514): stderr: | [0;m[1;31m20221212232936445 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212232936445 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212232936445 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212232936445 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212232936445 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212232936445 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212232936474 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/handover_2G:trx-sysmocell5000+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212232936484 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212232936485 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212232936485 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:29:39.384787 run osmo-msc_10.42.42.6(pid=8520): ERR: Terminated: ERROR {rc=2} [trial-2383↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8520)] 23:29:39.433992 run osmo-msc_10.42.42.6(pid=8520): stdout: | (launched: 2022-12-12_23:29:38.242945) 23:29:39.485242 run osmo-msc_10.42.42.6(pid=8520): stderr: | [0;m[38;5;43m20221212232938566 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212232938566 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7feea253dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212232938566 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212232938566 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212232938567 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212232938567 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212232938568 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212232938569 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212232938569 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212232938569 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:29:39.536604 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8513): Terminating (SIGTERM) 23:29:39.577625 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8516): Terminating (SIGTERM) 23:29:39.618320 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8519): Terminating (SIGTERM) 23:29:39.659461 --- ParallelTerminationStrategy: PID 8513 died... 23:29:39.679200 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8513): Terminated: ok {rc=0} 23:29:39.724475 --- ParallelTerminationStrategy: PID 8516 died... 23:29:39.744196 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8516): Terminated: ok {rc=0} 23:29:39.789409 --- ParallelTerminationStrategy: PID 8519 died... 23:29:39.808603 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8519): Terminated: ok {rc=0} 23:29:39.894844 bus /sierra_3: Setting Powered False 23:29:40.992416 bus /sierra_3: Setting Powered False 23:29:42.109546 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 handover_2G:trx-sysmocell5000+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 handover_2G:trx-sysmocell5000+bts1-trx-umtrx --------------------------------------------------------------------- 23:29:43.378589 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:29:43.384010 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 23:29:43.446347 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 23:29:43.472716 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 23:29:43.525539 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 23:29:43.591816 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 23:29:43.619531 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 23:29:44.167966 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover.py ---------------------------------------------- 23:29:44.173762 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:29:44.185312 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 23:29:44.240488 tst handover.py: using LAC 32273 23:29:44.368917 tst handover.py: using RAC 143 23:29:44.495122 tst handover.py: using CellId 32273 23:29:44.624297 tst handover.py: using BVCI 32274 23:29:44.742434 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 23:29:44.791646 tst handover.py: using LAC 32274 23:29:44.922724 tst handover.py: using RAC 144 23:29:45.052115 tst handover.py: using CellId 32274 23:29:45.181458 tst handover.py: using BVCI 32275 23:29:45.301360 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:29:45.312831 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:29:45.324229 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:29:45.335858 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:29:45.347241 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:29:45.358625 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 23:29:45.476389 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 23:29:45.596927 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:29:46.126133 run create_hlr_db(pid=8525): Launched 23:29:46.312529 bus /sierra_2: Setting Powered False 23:29:47.372065 run create_hlr_db(pid=8525): Terminated: ok {rc=0} 23:29:47.789680 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8527): Launched 23:29:48.115810 run osmo-hlr_10.42.42.2(pid=8528): Launched 23:29:48.240155 run osmo-stp_10.42.42.5: Starting osmo-stp 23:29:48.771467 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8530): Launched 23:29:49.096504 run osmo-stp_10.42.42.5(pid=8531): Launched 23:29:49.221956 run osmo-msc_10.42.42.6: Starting osmo-msc 23:29:49.783998 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8533): Launched 23:29:50.109513 run osmo-msc_10.42.42.6(pid=8534): Launched 23:29:50.292118 run osmo-stp_10.42.42.5(pid=8531): ERR: Terminated: ERROR {rc=1} [trial-2383↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8531)] 23:29:50.430193 run osmo-stp_10.42.42.5(pid=8531): stdout: | (launched: 2022-12-12_23:29:49.037762) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:29:50.568178 run osmo-stp_10.42.42.5(pid=8531): stderr: | [0;m[38;5;43m20221212232949230 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212232949230 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212232949230 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212232949231 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212232949231 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212232949231 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212232949231 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:29:50.705257 run osmo-stp_10.42.42.5(pid=8531): stdout: | (launched: 2022-12-12_23:29:49.037762) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:29:50.835315 run osmo-stp_10.42.42.5(pid=8531): stderr: | [0;m[38;5;43m20221212232949230 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212232949230 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212232949230 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212232949231 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212232949231 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212232949231 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212232949231 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:29:50.990618 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8531): Process ended prematurely: osmo-stp_10.42.42.5(pid=8531) [trial-2383↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8531)] [trial-2383↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18] 23:29:50.999343 tst handover.py:18: Test FAILED (6.8 sec) 23:29:51.026662 run osmo-hlr_10.42.42.2(pid=8528): ERR: Terminated: ERROR {rc=237} [trial-2383↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8528)] 23:29:51.076500 run osmo-hlr_10.42.42.2(pid=8528): stdout: | (launched: 2022-12-12_23:29:48.056783) 23:29:51.128151 run osmo-hlr_10.42.42.2(pid=8528): stderr: | [0;m[1;31m20221212232948256 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212232948256 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212232948256 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212232948256 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212232948256 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212232948257 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212232948268 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/handover_2G:trx-sysmocell5000+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212232948278 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212232948278 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212232948278 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:29:51.199853 run osmo-msc_10.42.42.6(pid=8534): ERR: Terminated: ERROR {rc=2} [trial-2383↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8534)] 23:29:51.249492 run osmo-msc_10.42.42.6(pid=8534): stdout: | (launched: 2022-12-12_23:29:50.050619) 23:29:51.300552 run osmo-msc_10.42.42.6(pid=8534): stderr: | [0;m[38;5;43m20221212232950372 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212232950372 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0fdb85fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212232950372 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212232950372 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212232950373 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212232950373 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212232950375 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212232950375 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212232950375 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212232950375 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:29:51.352041 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8527): Terminating (SIGTERM) 23:29:51.393361 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8530): Terminating (SIGTERM) 23:29:51.434859 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8533): Terminating (SIGTERM) 23:29:51.476494 --- ParallelTerminationStrategy: PID 8527 died... 23:29:51.496520 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8527): Terminated: ok {rc=0} 23:29:51.542660 --- ParallelTerminationStrategy: PID 8530 died... 23:29:51.562433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8530): Terminated: ok {rc=0} 23:29:51.608202 --- ParallelTerminationStrategy: PID 8533 died... 23:29:51.627656 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8533): Terminated: ok {rc=0} 23:29:51.714201 bus /sierra_3: Setting Powered False 23:29:52.812449 bus /sierra_3: Setting Powered False 23:29:53.929408 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 handover_2G:trx-sysmocell5000+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 handover_2G:sysmo+bts1-trx-b200 --------------------------------------------------------------------- 23:29:55.200031 tst handover_2G:sysmo+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:29:55.204903 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 23:29:55.255479 tst handover_2G:sysmo+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 23:29:55.281659 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 23:29:55.335371 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 23:29:55.387426 tst handover_2G:sysmo+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 23:29:55.414627 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 23:29:55.962261 tst handover_2G:sysmo+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 handover_2G:sysmo+bts1-trx-b200 handover.py ---------------------------------------------- 23:29:55.967563 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:29:55.978433 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 23:29:56.012754 tst handover.py: using LAC 32275 23:29:56.133381 tst handover.py: using RAC 145 23:29:56.254731 tst handover.py: using CellId 32275 23:29:56.375798 tst handover.py: using BVCI 32276 23:29:56.488672 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 23:29:56.536690 tst handover.py: using LAC 32276 23:29:56.660894 tst handover.py: using RAC 146 23:29:56.780460 tst handover.py: using CellId 32276 23:29:56.898586 tst handover.py: using BVCI 32277 23:29:57.009350 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:29:57.020096 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:29:57.030754 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:29:57.041756 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:29:57.052585 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 23:29:57.063617 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 23:29:57.182979 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 23:29:57.305519 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:29:57.781443 run create_hlr_db(pid=8539): Launched 23:29:57.914908 bus /sierra_2: Setting Powered False 23:29:58.978931 run create_hlr_db(pid=8539): Terminated: ok {rc=0} 23:29:59.402333 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8541): Launched 23:29:59.727615 run osmo-hlr_10.42.42.2(pid=8542): Launched 23:29:59.855368 run osmo-stp_10.42.42.5: Starting osmo-stp 23:30:00.387798 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8544): Launched 23:30:00.713244 run osmo-stp_10.42.42.5(pid=8545): Launched 23:30:00.865391 run osmo-msc_10.42.42.6: Starting osmo-msc 23:30:01.522446 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8547): Launched 23:30:01.889694 run osmo-msc_10.42.42.6(pid=8550): Launched 23:30:02.291772 run osmo-stp_10.42.42.5(pid=8545): ERR: Terminated: ERROR {rc=1} [trial-2383↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8545)] 23:30:02.451018 run osmo-stp_10.42.42.5(pid=8545): stdout: | (launched: 2022-12-12_23:30:00.654116) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:30:02.578596 run osmo-stp_10.42.42.5(pid=8545): stderr: | [0;m[38;5;43m20221212233000884 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212233000884 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212233000884 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212233000884 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212233000890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212233000891 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212233000891 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:30:02.706087 run osmo-stp_10.42.42.5(pid=8545): stdout: | (launched: 2022-12-12_23:30:00.654116) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:30:02.827478 run osmo-stp_10.42.42.5(pid=8545): stderr: | [0;m[38;5;43m20221212233000884 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212233000884 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212233000884 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212233000884 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212233000890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212233000891 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212233000891 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:30:02.972022 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8545): Process ended prematurely: osmo-stp_10.42.42.5(pid=8545) [trial-2383↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8545)] [trial-2383↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18] 23:30:02.980173 tst handover.py:18: Test FAILED (7.0 sec) 23:30:03.006270 run osmo-hlr_10.42.42.2(pid=8542): ERR: Terminated: ERROR {rc=237} [trial-2383↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8542)] 23:30:03.053756 run osmo-hlr_10.42.42.2(pid=8542): stdout: | (launched: 2022-12-12_23:29:59.668786) 23:30:03.102728 run osmo-hlr_10.42.42.2(pid=8542): stderr: | [0;m[1;31m20221212232959865 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212232959865 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212232959865 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212232959865 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212232959866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212232959866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212232959877 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/handover_2G:sysmo+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212232959886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212232959886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212232959886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:30:03.171038 run osmo-msc_10.42.42.6(pid=8550): ERR: Terminated: ERROR {rc=2} [trial-2383↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8550)] 23:30:03.218002 run osmo-msc_10.42.42.6(pid=8550): stdout: | (launched: 2022-12-12_23:30:01.803933) 23:30:03.266760 run osmo-msc_10.42.42.6(pid=8550): stderr: | [0;m[38;5;43m20221212233002254 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212233002254 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f88fdac3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212233002254 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212233002254 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212233002254 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212233002255 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212233002256 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212233002257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212233002257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212233002257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:30:03.315777 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8541): Terminating (SIGTERM) 23:30:03.355025 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8544): Terminating (SIGTERM) 23:30:03.394629 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8547): Terminating (SIGTERM) 23:30:03.434618 --- ParallelTerminationStrategy: PID 8541 died... 23:30:03.453514 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8541): Terminated: ok {rc=0} 23:30:03.497336 --- ParallelTerminationStrategy: PID 8544 died... 23:30:03.515596 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8544): Terminated: ok {rc=0} 23:30:03.559487 --- ParallelTerminationStrategy: PID 8547 died... 23:30:03.577876 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8547): Terminated: ok {rc=0} 23:30:03.660819 bus /sierra_3: Setting Powered False 23:30:04.755947 bus /sierra_3: Setting Powered False 23:30:05.870160 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 handover_2G:sysmo+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 handover_2G:sysmo+bts1-trx-umtrx --------------------------------------------------------------------- 23:30:07.123799 tst handover_2G:sysmo+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:30:07.130336 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 23:30:07.181461 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 23:30:07.209096 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 23:30:07.262862 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 23:30:07.314506 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 23:30:07.341548 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 23:30:07.890659 tst handover_2G:sysmo+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 handover_2G:sysmo+bts1-trx-umtrx handover.py ---------------------------------------------- 23:30:07.896308 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:30:07.907742 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 23:30:07.943005 tst handover.py: using LAC 32277 23:30:08.071274 tst handover.py: using RAC 147 23:30:08.201343 tst handover.py: using CellId 32277 23:30:08.323017 tst handover.py: using BVCI 32278 23:30:08.434096 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 23:30:08.481679 tst handover.py: using LAC 32278 23:30:08.601825 tst handover.py: using RAC 148 23:30:08.721342 tst handover.py: using CellId 32278 23:30:08.842519 tst handover.py: using BVCI 32279 23:30:08.953230 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:30:08.963801 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:30:08.974391 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:30:08.985419 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:30:08.996239 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:30:09.007061 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 23:30:09.126713 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 23:30:09.242289 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:30:09.689773 run create_hlr_db(pid=8557): Launched 23:30:09.807684 bus /sierra_2: Setting Powered False 23:30:10.868907 run create_hlr_db(pid=8557): Terminated: ok {rc=0} 23:30:11.286586 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8559): Launched 23:30:11.612018 run osmo-hlr_10.42.42.2(pid=8560): Launched 23:30:11.735907 run osmo-stp_10.42.42.5: Starting osmo-stp 23:30:12.266401 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8562): Launched 23:30:12.591439 run osmo-stp_10.42.42.5(pid=8563): Launched 23:30:12.715610 run osmo-msc_10.42.42.6: Starting osmo-msc 23:30:13.275986 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8565): Launched 23:30:13.600348 run osmo-msc_10.42.42.6(pid=8566): Launched 23:30:13.782197 run osmo-stp_10.42.42.5(pid=8563): ERR: Terminated: ERROR {rc=1} [trial-2383↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8563)] 23:30:13.919094 run osmo-stp_10.42.42.5(pid=8563): stdout: | (launched: 2022-12-12_23:30:12.532369) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:30:14.056171 run osmo-stp_10.42.42.5(pid=8563): stderr: | [0;m[38;5;43m20221212233012726 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212233012726 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212233012726 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212233012727 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212233012727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212233012727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212233012727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:30:14.192866 run osmo-stp_10.42.42.5(pid=8563): stdout: | (launched: 2022-12-12_23:30:12.532369) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:30:14.322058 run osmo-stp_10.42.42.5(pid=8563): stderr: | [0;m[38;5;43m20221212233012726 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212233012726 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212233012726 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212233012727 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212233012727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212233012727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212233012727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:30:14.476781 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8563): Process ended prematurely: osmo-stp_10.42.42.5(pid=8563) [trial-2383↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8563)] [trial-2383↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18] 23:30:14.485905 tst handover.py:18: Test FAILED (6.6 sec) 23:30:14.513027 run osmo-hlr_10.42.42.2(pid=8560): ERR: Terminated: ERROR {rc=237} [trial-2383↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8560)] 23:30:14.562644 run osmo-hlr_10.42.42.2(pid=8560): stdout: | (launched: 2022-12-12_23:30:11.553203) 23:30:14.613648 run osmo-hlr_10.42.42.2(pid=8560): stderr: | [0;m[1;31m20221212233011755 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212233011755 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212233011755 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212233011755 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212233011755 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212233011755 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212233011768 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/handover_2G:sysmo+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212233011778 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212233011778 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212233011778 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:30:14.685083 run osmo-msc_10.42.42.6(pid=8566): ERR: Terminated: ERROR {rc=2} [trial-2383↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8566)] 23:30:14.734368 run osmo-msc_10.42.42.6(pid=8566): stdout: | (launched: 2022-12-12_23:30:13.541361) 23:30:14.785580 run osmo-msc_10.42.42.6(pid=8566): stderr: | [0;m[38;5;43m20221212233013865 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212233013865 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7290bdcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212233013865 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212233013865 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212233013866 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212233013866 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212233013867 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212233013868 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212233013868 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212233013868 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:30:14.837048 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8559): Terminating (SIGTERM) 23:30:14.878105 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8562): Terminating (SIGTERM) 23:30:14.919369 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8565): Terminating (SIGTERM) 23:30:14.960923 --- ParallelTerminationStrategy: PID 8559 died... 23:30:14.980479 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8559): Terminated: ok {rc=0} 23:30:15.026256 --- ParallelTerminationStrategy: PID 8562 died... 23:30:15.045644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8562): Terminated: ok {rc=0} 23:30:15.091226 --- ParallelTerminationStrategy: PID 8565 died... 23:30:15.110616 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8565): Terminated: ok {rc=0} 23:30:15.197626 bus /sierra_3: Setting Powered False 23:30:16.294337 bus /sierra_3: Setting Powered False 23:30:17.407137 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 handover_2G:sysmo+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2383 handover_2G:trx-b200+bts1-trx-umtrx --------------------------------------------------------------------- 23:30:18.661274 tst handover_2G:trx-b200+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:30:18.666673 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 23:30:18.729553 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 23:30:18.756757 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 23:30:18.810329 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 23:30:18.874884 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 23:30:18.902004 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 23:30:19.450778 tst handover_2G:trx-b200+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts Ettus B200 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2383 handover_2G:trx-b200+bts1-trx-umtrx handover.py ---------------------------------------------- 23:30:19.456160 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:30:19.467511 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 23:30:19.515914 tst handover.py: using LAC 32279 23:30:19.643707 tst handover.py: using RAC 149 23:30:19.766781 tst handover.py: using CellId 32279 23:30:19.887965 tst handover.py: using BVCI 32280 23:30:20.008146 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 23:30:20.057315 tst handover.py: using LAC 32280 23:30:20.185951 tst handover.py: using RAC 150 23:30:20.308250 tst handover.py: using CellId 32280 23:30:20.429355 tst handover.py: using BVCI 32281 23:30:20.540777 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:30:20.551813 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:30:20.562725 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:30:20.573980 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:30:20.584546 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 23:30:20.595737 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 23:30:20.715872 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 23:30:20.834383 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:30:21.283750 run create_hlr_db(pid=8571): Launched 23:30:21.416628 bus /sierra_2: Setting Powered False 23:30:22.481622 run create_hlr_db(pid=8571): Terminated: ok {rc=0} 23:30:22.906588 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8573): Launched 23:30:23.232823 run osmo-hlr_10.42.42.2(pid=8574): Launched 23:30:23.358453 run osmo-stp_10.42.42.5: Starting osmo-stp 23:30:23.896701 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8576): Launched 23:30:24.222082 run osmo-stp_10.42.42.5(pid=8577): Launched 23:30:24.346728 run osmo-msc_10.42.42.6: Starting osmo-msc 23:30:24.907363 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8579): Launched 23:30:25.233069 run osmo-msc_10.42.42.6(pid=8580): Launched 23:30:25.415759 run osmo-stp_10.42.42.5(pid=8577): ERR: Terminated: ERROR {rc=1} [trial-2383↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8577)] 23:30:25.554292 run osmo-stp_10.42.42.5(pid=8577): stdout: | (launched: 2022-12-12_23:30:24.163071) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:30:25.692232 run osmo-stp_10.42.42.5(pid=8577): stderr: | [0;m[38;5;43m20221212233024356 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212233024356 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212233024356 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212233024357 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212233024357 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212233024357 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212233024357 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:30:25.829507 run osmo-stp_10.42.42.5(pid=8577): stdout: | (launched: 2022-12-12_23:30:24.163071) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:30:25.958931 run osmo-stp_10.42.42.5(pid=8577): stderr: | [0;m[38;5;43m20221212233024356 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212233024356 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212233024356 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212233024357 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212233024357 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212233024357 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212233024357 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:30:26.114079 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=8577): Process ended prematurely: osmo-stp_10.42.42.5(pid=8577) [trial-2383↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8577)] [trial-2383↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18] 23:30:26.122804 tst handover.py:18: Test FAILED (6.7 sec) 23:30:26.150210 run osmo-hlr_10.42.42.2(pid=8574): ERR: Terminated: ERROR {rc=237} [trial-2383↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8574)] 23:30:26.200090 run osmo-hlr_10.42.42.2(pid=8574): stdout: | (launched: 2022-12-12_23:30:23.173708) 23:30:26.251591 run osmo-hlr_10.42.42.2(pid=8574): stderr: | [0;m[1;31m20221212233023373 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212233023373 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212233023373 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212233023373 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212233023374 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212233023374 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212233023386 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/handover_2G:trx-b200+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212233023394 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212233023394 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212233023394 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:30:26.323671 run osmo-msc_10.42.42.6(pid=8580): ERR: Terminated: ERROR {rc=2} [trial-2383↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8580)] 23:30:26.373317 run osmo-msc_10.42.42.6(pid=8580): stdout: | (launched: 2022-12-12_23:30:25.174040) 23:30:26.424479 run osmo-msc_10.42.42.6(pid=8580): stderr: | [0;m[38;5;43m20221212233025499 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212233025499 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb90f4bbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212233025499 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212233025499 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212233025499 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212233025499 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212233025501 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212233025501 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212233025501 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212233025502 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:30:26.476196 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8573): Terminating (SIGTERM) 23:30:26.517613 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8576): Terminating (SIGTERM) 23:30:26.558939 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8579): Terminating (SIGTERM) 23:30:26.600537 --- ParallelTerminationStrategy: PID 8573 died... 23:30:26.620421 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8573): Terminated: ok {rc=0} 23:30:26.666339 --- ParallelTerminationStrategy: PID 8576 died... 23:30:26.685662 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8576): Terminated: ok {rc=0} 23:30:26.731203 --- ParallelTerminationStrategy: PID 8579 died... 23:30:26.750488 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8579): Terminated: ok {rc=0} 23:30:26.837706 bus /sierra_3: Setting Powered False 23:30:27.937220 bus /sierra_3: Setting Powered False 23:30:29.053370 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2383 handover_2G:trx-b200+bts1-trx-umtrx FAIL --------------------------------------------------------------------- 23:30:30.324435 tst trial-2383: Storing JUnit report in /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383/run.2022-12-12_22-05-43/trial-2383.xml -------------------------------------------------------------------------------------------- trial-2383 FAIL -------------------------------------------------------------------------------------------- 23:30:32.411847 tst trial-2383: trial-2383: FAIL, 200 suites failed FAIL: nitb_sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (4.7 sec) Error: osmo-nitb_10.42.42.2(pid=615): Process ended prematurely: osmo-nitb_10.42.42.2(pid=615) [trial-2383↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=615)] FAIL: sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (14.6 sec) Error: osmo-stp_10.42.42.5(pid=626): Process ended prematurely: osmo-stp_10.42.42.5(pid=626) [trial-2383↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=626)] FAIL: nitb_ussd:sysmo (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=636): Process ended prematurely: osmo-nitb_10.42.42.2(pid=636) [trial-2383↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=636)] FAIL: ussd:sysmo (fail: 1) FAIL: assert_extension.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=647): Process ended prematurely: osmo-stp_10.42.42.5(pid=647) [trial-2383↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=647)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=661): Process ended prematurely: osmo-stp_10.42.42.5(pid=661) [trial-2383↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=661)] FAIL: mo_mt_call_osmux.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=966): Process ended prematurely: osmo-stp_10.42.42.5(pid=966) [trial-2383↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=966)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=980): Process ended prematurely: osmo-stp_10.42.42.5(pid=980) [trial-2383↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=980)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=998): Process ended prematurely: osmo-stp_10.42.42.5(pid=998) [trial-2383↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=998)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=1012): Process ended prematurely: osmo-stp_10.42.42.5(pid=1012) [trial-2383↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1012)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=1023): Process ended prematurely: osmo-stp_10.42.42.5(pid=1023) [trial-2383↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1023)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=1038): Process ended prematurely: osmo-stp_10.42.42.5(pid=1038) [trial-2383↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1038)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=1049): Process ended prematurely: osmo-stp_10.42.42.5(pid=1049) [trial-2383↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1049)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=1066): Process ended prematurely: osmo-stp_10.42.42.5(pid=1066) [trial-2383↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1066)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=1077): Process ended prematurely: osmo-stp_10.42.42.5(pid=1077) [trial-2383↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1077)] FAIL: voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=1091): Process ended prematurely: osmo-stp_10.42.42.5(pid=1091) [trial-2383↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1091)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=1102): Process ended prematurely: osmo-stp_10.42.42.5(pid=1102) [trial-2383↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1102)] FAIL: voice:sysmo+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=1118): Process ended prematurely: osmo-stp_10.42.42.5(pid=1118) [trial-2383↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1118)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=1139): Process ended prematurely: osmo-stp_10.42.42.5(pid=1139) [trial-2383↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1139)] FAIL: emergency:sysmo (fail: 2) FAIL: emergency_mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=1154): Process ended prematurely: osmo-stp_10.42.42.5(pid=1154) [trial-2383↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1154)] FAIL: emergency_preemptive_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=1165): Process ended prematurely: osmo-stp_10.42.42.5(pid=1165) [trial-2383↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1165)] FAIL: gprs:sysmo (fail: 5) FAIL: cs_paging_gprs_active.py (10.0 sec) Error: osmo-stp_10.42.42.5(pid=1185): Process ended prematurely: osmo-stp_10.42.42.5(pid=1185) [trial-2383↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1185)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=1197): Process ended prematurely: osmo-stp_10.42.42.5(pid=1197) [trial-2383↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1197)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=1215): Process ended prematurely: osmo-stp_10.42.42.5(pid=1215) [trial-2383↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1215)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=1225): Process ended prematurely: osmo-stp_10.42.42.5(pid=1225) [trial-2383↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1225)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=1237): Process ended prematurely: osmo-stp_10.42.42.5(pid=1237) [trial-2383↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1237)] FAIL: gprs:sysmo+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=1255): Process ended prematurely: osmo-stp_10.42.42.5(pid=1255) [trial-2383↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1255)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=1267): Process ended prematurely: osmo-stp_10.42.42.5(pid=1267) [trial-2383↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1267)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=1285): Process ended prematurely: osmo-stp_10.42.42.5(pid=1285) [trial-2383↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1285)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=1295): Process ended prematurely: osmo-stp_10.42.42.5(pid=1295) [trial-2383↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1295)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=1305): Process ended prematurely: osmo-stp_10.42.42.5(pid=1305) [trial-2383↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1305)] FAIL: gprs:sysmo+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=1323): Process ended prematurely: osmo-stp_10.42.42.5(pid=1323) [trial-2383↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1323)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=1335): Process ended prematurely: osmo-stp_10.42.42.5(pid=1335) [trial-2383↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1335)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=1353): Process ended prematurely: osmo-stp_10.42.42.5(pid=1353) [trial-2383↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1353)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=1363): Process ended prematurely: osmo-stp_10.42.42.5(pid=1363) [trial-2383↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1363)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=1373): Process ended prematurely: osmo-stp_10.42.42.5(pid=1373) [trial-2383↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1373)] FAIL: gprs:sysmo+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.2 sec) Error: osmo-stp_10.42.42.5(pid=1401): Process ended prematurely: osmo-stp_10.42.42.5(pid=1401) [trial-2383↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1401)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=1413): Process ended prematurely: osmo-stp_10.42.42.5(pid=1413) [trial-2383↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1413)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=1434): Process ended prematurely: osmo-stp_10.42.42.5(pid=1434) [trial-2383↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1434)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=1444): Process ended prematurely: osmo-stp_10.42.42.5(pid=1444) [trial-2383↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1444)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=1454): Process ended prematurely: osmo-stp_10.42.42.5(pid=1454) [trial-2383↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1454)] FAIL: dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=1467): Process ended prematurely: osmo-stp_10.42.42.5(pid=1467) [trial-2383↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1467)] FAIL: dynts:sysmo+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=1480): Process ended prematurely: osmo-stp_10.42.42.5(pid=1480) [trial-2383↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1480)] FAIL: nitb_sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=1490): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1490) [trial-2383↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1490)] FAIL: sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=1500): Process ended prematurely: osmo-stp_10.42.42.5(pid=1500) [trial-2383↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1500)] FAIL: nitb_ussd:oc2g (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=1509): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1509) [trial-2383↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1509)] FAIL: ussd:oc2g (fail: 1) FAIL: assert_extension.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=1519): Process ended prematurely: osmo-stp_10.42.42.5(pid=1519) [trial-2383↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1519)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=1533): Process ended prematurely: osmo-stp_10.42.42.5(pid=1533) [trial-2383↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1533)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=1544): Process ended prematurely: osmo-stp_10.42.42.5(pid=1544) [trial-2383↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1544)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=1561): Process ended prematurely: osmo-stp_10.42.42.5(pid=1561) [trial-2383↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1561)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=1572): Process ended prematurely: osmo-stp_10.42.42.5(pid=1572) [trial-2383↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1572)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=1586): Process ended prematurely: osmo-stp_10.42.42.5(pid=1586) [trial-2383↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1586)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=1597): Process ended prematurely: osmo-stp_10.42.42.5(pid=1597) [trial-2383↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1597)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=1611): Process ended prematurely: osmo-stp_10.42.42.5(pid=1611) [trial-2383↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1611)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=1622): Process ended prematurely: osmo-stp_10.42.42.5(pid=1622) [trial-2383↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1622)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=1636): Process ended prematurely: osmo-stp_10.42.42.5(pid=1636) [trial-2383↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1636)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=1647): Process ended prematurely: osmo-stp_10.42.42.5(pid=1647) [trial-2383↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1647)] FAIL: voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=1663): Process ended prematurely: osmo-stp_10.42.42.5(pid=1663) [trial-2383↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1663)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=1674): Process ended prematurely: osmo-stp_10.42.42.5(pid=1674) [trial-2383↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1674)] FAIL: voice:oc2g+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=1688): Process ended prematurely: osmo-stp_10.42.42.5(pid=1688) [trial-2383↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1688)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=1699): Process ended prematurely: osmo-stp_10.42.42.5(pid=1699) [trial-2383↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1699)] FAIL: emergency:oc2g (fail: 2) FAIL: emergency_mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=1713): Process ended prematurely: osmo-stp_10.42.42.5(pid=1713) [trial-2383↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1713)] FAIL: emergency_preemptive_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=1724): Process ended prematurely: osmo-stp_10.42.42.5(pid=1724) [trial-2383↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1724)] FAIL: gprs:oc2g (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=1743): Process ended prematurely: osmo-stp_10.42.42.5(pid=1743) [trial-2383↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1743)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=1755): Process ended prematurely: osmo-stp_10.42.42.5(pid=1755) [trial-2383↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1755)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=1776): Process ended prematurely: osmo-stp_10.42.42.5(pid=1776) [trial-2383↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1776)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=1787): Process ended prematurely: osmo-stp_10.42.42.5(pid=1787) [trial-2383↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1787)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=1797): Process ended prematurely: osmo-stp_10.42.42.5(pid=1797) [trial-2383↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1797)] FAIL: gprs:oc2g+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=1816): Process ended prematurely: osmo-stp_10.42.42.5(pid=1816) [trial-2383↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1816)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=1829): Process ended prematurely: osmo-stp_10.42.42.5(pid=1829) [trial-2383↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1829)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=1847): Process ended prematurely: osmo-stp_10.42.42.5(pid=1847) [trial-2383↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1847)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=1858): Process ended prematurely: osmo-stp_10.42.42.5(pid=1858) [trial-2383↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1858)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=1868): Process ended prematurely: osmo-stp_10.42.42.5(pid=1868) [trial-2383↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1868)] FAIL: gprs:oc2g+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=1889): Process ended prematurely: osmo-stp_10.42.42.5(pid=1889) [trial-2383↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1889)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=1901): Process ended prematurely: osmo-stp_10.42.42.5(pid=1901) [trial-2383↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1901)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=1919): Process ended prematurely: osmo-stp_10.42.42.5(pid=1919) [trial-2383↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1919)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=1931): Process ended prematurely: osmo-stp_10.42.42.5(pid=1931) [trial-2383↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1931)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=1941): Process ended prematurely: osmo-stp_10.42.42.5(pid=1941) [trial-2383↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1941)] FAIL: gprs:oc2g+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=1958): Process ended prematurely: osmo-stp_10.42.42.5(pid=1958) [trial-2383↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1958)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=1971): Process ended prematurely: osmo-stp_10.42.42.5(pid=1971) [trial-2383↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1971)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=1989): Process ended prematurely: osmo-stp_10.42.42.5(pid=1989) [trial-2383↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1989)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=1999): Process ended prematurely: osmo-stp_10.42.42.5(pid=1999) [trial-2383↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1999)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=2009): Process ended prematurely: osmo-stp_10.42.42.5(pid=2009) [trial-2383↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2009)] FAIL: dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=2023): Process ended prematurely: osmo-stp_10.42.42.5(pid=2023) [trial-2383↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2023)] FAIL: dynts:oc2g+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=2308): Process ended prematurely: osmo-stp_10.42.42.5(pid=2308) [trial-2383↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2308)] FAIL: nitb_sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (3.5 sec) Error: osmo-nitb_10.42.42.2(pid=2318): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2318) [trial-2383↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2318)] FAIL: sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=2328): Process ended prematurely: osmo-stp_10.42.42.5(pid=2328) [trial-2383↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2328)] FAIL: nitb_ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=2337): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2337) [trial-2383↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2337)] FAIL: ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=2347): Process ended prematurely: osmo-stp_10.42.42.5(pid=2347) [trial-2383↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2347)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=2362): Process ended prematurely: osmo-stp_10.42.42.5(pid=2362) [trial-2383↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2362)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=2373): Process ended prematurely: osmo-stp_10.42.42.5(pid=2373) [trial-2383↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2373)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=2387): Process ended prematurely: osmo-stp_10.42.42.5(pid=2387) [trial-2383↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2387)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=2401): Process ended prematurely: osmo-stp_10.42.42.5(pid=2401) [trial-2383↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2401)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=2415): Process ended prematurely: osmo-stp_10.42.42.5(pid=2415) [trial-2383↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2415)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=2426): Process ended prematurely: osmo-stp_10.42.42.5(pid=2426) [trial-2383↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2426)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=2442): Process ended prematurely: osmo-stp_10.42.42.5(pid=2442) [trial-2383↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2442)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=2453): Process ended prematurely: osmo-stp_10.42.42.5(pid=2453) [trial-2383↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2453)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=2467): Process ended prematurely: osmo-stp_10.42.42.5(pid=2467) [trial-2383↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2467)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=2478): Process ended prematurely: osmo-stp_10.42.42.5(pid=2478) [trial-2383↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2478)] FAIL: voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=2492): Process ended prematurely: osmo-stp_10.42.42.5(pid=2492) [trial-2383↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2492)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=2504): Process ended prematurely: osmo-stp_10.42.42.5(pid=2504) [trial-2383↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2504)] FAIL: voice:trx-b200+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=2518): Process ended prematurely: osmo-stp_10.42.42.5(pid=2518) [trial-2383↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2518)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=2529): Process ended prematurely: osmo-stp_10.42.42.5(pid=2529) [trial-2383↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2529)] FAIL: voice:trx-b200+mod-bts0-trxdversion0 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=2543): Process ended prematurely: osmo-stp_10.42.42.5(pid=2543) [trial-2383↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2543)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=2554): Process ended prematurely: osmo-stp_10.42.42.5(pid=2554) [trial-2383↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2554)] FAIL: voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=2568): Process ended prematurely: osmo-stp_10.42.42.5(pid=2568) [trial-2383↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2568)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=2579): Process ended prematurely: osmo-stp_10.42.42.5(pid=2579) [trial-2383↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2579)] FAIL: emergency:trx-b200 (fail: 2) FAIL: emergency_mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=2595): Process ended prematurely: osmo-stp_10.42.42.5(pid=2595) [trial-2383↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2595)] FAIL: emergency_preemptive_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=2606): Process ended prematurely: osmo-stp_10.42.42.5(pid=2606) [trial-2383↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2606)] FAIL: gprs:trx-b200 (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=2627): Process ended prematurely: osmo-stp_10.42.42.5(pid=2627) [trial-2383↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2627)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=2639): Process ended prematurely: osmo-stp_10.42.42.5(pid=2639) [trial-2383↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2639)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=2657): Process ended prematurely: osmo-stp_10.42.42.5(pid=2657) [trial-2383↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2657)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=2668): Process ended prematurely: osmo-stp_10.42.42.5(pid=2668) [trial-2383↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2668)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=2679): Process ended prematurely: osmo-stp_10.42.42.5(pid=2679) [trial-2383↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2679)] FAIL: gprs:trx-b200+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (9.1 sec) Error: osmo-stp_10.42.42.5(pid=2696): Process ended prematurely: osmo-stp_10.42.42.5(pid=2696) [trial-2383↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2696)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=2708): Process ended prematurely: osmo-stp_10.42.42.5(pid=2708) [trial-2383↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2708)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=2727): Process ended prematurely: osmo-stp_10.42.42.5(pid=2727) [trial-2383↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2727)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=2737): Process ended prematurely: osmo-stp_10.42.42.5(pid=2737) [trial-2383↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2737)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=2750): Process ended prematurely: osmo-stp_10.42.42.5(pid=2750) [trial-2383↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2750)] FAIL: gprs:trx-b200+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (9.2 sec) Error: osmo-stp_10.42.42.5(pid=2767): Process ended prematurely: osmo-stp_10.42.42.5(pid=2767) [trial-2383↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2767)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=2779): Process ended prematurely: osmo-stp_10.42.42.5(pid=2779) [trial-2383↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2779)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=2797): Process ended prematurely: osmo-stp_10.42.42.5(pid=2797) [trial-2383↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2797)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=2807): Process ended prematurely: osmo-stp_10.42.42.5(pid=2807) [trial-2383↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2807)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=2818): Process ended prematurely: osmo-stp_10.42.42.5(pid=2818) [trial-2383↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2818)] FAIL: gprs:trx-b200+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=2838): Process ended prematurely: osmo-stp_10.42.42.5(pid=2838) [trial-2383↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2838)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=2850): Process ended prematurely: osmo-stp_10.42.42.5(pid=2850) [trial-2383↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2850)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=2868): Process ended prematurely: osmo-stp_10.42.42.5(pid=2868) [trial-2383↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2868)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=2879): Process ended prematurely: osmo-stp_10.42.42.5(pid=2879) [trial-2383↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2879)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=2889): Process ended prematurely: osmo-stp_10.42.42.5(pid=2889) [trial-2383↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2889)] FAIL: gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (9.1 sec) Error: osmo-stp_10.42.42.5(pid=2906): Process ended prematurely: osmo-stp_10.42.42.5(pid=2906) [trial-2383↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2906)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=2918): Process ended prematurely: osmo-stp_10.42.42.5(pid=2918) [trial-2383↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2918)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=2936): Process ended prematurely: osmo-stp_10.42.42.5(pid=2936) [trial-2383↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2936)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=2946): Process ended prematurely: osmo-stp_10.42.42.5(pid=2946) [trial-2383↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2946)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=2957): Process ended prematurely: osmo-stp_10.42.42.5(pid=2957) [trial-2383↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2957)] FAIL: dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=2971): Process ended prematurely: osmo-stp_10.42.42.5(pid=2971) [trial-2383↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2971)] FAIL: dynts:trx-b200+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=2984): Process ended prematurely: osmo-stp_10.42.42.5(pid=2984) [trial-2383↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2984)] FAIL: nitb_sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=2992): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2992) [trial-2383↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2992)] FAIL: sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=3002): Process ended prematurely: osmo-stp_10.42.42.5(pid=3002) [trial-2383↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3002)] FAIL: nitb_ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=3011): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3011) [trial-2383↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3011)] FAIL: ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=3021): Process ended prematurely: osmo-stp_10.42.42.5(pid=3021) [trial-2383↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3021)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=3035): Process ended prematurely: osmo-stp_10.42.42.5(pid=3035) [trial-2383↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3035)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=3046): Process ended prematurely: osmo-stp_10.42.42.5(pid=3046) [trial-2383↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3046)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=3060): Process ended prematurely: osmo-stp_10.42.42.5(pid=3060) [trial-2383↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3060)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=3072): Process ended prematurely: osmo-stp_10.42.42.5(pid=3072) [trial-2383↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3072)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=3086): Process ended prematurely: osmo-stp_10.42.42.5(pid=3086) [trial-2383↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3086)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=3100): Process ended prematurely: osmo-stp_10.42.42.5(pid=3100) [trial-2383↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3100)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=3114): Process ended prematurely: osmo-stp_10.42.42.5(pid=3114) [trial-2383↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3114)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=3125): Process ended prematurely: osmo-stp_10.42.42.5(pid=3125) [trial-2383↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3125)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=3139): Process ended prematurely: osmo-stp_10.42.42.5(pid=3139) [trial-2383↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3139)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=3150): Process ended prematurely: osmo-stp_10.42.42.5(pid=3150) [trial-2383↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3150)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=3164): Process ended prematurely: osmo-stp_10.42.42.5(pid=3164) [trial-2383↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3164)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=3175): Process ended prematurely: osmo-stp_10.42.42.5(pid=3175) [trial-2383↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3175)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=3189): Process ended prematurely: osmo-stp_10.42.42.5(pid=3189) [trial-2383↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3189)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=3200): Process ended prematurely: osmo-stp_10.42.42.5(pid=3200) [trial-2383↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3200)] FAIL: emergency:trx-sysmocell5000 (fail: 2) FAIL: emergency_mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=3214): Process ended prematurely: osmo-stp_10.42.42.5(pid=3214) [trial-2383↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3214)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=3225): Process ended prematurely: osmo-stp_10.42.42.5(pid=3225) [trial-2383↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3225)] FAIL: gprs:trx-sysmocell5000 (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=3244): Process ended prematurely: osmo-stp_10.42.42.5(pid=3244) [trial-2383↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3244)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=3256): Process ended prematurely: osmo-stp_10.42.42.5(pid=3256) [trial-2383↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3256)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=3275): Process ended prematurely: osmo-stp_10.42.42.5(pid=3275) [trial-2383↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3275)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=3285): Process ended prematurely: osmo-stp_10.42.42.5(pid=3285) [trial-2383↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3285)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=3295): Process ended prematurely: osmo-stp_10.42.42.5(pid=3295) [trial-2383↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3295)] FAIL: gprs:trx-sysmocell5000+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=3312): Process ended prematurely: osmo-stp_10.42.42.5(pid=3312) [trial-2383↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3312)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=3324): Process ended prematurely: osmo-stp_10.42.42.5(pid=3324) [trial-2383↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3324)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=3342): Process ended prematurely: osmo-stp_10.42.42.5(pid=3342) [trial-2383↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3342)] FAIL: ping.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=3621): Process ended prematurely: osmo-stp_10.42.42.5(pid=3621) [trial-2383↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3621)] FAIL: ping_idle_ping.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=3633): Process ended prematurely: osmo-stp_10.42.42.5(pid=3633) [trial-2383↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3633)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=3651): Process ended prematurely: osmo-stp_10.42.42.5(pid=3651) [trial-2383↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3651)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=3663): Process ended prematurely: osmo-stp_10.42.42.5(pid=3663) [trial-2383↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3663)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=3681): Process ended prematurely: osmo-stp_10.42.42.5(pid=3681) [trial-2383↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3681)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=3691): Process ended prematurely: osmo-stp_10.42.42.5(pid=3691) [trial-2383↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3691)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=3701): Process ended prematurely: osmo-stp_10.42.42.5(pid=3701) [trial-2383↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3701)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=3723): Process ended prematurely: osmo-stp_10.42.42.5(pid=3723) [trial-2383↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3723)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=3735): Process ended prematurely: osmo-stp_10.42.42.5(pid=3735) [trial-2383↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3735)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=3753): Process ended prematurely: osmo-stp_10.42.42.5(pid=3753) [trial-2383↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3753)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=3763): Process ended prematurely: osmo-stp_10.42.42.5(pid=3763) [trial-2383↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3763)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=3773): Process ended prematurely: osmo-stp_10.42.42.5(pid=3773) [trial-2383↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3773)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=3786): Process ended prematurely: osmo-stp_10.42.42.5(pid=3786) [trial-2383↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3786)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=3799): Process ended prematurely: osmo-stp_10.42.42.5(pid=3799) [trial-2383↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3799)] FAIL: nitb_sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=3807): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3807) [trial-2383↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3807)] FAIL: sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=3817): Process ended prematurely: osmo-stp_10.42.42.5(pid=3817) [trial-2383↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3817)] FAIL: nitb_ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=3826): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3826) [trial-2383↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3826)] FAIL: ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=3836): Process ended prematurely: osmo-stp_10.42.42.5(pid=3836) [trial-2383↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3836)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=3856): Process ended prematurely: osmo-stp_10.42.42.5(pid=3856) [trial-2383↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3856)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=3867): Process ended prematurely: osmo-stp_10.42.42.5(pid=3867) [trial-2383↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3867)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=3881): Process ended prematurely: osmo-stp_10.42.42.5(pid=3881) [trial-2383↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3881)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=3892): Process ended prematurely: osmo-stp_10.42.42.5(pid=3892) [trial-2383↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3892)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=3906): Process ended prematurely: osmo-stp_10.42.42.5(pid=3906) [trial-2383↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3906)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=3917): Process ended prematurely: osmo-stp_10.42.42.5(pid=3917) [trial-2383↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3917)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=3931): Process ended prematurely: osmo-stp_10.42.42.5(pid=3931) [trial-2383↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3931)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=3942): Process ended prematurely: osmo-stp_10.42.42.5(pid=3942) [trial-2383↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3942)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=3956): Process ended prematurely: osmo-stp_10.42.42.5(pid=3956) [trial-2383↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3956)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=3967): Process ended prematurely: osmo-stp_10.42.42.5(pid=3967) [trial-2383↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3967)] FAIL: voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=3981): Process ended prematurely: osmo-stp_10.42.42.5(pid=3981) [trial-2383↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3981)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=3992): Process ended prematurely: osmo-stp_10.42.42.5(pid=3992) [trial-2383↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3992)] FAIL: voice:trx-umtrx+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=4008): Process ended prematurely: osmo-stp_10.42.42.5(pid=4008) [trial-2383↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4008)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=4019): Process ended prematurely: osmo-stp_10.42.42.5(pid=4019) [trial-2383↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4019)] FAIL: voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=4034): Process ended prematurely: osmo-stp_10.42.42.5(pid=4034) [trial-2383↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4034)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=4045): Process ended prematurely: osmo-stp_10.42.42.5(pid=4045) [trial-2383↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4045)] FAIL: emergency:trx-umtrx (fail: 2) FAIL: emergency_mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=4059): Process ended prematurely: osmo-stp_10.42.42.5(pid=4059) [trial-2383↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4059)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=4073): Process ended prematurely: osmo-stp_10.42.42.5(pid=4073) [trial-2383↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4073)] FAIL: gprs:trx-umtrx (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=4091): Process ended prematurely: osmo-stp_10.42.42.5(pid=4091) [trial-2383↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4091)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=4103): Process ended prematurely: osmo-stp_10.42.42.5(pid=4103) [trial-2383↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4103)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=4121): Process ended prematurely: osmo-stp_10.42.42.5(pid=4121) [trial-2383↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4121)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=4131): Process ended prematurely: osmo-stp_10.42.42.5(pid=4131) [trial-2383↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4131)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=4141): Process ended prematurely: osmo-stp_10.42.42.5(pid=4141) [trial-2383↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4141)] FAIL: gprs:trx-umtrx+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=4159): Process ended prematurely: osmo-stp_10.42.42.5(pid=4159) [trial-2383↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4159)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=4171): Process ended prematurely: osmo-stp_10.42.42.5(pid=4171) [trial-2383↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4171)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=4189): Process ended prematurely: osmo-stp_10.42.42.5(pid=4189) [trial-2383↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4189)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=4199): Process ended prematurely: osmo-stp_10.42.42.5(pid=4199) [trial-2383↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4199)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=4209): Process ended prematurely: osmo-stp_10.42.42.5(pid=4209) [trial-2383↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4209)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=4227): Process ended prematurely: osmo-stp_10.42.42.5(pid=4227) [trial-2383↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4227)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=4239): Process ended prematurely: osmo-stp_10.42.42.5(pid=4239) [trial-2383↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4239)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=4259): Process ended prematurely: osmo-stp_10.42.42.5(pid=4259) [trial-2383↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4259)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=4277): Process ended prematurely: osmo-stp_10.42.42.5(pid=4277) [trial-2383↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4277)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=4287): Process ended prematurely: osmo-stp_10.42.42.5(pid=4287) [trial-2383↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4287)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=4304): Process ended prematurely: osmo-stp_10.42.42.5(pid=4304) [trial-2383↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4304)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=4316): Process ended prematurely: osmo-stp_10.42.42.5(pid=4316) [trial-2383↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4316)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=4334): Process ended prematurely: osmo-stp_10.42.42.5(pid=4334) [trial-2383↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4334)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=4344): Process ended prematurely: osmo-stp_10.42.42.5(pid=4344) [trial-2383↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4344)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=4354): Process ended prematurely: osmo-stp_10.42.42.5(pid=4354) [trial-2383↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4354)] FAIL: gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=4371): Process ended prematurely: osmo-stp_10.42.42.5(pid=4371) [trial-2383↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4371)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=4384): Process ended prematurely: osmo-stp_10.42.42.5(pid=4384) [trial-2383↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4384)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=4403): Process ended prematurely: osmo-stp_10.42.42.5(pid=4403) [trial-2383↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4403)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=4416): Process ended prematurely: osmo-stp_10.42.42.5(pid=4416) [trial-2383↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4416)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=4426): Process ended prematurely: osmo-stp_10.42.42.5(pid=4426) [trial-2383↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4426)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=4439): Process ended prematurely: osmo-stp_10.42.42.5(pid=4439) [trial-2383↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4439)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=4452): Process ended prematurely: osmo-stp_10.42.42.5(pid=4452) [trial-2383↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4452)] FAIL: nitb_sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=4461): Process ended prematurely: osmo-nitb_10.42.42.2(pid=4461) [trial-2383↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4461)] FAIL: sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=4471): Process ended prematurely: osmo-stp_10.42.42.5(pid=4471) [trial-2383↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4471)] FAIL: nitb_ussd:trx-lms (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=4480): Process ended prematurely: osmo-nitb_10.42.42.2(pid=4480) [trial-2383↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4480)] FAIL: ussd:trx-lms (fail: 1) FAIL: assert_extension.py (5.7 sec) Error: osmo-stp_10.42.42.5(pid=4491): Process ended prematurely: osmo-stp_10.42.42.5(pid=4491) [trial-2383↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4491)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=4506): Process ended prematurely: osmo-stp_10.42.42.5(pid=4506) [trial-2383↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4506)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=4517): Process ended prematurely: osmo-stp_10.42.42.5(pid=4517) [trial-2383↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4517)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=4531): Process ended prematurely: osmo-stp_10.42.42.5(pid=4531) [trial-2383↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4531)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=4542): Process ended prematurely: osmo-stp_10.42.42.5(pid=4542) [trial-2383↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4542)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=4556): Process ended prematurely: osmo-stp_10.42.42.5(pid=4556) [trial-2383↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4556)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=4567): Process ended prematurely: osmo-stp_10.42.42.5(pid=4567) [trial-2383↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4567)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=4581): Process ended prematurely: osmo-stp_10.42.42.5(pid=4581) [trial-2383↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4581)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=4592): Process ended prematurely: osmo-stp_10.42.42.5(pid=4592) [trial-2383↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4592)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=4607): Process ended prematurely: osmo-stp_10.42.42.5(pid=4607) [trial-2383↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4607)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=4618): Process ended prematurely: osmo-stp_10.42.42.5(pid=4618) [trial-2383↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4618)] FAIL: voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=4632): Process ended prematurely: osmo-stp_10.42.42.5(pid=4632) [trial-2383↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4632)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=4643): Process ended prematurely: osmo-stp_10.42.42.5(pid=4643) [trial-2383↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4643)] FAIL: voice:trx-lms+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=4658): Process ended prematurely: osmo-stp_10.42.42.5(pid=4658) [trial-2383↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4658)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=4669): Process ended prematurely: osmo-stp_10.42.42.5(pid=4669) [trial-2383↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4669)] FAIL: emergency:trx-lms (fail: 2) FAIL: emergency_mo_mt_call.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=4752): Process ended prematurely: osmo-stp_10.42.42.5(pid=4752) [trial-2383↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4752)] FAIL: emergency_preemptive_call.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=4967): Process ended prematurely: osmo-stp_10.42.42.5(pid=4967) [trial-2383↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4967)] FAIL: gprs:trx-lms (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=4988): Process ended prematurely: osmo-stp_10.42.42.5(pid=4988) [trial-2383↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4988)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=5000): Process ended prematurely: osmo-stp_10.42.42.5(pid=5000) [trial-2383↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5000)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=5021): Process ended prematurely: osmo-stp_10.42.42.5(pid=5021) [trial-2383↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5021)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=5032): Process ended prematurely: osmo-stp_10.42.42.5(pid=5032) [trial-2383↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5032)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=5045): Process ended prematurely: osmo-stp_10.42.42.5(pid=5045) [trial-2383↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5045)] FAIL: gprs:trx-lms+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=5062): Process ended prematurely: osmo-stp_10.42.42.5(pid=5062) [trial-2383↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5062)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=5074): Process ended prematurely: osmo-stp_10.42.42.5(pid=5074) [trial-2383↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5074)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=5092): Process ended prematurely: osmo-stp_10.42.42.5(pid=5092) [trial-2383↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5092)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=5102): Process ended prematurely: osmo-stp_10.42.42.5(pid=5102) [trial-2383↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5102)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=5112): Process ended prematurely: osmo-stp_10.42.42.5(pid=5112) [trial-2383↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5112)] FAIL: gprs:trx-lms+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=5130): Process ended prematurely: osmo-stp_10.42.42.5(pid=5130) [trial-2383↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5130)] FAIL: iperf3.py (8.1 sec) Error: osmo-stp_10.42.42.5(pid=5143): Process ended prematurely: osmo-stp_10.42.42.5(pid=5143) [trial-2383↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5143)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=5161): Process ended prematurely: osmo-stp_10.42.42.5(pid=5161) [trial-2383↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5161)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=5171): Process ended prematurely: osmo-stp_10.42.42.5(pid=5171) [trial-2383↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5171)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=5181): Process ended prematurely: osmo-stp_10.42.42.5(pid=5181) [trial-2383↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5181)] FAIL: gprs:trx-lms+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=5198): Process ended prematurely: osmo-stp_10.42.42.5(pid=5198) [trial-2383↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5198)] FAIL: iperf3.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=5210): Process ended prematurely: osmo-stp_10.42.42.5(pid=5210) [trial-2383↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5210)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=5228): Process ended prematurely: osmo-stp_10.42.42.5(pid=5228) [trial-2383↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5228)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=5238): Process ended prematurely: osmo-stp_10.42.42.5(pid=5238) [trial-2383↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5238)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=5248): Process ended prematurely: osmo-stp_10.42.42.5(pid=5248) [trial-2383↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5248)] FAIL: dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=5262): Process ended prematurely: osmo-stp_10.42.42.5(pid=5262) [trial-2383↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5262)] FAIL: dynts:trx-lms+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=5275): Process ended prematurely: osmo-stp_10.42.42.5(pid=5275) [trial-2383↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5275)] FAIL: nitb_sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=5285): Process ended prematurely: osmo-nitb_10.42.42.2(pid=5285) [trial-2383↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5285)] FAIL: sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=5296): Process ended prematurely: osmo-stp_10.42.42.5(pid=5296) [trial-2383↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5296)] FAIL: nitb_ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=5305): Process ended prematurely: osmo-nitb_10.42.42.2(pid=5305) [trial-2383↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5305)] FAIL: ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=5315): Process ended prematurely: osmo-stp_10.42.42.5(pid=5315) [trial-2383↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5315)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=5330): Process ended prematurely: osmo-stp_10.42.42.5(pid=5330) [trial-2383↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5330)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=5341): Process ended prematurely: osmo-stp_10.42.42.5(pid=5341) [trial-2383↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5341)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=5357): Process ended prematurely: osmo-stp_10.42.42.5(pid=5357) [trial-2383↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5357)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=5368): Process ended prematurely: osmo-stp_10.42.42.5(pid=5368) [trial-2383↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5368)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=5382): Process ended prematurely: osmo-stp_10.42.42.5(pid=5382) [trial-2383↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5382)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=5404): Process ended prematurely: osmo-stp_10.42.42.5(pid=5404) [trial-2383↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5404)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=5769): Process ended prematurely: osmo-stp_10.42.42.5(pid=5769) [trial-2383↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5769)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=5956): Process ended prematurely: osmo-stp_10.42.42.5(pid=5956) [trial-2383↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5956)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=5970): Process ended prematurely: osmo-stp_10.42.42.5(pid=5970) [trial-2383↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5970)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=5981): Process ended prematurely: osmo-stp_10.42.42.5(pid=5981) [trial-2383↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5981)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=5995): Process ended prematurely: osmo-stp_10.42.42.5(pid=5995) [trial-2383↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5995)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=6006): Process ended prematurely: osmo-stp_10.42.42.5(pid=6006) [trial-2383↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6006)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=6021): Process ended prematurely: osmo-stp_10.42.42.5(pid=6021) [trial-2383↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6021)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=6032): Process ended prematurely: osmo-stp_10.42.42.5(pid=6032) [trial-2383↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6032)] FAIL: emergency:trx-lms-limenet-micro (fail: 2) FAIL: emergency_mo_mt_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=6048): Process ended prematurely: osmo-stp_10.42.42.5(pid=6048) [trial-2383↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6048)] FAIL: emergency_preemptive_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=6059): Process ended prematurely: osmo-stp_10.42.42.5(pid=6059) [trial-2383↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6059)] FAIL: gprs:trx-lms-limenet-micro (fail: 5) FAIL: cs_paging_gprs_active.py (9.1 sec) Error: osmo-stp_10.42.42.5(pid=6077): Process ended prematurely: osmo-stp_10.42.42.5(pid=6077) [trial-2383↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6077)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=6089): Process ended prematurely: osmo-stp_10.42.42.5(pid=6089) [trial-2383↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6089)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=6108): Process ended prematurely: osmo-stp_10.42.42.5(pid=6108) [trial-2383↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6108)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=6118): Process ended prematurely: osmo-stp_10.42.42.5(pid=6118) [trial-2383↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6118)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=6129): Process ended prematurely: osmo-stp_10.42.42.5(pid=6129) [trial-2383↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6129)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=6147): Process ended prematurely: osmo-stp_10.42.42.5(pid=6147) [trial-2383↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6147)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=6159): Process ended prematurely: osmo-stp_10.42.42.5(pid=6159) [trial-2383↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6159)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=6177): Process ended prematurely: osmo-stp_10.42.42.5(pid=6177) [trial-2383↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6177)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=6187): Process ended prematurely: osmo-stp_10.42.42.5(pid=6187) [trial-2383↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6187)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=6197): Process ended prematurely: osmo-stp_10.42.42.5(pid=6197) [trial-2383↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6197)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (9.1 sec) Error: osmo-stp_10.42.42.5(pid=6215): Process ended prematurely: osmo-stp_10.42.42.5(pid=6215) [trial-2383↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6215)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=6229): Process ended prematurely: osmo-stp_10.42.42.5(pid=6229) [trial-2383↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6229)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=6247): Process ended prematurely: osmo-stp_10.42.42.5(pid=6247) [trial-2383↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6247)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=6257): Process ended prematurely: osmo-stp_10.42.42.5(pid=6257) [trial-2383↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6257)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=6270): Process ended prematurely: osmo-stp_10.42.42.5(pid=6270) [trial-2383↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6270)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=6288): Process ended prematurely: osmo-stp_10.42.42.5(pid=6288) [trial-2383↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6288)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=6300): Process ended prematurely: osmo-stp_10.42.42.5(pid=6300) [trial-2383↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6300)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=6318): Process ended prematurely: osmo-stp_10.42.42.5(pid=6318) [trial-2383↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6318)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=6328): Process ended prematurely: osmo-stp_10.42.42.5(pid=6328) [trial-2383↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6328)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=6338): Process ended prematurely: osmo-stp_10.42.42.5(pid=6338) [trial-2383↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6338)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=6351): Process ended prematurely: osmo-stp_10.42.42.5(pid=6351) [trial-2383↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6351)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=6364): Process ended prematurely: osmo-stp_10.42.42.5(pid=6364) [trial-2383↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6364)] FAIL: nitb_sms:nanobts (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=6372): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6372) [trial-2383↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6372)] FAIL: sms:nanobts+band-1900 (fail: 1) FAIL: mo_mt_sms.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=6382): Process ended prematurely: osmo-stp_10.42.42.5(pid=6382) [trial-2383↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6382)] FAIL: nitb_ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=6391): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6391) [trial-2383↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6391)] FAIL: ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=6402): Process ended prematurely: osmo-stp_10.42.42.5(pid=6402) [trial-2383↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6402)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=6416): Process ended prematurely: osmo-stp_10.42.42.5(pid=6416) [trial-2383↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6416)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=6427): Process ended prematurely: osmo-stp_10.42.42.5(pid=6427) [trial-2383↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6427)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=6442): Process ended prematurely: osmo-stp_10.42.42.5(pid=6442) [trial-2383↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6442)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=6453): Process ended prematurely: osmo-stp_10.42.42.5(pid=6453) [trial-2383↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6453)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=6467): Process ended prematurely: osmo-stp_10.42.42.5(pid=6467) [trial-2383↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6467)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=6478): Process ended prematurely: osmo-stp_10.42.42.5(pid=6478) [trial-2383↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6478)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=6492): Process ended prematurely: osmo-stp_10.42.42.5(pid=6492) [trial-2383↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6492)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=6503): Process ended prematurely: osmo-stp_10.42.42.5(pid=6503) [trial-2383↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6503)] FAIL: voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=6518): Process ended prematurely: osmo-stp_10.42.42.5(pid=6518) [trial-2383↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6518)] FAIL: mo_mt_call_osmux.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=6742): Process ended prematurely: osmo-stp_10.42.42.5(pid=6742) [trial-2383↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6742)] FAIL: emergency:nanobts+band-1900 (fail: 2) FAIL: emergency_mo_mt_call.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=6814): Process ended prematurely: osmo-stp_10.42.42.5(pid=6814) [trial-2383↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6814)] FAIL: emergency_preemptive_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=6827): Process ended prematurely: osmo-stp_10.42.42.5(pid=6827) [trial-2383↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6827)] FAIL: gprs:nanobts+band-1900 (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=6847): Process ended prematurely: osmo-stp_10.42.42.5(pid=6847) [trial-2383↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6847)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=6862): Process ended prematurely: osmo-stp_10.42.42.5(pid=6862) [trial-2383↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6862)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=6880): Process ended prematurely: osmo-stp_10.42.42.5(pid=6880) [trial-2383↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6880)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=6893): Process ended prematurely: osmo-stp_10.42.42.5(pid=6893) [trial-2383↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6893)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=6903): Process ended prematurely: osmo-stp_10.42.42.5(pid=6903) [trial-2383↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6903)] FAIL: gprs:nanobts+band-1900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (9.1 sec) Error: osmo-stp_10.42.42.5(pid=6920): Process ended prematurely: osmo-stp_10.42.42.5(pid=6920) [trial-2383↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6920)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=6932): Process ended prematurely: osmo-stp_10.42.42.5(pid=6932) [trial-2383↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6932)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=6950): Process ended prematurely: osmo-stp_10.42.42.5(pid=6950) [trial-2383↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6950)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=6960): Process ended prematurely: osmo-stp_10.42.42.5(pid=6960) [trial-2383↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6960)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=6970): Process ended prematurely: osmo-stp_10.42.42.5(pid=6970) [trial-2383↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6970)] FAIL: gprs:nanobts+band-1900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=6987): Process ended prematurely: osmo-stp_10.42.42.5(pid=6987) [trial-2383↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6987)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=6999): Process ended prematurely: osmo-stp_10.42.42.5(pid=6999) [trial-2383↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6999)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=7017): Process ended prematurely: osmo-stp_10.42.42.5(pid=7017) [trial-2383↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7017)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=7027): Process ended prematurely: osmo-stp_10.42.42.5(pid=7027) [trial-2383↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7027)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=7037): Process ended prematurely: osmo-stp_10.42.42.5(pid=7037) [trial-2383↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7037)] FAIL: dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=7051): Process ended prematurely: osmo-stp_10.42.42.5(pid=7051) [trial-2383↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7051)] FAIL: sms:nanobts+band-900 (fail: 1) FAIL: mo_mt_sms.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=7064): Process ended prematurely: osmo-stp_10.42.42.5(pid=7064) [trial-2383↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7064)] FAIL: nitb_ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=7073): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7073) [trial-2383↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7073)] FAIL: ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=7083): Process ended prematurely: osmo-stp_10.42.42.5(pid=7083) [trial-2383↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7083)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=7097): Process ended prematurely: osmo-stp_10.42.42.5(pid=7097) [trial-2383↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7097)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=7108): Process ended prematurely: osmo-stp_10.42.42.5(pid=7108) [trial-2383↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7108)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=7122): Process ended prematurely: osmo-stp_10.42.42.5(pid=7122) [trial-2383↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7122)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=7133): Process ended prematurely: osmo-stp_10.42.42.5(pid=7133) [trial-2383↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7133)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=7147): Process ended prematurely: osmo-stp_10.42.42.5(pid=7147) [trial-2383↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7147)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=7158): Process ended prematurely: osmo-stp_10.42.42.5(pid=7158) [trial-2383↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7158)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=7174): Process ended prematurely: osmo-stp_10.42.42.5(pid=7174) [trial-2383↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7174)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=7185): Process ended prematurely: osmo-stp_10.42.42.5(pid=7185) [trial-2383↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7185)] FAIL: voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=7201): Process ended prematurely: osmo-stp_10.42.42.5(pid=7201) [trial-2383↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7201)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=7214): Process ended prematurely: osmo-stp_10.42.42.5(pid=7214) [trial-2383↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7214)] FAIL: voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=7228): Process ended prematurely: osmo-stp_10.42.42.5(pid=7228) [trial-2383↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7228)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=7242): Process ended prematurely: osmo-stp_10.42.42.5(pid=7242) [trial-2383↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7242)] FAIL: emergency:nanobts+band-900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=7257): Process ended prematurely: osmo-stp_10.42.42.5(pid=7257) [trial-2383↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7257)] FAIL: emergency_preemptive_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=7268): Process ended prematurely: osmo-stp_10.42.42.5(pid=7268) [trial-2383↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7268)] FAIL: gprs:nanobts+band-900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=7286): Process ended prematurely: osmo-stp_10.42.42.5(pid=7286) [trial-2383↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7286)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=7298): Process ended prematurely: osmo-stp_10.42.42.5(pid=7298) [trial-2383↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7298)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=7316): Process ended prematurely: osmo-stp_10.42.42.5(pid=7316) [trial-2383↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7316)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=7326): Process ended prematurely: osmo-stp_10.42.42.5(pid=7326) [trial-2383↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7326)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=7336): Process ended prematurely: osmo-stp_10.42.42.5(pid=7336) [trial-2383↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7336)] FAIL: gprs:nanobts+band-900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=7353): Process ended prematurely: osmo-stp_10.42.42.5(pid=7353) [trial-2383↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7353)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=7365): Process ended prematurely: osmo-stp_10.42.42.5(pid=7365) [trial-2383↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7365)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=7386): Process ended prematurely: osmo-stp_10.42.42.5(pid=7386) [trial-2383↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7386)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=7396): Process ended prematurely: osmo-stp_10.42.42.5(pid=7396) [trial-2383↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7396)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=7406): Process ended prematurely: osmo-stp_10.42.42.5(pid=7406) [trial-2383↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7406)] FAIL: gprs:nanobts+band-900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=7423): Process ended prematurely: osmo-stp_10.42.42.5(pid=7423) [trial-2383↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7423)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=7435): Process ended prematurely: osmo-stp_10.42.42.5(pid=7435) [trial-2383↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7435)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=7453): Process ended prematurely: osmo-stp_10.42.42.5(pid=7453) [trial-2383↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7453)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=7463): Process ended prematurely: osmo-stp_10.42.42.5(pid=7463) [trial-2383↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7463)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=7473): Process ended prematurely: osmo-stp_10.42.42.5(pid=7473) [trial-2383↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7473)] FAIL: gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=7490): Process ended prematurely: osmo-stp_10.42.42.5(pid=7490) [trial-2383↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7490)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=7503): Process ended prematurely: osmo-stp_10.42.42.5(pid=7503) [trial-2383↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7503)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=7521): Process ended prematurely: osmo-stp_10.42.42.5(pid=7521) [trial-2383↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7521)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=7531): Process ended prematurely: osmo-stp_10.42.42.5(pid=7531) [trial-2383↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7531)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=7541): Process ended prematurely: osmo-stp_10.42.42.5(pid=7541) [trial-2383↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7541)] FAIL: dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=7558): Process ended prematurely: osmo-stp_10.42.42.5(pid=7558) [trial-2383↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7558)] FAIL: nitb_smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (2.5 sec) Error: osmo-nitb_10.42.42.2(pid=7566): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7566) [trial-2383↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7566)] FAIL: esme_connect_policy_closed.py (2.1 sec) Error: osmo-nitb_10.42.42.2(pid=7568): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7568) [trial-2383↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7568)] FAIL: esme_ms_sms_storeforward.py (2.9 sec) Error: osmo-nitb_10.42.42.2(pid=7571): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7571) [trial-2383↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7571)] FAIL: esme_ms_sms_transaction.py (3.5 sec) Error: osmo-nitb_10.42.42.2(pid=7573): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7573) [trial-2383↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7573)] FAIL: smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (5.6 sec) Error: osmo-hlr_10.42.42.2(pid=7585): Process ended prematurely: osmo-hlr_10.42.42.2(pid=7585) [trial-2383↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7585)] FAIL: esme_connect_policy_closed.py (6.6 sec) Error: osmo-hlr_10.42.42.2(pid=7596): Process ended prematurely: osmo-hlr_10.42.42.2(pid=7596) [trial-2383↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7596)] FAIL: esme_ms_sms_storeforward.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=7608): Process ended prematurely: osmo-stp_10.42.42.5(pid=7608) [trial-2383↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7608)] FAIL: esme_ms_sms_transaction.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=7619): Process ended prematurely: osmo-stp_10.42.42.5(pid=7619) [trial-2383↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7619)] FAIL: encryption (fail: 4) FAIL: register_a5_0_authopt.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=7633): Process ended prematurely: osmo-stp_10.42.42.5(pid=7633) [trial-2383↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7633)] FAIL: register_a5_0_authreq.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=7644): Process ended prematurely: osmo-stp_10.42.42.5(pid=7644) [trial-2383↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7644)] FAIL: register_a5_1_authreq.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=7659): Process ended prematurely: osmo-stp_10.42.42.5(pid=7659) [trial-2383↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7659)] FAIL: register_a5_3_authreq.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=7670): Process ended prematurely: osmo-stp_10.42.42.5(pid=7670) [trial-2383↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7670)] FAIL: 4g:srsenb-rftype@zmq+srsue-rftype@zmq (fail: 7) FAIL: handover.py (19.7 sec) Error: srsepc(pid=7690): Process ended prematurely: srsepc(pid=7690) [trial-2383↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=7690)] FAIL: iperf3_bidir.py (19.0 sec) Error: srsepc(pid=7706): Process ended prematurely: srsepc(pid=7706) [trial-2383↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=7706)] FAIL: iperf3_dl.py (18.8 sec) Error: srsepc(pid=7722): Process ended prematurely: srsepc(pid=7722) [trial-2383↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=7722)] FAIL: iperf3_ul.py (18.6 sec) Error: srsepc(pid=7738): Process ended prematurely: srsepc(pid=7738) [trial-2383↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=7738)] FAIL: ping.py (18.9 sec) Error: srsepc(pid=7754): Process ended prematurely: srsepc(pid=7754) [trial-2383↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=7754)] FAIL: rrc_idle_mo_ping.py (18.4 sec) Error: srsepc(pid=7770): Process ended prematurely: srsepc(pid=7770) [trial-2383↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=7770)] FAIL: rrc_idle_mt_ping.py (18.2 sec) Error: srsepc(pid=7786): Process ended prematurely: srsepc(pid=7786) [trial-2383↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=7786)] FAIL: handover_2G:nanobts+bts1-oc2g (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=7801): Process ended prematurely: osmo-stp_10.42.42.5(pid=7801) [trial-2383↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7801)] FAIL: handover_2G:nanobts+bts1-octphy (fail: 1) FAIL: handover.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=7894): Process ended prematurely: osmo-stp_10.42.42.5(pid=7894) [trial-2383↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7894)] FAIL: handover_2G:nanobts+bts1-trx-lms (fail: 1) FAIL: handover.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=8101): Process ended prematurely: osmo-stp_10.42.42.5(pid=8101) [trial-2383↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8101)] FAIL: handover_2G:nanobts+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=8116): Process ended prematurely: osmo-stp_10.42.42.5(pid=8116) [trial-2383↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8116)] FAIL: handover_2G:nanobts+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=8130): Process ended prematurely: osmo-stp_10.42.42.5(pid=8130) [trial-2383↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8130)] FAIL: handover_2G:nanobts+bts1-sysmo (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=8144): Process ended prematurely: osmo-stp_10.42.42.5(pid=8144) [trial-2383↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8144)] FAIL: handover_2G:nanobts+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=8158): Process ended prematurely: osmo-stp_10.42.42.5(pid=8158) [trial-2383↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8158)] FAIL: handover_2G:nanobts+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=8173): Process ended prematurely: osmo-stp_10.42.42.5(pid=8173) [trial-2383↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8173)] FAIL: handover_2G:oc2g+bts1-octphy (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=8191): Process ended prematurely: osmo-stp_10.42.42.5(pid=8191) [trial-2383↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8191)] FAIL: handover_2G:oc2g+bts1-trx-lms (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=8205): Process ended prematurely: osmo-stp_10.42.42.5(pid=8205) [trial-2383↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8205)] FAIL: handover_2G:oc2g+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=8220): Process ended prematurely: osmo-stp_10.42.42.5(pid=8220) [trial-2383↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8220)] FAIL: handover_2G:oc2g+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=8234): Process ended prematurely: osmo-stp_10.42.42.5(pid=8234) [trial-2383↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8234)] FAIL: handover_2G:oc2g+bts1-sysmo (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=8248): Process ended prematurely: osmo-stp_10.42.42.5(pid=8248) [trial-2383↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8248)] FAIL: handover_2G:oc2g+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=8262): Process ended prematurely: osmo-stp_10.42.42.5(pid=8262) [trial-2383↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8262)] FAIL: handover_2G:oc2g+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=8277): Process ended prematurely: osmo-stp_10.42.42.5(pid=8277) [trial-2383↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8277)] FAIL: handover_2G:octphy+bts1-trx-lms (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=8291): Process ended prematurely: osmo-stp_10.42.42.5(pid=8291) [trial-2383↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8291)] FAIL: handover_2G:octphy+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=8305): Process ended prematurely: osmo-stp_10.42.42.5(pid=8305) [trial-2383↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8305)] FAIL: handover_2G:octphy+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=8319): Process ended prematurely: osmo-stp_10.42.42.5(pid=8319) [trial-2383↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8319)] FAIL: handover_2G:octphy+bts1-sysmo (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=8333): Process ended prematurely: osmo-stp_10.42.42.5(pid=8333) [trial-2383↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8333)] FAIL: handover_2G:octphy+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=8347): Process ended prematurely: osmo-stp_10.42.42.5(pid=8347) [trial-2383↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8347)] FAIL: handover_2G:octphy+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=8361): Process ended prematurely: osmo-stp_10.42.42.5(pid=8361) [trial-2383↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8361)] FAIL: handover_2G:trx-lms+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=8375): Process ended prematurely: osmo-stp_10.42.42.5(pid=8375) [trial-2383↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8375)] FAIL: handover_2G:trx-lms+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=8389): Process ended prematurely: osmo-stp_10.42.42.5(pid=8389) [trial-2383↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8389)] FAIL: handover_2G:trx-lms+bts1-sysmo (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=8403): Process ended prematurely: osmo-stp_10.42.42.5(pid=8403) [trial-2383↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8403)] FAIL: handover_2G:trx-lms+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=8417): Process ended prematurely: osmo-stp_10.42.42.5(pid=8417) [trial-2383↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8417)] FAIL: handover_2G:trx-lms+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=8431): Process ended prematurely: osmo-stp_10.42.42.5(pid=8431) [trial-2383↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8431)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=8445): Process ended prematurely: osmo-stp_10.42.42.5(pid=8445) [trial-2383↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8445)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-sysmo (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=8459): Process ended prematurely: osmo-stp_10.42.42.5(pid=8459) [trial-2383↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8459)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=8473): Process ended prematurely: osmo-stp_10.42.42.5(pid=8473) [trial-2383↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8473)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=8487): Process ended prematurely: osmo-stp_10.42.42.5(pid=8487) [trial-2383↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8487)] FAIL: handover_2G:trx-sysmocell5000+bts1-sysmo (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=8501): Process ended prematurely: osmo-stp_10.42.42.5(pid=8501) [trial-2383↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8501)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=8517): Process ended prematurely: osmo-stp_10.42.42.5(pid=8517) [trial-2383↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8517)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=8531): Process ended prematurely: osmo-stp_10.42.42.5(pid=8531) [trial-2383↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8531)] FAIL: handover_2G:sysmo+bts1-trx-b200 (fail: 1) FAIL: handover.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=8545): Process ended prematurely: osmo-stp_10.42.42.5(pid=8545) [trial-2383↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8545)] FAIL: handover_2G:sysmo+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=8563): Process ended prematurely: osmo-stp_10.42.42.5(pid=8563) [trial-2383↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8563)] FAIL: handover_2G:trx-b200+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=8577): Process ended prematurely: osmo-stp_10.42.42.5(pid=8577) [trial-2383↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8577)] + rm -rf trial-2383/inst + cd trial-2383 + command -v journalctl + [ ! -z /bin/journalctl ] + readlink last_run + journalctl -u ofono -o short-precise --since 2022-12-12 22:05:32 + readlink last_run + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383-run.tgz run.2022-12-12_22-05-43 + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2383-bin.tgz checksums.md5 open5gs.build-8.tgz osmo-bsc.build-17675.tgz osmo-bts-oc2g.build-5534.tgz osmo-bts-sysmo.build-8038.tgz osmo-bts.build-7507.tgz osmo-ggsn.build-6688.tgz osmo-hlr.build-8711.tgz osmo-hnbgw.build-2978.tgz osmo-mgw.build-8956.tgz osmo-msc.build-29296.tgz osmo-nitb.build-12985.tgz osmo-pcu-oc2g.build-3910.tgz osmo-pcu-sysmo.build-5192.tgz osmo-pcu.build-5153.tgz osmo-sgsn.build-30080.tgz osmo-stp.build-9252.tgz osmo-trx.build-4679.tgz osmocom-bb.build-4708.tgz srslte.build-19.tgz + exit 1 Build step 'Execute shell' marked build as failure Archiving artifacts Recording test results [Checks API] No suitable checks publisher found. Sending e-mails to: pespin@sysmocom.de Finished: FAILURE